2024-09-11T23:38:41.351 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T23:38:41.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:38:41.481 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/ffsb}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901495' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBf97LfcfEuHBC9ih+XWhFqS5zjllv0fEGAGNELE6mLPir1LFKr9WU6M2tt7nI14bGdRGJunxnSSoQRZKtAePLw= smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH2Bs/zI//Fj4w8QyVKijzfAR4DtXdlwGesivm3kytdyat1RuNhwNkHDVS82NvtfnmWRK+8kilXvuJivW+Axlsg= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOC4Di0Lj2Y+Me2deBUoUHoSi9RRlhegpZdyp1BS0kBUPO1dkEOfhvpWMf3ROxjazRwCtnDZnPq0TlyXeYLWsSc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T23:38:41.481 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-11T23:38:41.482 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-11T23:38:41.482 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T23:38:41.484 INFO:teuthology.task.internal:Checking packages... 2024-09-11T23:38:41.506 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T23:38:41.506 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T23:38:41.506 INFO:teuthology.packaging:ref: None 2024-09-11T23:38:41.506 INFO:teuthology.packaging:tag: None 2024-09-11T23:38:41.506 INFO:teuthology.packaging:branch: squid 2024-09-11T23:38:41.506 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:38:41.506 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T23:38:41.743 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-11T23:38:41.745 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T23:38:41.752 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T23:38:41.752 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T23:38:41.761 INFO:teuthology.task.internal:Saving configuration 2024-09-11T23:38:41.779 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T23:38:41.786 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T23:38:41.819 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:32:54.167572', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBf97LfcfEuHBC9ih+XWhFqS5zjllv0fEGAGNELE6mLPir1LFKr9WU6M2tt7nI14bGdRGJunxnSSoQRZKtAePLw='} 2024-09-11T23:38:41.850 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:32:54.168633', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH2Bs/zI//Fj4w8QyVKijzfAR4DtXdlwGesivm3kytdyat1RuNhwNkHDVS82NvtfnmWRK+8kilXvuJivW+Axlsg='} 2024-09-11T23:38:41.877 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:32:54.165835', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOC4Di0Lj2Y+Me2deBUoUHoSi9RRlhegpZdyp1BS0kBUPO1dkEOfhvpWMf3ROxjazRwCtnDZnPq0TlyXeYLWsSc='} 2024-09-11T23:38:41.877 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T23:38:41.883 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-11T23:38:41.884 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-11T23:38:41.884 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-11T23:38:41.884 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T23:38:41.994 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdd9bf3b520>, signals=[15]) 2024-09-11T23:38:41.994 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T23:38:42.000 INFO:teuthology.task.internal:Opening connections... 2024-09-11T23:38:42.001 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2024-09-11T23:38:42.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:38:42.102 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2024-09-11T23:38:42.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:38:42.188 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-11T23:38:42.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:38:42.276 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T23:38:42.282 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-09-11T23:38:42.301 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-09-11T23:38:42.301 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-09-11T23:38:42.359 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-09-11T23:38:42.359 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-09-11T23:38:42.359 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-09-11T23:38:42.359 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:38:42.359 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-09-11T23:38:42.360 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:38:42.360 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:38:42.360 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-09-11T23:38:42.360 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:38:42.360 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:38:42.360 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:38:42.360 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:38:42.360 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:38:42.360 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:38:42.361 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-09-11T23:38:42.392 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-09-11T23:38:42.410 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-09-11T23:38:42.411 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-09-11T23:38:42.469 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-09-11T23:38:42.469 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-09-11T23:38:42.469 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-09-11T23:38:42.470 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:38:42.470 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-09-11T23:38:42.470 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:38:42.470 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:38:42.470 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-09-11T23:38:42.470 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:38:42.470 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:38:42.470 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:38:42.470 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:38:42.470 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:38:42.470 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:38:42.471 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-09-11T23:38:42.502 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-11T23:38:42.522 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-11T23:38:42.522 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-11T23:38:42.582 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-09-11T23:38:42.582 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-09-11T23:38:42.582 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-09-11T23:38:42.582 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:38:42.582 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-09-11T23:38:42.582 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:38:42.582 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:38:42.582 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-09-11T23:38:42.583 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:38:42.583 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:38:42.583 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:38:42.583 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:38:42.583 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:38:42.583 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:38:42.583 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-11T23:38:42.617 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T23:38:42.628 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T23:38:42.634 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T23:38:42.635 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:38:42.637 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:38:42.639 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:38:42.656 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T23:38:42.663 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T23:38:42.663 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:38:42.695 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:38:42.697 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:38:42.789 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T23:38:42.892 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T23:38:42.908 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T23:38:42.908 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T23:38:42.908 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:38:42.909 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:38:42.910 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:38:42.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:38:42.927 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-09-11T23:38:42.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:38:42.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:38:42.928 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-11T23:38:42.928 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-09-11T23:38:42.985 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:38:42.985 INFO:teuthology.task.kernel:Running kernel on smithi039: 5.14.0-503.el9.x86_64 2024-09-11T23:38:42.985 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum install -y kernel 2024-09-11T23:38:42.988 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:38:42.988 INFO:teuthology.orchestra.run.smithi006.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:38:42.989 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.14.0-503.el9.x86_64 2024-09-11T23:38:42.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-09-11T23:38:42.989 INFO:teuthology.task.kernel:Running kernel on smithi006: 5.14.0-503.el9.x86_64 2024-09-11T23:38:42.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2024-09-11T23:38:45.280 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-11T23:38:45.314 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-11T23:38:46.548 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-11T23:38:48.014 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-11T23:38:48.490 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-11T23:38:50.140 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 20 MB 00:02 2024-09-11T23:38:52.973 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.5 MB 00:01 2024-09-11T23:38:54.257 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-11T23:38:54.390 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-11T23:38:54.899 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 6.5 MB 00:00 2024-09-11T23:38:55.136 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-11T23:38:56.016 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-11T23:38:56.491 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 19 kB 00:00 2024-09-11T23:38:56.937 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-11T23:38:57.312 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-11T23:39:00.633 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-11T23:39:02.501 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-11T23:39:02.623 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T23:39:02.623 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T23:39:02.728 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-11T23:39:02.731 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-11T23:39:02.732 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-11T23:39:02.732 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-11T23:39:02.732 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-11T23:39:02.732 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T23:39:02.732 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-11T23:39:02.732 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T23:39:02.732 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T23:39:02.732 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T23:39:02.733 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:39:02.733 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-11T23:39:02.733 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-11T23:39:02.733 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-09-11T23:39:02.733 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:39:02.733 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 79 M 2024-09-11T23:39:02.733 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 126 M 2024-09-11T23:39:02.734 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-11T23:39:03.043 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 79 kB/s | 23 kB 00:00 2024-09-11T23:39:03.142 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-11T23:39:04.477 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 9.1 MB/s | 16 MB 00:01 2024-09-11T23:39:04.599 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T23:39:04.599 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T23:39:04.690 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-09-11T23:39:04.704 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-09-11T23:39:04.705 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2024-09-11T23:39:04.705 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-09-11T23:39:04.705 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-09-11T23:39:04.705 INFO:teuthology.orchestra.run.smithi006.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T23:39:04.705 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-09-11T23:39:04.705 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T23:39:04.705 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T23:39:04.706 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T23:39:04.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:39:04.706 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-09-11T23:39:04.706 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-09-11T23:39:04.706 INFO:teuthology.orchestra.run.smithi006.stdout:Install 4 Packages 2024-09-11T23:39:04.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:39:04.706 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 79 M 2024-09-11T23:39:04.706 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 126 M 2024-09-11T23:39:04.706 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-09-11T23:39:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 181 kB/s | 23 kB 00:00 2024-09-11T23:39:05.168 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-11T23:39:05.215 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T23:39:05.216 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T23:39:05.302 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-09-11T23:39:05.315 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-11T23:39:05.315 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2024-09-11T23:39:05.315 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-11T23:39:05.315 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-09-11T23:39:05.315 INFO:teuthology.orchestra.run.smithi039.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T23:39:05.315 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-09-11T23:39:05.315 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T23:39:05.316 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T23:39:05.316 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T23:39:05.316 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:39:05.316 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-09-11T23:39:05.316 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-11T23:39:05.316 INFO:teuthology.orchestra.run.smithi039.stdout:Install 4 Packages 2024-09-11T23:39:05.316 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:39:05.316 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 79 M 2024-09-11T23:39:05.316 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 126 M 2024-09-11T23:39:05.317 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-09-11T23:39:05.410 INFO:teuthology.orchestra.run.smithi039.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 307 kB/s | 23 kB 00:00 2024-09-11T23:39:05.552 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 12 MB/s | 35 MB 00:02 2024-09-11T23:39:05.552 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:39:05.552 INFO:teuthology.orchestra.run.smithi134.stdout:Total 28 MB/s | 79 MB 00:02 2024-09-11T23:39:05.561 INFO:teuthology.orchestra.run.smithi006.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 47 MB/s | 29 MB 00:00 2024-09-11T23:39:05.737 INFO:teuthology.orchestra.run.smithi006.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-11T23:39:05.977 INFO:teuthology.orchestra.run.smithi039.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-11T23:39:06.240 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-11T23:39:06.379 INFO:teuthology.orchestra.run.smithi006.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 22 MB/s | 35 MB 00:01 2024-09-11T23:39:06.379 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:39:06.379 INFO:teuthology.orchestra.run.smithi006.stdout:Total 47 MB/s | 79 MB 00:01 2024-09-11T23:39:06.519 INFO:teuthology.orchestra.run.smithi039.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-11T23:39:06.574 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-11T23:39:06.574 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-11T23:39:06.936 INFO:teuthology.orchestra.run.smithi039.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 19 MB/s | 29 MB 00:01 2024-09-11T23:39:06.936 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:39:06.936 INFO:teuthology.orchestra.run.smithi039.stdout:Total 49 MB/s | 79 MB 00:01 2024-09-11T23:39:07.089 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-09-11T23:39:07.451 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-09-11T23:39:07.451 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-09-11T23:39:07.545 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-11T23:39:07.545 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-11T23:39:07.646 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-09-11T23:39:08.014 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-09-11T23:39:08.014 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-09-11T23:39:08.442 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-09-11T23:39:08.442 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-09-11T23:39:09.013 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-09-11T23:39:09.013 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-09-11T23:39:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-11T23:39:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:39:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:39:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-09-11T23:39:11.582 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-09-11T23:39:11.780 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:39:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:39:12.246 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:39:12.328 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:39:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:39:13.691 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:39:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:39:14.809 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:39:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:39:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:39:18.516 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:39:18.550 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:39:19.935 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:39:19.977 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:39:20.382 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:39:20.426 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:39:23.398 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:39:25.120 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:39:25.572 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:40:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:40:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:40:02.537 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:02.537 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:40:02.537 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-11T23:40:02.537 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T23:40:02.537 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T23:40:02.537 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T23:40:02.538 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T23:40:02.538 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:40:02.538 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-11T23:40:02.915 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:40:03.007 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:40:03.008 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:40:03.008 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T23:40:03.008 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:40:03.008 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:40:03.008 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-11T23:40:03.008 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:40:03.009 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:40:03.067 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:40:03.067 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:40:03.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-09-11T23:40:03.107 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-09-11T23:40:03.108 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-09-11T23:40:03.108 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.06 2024-09-11T23:40:03.108 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 82.el9 2024-09-11T23:40:03.108 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-09-11T23:40:03.108 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:40:03.108 INFO:teuthology.orchestra.run.smithi134.stdout:Group : Unspecified 2024-09-11T23:40:03.108 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 8274670 2024-09-11T23:40:03.108 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-09-11T23:40:03.108 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:40:03.108 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:40:03.108 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:40:03.108 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:40:03.109 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : builder@centos.org 2024-09-11T23:40:03.109 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-09-11T23:40:03.109 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:40:03.109 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-09-11T23:40:03.109 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-09-11T23:40:03.109 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:40:03.109 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:40:03.109 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:40:03.109 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:40:03.109 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-09-11T23:40:03.109 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:40:03.109 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:40:03.110 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:40:03.110 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 5.14.0-505.el9.x86_64 2024-09-11T23:40:03.110 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:40:03.750 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-09-11T23:40:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:04.458 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:04.833 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:04.833 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:40:04.833 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:40:04.833 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:40:04.928 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:04.970 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:05.110 INFO:teuthology.orchestra.run.smithi134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:40:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-09-11T23:40:05.146 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-11T23:40:05.162 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.mHSPszSanb 2024-09-11T23:40:05.162 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mHSPszSanb 2024-09-11T23:40:05.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.mHSPszSanb 2024-09-11T23:40:05.257 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:05.257 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:40:05.257 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:40:05.257 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:40:05.371 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.mHSPszSanb is 6KB 2024-09-11T23:40:05.423 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.mHSPszSanb 2024-09-11T23:40:05.437 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:40:05.508 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:40:05.508 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:40:05.508 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:40:05.508 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T23:40:05.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T23:40:05.651 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-09-11T23:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-09-11T23:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T23:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T23:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T23:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T23:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-09-11T23:40:06.021 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:40:06.093 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:06.093 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:40:06.093 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-09-11T23:40:06.093 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T23:40:06.093 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T23:40:06.094 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T23:40:06.094 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T23:40:06.094 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:40:06.094 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-09-11T23:40:06.147 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:40:06.148 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:40:06.148 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T23:40:06.148 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:40:06.148 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:40:06.148 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T23:40:06.148 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:40:06.148 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:40:06.207 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:40:06.207 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:40:06.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo rpm -qi grub2-tools 2024-09-11T23:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:Name : grub2-tools 2024-09-11T23:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:Epoch : 1 2024-09-11T23:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:Version : 2.06 2024-09-11T23:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:Release : 82.el9 2024-09-11T23:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: x86_64 2024-09-11T23:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Group : Unspecified 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Size : 8274670 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:License : GPLv3+ 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Packager : builder@centos.org 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Vendor : CentOS 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Summary : Support tools for GRUB. 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Description : 2024-09-11T23:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:hardware devices. 2024-09-11T23:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:40:06.242 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:40:06.242 INFO:teuthology.task.kernel:Updating grub on smithi006 to boot 5.14.0-505.el9.x86_64 2024-09-11T23:40:06.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:40:06.453 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:40:06.543 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:40:06.544 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:40:06.544 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T23:40:06.544 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:40:06.544 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:40:06.544 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T23:40:06.544 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi039.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:40:06.545 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:40:06.603 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:40:06.604 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:40:06.604 DEBUG:teuthology.orchestra.run.smithi039:> sudo rpm -qi grub2-tools 2024-09-11T23:40:06.643 INFO:teuthology.orchestra.run.smithi039.stdout:Name : grub2-tools 2024-09-11T23:40:06.643 INFO:teuthology.orchestra.run.smithi039.stdout:Epoch : 1 2024-09-11T23:40:06.643 INFO:teuthology.orchestra.run.smithi039.stdout:Version : 2.06 2024-09-11T23:40:06.643 INFO:teuthology.orchestra.run.smithi039.stdout:Release : 82.el9 2024-09-11T23:40:06.643 INFO:teuthology.orchestra.run.smithi039.stdout:Architecture: x86_64 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:Group : Unspecified 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:Size : 8274670 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:License : GPLv3+ 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:Packager : builder@centos.org 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:Vendor : CentOS 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:Summary : Support tools for GRUB. 2024-09-11T23:40:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:Description : 2024-09-11T23:40:06.645 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:40:06.645 INFO:teuthology.orchestra.run.smithi039.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:40:06.645 INFO:teuthology.orchestra.run.smithi039.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:40:06.645 INFO:teuthology.orchestra.run.smithi039.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:40:06.645 INFO:teuthology.orchestra.run.smithi039.stdout:hardware devices. 2024-09-11T23:40:06.645 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:40:06.645 INFO:teuthology.orchestra.run.smithi039.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:40:06.646 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:40:06.646 INFO:teuthology.task.kernel:Updating grub on smithi039 to boot 5.14.0-505.el9.x86_64 2024-09-11T23:40:06.647 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:40:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2024-09-11T23:40:07.308 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2024-09-11T23:40:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:40:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:done 2024-09-11T23:40:08.329 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-09-11T23:40:08.367 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.xKCDBZslUy 2024-09-11T23:40:08.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xKCDBZslUy 2024-09-11T23:40:08.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.xKCDBZslUy 2024-09-11T23:40:08.586 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.xKCDBZslUy is 6KB 2024-09-11T23:40:08.606 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.xKCDBZslUy 2024-09-11T23:40:08.618 INFO:teuthology.orchestra.run.smithi039.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:40:08.621 DEBUG:teuthology.orchestra.run.smithi006:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:40:08.657 INFO:teuthology.orchestra.run.smithi039.stderr:done 2024-09-11T23:40:08.658 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-09-11T23:40:08.673 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.DBmrjlOtqo 2024-09-11T23:40:08.674 DEBUG:teuthology.orchestra.run.smithi039:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DBmrjlOtqo 2024-09-11T23:40:08.684 INFO:teuthology.orchestra.run.smithi006.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:40:08.685 INFO:teuthology.orchestra.run.smithi006.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:40:08.685 INFO:teuthology.orchestra.run.smithi006.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:40:08.685 INFO:teuthology.orchestra.run.smithi006.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T23:40:08.689 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T23:40:08.750 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.DBmrjlOtqo 2024-09-11T23:40:08.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2024-09-11T23:40:08.882 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.DBmrjlOtqo is 6KB 2024-09-11T23:40:08.929 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.DBmrjlOtqo 2024-09-11T23:40:08.943 DEBUG:teuthology.orchestra.run.smithi039:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:40:09.006 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:40:09.006 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:40:09.006 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:40:09.006 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T23:40:09.008 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T23:40:09.163 DEBUG:teuthology.orchestra.run.smithi039:> sudo shutdown -r now 2024-09-11T23:40:35.678 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-11T23:40:35.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-11T23:40:35.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:40:38.852 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T23:40:38.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-11T23:40:38.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:40:39.166 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T23:40:39.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-11T23:40:39.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:41:13.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-11T23:41:22.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-11T23:41:22.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:41:25.761 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-11T23:41:35.699 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T23:41:37.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-11T23:41:37.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:41:38.863 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T23:41:40.861 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-11T23:41:44.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-11T23:41:44.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:41:46.153 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-11T23:41:46.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-11T23:41:46.688 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-505.el9.x86_64"... 2024-09-11T23:41:46.688 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-11T23:41:46.703 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-505.el9.x86_64 2024-09-11T23:41:46.703 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T23:41:46.703 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:41:46.704 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:41:47.704 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-11T23:41:47.705 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:41:47.826 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-09-11T23:41:47.849 DEBUG:teuthology.parallel:result is None 2024-09-11T23:41:47.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-11T23:41:47.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:41:49.628 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-09-11T23:41:49.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-11T23:41:49.996 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T23:41:49.996 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-09-11T23:41:50.011 INFO:teuthology.orchestra.run.smithi006.stdout:5.14.0-505.el9.x86_64 2024-09-11T23:41:50.011 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T23:41:50.011 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:41:50.011 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:41:51.012 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T23:41:51.012 DEBUG:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:41:51.142 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2024-09-11T23:41:51.165 DEBUG:teuthology.parallel:result is None 2024-09-11T23:41:55.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-11T23:41:55.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:42:27.728 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-09-11T23:42:28.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-11T23:42:28.086 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-11T23:42:28.087 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-09-11T23:42:28.103 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-505.el9.x86_64 2024-09-11T23:42:28.103 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T23:42:28.103 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:42:28.103 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:42:29.104 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T23:42:29.104 DEBUG:teuthology.orchestra.run.smithi039:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:42:29.176 INFO:teuthology.orchestra.run.smithi039.stdout:ttyS1 2024-09-11T23:42:29.200 DEBUG:teuthology.parallel:result is None 2024-09-11T23:42:29.200 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T23:42:29.207 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T23:42:29.208 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:42:29.211 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:42:29.214 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:42:29.235 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T23:42:29.240 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T23:42:29.250 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T23:42:29.251 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:42:29.272 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:42:29.274 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:42:29.364 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T23:42:29.371 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T23:42:29.371 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:42:29.374 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:42:29.376 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:42:29.405 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:42:29.408 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:42:29.417 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:42:29.421 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:42:29.429 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:42:29.441 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:42:29.443 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T23:42:29.450 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T23:42:29.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:42:29.465 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:42:29.468 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:42:29.498 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T23:42:29.507 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T23:42:29.507 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:42:29.534 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:42:29.538 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:42:29.554 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:42:29.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:42:29.688 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:42:29.783 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:42:29.817 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:42:29.817 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:42:29.886 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:42:29.938 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:42:29.987 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:42:30.099 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:42:30.138 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-11T23:42:30.138 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:42:30.207 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:42:30.258 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:42:30.307 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:42:30.400 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:42:30.438 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-11T23:42:30.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:42:30.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2024-09-11T23:42:30.509 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2024-09-11T23:42:30.512 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-11T23:42:30.559 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:42:30.563 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:42:30.595 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:42:30.990 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T23:42:30.997 INFO:teuthology.task.internal:Starting timer... 2024-09-11T23:42:30.997 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T23:42:31.009 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T23:42:31.019 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-11T23:42:31.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2024-09-11T23:42:31.072 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2024-09-11T23:42:31.074 DEBUG:teuthology.orchestra.run.smithi039:> sudo service auditd rotate 2024-09-11T23:42:31.118 INFO:teuthology.orchestra.run.smithi039.stdout:Rotating logs: 2024-09-11T23:42:31.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-09-11T23:42:31.162 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-09-11T23:42:31.164 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T23:42:31.164 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2024-09-11T23:42:31.192 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2024-09-11T23:42:31.193 DEBUG:teuthology.orchestra.run.smithi039:> /usr/sbin/getenforce 2024-09-11T23:42:31.223 INFO:teuthology.orchestra.run.smithi039.stdout:Permissive 2024-09-11T23:42:31.223 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-09-11T23:42:31.257 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-09-11T23:42:31.257 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi039.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2024-09-11T23:42:31.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:42:31.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:42:31.289 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:42:31.320 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:42:31.320 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:42:31.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:42:31.348 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T23:42:31.348 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:42:31.381 DEBUG:teuthology.orchestra.run.smithi039:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:42:31.428 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:42:31.468 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T23:42:31.478 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T23:42:31.490 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T23:42:31.491 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi039.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T23:46:20.006 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi039.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-09-11T23:46:20.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-11T23:46:20.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:46:20.107 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-09-11T23:46:20.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-11T23:46:20.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-11T23:46:20.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:46:20.277 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-09-11T23:46:20.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-11T23:46:20.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-11T23:46:20.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:46:20.442 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-11T23:46:20.524 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-11T23:46:20.525 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T23:46:20.536 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T23:46:20.537 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:46:20.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:46:20.540 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:46:20.540 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:46:20.542 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:46:20.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:46:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:46:20.572 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:46:20.585 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:46:20.587 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:46:20.594 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:46:20.608 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:46:20.611 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2024-09-11T23:46:20.614 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: ntpd: command not found 2024-09-11T23:46:20.623 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2024-09-11T23:46:20.626 INFO:teuthology.orchestra.run.smithi039.stdout:506 Cannot talk to daemon 2024-09-11T23:46:20.633 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-09-11T23:46:20.638 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:46:20.641 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:46:20.644 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-09-11T23:46:20.652 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:46:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:46:20.658 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:46:20.673 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:46:20.707 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:46:20.711 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:46:20.711 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-09-11T23:46:20.711 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:46:20.711 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:46:20.711 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:46:20.711 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:46:20.713 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:46:20.717 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:46:20.718 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-09-11T23:46:20.718 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:46:20.718 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:46:20.718 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:46:20.718 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:46:20.731 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:46:20.734 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:46:20.734 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-11T23:46:20.734 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:46:20.735 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:46:20.735 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:46:20.735 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:46:20.736 INFO:teuthology.run_tasks:Running task install... 2024-09-11T23:46:20.744 DEBUG:teuthology.task.install:project ceph 2024-09-11T23:46:20.744 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T23:46:20.744 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T23:46:20.744 INFO:teuthology.task.install:Using flavor: default 2024-09-11T23:46:20.750 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T23:46:20.750 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T23:46:20.750 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:46:20.751 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:46:20.753 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:46:20.753 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:46:20.754 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:46:20.754 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:46:20.902 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:46:20.902 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:46:20.920 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:46:20.920 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:46:20.935 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:46:20.935 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:46:21.034 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:46:21.035 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:46:21.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:46:21.040 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:46:21.041 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-11T23:46:21.041 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:46:21.049 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:46:21.049 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-11T23:46:21.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:46:21.061 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:46:21.062 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:46:21.068 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:46:21.068 DEBUG:teuthology.orchestra.run.smithi039:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:46:21.075 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:46:21.076 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:46:21.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:46:21.135 DEBUG:teuthology.orchestra.run.smithi039:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:46:21.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:46:21.206 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:46:21.211 DEBUG:teuthology.orchestra.run.smithi039:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:46:21.216 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:46:21.272 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2024-09-11T23:46:21.273 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2024-09-11T23:46:21.276 INFO:teuthology.orchestra.run.smithi039.stdout:check_obsoletes = 1 2024-09-11T23:46:21.277 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum clean all 2024-09-11T23:46:21.281 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-09-11T23:46:21.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-09-11T23:46:21.514 INFO:teuthology.orchestra.run.smithi039.stdout:45 files removed 2024-09-11T23:46:21.514 INFO:teuthology.orchestra.run.smithi006.stdout:45 files removed 2024-09-11T23:46:21.515 INFO:teuthology.orchestra.run.smithi134.stdout:45 files removed 2024-09-11T23:46:21.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:46:21.543 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:46:21.544 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:46:22.095 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-11T23:46:22.117 INFO:teuthology.orchestra.run.smithi039.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-11T23:46:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-11T23:46:22.379 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-11T23:46:22.393 INFO:teuthology.orchestra.run.smithi039.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-11T23:46:22.394 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-11T23:46:22.655 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-11T23:46:22.661 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-11T23:46:22.668 INFO:teuthology.orchestra.run.smithi039.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-11T23:46:23.205 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-11T23:46:23.261 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-11T23:46:23.610 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.2 MB 00:00 2024-09-11T23:46:25.406 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-11T23:46:26.854 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 20 MB 00:02 2024-09-11T23:46:27.261 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 8.2 MB/s | 20 MB 00:02 2024-09-11T23:46:31.074 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-11T23:46:32.314 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-11T23:46:32.540 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-11T23:46:33.062 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-11T23:46:33.445 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-11T23:46:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 112 kB/s | 19 kB 00:00 2024-09-11T23:46:34.485 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-11T23:46:34.738 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-11T23:46:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-11T23:46:38.851 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-11T23:46:40.125 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-11T23:46:41.172 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:46:41.173 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:46:41.187 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:46:41.188 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:46:41.189 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:46:41.190 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:46:41.192 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:46:41.195 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:46:41.195 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:46:41.259 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-11T23:46:41.278 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-11T23:46:41.278 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-11T23:46:41.279 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-11T23:46:41.279 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-11T23:46:41.279 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:46:41.279 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:46:41.279 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:46:41.279 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:46:41.279 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:46:41.279 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:46:41.279 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:46:41.279 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:46:41.279 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:46:41.279 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:46:41.280 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:46:41.281 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:46:41.281 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:46:41.281 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:46:41.281 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:46:41.281 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:46:41.281 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:46:41.281 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:46:41.281 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:46:41.281 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:46:41.281 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:46:41.281 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:46:41.281 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-11T23:46:41.282 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:46:41.283 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:46:41.285 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:46:41.285 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:46:41.285 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:46:41.285 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:46:41.285 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:46:41.285 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:46:41.285 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:46:41.285 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:46:41.285 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:46:41.285 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:46:41.285 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:46:41.285 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:46:41.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:46:41.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:46:41.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:46:41.288 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:46:41.288 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:46:41.288 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:46:41.288 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:46:41.288 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:46:41.288 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:46:41.288 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:46:41.288 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:46:41.288 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:46:41.288 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:46:41.289 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:46:41.290 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:46:41.290 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:46:41.290 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:46:41.290 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:46:41.290 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:46:41.290 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:46:41.290 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:46:41.290 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:46:41.290 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:46:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-09-11T23:46:41.292 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:46:41.293 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:46:41.293 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-11T23:46:41.293 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-11T23:46:41.293 INFO:teuthology.orchestra.run.smithi134.stdout:Install 148 Packages 2024-09-11T23:46:41.293 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 8 Packages 2024-09-11T23:46:41.293 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:46:41.293 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 226 M 2024-09-11T23:46:41.294 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-11T23:46:41.631 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-11T23:46:42.035 INFO:teuthology.orchestra.run.smithi134.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 44 kB/s | 6.5 kB 00:00 2024-09-11T23:46:42.302 INFO:teuthology.orchestra.run.smithi134.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.3 MB/s | 897 kB 00:00 2024-09-11T23:46:42.385 INFO:teuthology.orchestra.run.smithi134.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-11T23:46:42.411 INFO:teuthology.orchestra.run.smithi134.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.3 MB/s | 145 kB 00:00 2024-09-11T23:46:42.486 INFO:teuthology.orchestra.run.smithi134.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 24 MB/s | 2.4 MB 00:00 2024-09-11T23:46:42.579 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:46:42.579 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:46:42.593 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:46:42.594 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:46:42.595 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:46:42.596 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:46:42.598 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:46:42.601 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:46:42.601 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:46:42.672 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-09-11T23:46:42.693 INFO:teuthology.orchestra.run.smithi006.stdout:====================================================================================== 2024-09-11T23:46:42.693 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-09-11T23:46:42.693 INFO:teuthology.orchestra.run.smithi006.stdout:====================================================================================== 2024-09-11T23:46:42.693 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-09-11T23:46:42.693 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:46:42.693 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:46:42.693 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:46:42.694 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:46:42.695 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:46:42.696 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:46:42.697 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:46:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:46:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:46:42.700 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:46:42.701 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:46:42.701 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:46:42.701 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:46:42.701 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:46:42.701 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:46:42.701 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:46:42.701 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:46:42.701 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:46:42.701 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:46:42.701 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:46:42.701 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:46:42.701 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:46:42.702 INFO:teuthology.orchestra.run.smithi006.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:46:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:46:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout:Installing weak dependencies: 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-09-11T23:46:42.705 INFO:teuthology.orchestra.run.smithi006.stdout:====================================================================================== 2024-09-11T23:46:42.706 INFO:teuthology.orchestra.run.smithi006.stdout:Install 148 Packages 2024-09-11T23:46:42.706 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 8 Packages 2024-09-11T23:46:42.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:46:42.706 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 226 M 2024-09-11T23:46:42.706 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-09-11T23:46:42.753 INFO:teuthology.orchestra.run.smithi134.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 4.5 MB/s | 1.5 MB 00:00 2024-09-11T23:46:42.820 INFO:teuthology.orchestra.run.smithi134.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-11T23:46:43.028 INFO:teuthology.orchestra.run.smithi134.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 19 MB/s | 21 MB 00:01 2024-09-11T23:46:43.070 INFO:teuthology.orchestra.run.smithi134.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 609 kB/s | 25 kB 00:00 2024-09-11T23:46:43.397 INFO:teuthology.orchestra.run.smithi134.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 18 MB/s | 11 MB 00:00 2024-09-11T23:46:43.445 INFO:teuthology.orchestra.run.smithi134.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-11T23:46:43.513 INFO:teuthology.orchestra.run.smithi134.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 405 kB/s | 27 kB 00:00 2024-09-11T23:46:43.571 INFO:teuthology.orchestra.run.smithi134.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 546 kB/s | 32 kB 00:00 2024-09-11T23:46:43.601 INFO:teuthology.orchestra.run.smithi006.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 37 kB/s | 6.5 kB 00:00 2024-09-11T23:46:43.671 INFO:teuthology.orchestra.run.smithi134.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 752 kB 00:00 2024-09-11T23:46:43.730 INFO:teuthology.orchestra.run.smithi134.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-11T23:46:43.814 INFO:teuthology.orchestra.run.smithi134.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 127 kB 00:00 2024-09-11T23:46:43.897 INFO:teuthology.orchestra.run.smithi134.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.9 MB/s | 506 kB 00:00 2024-09-11T23:46:44.084 INFO:teuthology.orchestra.run.smithi039.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:46:44.084 INFO:teuthology.orchestra.run.smithi039.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:46:44.097 INFO:teuthology.orchestra.run.smithi039.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:46:44.098 INFO:teuthology.orchestra.run.smithi039.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:46:44.099 INFO:teuthology.orchestra.run.smithi039.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:46:44.099 INFO:teuthology.orchestra.run.smithi039.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:46:44.101 INFO:teuthology.orchestra.run.smithi039.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:46:44.104 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:46:44.105 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:46:44.172 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-09-11T23:46:44.191 INFO:teuthology.orchestra.run.smithi039.stdout:====================================================================================== 2024-09-11T23:46:44.191 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2024-09-11T23:46:44.192 INFO:teuthology.orchestra.run.smithi039.stdout:====================================================================================== 2024-09-11T23:46:44.192 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-09-11T23:46:44.192 INFO:teuthology.orchestra.run.smithi039.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:46:44.192 INFO:teuthology.orchestra.run.smithi039.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:46:44.192 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:46:44.192 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:46:44.192 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:46:44.192 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:46:44.193 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:46:44.193 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:46:44.193 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:46:44.193 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:46:44.193 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:46:44.193 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:46:44.193 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:46:44.193 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:46:44.193 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:46:44.193 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:46:44.193 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:46:44.193 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:46:44.194 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrading: 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:46:44.195 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:46:44.196 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:46:44.197 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:46:44.198 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:46:44.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:46:44.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:46:44.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:46:44.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:46:44.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:46:44.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:46:44.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:46:44.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:46:44.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:46:44.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:46:44.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:46:44.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:46:44.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:46:44.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:46:44.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:46:44.203 INFO:teuthology.orchestra.run.smithi039.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout:Installing weak dependencies: 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout:====================================================================================== 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout:Install 148 Packages 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrade 8 Packages 2024-09-11T23:46:44.204 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:46:44.205 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 226 M 2024-09-11T23:46:44.205 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-09-11T23:46:44.264 INFO:teuthology.orchestra.run.smithi134.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-11T23:46:44.293 INFO:teuthology.orchestra.run.smithi006.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.3 MB/s | 897 kB 00:00 2024-09-11T23:46:44.331 INFO:teuthology.orchestra.run.smithi134.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 680 kB/s | 45 kB 00:00 2024-09-11T23:46:44.417 INFO:teuthology.orchestra.run.smithi134.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.6 MB/s | 136 kB 00:00 2024-09-11T23:46:44.429 INFO:teuthology.orchestra.run.smithi006.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.0 MB/s | 145 kB 00:00 2024-09-11T23:46:44.498 INFO:teuthology.orchestra.run.smithi134.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 162 kB 00:00 2024-09-11T23:46:44.587 INFO:teuthology.orchestra.run.smithi006.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 4.6 MB/s | 5.4 MB 00:01 2024-09-11T23:46:44.624 INFO:teuthology.orchestra.run.smithi039.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 34 kB/s | 6.5 kB 00:00 2024-09-11T23:46:44.704 INFO:teuthology.orchestra.run.smithi006.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 1.5 MB 00:00 2024-09-11T23:46:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:(22/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 26 MB/s | 49 MB 00:01 2024-09-11T23:46:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 652 kB/s | 321 kB 00:00 2024-09-11T23:46:45.032 INFO:teuthology.orchestra.run.smithi039.stdout:(2/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 9.0 MB/s | 5.4 MB 00:00 2024-09-11T23:46:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.5 MB/s | 301 kB 00:00 2024-09-11T23:46:45.066 INFO:teuthology.orchestra.run.smithi134.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.3 MB/s | 100 kB 00:00 2024-09-11T23:46:45.074 INFO:teuthology.orchestra.run.smithi039.stdout:(3/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.9 MB/s | 897 kB 00:00 2024-09-11T23:46:45.108 INFO:teuthology.orchestra.run.smithi039.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.9 MB/s | 145 kB 00:00 2024-09-11T23:46:45.116 INFO:teuthology.orchestra.run.smithi134.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-11T23:46:45.121 INFO:teuthology.orchestra.run.smithi006.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 3.4 MB/s | 2.4 MB 00:00 2024-09-11T23:46:45.208 INFO:teuthology.orchestra.run.smithi039.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 1.5 MB 00:00 2024-09-11T23:46:45.272 INFO:teuthology.orchestra.run.smithi006.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 8.3 MB/s | 4.7 MB 00:00 2024-09-11T23:46:45.550 INFO:teuthology.orchestra.run.smithi039.stdout:(6/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-11T23:46:45.567 INFO:teuthology.orchestra.run.smithi134.stdout:(27/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 6.2 MB/s | 3.1 MB 00:00 2024-09-11T23:46:45.659 INFO:teuthology.orchestra.run.smithi134.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 348 kB/s | 32 kB 00:00 2024-09-11T23:46:45.851 INFO:teuthology.orchestra.run.smithi134.stdout:(29/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 5.4 MB/s | 17 MB 00:03 2024-09-11T23:46:45.876 INFO:teuthology.orchestra.run.smithi134.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 675 kB/s | 146 kB 00:00 2024-09-11T23:46:45.950 INFO:teuthology.orchestra.run.smithi039.stdout:(7/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 2.7 MB/s | 2.4 MB 00:00 2024-09-11T23:46:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:(31/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 164 kB/s | 171 kB 00:01 2024-09-11T23:46:46.268 INFO:teuthology.orchestra.run.smithi134.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.3 MB/s | 249 kB 00:00 2024-09-11T23:46:46.368 INFO:teuthology.orchestra.run.smithi134.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 493 kB/s | 49 kB 00:00 2024-09-11T23:46:46.443 INFO:teuthology.orchestra.run.smithi134.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 219 kB/s | 16 kB 00:00 2024-09-11T23:46:46.484 INFO:teuthology.orchestra.run.smithi039.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 10 MB/s | 21 MB 00:02 2024-09-11T23:46:46.544 INFO:teuthology.orchestra.run.smithi134.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.8 MB/s | 285 kB 00:00 2024-09-11T23:46:46.584 INFO:teuthology.orchestra.run.smithi039.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 252 kB/s | 25 kB 00:00 2024-09-11T23:46:46.827 INFO:teuthology.orchestra.run.smithi134.stdout:(36/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 3.6 MB/s | 3.6 MB 00:00 2024-09-11T23:46:46.927 INFO:teuthology.orchestra.run.smithi134.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 183 kB/s | 18 kB 00:00 2024-09-11T23:46:47.052 INFO:teuthology.orchestra.run.smithi134.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 639 kB/s | 80 kB 00:00 2024-09-11T23:46:47.086 INFO:teuthology.orchestra.run.smithi134.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 1.4 MB/s | 765 kB 00:00 2024-09-11T23:46:47.151 INFO:teuthology.orchestra.run.smithi039.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 17 MB 00:01 2024-09-11T23:46:47.188 INFO:teuthology.orchestra.run.smithi006.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 5.5 MB/s | 11 MB 00:01 2024-09-11T23:46:47.195 INFO:teuthology.orchestra.run.smithi134.stdout:(40/156): ceph-mgr-diskprediction-local-19.1.1- 5.6 MB/s | 7.4 MB 00:01 2024-09-11T23:46:47.235 INFO:teuthology.orchestra.run.smithi039.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 228 kB 00:00 2024-09-11T23:46:47.245 INFO:teuthology.orchestra.run.smithi134.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-11T23:46:47.263 INFO:teuthology.orchestra.run.smithi006.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 336 kB/s | 25 kB 00:00 2024-09-11T23:46:47.310 INFO:teuthology.orchestra.run.smithi039.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 361 kB/s | 27 kB 00:00 2024-09-11T23:46:47.312 INFO:teuthology.orchestra.run.smithi134.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 847 kB/s | 191 kB 00:00 2024-09-11T23:46:47.362 INFO:teuthology.orchestra.run.smithi134.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-11T23:46:47.385 INFO:teuthology.orchestra.run.smithi039.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 423 kB/s | 32 kB 00:00 2024-09-11T23:46:47.387 INFO:teuthology.orchestra.run.smithi134.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-11T23:46:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-11T23:46:47.454 INFO:teuthology.orchestra.run.smithi134.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-11T23:46:47.480 INFO:teuthology.orchestra.run.smithi134.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-11T23:46:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-11T23:46:47.569 INFO:teuthology.orchestra.run.smithi039.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 4.0 MB/s | 752 kB 00:00 2024-09-11T23:46:47.622 INFO:teuthology.orchestra.run.smithi006.stdout:(10/156): ceph-common-19.1.1-298.gb53b6d3e.el9. 5.1 MB/s | 21 MB 00:04 2024-09-11T23:46:47.661 INFO:teuthology.orchestra.run.smithi039.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.7 MB/s | 163 kB 00:00 2024-09-11T23:46:47.713 INFO:teuthology.orchestra.run.smithi134.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 642 kB/s | 107 kB 00:00 2024-09-11T23:46:47.747 INFO:teuthology.orchestra.run.smithi134.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-11T23:46:47.761 INFO:teuthology.orchestra.run.smithi039.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.2 MB/s | 127 kB 00:00 2024-09-11T23:46:47.772 INFO:teuthology.orchestra.run.smithi134.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-11T23:46:47.789 INFO:teuthology.orchestra.run.smithi006.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.3 MB/s | 228 kB 00:00 2024-09-11T23:46:47.797 INFO:teuthology.orchestra.run.smithi134.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-09-11T23:46:47.831 INFO:teuthology.orchestra.run.smithi134.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-11T23:46:47.848 INFO:teuthology.orchestra.run.smithi134.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 433 kB/s | 33 kB 00:00 2024-09-11T23:46:47.881 INFO:teuthology.orchestra.run.smithi006.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 295 kB/s | 27 kB 00:00 2024-09-11T23:46:47.881 INFO:teuthology.orchestra.run.smithi134.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-11T23:46:47.898 INFO:teuthology.orchestra.run.smithi134.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-11T23:46:47.928 INFO:teuthology.orchestra.run.smithi039.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 3.0 MB/s | 506 kB 00:00 2024-09-11T23:46:47.949 INFO:teuthology.orchestra.run.smithi134.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2024-09-11T23:46:47.964 INFO:teuthology.orchestra.run.smithi006.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 382 kB/s | 32 kB 00:00 2024-09-11T23:46:47.966 INFO:teuthology.orchestra.run.smithi134.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-09-11T23:46:47.991 INFO:teuthology.orchestra.run.smithi134.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-11T23:46:48.033 INFO:teuthology.orchestra.run.smithi134.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-11T23:46:48.058 INFO:teuthology.orchestra.run.smithi134.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 365 kB/s | 24 kB 00:00 2024-09-11T23:46:48.092 INFO:teuthology.orchestra.run.smithi134.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-09-11T23:46:48.117 INFO:teuthology.orchestra.run.smithi134.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-11T23:46:48.143 INFO:teuthology.orchestra.run.smithi134.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-11T23:46:48.168 INFO:teuthology.orchestra.run.smithi134.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-11T23:46:48.193 INFO:teuthology.orchestra.run.smithi134.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-11T23:46:48.281 INFO:teuthology.orchestra.run.smithi006.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 2.3 MB/s | 752 kB 00:00 2024-09-11T23:46:48.310 INFO:teuthology.orchestra.run.smithi134.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-11T23:46:48.352 INFO:teuthology.orchestra.run.smithi134.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-11T23:46:48.373 INFO:teuthology.orchestra.run.smithi006.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.7 MB/s | 163 kB 00:00 2024-09-11T23:46:48.385 INFO:teuthology.orchestra.run.smithi134.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-11T23:46:48.410 INFO:teuthology.orchestra.run.smithi134.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-11T23:46:48.465 INFO:teuthology.orchestra.run.smithi006.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.4 MB/s | 127 kB 00:00 2024-09-11T23:46:48.478 INFO:teuthology.orchestra.run.smithi134.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 15 MB/s | 4.9 MB 00:00 2024-09-11T23:46:48.511 INFO:teuthology.orchestra.run.smithi134.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-11T23:46:48.536 INFO:teuthology.orchestra.run.smithi134.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-11T23:46:48.595 INFO:teuthology.orchestra.run.smithi134.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-11T23:46:48.670 INFO:teuthology.orchestra.run.smithi134.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-11T23:46:48.691 INFO:teuthology.orchestra.run.smithi006.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 2.2 MB/s | 506 kB 00:00 2024-09-11T23:46:48.695 INFO:teuthology.orchestra.run.smithi134.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-11T23:46:48.729 INFO:teuthology.orchestra.run.smithi134.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-11T23:46:48.754 INFO:teuthology.orchestra.run.smithi134.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-11T23:46:48.829 INFO:teuthology.orchestra.run.smithi134.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-11T23:46:48.855 INFO:teuthology.orchestra.run.smithi134.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-09-11T23:46:48.880 INFO:teuthology.orchestra.run.smithi134.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-11T23:46:48.905 INFO:teuthology.orchestra.run.smithi134.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-09-11T23:46:48.947 INFO:teuthology.orchestra.run.smithi134.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-11T23:46:49.000 INFO:teuthology.orchestra.run.smithi134.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.3 MB/s | 222 kB 00:00 2024-09-11T23:46:49.003 INFO:teuthology.orchestra.run.smithi039.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 5.0 MB/s | 5.3 MB 00:01 2024-09-11T23:46:49.031 INFO:teuthology.orchestra.run.smithi134.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 925 kB/s | 77 kB 00:00 2024-09-11T23:46:49.056 INFO:teuthology.orchestra.run.smithi134.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 754 kB/s | 42 kB 00:00 2024-09-11T23:46:49.086 INFO:teuthology.orchestra.run.smithi039.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 543 kB/s | 45 kB 00:00 2024-09-11T23:46:49.140 INFO:teuthology.orchestra.run.smithi134.stdout:(87/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-11T23:46:49.165 INFO:teuthology.orchestra.run.smithi134.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-11T23:46:49.178 INFO:teuthology.orchestra.run.smithi039.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.4 MB/s | 136 kB 00:00 2024-09-11T23:46:49.190 INFO:teuthology.orchestra.run.smithi134.stdout:(89/156): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-09-11T23:46:49.215 INFO:teuthology.orchestra.run.smithi134.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-11T23:46:49.241 INFO:teuthology.orchestra.run.smithi134.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-11T23:46:49.266 INFO:teuthology.orchestra.run.smithi134.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 707 kB/s | 54 kB 00:00 2024-09-11T23:46:49.271 INFO:teuthology.orchestra.run.smithi039.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.7 MB/s | 162 kB 00:00 2024-09-11T23:46:49.308 INFO:teuthology.orchestra.run.smithi134.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 620 kB/s | 42 kB 00:00 2024-09-11T23:46:49.334 INFO:teuthology.orchestra.run.smithi134.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 661 kB/s | 44 kB 00:00 2024-09-11T23:46:49.362 INFO:teuthology.orchestra.run.smithi039.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 321 kB 00:00 2024-09-11T23:46:49.375 INFO:teuthology.orchestra.run.smithi134.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-11T23:46:49.401 INFO:teuthology.orchestra.run.smithi134.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-09-11T23:46:49.434 INFO:teuthology.orchestra.run.smithi134.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-11T23:46:49.446 INFO:teuthology.orchestra.run.smithi039.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.5 MB/s | 301 kB 00:00 2024-09-11T23:46:49.459 INFO:teuthology.orchestra.run.smithi134.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-11T23:46:49.493 INFO:teuthology.orchestra.run.smithi134.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-11T23:46:49.518 INFO:teuthology.orchestra.run.smithi134.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-11T23:46:49.530 INFO:teuthology.orchestra.run.smithi039.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.2 MB/s | 100 kB 00:00 2024-09-11T23:46:49.535 INFO:teuthology.orchestra.run.smithi134.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-11T23:46:49.622 INFO:teuthology.orchestra.run.smithi039.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 932 kB/s | 85 kB 00:00 2024-09-11T23:46:49.702 INFO:teuthology.orchestra.run.smithi134.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-11T23:46:49.719 INFO:teuthology.orchestra.run.smithi134.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 224 kB/s | 45 kB 00:00 2024-09-11T23:46:49.769 INFO:teuthology.orchestra.run.smithi134.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-11T23:46:49.786 INFO:teuthology.orchestra.run.smithi134.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 89 kB/s | 22 kB 00:00 2024-09-11T23:46:49.820 INFO:teuthology.orchestra.run.smithi134.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 6.0 MB/s | 309 kB 00:00 2024-09-11T23:46:49.837 INFO:teuthology.orchestra.run.smithi134.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 386 kB/s | 19 kB 00:00 2024-09-11T23:46:49.862 INFO:teuthology.orchestra.run.smithi134.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:46:49.888 INFO:teuthology.orchestra.run.smithi134.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T23:46:49.912 INFO:teuthology.orchestra.run.smithi134.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-11T23:46:49.941 INFO:teuthology.orchestra.run.smithi134.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-11T23:46:49.980 INFO:teuthology.orchestra.run.smithi134.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-11T23:46:50.014 INFO:teuthology.orchestra.run.smithi134.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-11T23:46:50.047 INFO:teuthology.orchestra.run.smithi134.stdout:(114/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-09-11T23:46:50.081 INFO:teuthology.orchestra.run.smithi134.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 651 kB/s | 43 kB 00:00 2024-09-11T23:46:50.106 INFO:teuthology.orchestra.run.smithi134.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 604 kB/s | 14 kB 00:00 2024-09-11T23:46:50.131 INFO:teuthology.orchestra.run.smithi134.stdout:(117/156): python3-cachetools-4.2.4-1.el9.noarc 384 kB/s | 32 kB 00:00 2024-09-11T23:46:50.157 INFO:teuthology.orchestra.run.smithi134.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T23:46:50.189 INFO:teuthology.orchestra.run.smithi039.stdout:(26/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 5.5 MB/s | 3.1 MB 00:00 2024-09-11T23:46:50.190 INFO:teuthology.orchestra.run.smithi134.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.0 MB/s | 303 kB 00:00 2024-09-11T23:46:50.215 INFO:teuthology.orchestra.run.smithi134.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-11T23:46:50.240 INFO:teuthology.orchestra.run.smithi134.stdout:(121/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-11T23:46:50.255 INFO:teuthology.orchestra.run.smithi039.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-11T23:46:50.282 INFO:teuthology.orchestra.run.smithi134.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-11T23:46:50.309 INFO:teuthology.orchestra.run.smithi134.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-11T23:46:50.309 INFO:teuthology.orchestra.run.smithi039.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 638 kB/s | 32 kB 00:00 2024-09-11T23:46:50.316 INFO:teuthology.orchestra.run.smithi006.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 5.3 MB 00:01 2024-09-11T23:46:50.333 INFO:teuthology.orchestra.run.smithi134.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-11T23:46:50.365 INFO:teuthology.orchestra.run.smithi039.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.5 MB/s | 146 kB 00:00 2024-09-11T23:46:50.367 INFO:teuthology.orchestra.run.smithi134.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 690 kB/s | 23 kB 00:00 2024-09-11T23:46:50.374 INFO:teuthology.orchestra.run.smithi006.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 788 kB/s | 45 kB 00:00 2024-09-11T23:46:50.409 INFO:teuthology.orchestra.run.smithi134.stdout:(126/156): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-09-11T23:46:50.434 INFO:teuthology.orchestra.run.smithi134.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 291 kB/s | 19 kB 00:00 2024-09-11T23:46:50.441 INFO:teuthology.orchestra.run.smithi006.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.0 MB/s | 136 kB 00:00 2024-09-11T23:46:50.459 INFO:teuthology.orchestra.run.smithi134.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-11T23:46:50.484 INFO:teuthology.orchestra.run.smithi134.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:46:50.508 INFO:teuthology.orchestra.run.smithi006.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-11T23:46:50.510 INFO:teuthology.orchestra.run.smithi134.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T23:46:50.535 INFO:teuthology.orchestra.run.smithi134.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T23:46:50.548 INFO:teuthology.orchestra.run.smithi039.stdout:(30/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 2.3 MB/s | 11 MB 00:04 2024-09-11T23:46:50.602 INFO:teuthology.orchestra.run.smithi134.stdout:(132/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2024-09-11T23:46:50.608 INFO:teuthology.orchestra.run.smithi006.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.1 MB/s | 321 kB 00:00 2024-09-11T23:46:50.627 INFO:teuthology.orchestra.run.smithi134.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-11T23:46:50.652 INFO:teuthology.orchestra.run.smithi134.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-11T23:46:50.678 INFO:teuthology.orchestra.run.smithi134.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-11T23:46:50.703 INFO:teuthology.orchestra.run.smithi134.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-11T23:46:50.717 INFO:teuthology.orchestra.run.smithi006.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 2.7 MB/s | 301 kB 00:00 2024-09-11T23:46:50.720 INFO:teuthology.orchestra.run.smithi134.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 733 kB/s | 31 kB 00:00 2024-09-11T23:46:50.737 INFO:teuthology.orchestra.run.smithi134.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-11T23:46:50.770 INFO:teuthology.orchestra.run.smithi134.stdout:(139/156): python3-kubernetes-26.1.0-2.el9.noar 3.0 MB/s | 1.0 MB 00:00 2024-09-11T23:46:50.784 INFO:teuthology.orchestra.run.smithi006.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.5 MB/s | 100 kB 00:00 2024-09-11T23:46:50.821 INFO:teuthology.orchestra.run.smithi134.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-11T23:46:50.846 INFO:teuthology.orchestra.run.smithi134.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 329 kB/s | 36 kB 00:00 2024-09-11T23:46:50.851 INFO:teuthology.orchestra.run.smithi006.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-11T23:46:50.871 INFO:teuthology.orchestra.run.smithi134.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 741 kB/s | 74 kB 00:00 2024-09-11T23:46:50.882 INFO:teuthology.orchestra.run.smithi039.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 6.9 MB/s | 3.6 MB 00:00 2024-09-11T23:46:50.896 INFO:teuthology.orchestra.run.smithi134.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T23:46:50.930 INFO:teuthology.orchestra.run.smithi134.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-11T23:46:50.940 INFO:teuthology.orchestra.run.smithi039.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.2 MB/s | 249 kB 00:00 2024-09-11T23:46:50.947 INFO:teuthology.orchestra.run.smithi134.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-11T23:46:50.972 INFO:teuthology.orchestra.run.smithi134.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-11T23:46:50.997 INFO:teuthology.orchestra.run.smithi134.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-11T23:46:50.999 INFO:teuthology.orchestra.run.smithi039.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 849 kB/s | 49 kB 00:00 2024-09-11T23:46:51.048 INFO:teuthology.orchestra.run.smithi134.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T23:46:51.058 INFO:teuthology.orchestra.run.smithi039.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 281 kB/s | 16 kB 00:00 2024-09-11T23:46:51.124 INFO:teuthology.orchestra.run.smithi039.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.2 MB/s | 285 kB 00:00 2024-09-11T23:46:51.190 INFO:teuthology.orchestra.run.smithi134.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 17 MB/s | 2.3 MB 00:00 2024-09-11T23:46:51.258 INFO:teuthology.orchestra.run.smithi039.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 5.6 MB/s | 765 kB 00:00 2024-09-11T23:46:51.290 INFO:teuthology.orchestra.run.smithi134.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-09-11T23:46:51.325 INFO:teuthology.orchestra.run.smithi039.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 274 kB/s | 18 kB 00:00 2024-09-11T23:46:51.357 INFO:teuthology.orchestra.run.smithi134.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 612 kB/s | 41 kB 00:00 2024-09-11T23:46:51.424 INFO:teuthology.orchestra.run.smithi134.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 3.7 MB/s | 249 kB 00:00 2024-09-11T23:46:51.426 INFO:teuthology.orchestra.run.smithi006.stdout:(26/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 5.4 MB/s | 3.1 MB 00:00 2024-09-11T23:46:51.485 INFO:teuthology.orchestra.run.smithi006.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-11T23:46:51.532 INFO:teuthology.orchestra.run.smithi134.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 13 MB/s | 1.4 MB 00:00 2024-09-11T23:46:51.543 INFO:teuthology.orchestra.run.smithi006.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 547 kB/s | 32 kB 00:00 2024-09-11T23:46:51.594 INFO:teuthology.orchestra.run.smithi006.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-11T23:46:51.608 INFO:teuthology.orchestra.run.smithi134.stdout:(154/156): librados2-19.1.1-298.gb53b6d3e.el9.x 5.4 MB/s | 3.4 MB 00:00 2024-09-11T23:46:51.658 INFO:teuthology.orchestra.run.smithi134.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-09-11T23:46:51.875 INFO:teuthology.orchestra.run.smithi039.stdout:(38/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 9.2 MB/s | 49 MB 00:05 2024-09-11T23:46:51.901 INFO:teuthology.orchestra.run.smithi039.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 139 kB/s | 80 kB 00:00 2024-09-11T23:46:52.036 INFO:teuthology.orchestra.run.smithi006.stdout:(30/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 2.4 MB/s | 17 MB 00:06 2024-09-11T23:46:52.042 INFO:teuthology.orchestra.run.smithi039.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-11T23:46:52.074 INFO:teuthology.orchestra.run.smithi134.stdout:(156/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 2.9 MB/s | 3.2 MB 00:01 2024-09-11T23:46:52.080 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:46:52.081 INFO:teuthology.orchestra.run.smithi134.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-11T23:46:52.094 INFO:teuthology.orchestra.run.smithi006.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 7.1 MB/s | 3.6 MB 00:00 2024-09-11T23:46:52.143 INFO:teuthology.orchestra.run.smithi039.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-11T23:46:52.161 INFO:teuthology.orchestra.run.smithi006.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.7 MB/s | 249 kB 00:00 2024-09-11T23:46:52.176 INFO:teuthology.orchestra.run.smithi039.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-11T23:46:52.220 INFO:teuthology.orchestra.run.smithi006.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 846 kB/s | 49 kB 00:00 2024-09-11T23:46:52.260 INFO:teuthology.orchestra.run.smithi039.stdout:(43/156): ceph-mgr-diskprediction-local-19.1.1- 4.3 MB/s | 7.4 MB 00:01 2024-09-11T23:46:52.270 INFO:teuthology.orchestra.run.smithi006.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 330 kB/s | 16 kB 00:00 2024-09-11T23:46:52.285 INFO:teuthology.orchestra.run.smithi039.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 982 kB/s | 106 kB 00:00 2024-09-11T23:46:52.327 INFO:teuthology.orchestra.run.smithi039.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 6.7 MB/s | 1.2 MB 00:00 2024-09-11T23:46:52.337 INFO:teuthology.orchestra.run.smithi006.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.2 MB/s | 285 kB 00:00 2024-09-11T23:46:52.352 INFO:teuthology.orchestra.run.smithi039.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-11T23:46:52.386 INFO:teuthology.orchestra.run.smithi039.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-11T23:46:52.446 INFO:teuthology.orchestra.run.smithi006.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 6.9 MB/s | 765 kB 00:00 2024-09-11T23:46:52.496 INFO:teuthology.orchestra.run.smithi006.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 367 kB/s | 18 kB 00:00 2024-09-11T23:46:52.503 INFO:teuthology.orchestra.run.smithi039.stdout:(48/156): python3-pycparser-2.20-6.el9.noarch.r 557 kB/s | 135 kB 00:00 2024-09-11T23:46:52.604 INFO:teuthology.orchestra.run.smithi006.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 737 kB/s | 80 kB 00:00 2024-09-11T23:46:52.611 INFO:teuthology.orchestra.run.smithi039.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-11T23:46:52.662 INFO:teuthology.orchestra.run.smithi039.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-09-11T23:46:52.679 INFO:teuthology.orchestra.run.smithi039.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 610 kB/s | 107 kB 00:00 2024-09-11T23:46:52.712 INFO:teuthology.orchestra.run.smithi039.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-11T23:46:52.713 INFO:teuthology.orchestra.run.smithi006.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 7.2 MB/s | 801 kB 00:00 2024-09-11T23:46:52.738 INFO:teuthology.orchestra.run.smithi039.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-11T23:46:52.755 INFO:teuthology.orchestra.run.smithi006.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-11T23:46:52.763 INFO:teuthology.orchestra.run.smithi039.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-11T23:46:52.788 INFO:teuthology.orchestra.run.smithi039.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-11T23:46:52.797 INFO:teuthology.orchestra.run.smithi006.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-09-11T23:46:52.817 INFO:teuthology.orchestra.run.smithi039.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-11T23:46:52.838 INFO:teuthology.orchestra.run.smithi039.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-11T23:46:52.864 INFO:teuthology.orchestra.run.smithi039.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-11T23:46:52.872 INFO:teuthology.orchestra.run.smithi006.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-11T23:46:52.939 INFO:teuthology.orchestra.run.smithi006.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-11T23:46:52.989 INFO:teuthology.orchestra.run.smithi039.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-11T23:46:52.989 INFO:teuthology.orchestra.run.smithi006.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2024-09-11T23:46:53.023 INFO:teuthology.orchestra.run.smithi039.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-09-11T23:46:53.031 INFO:teuthology.orchestra.run.smithi006.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-11T23:46:53.048 INFO:teuthology.orchestra.run.smithi039.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-11T23:46:53.073 INFO:teuthology.orchestra.run.smithi039.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-11T23:46:53.073 INFO:teuthology.orchestra.run.smithi006.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-09-11T23:46:53.132 INFO:teuthology.orchestra.run.smithi039.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-11T23:46:53.157 INFO:teuthology.orchestra.run.smithi039.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-11T23:46:53.191 INFO:teuthology.orchestra.run.smithi039.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 656 kB/s | 38 kB 00:00 2024-09-11T23:46:53.274 INFO:teuthology.orchestra.run.smithi006.stdout:(47/156): ceph-mgr-diskprediction-local-19.1.1- 6.0 MB/s | 7.4 MB 00:01 2024-09-11T23:46:53.283 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-11T23:46:53.307 INFO:teuthology.orchestra.run.smithi006.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-11T23:46:53.325 INFO:teuthology.orchestra.run.smithi039.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.9 MB/s | 3.0 MB 00:00 2024-09-11T23:46:53.383 INFO:teuthology.orchestra.run.smithi006.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-11T23:46:53.432 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-11T23:46:53.432 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-11T23:46:53.466 INFO:teuthology.orchestra.run.smithi006.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-11T23:46:53.483 INFO:teuthology.orchestra.run.smithi006.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 216 kB/s | 22 kB 00:00 2024-09-11T23:46:53.550 INFO:teuthology.orchestra.run.smithi006.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-11T23:46:53.575 INFO:teuthology.orchestra.run.smithi006.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-11T23:46:53.608 INFO:teuthology.orchestra.run.smithi039.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-09-11T23:46:53.676 INFO:teuthology.orchestra.run.smithi006.stdout:(54/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-11T23:46:53.701 INFO:teuthology.orchestra.run.smithi006.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 145 kB/s | 18 kB 00:00 2024-09-11T23:46:53.751 INFO:teuthology.orchestra.run.smithi006.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-11T23:46:53.775 INFO:teuthology.orchestra.run.smithi039.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-11T23:46:53.776 INFO:teuthology.orchestra.run.smithi006.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-11T23:46:53.819 INFO:teuthology.orchestra.run.smithi006.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 678 kB/s | 45 kB 00:00 2024-09-11T23:46:53.834 INFO:teuthology.orchestra.run.smithi039.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-09-11T23:46:53.859 INFO:teuthology.orchestra.run.smithi039.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-11T23:46:53.860 INFO:teuthology.orchestra.run.smithi006.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-11T23:46:53.902 INFO:teuthology.orchestra.run.smithi006.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-11T23:46:53.936 INFO:teuthology.orchestra.run.smithi006.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-11T23:46:54.012 INFO:teuthology.orchestra.run.smithi006.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-11T23:46:54.043 INFO:teuthology.orchestra.run.smithi039.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 5.6 MB/s | 4.9 MB 00:00 2024-09-11T23:46:54.053 INFO:teuthology.orchestra.run.smithi006.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-11T23:46:54.076 INFO:teuthology.orchestra.run.smithi039.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-09-11T23:46:54.079 INFO:teuthology.orchestra.run.smithi006.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-09-11T23:46:54.101 INFO:teuthology.orchestra.run.smithi039.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-11T23:46:54.121 INFO:teuthology.orchestra.run.smithi006.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 576 kB/s | 38 kB 00:00 2024-09-11T23:46:54.152 INFO:teuthology.orchestra.run.smithi039.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-11T23:46:54.221 INFO:teuthology.orchestra.run.smithi006.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-11T23:46:54.235 INFO:teuthology.orchestra.run.smithi039.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-11T23:46:54.319 INFO:teuthology.orchestra.run.smithi039.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-11T23:46:54.369 INFO:teuthology.orchestra.run.smithi039.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-11T23:46:54.419 INFO:teuthology.orchestra.run.smithi039.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-11T23:46:54.478 INFO:teuthology.orchestra.run.smithi039.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T23:46:54.528 INFO:teuthology.orchestra.run.smithi039.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-09-11T23:46:54.662 INFO:teuthology.orchestra.run.smithi039.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 7.0 MB/s | 5.8 MB 00:00 2024-09-11T23:46:54.663 INFO:teuthology.orchestra.run.smithi006.stdout:(67/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 6.6 MB/s | 49 MB 00:07 2024-09-11T23:46:54.705 INFO:teuthology.orchestra.run.smithi006.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 3.3 MB/s | 1.6 MB 00:00 2024-09-11T23:46:54.737 INFO:teuthology.orchestra.run.smithi039.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-11T23:46:54.780 INFO:teuthology.orchestra.run.smithi006.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-11T23:46:54.796 INFO:teuthology.orchestra.run.smithi039.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-11T23:46:54.805 INFO:teuthology.orchestra.run.smithi006.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-09-11T23:46:54.854 INFO:teuthology.orchestra.run.smithi039.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-11T23:46:54.889 INFO:teuthology.orchestra.run.smithi006.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-11T23:46:54.913 INFO:teuthology.orchestra.run.smithi039.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 726 kB/s | 42 kB 00:00 2024-09-11T23:46:54.914 INFO:teuthology.orchestra.run.smithi006.stdout:(72/156): postgresql-contrib-13.16-1.el9.x86_64 3.5 MB/s | 910 kB 00:00 2024-09-11T23:46:54.971 INFO:teuthology.orchestra.run.smithi039.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-11T23:46:54.998 INFO:teuthology.orchestra.run.smithi006.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-09-11T23:46:55.023 INFO:teuthology.orchestra.run.smithi006.stdout:(74/156): python3-attrs-20.3.0-7.el9.noarch.rpm 654 kB/s | 87 kB 00:00 2024-09-11T23:46:55.047 INFO:teuthology.orchestra.run.smithi039.stdout:(87/156): python3-babel-2.9.1-2.el9.noarch.rpm 6.1 MB/s | 6.0 MB 00:00 2024-09-11T23:46:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 917 kB/s | 61 kB 00:00 2024-09-11T23:46:55.072 INFO:teuthology.orchestra.run.smithi039.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-11T23:46:55.105 INFO:teuthology.orchestra.run.smithi039.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-11T23:46:55.106 INFO:teuthology.orchestra.run.smithi006.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-11T23:46:55.131 INFO:teuthology.orchestra.run.smithi039.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-09-11T23:46:55.156 INFO:teuthology.orchestra.run.smithi039.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-11T23:46:55.190 INFO:teuthology.orchestra.run.smithi006.stdout:(77/156): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-09-11T23:46:55.206 INFO:teuthology.orchestra.run.smithi039.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-11T23:46:55.224 INFO:teuthology.orchestra.run.smithi006.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-11T23:46:55.249 INFO:teuthology.orchestra.run.smithi006.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-09-11T23:46:55.265 INFO:teuthology.orchestra.run.smithi039.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 760 kB/s | 44 kB 00:00 2024-09-11T23:46:55.275 INFO:teuthology.orchestra.run.smithi006.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 229 kB/s | 19 kB 00:00 2024-09-11T23:46:55.300 INFO:teuthology.orchestra.run.smithi006.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-11T23:46:55.317 INFO:teuthology.orchestra.run.smithi006.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 517 kB/s | 35 kB 00:00 2024-09-11T23:46:55.332 INFO:teuthology.orchestra.run.smithi039.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.3 MB/s | 5.1 MB 00:00 2024-09-11T23:46:55.358 INFO:teuthology.orchestra.run.smithi039.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-11T23:46:55.359 INFO:teuthology.orchestra.run.smithi006.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-11T23:46:55.383 INFO:teuthology.orchestra.run.smithi039.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-11T23:46:55.384 INFO:teuthology.orchestra.run.smithi006.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-11T23:46:55.408 INFO:teuthology.orchestra.run.smithi039.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-11T23:46:55.469 INFO:teuthology.orchestra.run.smithi039.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.5 MB/s | 304 kB 00:00 2024-09-11T23:46:55.492 INFO:teuthology.orchestra.run.smithi039.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 694 kB/s | 58 kB 00:00 2024-09-11T23:46:55.501 INFO:teuthology.orchestra.run.smithi006.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 543 kB/s | 77 kB 00:00 2024-09-11T23:46:55.526 INFO:teuthology.orchestra.run.smithi006.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 298 kB/s | 42 kB 00:00 2024-09-11T23:46:55.550 INFO:teuthology.orchestra.run.smithi039.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-11T23:46:55.576 INFO:teuthology.orchestra.run.smithi039.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-11T23:46:55.593 INFO:teuthology.orchestra.run.smithi006.stdout:(87/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-11T23:46:55.601 INFO:teuthology.orchestra.run.smithi039.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-11T23:46:55.610 INFO:teuthology.orchestra.run.smithi006.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-11T23:46:55.635 INFO:teuthology.orchestra.run.smithi006.stdout:(89/156): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-09-11T23:46:55.651 INFO:teuthology.orchestra.run.smithi039.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-09-11T23:46:55.653 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-11T23:46:55.653 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-11T23:46:55.673 INFO:teuthology.orchestra.run.smithi006.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-11T23:46:55.694 INFO:teuthology.orchestra.run.smithi006.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-11T23:46:55.710 INFO:teuthology.orchestra.run.smithi039.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-11T23:46:55.720 INFO:teuthology.orchestra.run.smithi006.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 638 kB/s | 54 kB 00:00 2024-09-11T23:46:55.744 INFO:teuthology.orchestra.run.smithi039.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T23:46:55.753 INFO:teuthology.orchestra.run.smithi006.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-09-11T23:46:55.760 INFO:teuthology.orchestra.run.smithi039.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-11T23:46:55.787 INFO:teuthology.orchestra.run.smithi006.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 660 kB/s | 44 kB 00:00 2024-09-11T23:46:55.802 INFO:teuthology.orchestra.run.smithi039.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-09-11T23:46:55.821 INFO:teuthology.orchestra.run.smithi006.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-11T23:46:55.836 INFO:teuthology.orchestra.run.smithi039.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 781 kB/s | 26 kB 00:00 2024-09-11T23:46:55.853 INFO:teuthology.orchestra.run.smithi039.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-11T23:46:55.854 INFO:teuthology.orchestra.run.smithi006.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 536 kB/s | 36 kB 00:00 2024-09-11T23:46:55.878 INFO:teuthology.orchestra.run.smithi039.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T23:46:55.879 INFO:teuthology.orchestra.run.smithi006.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-09-11T23:46:55.895 INFO:teuthology.orchestra.run.smithi039.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 8.9 MB/s | 151 kB 00:00 2024-09-11T23:46:55.937 INFO:teuthology.orchestra.run.smithi039.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-11T23:46:55.938 INFO:teuthology.orchestra.run.smithi006.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-11T23:46:55.963 INFO:teuthology.orchestra.run.smithi006.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 692 kB/s | 58 kB 00:00 2024-09-11T23:46:55.979 INFO:teuthology.orchestra.run.smithi039.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-11T23:46:56.004 INFO:teuthology.orchestra.run.smithi039.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T23:46:56.005 INFO:teuthology.orchestra.run.smithi006.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-11T23:46:56.030 INFO:teuthology.orchestra.run.smithi039.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T23:46:56.055 INFO:teuthology.orchestra.run.smithi039.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 570 kB/s | 14 kB 00:00 2024-09-11T23:46:56.088 INFO:teuthology.orchestra.run.smithi039.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-11T23:46:56.122 INFO:teuthology.orchestra.run.smithi039.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-11T23:46:56.156 INFO:teuthology.orchestra.run.smithi039.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-11T23:46:56.172 INFO:teuthology.orchestra.run.smithi006.stdout:(101/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-11T23:46:56.189 INFO:teuthology.orchestra.run.smithi039.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-11T23:46:56.197 INFO:teuthology.orchestra.run.smithi006.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 233 kB/s | 45 kB 00:00 2024-09-11T23:46:56.223 INFO:teuthology.orchestra.run.smithi006.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 246 kB/s | 64 kB 00:00 2024-09-11T23:46:56.256 INFO:teuthology.orchestra.run.smithi039.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-09-11T23:46:56.281 INFO:teuthology.orchestra.run.smithi006.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-11T23:46:56.284 INFO:teuthology.orchestra.run.smithi039.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-11T23:46:56.307 INFO:teuthology.orchestra.run.smithi039.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-11T23:46:56.315 INFO:teuthology.orchestra.run.smithi006.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T23:46:56.333 INFO:teuthology.orchestra.run.smithi039.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 702 kB/s | 18 kB 00:00 2024-09-11T23:46:56.340 INFO:teuthology.orchestra.run.smithi006.stdout:(106/156): lua-devel-5.4.4-4.el9.x86_64.rpm 133 kB/s | 22 kB 00:00 2024-09-11T23:46:56.358 INFO:teuthology.orchestra.run.smithi039.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-11T23:46:56.365 INFO:teuthology.orchestra.run.smithi006.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-09-11T23:46:56.383 INFO:teuthology.orchestra.run.smithi039.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-11T23:46:56.399 INFO:teuthology.orchestra.run.smithi006.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:46:56.408 INFO:teuthology.orchestra.run.smithi039.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 794 kB/s | 20 kB 00:00 2024-09-11T23:46:56.424 INFO:teuthology.orchestra.run.smithi006.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-11T23:46:56.441 INFO:teuthology.orchestra.run.smithi006.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-11T23:46:56.467 INFO:teuthology.orchestra.run.smithi039.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-11T23:46:56.474 INFO:teuthology.orchestra.run.smithi006.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-11T23:46:56.493 INFO:teuthology.orchestra.run.smithi039.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:46:56.517 INFO:teuthology.orchestra.run.smithi006.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-11T23:46:56.518 INFO:teuthology.orchestra.run.smithi039.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T23:46:56.560 INFO:teuthology.orchestra.run.smithi039.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-09-11T23:46:56.584 INFO:teuthology.orchestra.run.smithi006.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-11T23:46:56.585 INFO:teuthology.orchestra.run.smithi039.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-09-11T23:46:56.641 INFO:teuthology.orchestra.run.smithi039.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 296 kB/s | 16 kB 00:00 2024-09-11T23:46:56.669 INFO:teuthology.orchestra.run.smithi039.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-11T23:46:56.694 INFO:teuthology.orchestra.run.smithi039.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-11T23:46:56.720 INFO:teuthology.orchestra.run.smithi039.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-11T23:46:56.734 INFO:teuthology.orchestra.run.smithi006.stdout:(114/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.6 MB/s | 863 kB 00:00 2024-09-11T23:46:56.745 INFO:teuthology.orchestra.run.smithi039.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-11T23:46:56.751 INFO:teuthology.orchestra.run.smithi006.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 261 kB/s | 43 kB 00:00 2024-09-11T23:46:56.770 INFO:teuthology.orchestra.run.smithi039.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T23:46:56.776 INFO:teuthology.orchestra.run.smithi006.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 856 kB/s | 14 kB 00:00 2024-09-11T23:46:56.795 INFO:teuthology.orchestra.run.smithi039.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-11T23:46:56.801 INFO:teuthology.orchestra.run.smithi006.stdout:(117/156): python3-cachetools-4.2.4-1.el9.noarc 479 kB/s | 32 kB 00:00 2024-09-11T23:46:56.821 INFO:teuthology.orchestra.run.smithi039.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-11T23:46:56.827 INFO:teuthology.orchestra.run.smithi006.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.5 MB/s | 172 kB 00:00 2024-09-11T23:46:56.846 INFO:teuthology.orchestra.run.smithi039.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-11T23:46:56.860 INFO:teuthology.orchestra.run.smithi006.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-11T23:46:56.863 INFO:teuthology.orchestra.run.smithi039.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 5.3 MB/s | 90 kB 00:00 2024-09-11T23:46:56.885 INFO:teuthology.orchestra.run.smithi006.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-11T23:46:56.888 INFO:teuthology.orchestra.run.smithi039.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-11T23:46:56.911 INFO:teuthology.orchestra.run.smithi006.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T23:46:56.913 INFO:teuthology.orchestra.run.smithi039.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-11T23:46:56.936 INFO:teuthology.orchestra.run.smithi006.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-11T23:46:56.961 INFO:teuthology.orchestra.run.smithi006.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-11T23:46:56.995 INFO:teuthology.orchestra.run.smithi006.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 528 kB/s | 18 kB 00:00 2024-09-11T23:46:56.997 INFO:teuthology.orchestra.run.smithi039.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-11T23:46:57.021 INFO:teuthology.orchestra.run.smithi006.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-11T23:46:57.022 INFO:teuthology.orchestra.run.smithi039.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-11T23:46:57.046 INFO:teuthology.orchestra.run.smithi006.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-11T23:46:57.071 INFO:teuthology.orchestra.run.smithi006.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-11T23:46:57.138 INFO:teuthology.orchestra.run.smithi006.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2024-09-11T23:46:57.163 INFO:teuthology.orchestra.run.smithi006.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:46:57.188 INFO:teuthology.orchestra.run.smithi006.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T23:46:57.189 INFO:teuthology.orchestra.run.smithi039.stdout:(147/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.9 MB/s | 16 MB 00:02 2024-09-11T23:46:57.214 INFO:teuthology.orchestra.run.smithi006.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T23:46:57.239 INFO:teuthology.orchestra.run.smithi039.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 6.5 MB/s | 1.6 MB 00:00 2024-09-11T23:46:57.247 INFO:teuthology.orchestra.run.smithi006.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-11T23:46:57.273 INFO:teuthology.orchestra.run.smithi006.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-11T23:46:57.315 INFO:teuthology.orchestra.run.smithi006.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-11T23:46:57.331 INFO:teuthology.orchestra.run.smithi006.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-11T23:46:57.357 INFO:teuthology.orchestra.run.smithi006.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-11T23:46:57.381 INFO:teuthology.orchestra.run.smithi039.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 16 MB/s | 2.3 MB 00:00 2024-09-11T23:46:57.382 INFO:teuthology.orchestra.run.smithi006.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-11T23:46:57.407 INFO:teuthology.orchestra.run.smithi006.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T23:46:57.449 INFO:teuthology.orchestra.run.smithi006.stdout:(139/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-11T23:46:57.465 INFO:teuthology.orchestra.run.smithi039.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 22 MB/s | 1.8 MB 00:00 2024-09-11T23:46:57.474 INFO:teuthology.orchestra.run.smithi006.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-11T23:46:57.500 INFO:teuthology.orchestra.run.smithi006.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 387 kB/s | 36 kB 00:00 2024-09-11T23:46:57.524 INFO:teuthology.orchestra.run.smithi039.stdout:(151/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.5 MB/s | 3.2 MB 00:00 2024-09-11T23:46:57.525 INFO:teuthology.orchestra.run.smithi006.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-11T23:46:57.542 INFO:teuthology.orchestra.run.smithi006.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-11T23:46:57.557 INFO:teuthology.orchestra.run.smithi039.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 444 kB/s | 41 kB 00:00 2024-09-11T23:46:57.567 INFO:teuthology.orchestra.run.smithi006.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-11T23:46:57.591 INFO:teuthology.orchestra.run.smithi039.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 3.6 MB/s | 249 kB 00:00 2024-09-11T23:46:57.592 INFO:teuthology.orchestra.run.smithi006.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-11T23:46:57.618 INFO:teuthology.orchestra.run.smithi006.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T23:46:57.641 INFO:teuthology.orchestra.run.smithi039.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-11T23:46:57.643 INFO:teuthology.orchestra.run.smithi006.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-11T23:46:57.693 INFO:teuthology.orchestra.run.smithi006.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T23:46:57.700 INFO:teuthology.orchestra.run.smithi039.stdout:(155/156): librados2-19.1.1-298.gb53b6d3e.el9.x 5.1 MB/s | 3.4 MB 00:00 2024-09-11T23:46:57.758 INFO:teuthology.orchestra.run.smithi039.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-11T23:46:57.764 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:46:57.764 INFO:teuthology.orchestra.run.smithi039.stdout:Total 17 MB/s | 226 MB 00:13 2024-09-11T23:46:57.868 INFO:teuthology.orchestra.run.smithi006.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-09-11T23:46:57.935 INFO:teuthology.orchestra.run.smithi006.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-09-11T23:46:57.977 INFO:teuthology.orchestra.run.smithi006.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 983 kB/s | 41 kB 00:00 2024-09-11T23:46:58.036 INFO:teuthology.orchestra.run.smithi006.stdout:(152/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 8.0 MB/s | 3.2 MB 00:00 2024-09-11T23:46:58.061 INFO:teuthology.orchestra.run.smithi006.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.9 MB/s | 249 kB 00:00 2024-09-11T23:46:58.137 INFO:teuthology.orchestra.run.smithi006.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-11T23:46:58.362 INFO:teuthology.orchestra.run.smithi006.stdout:(155/156): librados2-19.1.1-298.gb53b6d3e.el9.x 4.6 MB/s | 3.4 MB 00:00 2024-09-11T23:46:58.429 INFO:teuthology.orchestra.run.smithi006.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 1.4 MB 00:00 2024-09-11T23:46:58.434 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:46:58.434 INFO:teuthology.orchestra.run.smithi006.stdout:Total 14 MB/s | 226 MB 00:15 2024-09-11T23:46:59.025 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-09-11T23:46:59.194 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-09-11T23:46:59.194 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-09-11T23:46:59.658 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-09-11T23:46:59.823 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-09-11T23:46:59.823 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-09-11T23:47:01.485 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-09-11T23:47:01.485 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-09-11T23:47:02.131 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-09-11T23:47:02.132 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-09-11T23:47:02.386 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-11T23:47:02.504 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:47:02.548 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:47:02.629 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:47:02.662 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:47:02.687 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:47:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:47:03.087 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:47:03.195 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:47:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:47:03.346 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:47:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:47:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:47:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:47:03.664 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:47:03.692 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:47:03.795 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:47:03.818 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:47:03.880 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:47:03.902 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:47:03.926 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:47:04.121 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:47:04.310 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:47:04.433 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:47:04.548 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:47:04.626 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:47:04.852 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:47:04.961 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:47:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:47:05.082 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:47:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:47:05.188 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:47:05.233 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:47:05.265 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:47:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:47:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:47:05.377 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:47:05.446 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:47:05.499 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:47:05.531 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:47:05.566 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:47:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:47:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:47:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:47:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:47:05.809 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:47:05.854 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:47:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:47:06.078 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:47:06.132 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:47:06.655 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:47:06.735 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:47:06.765 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:47:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:47:06.845 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:47:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:47:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:47:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:47:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:47:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:47:07.249 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:47:07.285 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:47:07.332 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:47:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:47:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:47:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:47:07.604 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:47:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:47:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:47:07.788 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:47:07.821 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:47:07.926 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:47:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:47:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-09-11T23:47:08.137 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:47:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:47:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:47:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:47:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:47:08.356 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:47:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:47:08.393 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:47:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:47:08.430 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:47:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:47:08.469 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:47:08.510 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:47:08.542 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:47:08.572 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:47:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-09-11T23:47:08.607 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:47:08.640 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:47:08.682 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:47:08.683 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:47:08.719 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:47:08.779 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:47:08.805 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:47:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:47:08.849 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:47:08.880 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:47:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:47:08.982 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:47:09.002 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:47:09.040 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:47:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:47:09.067 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:47:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:47:09.092 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:47:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:47:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:47:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:47:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:47:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:47:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:47:09.585 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:47:09.612 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:47:09.652 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:47:09.676 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:47:09.705 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:47:09.725 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:47:09.757 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:47:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:47:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:47:09.803 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:47:09.837 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:47:09.895 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:47:09.924 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:47:09.925 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:47:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:47:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:47:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:47:10.098 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:47:10.109 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:47:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:47:10.155 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:47:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:47:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:47:10.254 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:47:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:47:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:47:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:47:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:47:10.374 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:47:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:47:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:47:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:47:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:47:10.463 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:47:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:47:10.701 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:47:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:47:10.814 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:47:10.909 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:47:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:47:10.943 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:47:10.978 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:47:11.025 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:47:11.045 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:47:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:47:11.096 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:47:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:47:11.145 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:47:11.189 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:47:11.221 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:47:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:47:11.248 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:47:11.319 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:47:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:47:11.371 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:47:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:47:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:47:11.445 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:47:11.523 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:47:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:47:11.555 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:47:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:47:11.599 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:47:11.607 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:47:11.627 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:47:11.683 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:47:11.700 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:47:11.743 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:47:11.743 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:47:11.791 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:47:11.819 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:47:11.834 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:47:11.867 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:47:11.894 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:47:11.965 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:47:11.966 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:47:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:47:12.020 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:47:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:47:12.091 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:47:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:47:12.218 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:47:12.280 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:47:12.315 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:47:12.389 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:47:12.447 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:47:12.454 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:47:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:47:12.539 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:47:12.568 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:47:12.575 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:47:12.593 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:47:12.659 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:47:12.680 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:47:12.694 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:47:12.737 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:47:12.742 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:47:12.775 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:47:12.818 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:47:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:47:12.956 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:47:12.979 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:47:13.036 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:47:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:47:13.077 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:47:13.093 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:47:13.113 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:47:13.175 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:47:13.213 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:47:13.248 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:47:13.304 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:47:13.314 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:47:13.339 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:47:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:47:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:47:13.433 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:47:13.457 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:47:13.500 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:47:13.538 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:47:13.578 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:47:13.581 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:47:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:47:13.627 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:47:13.634 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:47:13.668 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:47:13.705 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:47:13.735 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:47:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:47:13.775 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:47:13.810 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:47:13.816 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:47:13.881 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:47:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:47:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:47:14.036 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:47:14.084 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:47:14.096 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:47:14.119 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:47:14.125 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:47:14.158 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:47:14.163 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:47:14.205 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:47:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:47:14.357 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:47:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:47:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:47:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:47:14.473 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:47:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:47:14.515 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:47:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:47:14.590 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:47:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:47:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:47:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:47:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:47:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:47:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:47:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:47:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:47:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:47:14.881 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:47:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:47:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:47:15.012 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:47:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:47:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:47:15.074 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:47:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:47:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:47:15.155 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:47:15.195 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:47:15.224 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:47:15.259 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:47:15.372 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:47:15.596 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:47:15.661 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:47:15.700 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:47:15.808 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:47:15.867 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:47:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:47:15.909 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:47:15.943 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:47:16.039 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:47:16.047 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:47:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:47:16.099 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:47:16.153 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:47:16.242 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:47:16.279 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:47:16.470 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:47:16.501 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:47:16.582 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:47:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:47:16.659 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:47:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:47:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:47:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:47:16.751 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:47:16.751 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:47:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:47:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:47:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:47:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:47:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:47:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:47:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:47:17.293 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:47:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:47:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:47:17.412 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:47:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:47:18.105 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:47:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:47:18.739 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:47:18.814 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:47:18.834 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:47:18.859 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:47:19.185 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:47:19.221 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:47:19.313 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:47:19.351 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:47:19.388 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:47:19.579 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:47:19.678 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:47:19.706 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:47:19.739 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:47:19.894 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:47:19.949 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:47:20.004 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:47:20.034 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:47:20.066 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:47:20.118 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:47:20.209 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:47:20.248 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:47:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:47:20.799 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:47:20.846 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:47:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:47:20.947 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:47:22.421 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:47:22.456 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:47:23.036 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:47:23.075 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:47:23.169 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:47:23.169 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:47:23.169 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:47:23.169 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:23.212 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:47:23.441 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:47:23.477 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:47:24.057 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:47:24.105 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:47:24.179 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:47:24.179 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:47:24.180 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:47:24.180 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:47:24.232 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:47:28.942 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:47:28.943 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-09-11T23:47:28.943 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-09-11T23:47:28.943 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-09-11T23:47:28.943 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-09-11T23:47:28.943 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-09-11T23:47:28.943 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-09-11T23:47:28.943 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-09-11T23:47:28.943 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:29.111 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:47:29.127 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:47:29.127 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:29.127 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:47:29.127 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:30.648 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:47:30.675 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:47:30.675 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:30.675 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:47:30.675 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:47:30.675 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:47:30.675 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:30.898 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:47:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:47:30.922 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:30.922 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:47:30.922 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:47:30.923 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:47:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:31.366 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:47:31.390 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:47:31.390 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:31.390 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:47:31.390 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:47:31.390 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:47:31.390 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:47:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:47:31.590 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:47:31.774 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:47:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:47:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:47:31.981 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:47:32.113 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:47:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:47:32.190 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:47:32.217 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:47:32.642 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:47:32.674 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:47:32.739 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:47:32.801 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:47:32.830 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:47:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:47:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:47:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:47:34.890 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:47:34.991 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:47:35.144 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:47:35.176 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:47:35.200 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:47:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:47:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:47:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:47:35.200 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:47:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:47:35.369 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:47:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:47:35.478 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:47:35.478 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /sys 2024-09-11T23:47:35.478 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /proc 2024-09-11T23:47:35.478 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /mnt 2024-09-11T23:47:35.479 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /var/tmp 2024-09-11T23:47:35.479 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /home 2024-09-11T23:47:35.479 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /root 2024-09-11T23:47:35.479 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /tmp 2024-09-11T23:47:35.479 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:35.656 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:47:35.673 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:47:35.673 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:35.673 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:47:35.673 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:36.361 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:47:36.388 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:47:36.412 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:47:36.412 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:36.412 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:47:36.412 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:47:36.412 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:47:36.412 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:36.480 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:47:36.503 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:47:36.503 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:36.503 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:47:36.503 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:36.564 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:47:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:47:36.587 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:36.587 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:47:36.587 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:47:36.587 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:47:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:36.651 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:47:36.652 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2024-09-11T23:47:36.652 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2024-09-11T23:47:36.652 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2024-09-11T23:47:36.652 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2024-09-11T23:47:36.652 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2024-09-11T23:47:36.652 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /root 2024-09-11T23:47:36.652 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2024-09-11T23:47:36.652 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:47:36.837 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:47:36.853 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:47:36.853 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:36.853 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:47:36.853 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:47:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:47:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:47:36.913 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:36.913 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:47:36.913 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:47:36.913 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:47:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:37.212 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:47:37.237 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:47:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:47:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:47:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:47:37.238 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:37.477 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:47:37.502 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:47:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:47:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:47:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:47:37.502 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:37.961 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:47:37.986 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:47:37.986 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:37.986 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:47:37.986 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:47:37.986 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:47:37.986 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:38.109 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:47:38.166 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:47:38.230 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:47:38.390 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:47:38.418 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:47:38.418 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:38.418 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:47:38.418 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:47:38.418 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:47:38.418 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:47:38.424 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:47:38.470 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:47:38.550 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:47:38.641 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:47:38.665 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:47:38.690 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:47:38.690 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:38.690 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:47:38.690 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:47:38.690 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:47:38.690 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:47:38.792 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:47:38.838 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:47:38.869 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:47:38.896 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:47:39.150 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:47:39.174 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:47:39.174 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:39.174 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:47:39.174 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:47:39.174 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:47:39.174 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:47:39.281 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:47:39.323 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:47:39.339 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:47:39.353 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:47:39.385 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:47:39.403 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:47:39.449 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:47:39.476 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:47:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:47:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:47:39.732 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:47:39.822 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:47:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:47:40.026 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:47:40.068 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:47:40.093 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:47:40.503 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:47:40.533 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:47:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:47:40.581 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:47:40.620 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:47:40.659 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:47:40.689 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:47:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:47:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:47:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:47:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:47:41.626 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:47:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:47:41.670 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:47:41.778 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:47:41.802 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:47:41.818 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:47:41.842 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:47:41.863 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:47:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:47:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:47:41.947 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:47:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:47:41.980 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:47:42.006 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:47:42.006 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:42.006 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:47:42.006 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:47:42.006 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:47:42.006 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:42.056 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:47:42.068 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:47:42.169 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:47:42.232 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:47:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:47:42.567 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:47:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:47:42.861 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:47:42.892 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:47:43.003 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:47:43.169 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:47:43.194 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:47:43.206 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:47:43.220 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:47:43.220 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:43.220 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:47:43.220 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:47:43.220 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:47:43.220 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:47:43.250 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:47:43.269 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:47:43.275 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:47:43.275 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:43.276 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:47:43.276 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:47:43.276 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:47:43.276 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:43.281 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:47:43.325 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:47:43.350 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:47:43.350 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:43.350 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:47:43.350 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:43.383 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:47:43.401 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:47:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:47:43.426 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:47:43.426 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:43.426 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:47:43.426 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:47:43.426 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:47:43.426 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:43.449 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:47:43.505 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:47:43.550 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:47:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:47:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:47:43.700 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:47:43.725 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:47:43.725 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:47:43.743 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:47:43.768 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:47:43.769 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:43.769 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:47:43.769 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:47:43.769 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:47:43.769 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:43.826 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:47:43.826 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:47:43.910 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:47:43.935 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:47:43.941 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:47:43.941 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:47:44.128 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:47:44.129 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:47:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:47:44.277 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:47:44.429 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:47:44.463 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:47:44.489 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:47:44.489 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:44.489 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:47:44.489 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:47:44.489 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:47:44.489 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:47:44.531 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:47:44.555 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:47:44.555 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:44.555 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:47:44.555 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:47:44.606 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:47:44.631 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:47:44.631 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:44.631 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:47:44.631 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:47:44.631 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:47:44.631 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:47:44.957 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:47:44.982 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:47:44.982 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:47:44.982 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:47:44.982 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:47:44.982 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:47:44.982 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:47:48.598 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:47:48.648 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:47:48.689 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:47:48.720 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:47:48.747 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:47:48.951 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:47:48.994 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:47:49.024 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:47:49.054 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:47:49.100 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:47:49.683 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:47:49.731 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:47:49.753 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:47:49.836 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:47:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:47:49.906 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:47:49.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:47:49.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:47:49.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:47:49.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:47:49.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:47:49.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:47:49.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:47:49.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:47:49.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:47:49.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:47:49.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:47:49.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:47:49.908 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:47:49.908 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:47:49.908 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:47:49.908 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:47:49.908 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:47:49.908 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:47:49.908 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:47:49.908 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:47:49.908 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:47:49.908 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:47:49.909 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:47:49.909 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:47:49.909 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:47:49.909 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:47:49.909 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:47:49.909 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:47:49.909 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:47:49.909 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:47:49.909 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:47:49.909 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:47:49.909 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:47:49.909 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:47:49.910 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:47:49.910 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:47:49.910 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:47:49.910 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:47:49.910 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:47:49.910 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:47:49.910 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:47:49.910 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:47:49.910 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:47:49.910 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:47:49.910 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:47:49.910 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:47:49.911 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:47:49.912 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:47:49.912 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:47:49.912 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:47:49.912 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:47:49.912 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:47:49.912 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:47:49.912 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:47:49.912 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:47:49.912 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:47:49.912 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:47:49.912 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:47:49.913 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:47:49.913 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:47:49.913 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:47:49.913 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:47:49.913 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:47:49.913 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:47:49.913 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:47:49.913 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:47:49.913 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:47:49.913 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:47:49.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:47:49.916 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:47:49.917 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:47:49.918 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:47:49.919 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:47:49.920 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:47:49.920 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:47:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:47:49.959 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:47:49.986 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:47:50.209 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:47:50.266 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:47:50.296 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:47:50.326 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:47:50.372 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:47:50.647 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:47:50.736 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:47:50.785 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:47:50.875 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:47:50.913 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:47:50.939 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:47:50.970 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:47:50.973 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:47:50.973 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:47:51.020 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:47:51.041 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:47:51.057 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:47:51.057 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:47:51.125 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:47:51.149 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:47:51.155 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:47:51.156 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:47:51.343 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:47:51.343 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:47:51.435 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:47:51.504 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:47:51.948 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:47:52.033 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:47:52.086 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:47:52.177 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:47:52.211 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:47:52.242 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:47:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:47:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:47:52.355 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:47:52.355 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:47:52.422 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:47:52.447 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:47:52.453 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:47:52.453 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:47:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:47:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:52.488 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-09-11T23:47:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:47:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:47:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:47:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:47:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:47:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:47:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:47:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:47:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:47:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:47:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:47:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:47:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:47:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:47:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:47:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:47:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:47:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:47:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:47:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:47:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:47:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:47:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:47:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:47:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:47:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:47:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:47:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:47:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:47:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:47:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:47:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:47:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:47:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:47:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:47:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:47:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:47:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:47:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:47:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:47:52.501 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-11T23:47:52.640 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:47:52.641 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:47:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:47:52.801 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:47:52.898 DEBUG:teuthology.parallel:result is None 2024-09-11T23:47:56.972 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:47:56.973 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:47:56.973 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:47:56.973 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:47:56.973 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:47:56.973 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:47:56.973 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:47:56.973 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:47:56.973 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:47:56.973 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:47:56.973 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:47:56.973 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:47:56.973 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:47:56.974 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:47:56.975 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:47:56.975 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:47:56.975 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:47:56.975 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:47:56.975 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:47:56.975 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:47:56.987 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:47:56.987 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:47:56.987 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:47:56.987 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:47:56.987 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:47:56.987 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:47:56.987 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:47:56.987 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:47:56.987 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:47:56.988 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:47:56.988 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:47:56.988 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:47:56.988 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:47:56.988 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:47:56.988 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:47:56.988 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:47:56.988 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:47:56.988 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:47:56.988 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:47:56.988 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:47:56.988 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:47:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:47:56.990 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:47:56.990 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:47:56.990 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:47:56.990 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:47:56.990 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:47:56.990 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:47:56.990 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:47:56.990 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:47:56.990 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:47:56.990 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:47:56.990 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:47:56.990 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:47:56.991 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:47:56.992 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:47:56.992 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:47:56.992 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:47:56.992 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:47:56.992 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:47:56.992 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:47:56.992 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:47:56.992 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:47:56.992 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:47:56.992 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:47:56.992 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:47:56.992 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:47:56.993 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:47:56.994 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:47:56.995 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:47:56.995 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:47:56.995 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:47:56.995 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:47:56.995 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:47:56.995 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:47:56.995 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:47:56.995 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:47:56.995 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:47:56.995 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:47:56.995 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:47:56.995 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:47:56.996 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:47:56.997 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:47:56.997 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:47:56.997 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:47:56.997 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:47:56.997 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:47:56.997 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:47:56.997 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:47:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:47:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:47:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:47:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:47:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:47:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:47:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:47:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:47:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:47:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:47:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:47:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:47:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:47:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:47:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:47:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:47:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:47:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:47:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:47:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:47:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:47:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:47:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:47:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:47:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:47:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:47:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:47:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:47:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:47:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:47:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:47:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:47:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:47:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:47:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:47:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:47:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:47:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:47:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:47:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:47:58.462 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:47:58.462 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:47:59.421 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout:Upgraded: 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:47:59.422 INFO:teuthology.orchestra.run.smithi039.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:59.423 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:59.424 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:59.424 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.424 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.424 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:59.424 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.424 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.424 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.424 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:59.424 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:59.424 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.424 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.424 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.425 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:47:59.426 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:47:59.427 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:47:59.428 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:47:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:47:59.430 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:47:59.431 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:47:59.432 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:47:59.433 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-09-11T23:47:59.832 DEBUG:teuthology.parallel:result is None 2024-09-11T23:48:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:48:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:48:01.236 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2024-09-11T23:48:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:48:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:48:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:48:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:48:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:48:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:48:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:48:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:48:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:48:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:48:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:48:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:48:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:48:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:48:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:48:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:48:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:48:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:48:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:48:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:48:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:48:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:48:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:48:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:48:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:48:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:48:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:48:01.248 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-09-11T23:48:01.648 DEBUG:teuthology.parallel:result is None 2024-09-11T23:48:01.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:48:01.808 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:48:01.832 INFO:teuthology.orchestra.run.smithi006.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:48:01.833 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:48:01.833 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:48:01.835 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:48:01.982 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:48:02.009 INFO:teuthology.orchestra.run.smithi039.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:48:02.010 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:48:02.010 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:48:02.012 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:48:02.165 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:48:02.192 INFO:teuthology.orchestra.run.smithi134.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:48:02.192 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:48:02.192 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:48:02.195 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T23:48:02.195 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:48:02.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:48:02.226 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-11T23:48:02.226 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:48:02.259 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-11T23:48:02.259 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:48:02.292 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T23:48:02.293 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:48:02.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:48:02.321 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:48:02.389 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-11T23:48:02.389 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:48:02.420 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:48:02.490 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-11T23:48:02.490 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:48:02.520 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:48:02.588 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T23:48:02.588 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:48:02.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:48:02.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:48:02.686 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-11T23:48:02.686 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:48:02.716 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:48:02.786 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-11T23:48:02.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:48:02.816 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:48:02.886 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T23:48:02.886 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:48:02.886 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:48:02.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:48:02.986 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-11T23:48:02.986 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:48:03.017 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:48:03.087 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-11T23:48:03.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:48:03.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:48:03.184 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-11T23:48:03.392 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2}} 2024-09-11T23:48:03.392 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:48:03.393 INFO:tasks.cephadm:Cluster fsid is 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:48:03.393 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-11T23:48:03.393 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.6', 'mon.b': '172.21.15.39', 'mon.c': '172.21.15.134'} 2024-09-11T23:48:03.393 INFO:tasks.cephadm:First mon is mon.a on smithi006 2024-09-11T23:48:03.393 INFO:tasks.cephadm:First mgr is x 2024-09-11T23:48:03.393 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-11T23:48:03.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname $(hostname -s) 2024-09-11T23:48:03.424 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname $(hostname -s) 2024-09-11T23:48:03.455 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2024-09-11T23:48:03.485 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-11T23:48:03.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:48:03.642 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-11T23:48:03.793 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:48:03.794 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T23:48:03.794 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T23:48:03.794 DEBUG:teuthology.orchestra.run.smithi006:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T23:48:04.184 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 23:48 /home/ubuntu/cephtest/cephadm 2024-09-11T23:48:04.185 DEBUG:teuthology.orchestra.run.smithi039:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T23:48:04.553 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 23:48 /home/ubuntu/cephtest/cephadm 2024-09-11T23:48:04.553 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T23:48:04.919 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 23:48 /home/ubuntu/cephtest/cephadm 2024-09-11T23:48:04.919 DEBUG:teuthology.orchestra.run.smithi006:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T23:48:04.940 DEBUG:teuthology.orchestra.run.smithi039:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T23:48:04.960 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T23:48:05.025 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-11T23:48:05.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T23:48:05.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T23:48:05.030 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T23:48:06.602 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:48:06.691 INFO:teuthology.orchestra.run.smithi039.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:48:06.754 INFO:teuthology.orchestra.run.smithi006.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:48:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:48:33.510 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:48:33.510 INFO:teuthology.orchestra.run.smithi006.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T23:48:33.510 INFO:teuthology.orchestra.run.smithi006.stdout: "repo_digests": [ 2024-09-11T23:48:33.510 INFO:teuthology.orchestra.run.smithi006.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T23:48:33.510 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-11T23:48:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:48:53.435 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-11T23:48:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:48:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T23:48:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2024-09-11T23:48:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T23:48:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-11T23:48:53.436 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-11T23:48:53.639 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-11T23:48:53.639 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:48:53.639 INFO:teuthology.orchestra.run.smithi039.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T23:48:53.639 INFO:teuthology.orchestra.run.smithi039.stdout: "repo_digests": [ 2024-09-11T23:48:53.639 INFO:teuthology.orchestra.run.smithi039.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T23:48:53.639 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-11T23:48:53.639 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-11T23:48:53.665 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph 2024-09-11T23:48:53.701 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph 2024-09-11T23:48:53.730 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2024-09-11T23:48:53.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /etc/ceph 2024-09-11T23:48:53.789 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /etc/ceph 2024-09-11T23:48:53.816 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2024-09-11T23:48:53.841 INFO:tasks.cephadm:Writing seed config... 2024-09-11T23:48:53.842 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-11T23:48:53.842 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-11T23:48:53.842 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-11T23:48:53.843 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-11T23:48:53.844 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-11T23:48:53.845 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-11T23:48:53.845 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-11T23:48:53.845 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-11T23:48:53.845 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-11T23:48:53.845 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-11T23:48:53.845 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-11T23:48:53.845 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-11T23:48:53.845 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-09-11T23:48:53.845 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-11T23:48:53.845 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-11T23:48:53.846 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-11T23:48:53.846 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-11T23:48:53.846 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-09-11T23:48:53.846 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-11T23:48:53.846 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-11T23:48:53.846 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-11T23:48:53.846 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-11T23:48:53.847 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:48:53.847 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-11T23:48:53.866 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4901345a-7098-11ef-bcea-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-11T23:48:53.866 DEBUG:teuthology.orchestra.run.smithi006:mon.a> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.a.service 2024-09-11T23:48:53.909 DEBUG:teuthology.orchestra.run.smithi006:mgr.x> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.x.service 2024-09-11T23:48:53.953 INFO:tasks.cephadm:Bootstrapping... 2024-09-11T23:48:53.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid 4901345a-7098-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.6 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:48:54.169 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:48:54.169 INFO:teuthology.orchestra.run.smithi006.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', '4901345a-7098-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.6', '--skip-admin-label'] 2024-09-11T23:48:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-11T23:48:54.170 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying podman|docker is present... 2024-09-11T23:48:54.194 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 5.2.2 2024-09-11T23:48:54.194 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying lvm2 is present... 2024-09-11T23:48:54.194 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying time synchronization is in place... 2024-09-11T23:48:54.202 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T23:48:54.202 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T23:48:54.209 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T23:48:54.209 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-09-11T23:48:54.215 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout enabled 2024-09-11T23:48:54.222 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout active 2024-09-11T23:48:54.222 INFO:teuthology.orchestra.run.smithi006.stdout:Unit chronyd.service is enabled and running 2024-09-11T23:48:54.222 INFO:teuthology.orchestra.run.smithi006.stdout:Repeating the final host check... 2024-09-11T23:48:54.246 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 5.2.2 2024-09-11T23:48:54.246 INFO:teuthology.orchestra.run.smithi006.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-11T23:48:54.246 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl is present 2024-09-11T23:48:54.246 INFO:teuthology.orchestra.run.smithi006.stdout:lvcreate is present 2024-09-11T23:48:54.252 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T23:48:54.253 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T23:48:54.259 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T23:48:54.259 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-09-11T23:48:54.265 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout enabled 2024-09-11T23:48:54.273 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout active 2024-09-11T23:48:54.273 INFO:teuthology.orchestra.run.smithi006.stdout:Unit chronyd.service is enabled and running 2024-09-11T23:48:54.273 INFO:teuthology.orchestra.run.smithi006.stdout:Host looks OK 2024-09-11T23:48:54.273 INFO:teuthology.orchestra.run.smithi006.stdout:Cluster fsid: 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:48:54.273 INFO:teuthology.orchestra.run.smithi006.stdout:Acquiring lock 140656876028928 on /run/cephadm/4901345a-7098-11ef-bcea-c7b262605968.lock 2024-09-11T23:48:54.274 INFO:teuthology.orchestra.run.smithi006.stdout:Lock 140656876028928 acquired on /run/cephadm/4901345a-7098-11ef-bcea-c7b262605968.lock 2024-09-11T23:48:54.274 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying IP 172.21.15.6 port 3300 ... 2024-09-11T23:48:54.275 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying IP 172.21.15.6 port 6789 ... 2024-09-11T23:48:54.275 INFO:teuthology.orchestra.run.smithi006.stdout:Base mon IP(s) is [172.21.15.6:3300, 172.21.15.6:6789], mon addrv is [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2024-09-11T23:48:54.277 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.6 metric 100 2024-09-11T23:48:54.277 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.6 metric 100 2024-09-11T23:48:54.280 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-11T23:48:54.280 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-11T23:48:54.280 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1792sec hoplimit 64 pref medium 2024-09-11T23:48:54.283 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-11T23:48:54.283 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-11T23:48:54.283 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T23:48:54.283 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-11T23:48:54.284 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2024-09-11T23:48:54.284 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T23:48:54.284 INFO:teuthology.orchestra.run.smithi006.stdout:Mon IP `172.21.15.6` is in CIDR network `172.21.0.0/20` 2024-09-11T23:48:54.284 INFO:teuthology.orchestra.run.smithi006.stdout:Mon IP `172.21.15.6` is in CIDR network `172.21.0.0/20` 2024-09-11T23:48:54.284 INFO:teuthology.orchestra.run.smithi006.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-11T23:48:54.285 INFO:teuthology.orchestra.run.smithi006.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-11T23:48:54.285 INFO:teuthology.orchestra.run.smithi006.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:48:54.776 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T23:48:54.776 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:48:54.776 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Getting image source signatures 2024-09-11T23:48:54.777 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-11T23:48:54.777 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-11T23:48:54.777 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T23:48:54.777 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-11T23:48:59.983 INFO:teuthology.orchestra.run.smithi006.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T23:48:59.983 INFO:teuthology.orchestra.run.smithi006.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T23:48:59.983 INFO:teuthology.orchestra.run.smithi006.stdout:Extracting ceph user uid/gid from container image... 2024-09-11T23:49:06.208 INFO:teuthology.orchestra.run.smithi006.stdout:stat: stdout 167 167 2024-09-11T23:49:06.208 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial keys... 2024-09-11T23:49:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQByLOJmUfDgHxAAnqPoLVlZIIty11iscdJmQw== 2024-09-11T23:49:08.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQBzLOJmMH6jMRAABrIdBCk/eXs3E6/LiQErAQ== 2024-09-11T23:49:09.383 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQB0LOJmzxX6KhAAnzLppZchbBYdL7fwAKFiAA== 2024-09-11T23:49:09.383 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial monmap... 2024-09-11T23:49:10.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T23:49:10.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-11T23:49:10.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:10.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T23:49:10.315 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool for a [v2:172.21.15.6:3300,v1:172.21.15.6:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T23:49:10.315 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = quincy 2024-09-11T23:49:10.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: set fsid to 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:10.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T23:49:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:49:10.316 INFO:teuthology.orchestra.run.smithi006.stdout:Creating mon... 2024-09-11T23:49:12.510 INFO:teuthology.orchestra.run.smithi006.stdout:create mon.a on 2024-09-11T23:49:12.730 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-11T23:49:12.882 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-11T23:49:13.183 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4901345a-7098-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-4901345a-7098-11ef-bcea-c7b262605968.target. 2024-09-11T23:49:13.183 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4901345a-7098-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-4901345a-7098-11ef-bcea-c7b262605968.target. 2024-09-11T23:49:13.418 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.a 2024-09-11T23:49:13.418 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-11T23:49:13.585 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4901345a-7098-11ef-bcea-c7b262605968.target.wants/ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-4901345a-7098-11ef-bcea-c7b262605968@.service. 2024-09-11T23:49:14.096 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:14 smithi006 ceph-mon[30580]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T23:49:14.096 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:14 smithi006 bash[30561]: 068fdf8faafaccb59b3aeebf63ff8a8e9db3ad8e84dd8c4ff226f023c9fa5f7b 2024-09-11T23:49:14.110 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:49:14.110 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2024-09-11T23:49:14.117 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:49:14.117 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-09-11T23:49:14.117 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2024-09-11T23:49:14.117 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T23:49:14.118 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mon to start... 2024-09-11T23:49:14.118 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mon... 2024-09-11T23:49:14.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:14 smithi006 systemd[1]: Started Ceph mon.a for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:49:15.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout cluster: 2024-09-11T23:49:15.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout id: 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout services: 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.578772s) 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout data: 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout pgs: 2024-09-11T23:49:15.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.570+0000 7fcb31209640 1 Processor -- start 2024-09-11T23:49:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.570+0000 7fcb31209640 1 -- start start 2024-09-11T23:49:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.570+0000 7fcb31209640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 0x7fcb2c10a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.570+0000 7fcb31209640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c075a20 con 0x7fcb2c108040 2024-09-11T23:49:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.570+0000 7fcb2ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 0x7fcb2c10a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.571+0000 7fcb2ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 0x7fcb2c10a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39852/0 (socket says 172.21.15.6:39852) 2024-09-11T23:49:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.571+0000 7fcb2ad9d640 1 -- 172.21.15.6:0/349166205 learned_addr learned my addr 172.21.15.6:0/349166205 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.571+0000 7fcb2ad9d640 1 -- 172.21.15.6:0/349166205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c10a970 con 0x7fcb2c108040 2024-09-11T23:49:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.573+0000 7fcb2ad9d640 1 --2- 172.21.15.6:0/349166205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 0x7fcb2c10a430 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009820 tx=0x7fcb1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611b5e1d9313f8e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.573+0000 7fcb29d9b640 1 -- 172.21.15.6:0/349166205 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c037070 con 0x7fcb2c108040 2024-09-11T23:49:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.573+0000 7fcb29d9b640 1 -- 172.21.15.6:0/349166205 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c032440 con 0x7fcb2c108040 2024-09-11T23:49:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.573+0000 7fcb29d9b640 1 -- 172.21.15.6:0/349166205 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c032740 con 0x7fcb2c108040 2024-09-11T23:49:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.574+0000 7fcb31209640 1 -- 172.21.15.6:0/349166205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 msgr2=0x7fcb2c10a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.574+0000 7fcb31209640 1 --2- 172.21.15.6:0/349166205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 0x7fcb2c10a430 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009820 tx=0x7fcb1c02a270 comp rx=0 tx=0).stop 2024-09-11T23:49:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.574+0000 7fcb31209640 1 -- 172.21.15.6:0/349166205 shutdown_connections 2024-09-11T23:49:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.574+0000 7fcb31209640 1 --2- 172.21.15.6:0/349166205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 0x7fcb2c10a430 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.574+0000 7fcb31209640 1 -- 172.21.15.6:0/349166205 >> 172.21.15.6:0/349166205 conn(0x7fcb2c101c40 msgr2=0x7fcb2c104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.574+0000 7fcb31209640 1 -- 172.21.15.6:0/349166205 shutdown_connections 2024-09-11T23:49:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.574+0000 7fcb31209640 1 -- 172.21.15.6:0/349166205 wait complete. 2024-09-11T23:49:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.574+0000 7fcb31209640 1 Processor -- start 2024-09-11T23:49:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.575+0000 7fcb31209640 1 -- start start 2024-09-11T23:49:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.575+0000 7fcb31209640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 0x7fcb2c1078c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.575+0000 7fcb31209640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c10ae50 con 0x7fcb2c108040 2024-09-11T23:49:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.575+0000 7fcb2ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 0x7fcb2c1078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:15.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.575+0000 7fcb2ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 0x7fcb2c1078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39862/0 (socket says 172.21.15.6:39862) 2024-09-11T23:49:15.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.575+0000 7fcb2ad9d640 1 -- 172.21.15.6:0/12397070 learned_addr learned my addr 172.21.15.6:0/12397070 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:15.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.575+0000 7fcb2ad9d640 1 -- 172.21.15.6:0/12397070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c107e00 con 0x7fcb2c108040 2024-09-11T23:49:15.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.575+0000 7fcb2ad9d640 1 --2- 172.21.15.6:0/12397070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 0x7fcb2c1078c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0090b0 tx=0x7fcb1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:15.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.576+0000 7fcb13fff640 1 -- 172.21.15.6:0/12397070 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c041070 con 0x7fcb2c108040 2024-09-11T23:49:15.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.576+0000 7fcb13fff640 1 -- 172.21.15.6:0/12397070 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c03c7a0 con 0x7fcb2c108040 2024-09-11T23:49:15.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.576+0000 7fcb31209640 1 -- 172.21.15.6:0/12397070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2c105ff0 con 0x7fcb2c108040 2024-09-11T23:49:15.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.576+0000 7fcb13fff640 1 -- 172.21.15.6:0/12397070 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c037040 con 0x7fcb2c108040 2024-09-11T23:49:15.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.576+0000 7fcb31209640 1 -- 172.21.15.6:0/12397070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2c106530 con 0x7fcb2c108040 2024-09-11T23:49:15.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.576+0000 7fcb13fff640 1 -- 172.21.15.6:0/12397070 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcb1c044070 con 0x7fcb2c108040 2024-09-11T23:49:15.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.576+0000 7fcb13fff640 1 -- 172.21.15.6:0/12397070 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcb1c03d3f0 con 0x7fcb2c108040 2024-09-11T23:49:15.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.577+0000 7fcb31209640 1 -- 172.21.15.6:0/12397070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2c1084a0 con 0x7fcb2c108040 2024-09-11T23:49:15.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.579+0000 7fcb13fff640 1 -- 172.21.15.6:0/12397070 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcb1c046450 con 0x7fcb2c108040 2024-09-11T23:49:15.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.641+0000 7fcb31209640 1 -- 172.21.15.6:0/12397070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fcb2c194780 con 0x7fcb2c108040 2024-09-11T23:49:15.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.641+0000 7fcb13fff640 1 -- 172.21.15.6:0/12397070 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fcb1c046630 con 0x7fcb2c108040 2024-09-11T23:49:15.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.642+0000 7fcb31209640 1 -- 172.21.15.6:0/12397070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 msgr2=0x7fcb2c1078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:15.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.642+0000 7fcb31209640 1 --2- 172.21.15.6:0/12397070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 0x7fcb2c1078c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0090b0 tx=0x7fcb1c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:49:15.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.642+0000 7fcb31209640 1 -- 172.21.15.6:0/12397070 shutdown_connections 2024-09-11T23:49:15.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.642+0000 7fcb31209640 1 --2- 172.21.15.6:0/12397070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2c108040 0x7fcb2c1078c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:15.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.642+0000 7fcb31209640 1 -- 172.21.15.6:0/12397070 >> 172.21.15.6:0/12397070 conn(0x7fcb2c101c40 msgr2=0x7fcb2c102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:15.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.642+0000 7fcb31209640 1 -- 172.21.15.6:0/12397070 shutdown_connections 2024-09-11T23:49:15.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:14.642+0000 7fcb31209640 1 -- 172.21.15.6:0/12397070 wait complete. 2024-09-11T23:49:15.182 INFO:teuthology.orchestra.run.smithi006.stdout:mon is available 2024-09-11T23:49:15.182 INFO:teuthology.orchestra.run.smithi006.stdout:Assimilating anything we can from ceph.conf... 2024-09-11T23:49:15.278 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:15 smithi006 ceph-mon[30580]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T23:49:15.278 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:15 smithi006 ceph-mon[30580]: monmap epoch 1 2024-09-11T23:49:15.278 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:15 smithi006 ceph-mon[30580]: fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:15.278 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:15 smithi006 ceph-mon[30580]: last_changed 2024-09-11T23:49:09.715349+0000 2024-09-11T23:49:15.278 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:15 smithi006 ceph-mon[30580]: created 2024-09-11T23:49:09.715349+0000 2024-09-11T23:49:15.278 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:15 smithi006 ceph-mon[30580]: min_mon_release 19 (squid) 2024-09-11T23:49:15.278 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:15 smithi006 ceph-mon[30580]: election_strategy: 1 2024-09-11T23:49:15.278 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:15 smithi006 ceph-mon[30580]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-11T23:49:15.278 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:15 smithi006 ceph-mon[30580]: fsmap 2024-09-11T23:49:15.279 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:15 smithi006 ceph-mon[30580]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T23:49:15.279 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:15 smithi006 ceph-mon[30580]: mgrmap e1: no daemons active 2024-09-11T23:49:15.279 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:15 smithi006 ceph-mon[30580]: from='client.? 172.21.15.6:0/12397070' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-11T23:49:16.208 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:16.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T23:49:16.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout fsid = 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:16.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2024-09-11T23:49:16.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T23:49:16.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T23:49:16.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T23:49:16.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T23:49:16.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:16.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T23:49:16.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T23:49:16.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:16.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T23:49:16.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-11T23:49:16.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T23:49:16.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T23:49:16.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T23:49:16.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T23:49:16.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T23:49:16.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.576+0000 7f1f4861a640 1 Processor -- start 2024-09-11T23:49:16.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.576+0000 7f1f4861a640 1 -- start start 2024-09-11T23:49:16.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.576+0000 7f1f4861a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 0x7f1f40106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:16.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.576+0000 7f1f4861a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1f401073a0 con 0x7f1f401069d0 2024-09-11T23:49:16.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.577+0000 7f1f463b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 0x7f1f40106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:16.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.577+0000 7f1f463b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 0x7f1f40106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39870/0 (socket says 172.21.15.6:39870) 2024-09-11T23:49:16.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.577+0000 7f1f463b6640 1 -- 172.21.15.6:0/4236052682 learned_addr learned my addr 172.21.15.6:0/4236052682 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:16.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.577+0000 7f1f463b6640 1 -- 172.21.15.6:0/4236052682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f401076f0 con 0x7f1f401069d0 2024-09-11T23:49:16.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.578+0000 7f1f463b6640 1 --2- 172.21.15.6:0/4236052682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 0x7f1f40106dd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009e80 tx=0x7f1f3002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e725c747270fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:16.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.578+0000 7f1f453b4640 1 -- 172.21.15.6:0/4236052682 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f30036070 con 0x7f1f401069d0 2024-09-11T23:49:16.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.578+0000 7f1f453b4640 1 -- 172.21.15.6:0/4236052682 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f30031400 con 0x7f1f401069d0 2024-09-11T23:49:16.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.578+0000 7f1f453b4640 1 -- 172.21.15.6:0/4236052682 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f30031700 con 0x7f1f401069d0 2024-09-11T23:49:16.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.578+0000 7f1f4861a640 1 -- 172.21.15.6:0/4236052682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 msgr2=0x7f1f40106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:16.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.578+0000 7f1f4861a640 1 --2- 172.21.15.6:0/4236052682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 0x7f1f40106dd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009e80 tx=0x7f1f3002a7a0 comp rx=0 tx=0).stop 2024-09-11T23:49:16.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.578+0000 7f1f4861a640 1 -- 172.21.15.6:0/4236052682 shutdown_connections 2024-09-11T23:49:16.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.578+0000 7f1f4861a640 1 --2- 172.21.15.6:0/4236052682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 0x7f1f40106dd0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:16.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.578+0000 7f1f4861a640 1 -- 172.21.15.6:0/4236052682 >> 172.21.15.6:0/4236052682 conn(0x7f1f40101420 msgr2=0x7f1f40103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:16.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.578+0000 7f1f4861a640 1 -- 172.21.15.6:0/4236052682 shutdown_connections 2024-09-11T23:49:16.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.578+0000 7f1f4861a640 1 -- 172.21.15.6:0/4236052682 wait complete. 2024-09-11T23:49:16.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.579+0000 7f1f4861a640 1 Processor -- start 2024-09-11T23:49:16.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.579+0000 7f1f4861a640 1 -- start start 2024-09-11T23:49:16.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.579+0000 7f1f4861a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 0x7f1f40105fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:16.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.579+0000 7f1f4861a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1f40107c30 con 0x7f1f401069d0 2024-09-11T23:49:16.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.579+0000 7f1f463b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 0x7f1f40105fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:16.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.579+0000 7f1f463b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 0x7f1f40105fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39880/0 (socket says 172.21.15.6:39880) 2024-09-11T23:49:16.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.579+0000 7f1f463b6640 1 -- 172.21.15.6:0/131233923 learned_addr learned my addr 172.21.15.6:0/131233923 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:16.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.580+0000 7f1f463b6640 1 -- 172.21.15.6:0/131233923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4019dac0 con 0x7f1f401069d0 2024-09-11T23:49:16.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.580+0000 7f1f463b6640 1 --2- 172.21.15.6:0/131233923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 0x7f1f40105fb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1f30034040 tx=0x7f1f30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:16.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.580+0000 7f1f3f7fe640 1 -- 172.21.15.6:0/131233923 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f30041070 con 0x7f1f401069d0 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.580+0000 7f1f3f7fe640 1 -- 172.21.15.6:0/131233923 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3003c650 con 0x7f1f401069d0 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.580+0000 7f1f4861a640 1 -- 172.21.15.6:0/131233923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f4019dc90 con 0x7f1f401069d0 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.580+0000 7f1f3f7fe640 1 -- 172.21.15.6:0/131233923 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f30036040 con 0x7f1f401069d0 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.580+0000 7f1f4861a640 1 -- 172.21.15.6:0/131233923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f4019e0b0 con 0x7f1f401069d0 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.580+0000 7f1f3f7fe640 1 -- 172.21.15.6:0/131233923 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f30044070 con 0x7f1f401069d0 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.580+0000 7f1f3f7fe640 1 -- 172.21.15.6:0/131233923 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1f30046c10 con 0x7f1f401069d0 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.581+0000 7f1f4861a640 1 -- 172.21.15.6:0/131233923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f401082f0 con 0x7f1f401069d0 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.583+0000 7f1f3f7fe640 1 -- 172.21.15.6:0/131233923 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1f3003c950 con 0x7f1f401069d0 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.643+0000 7f1f4861a640 1 -- 172.21.15.6:0/131233923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f1f4019f960 con 0x7f1f401069d0 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.646+0000 7f1f3f7fe640 1 -- 172.21.15.6:0/131233923 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+452 (secure 0 0 0) 0x7f1f3003cb30 con 0x7f1f401069d0 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.647+0000 7f1f3f7fe640 1 -- 172.21.15.6:0/131233923 <== mon.0 v2:172.21.15.6:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f1f30056070 con 0x7f1f401069d0 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.648+0000 7f1f4861a640 1 -- 172.21.15.6:0/131233923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 msgr2=0x7f1f40105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:16.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.648+0000 7f1f4861a640 1 --2- 172.21.15.6:0/131233923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 0x7f1f40105fb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1f30034040 tx=0x7f1f30004a40 comp rx=0 tx=0).stop 2024-09-11T23:49:16.214 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.648+0000 7f1f4861a640 1 -- 172.21.15.6:0/131233923 shutdown_connections 2024-09-11T23:49:16.214 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.648+0000 7f1f4861a640 1 --2- 172.21.15.6:0/131233923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f401069d0 0x7f1f40105fb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:16.214 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.648+0000 7f1f4861a640 1 -- 172.21.15.6:0/131233923 >> 172.21.15.6:0/131233923 conn(0x7f1f40101420 msgr2=0x7f1f4018df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:16.214 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.648+0000 7f1f4861a640 1 -- 172.21.15.6:0/131233923 shutdown_connections 2024-09-11T23:49:16.214 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:15.648+0000 7f1f4861a640 1 -- 172.21.15.6:0/131233923 wait complete. 2024-09-11T23:49:16.214 INFO:teuthology.orchestra.run.smithi006.stdout:Generating new minimal ceph.conf... 2024-09-11T23:49:16.309 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:16 smithi006 ceph-mon[30580]: from='client.? 172.21.15.6:0/131233923' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T23:49:16.309 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:16 smithi006 ceph-mon[30580]: from='client.? 172.21.15.6:0/131233923' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-11T23:49:17.239 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:17 smithi006 ceph-mon[30580]: from='client.? 172.21.15.6:0/1485733091' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:49:17.247 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.582+0000 7f23cb62b640 1 Processor -- start 2024-09-11T23:49:17.247 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.582+0000 7f23cb62b640 1 -- start start 2024-09-11T23:49:17.247 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.583+0000 7f23cb62b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 0x7f23c4106870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:17.247 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.583+0000 7f23cb62b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f23c4106e40 con 0x7f23c4106470 2024-09-11T23:49:17.247 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.583+0000 7f23c93c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 0x7f23c4106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:17.247 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.583+0000 7f23c93c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 0x7f23c4106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39890/0 (socket says 172.21.15.6:39890) 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.583+0000 7f23c93c7640 1 -- 172.21.15.6:0/327780097 learned_addr learned my addr 172.21.15.6:0/327780097 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.583+0000 7f23c93c7640 1 -- 172.21.15.6:0/327780097 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c4107670 con 0x7f23c4106470 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.584+0000 7f23c93c7640 1 --2- 172.21.15.6:0/327780097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 0x7f23c4106870 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009e80 tx=0x7f23b402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff9deda3b48030 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.584+0000 7f23c3fff640 1 -- 172.21.15.6:0/327780097 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b4036070 con 0x7f23c4106470 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.584+0000 7f23c3fff640 1 -- 172.21.15.6:0/327780097 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f23b4031890 con 0x7f23c4106470 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.584+0000 7f23c3fff640 1 -- 172.21.15.6:0/327780097 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b4007980 con 0x7f23c4106470 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.585+0000 7f23cb62b640 1 -- 172.21.15.6:0/327780097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 msgr2=0x7f23c4106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.585+0000 7f23cb62b640 1 --2- 172.21.15.6:0/327780097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 0x7f23c4106870 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009e80 tx=0x7f23b402a7a0 comp rx=0 tx=0).stop 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.585+0000 7f23cb62b640 1 -- 172.21.15.6:0/327780097 shutdown_connections 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.585+0000 7f23cb62b640 1 --2- 172.21.15.6:0/327780097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 0x7f23c4106870 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.585+0000 7f23cb62b640 1 -- 172.21.15.6:0/327780097 >> 172.21.15.6:0/327780097 conn(0x7f23c4101c40 msgr2=0x7f23c4104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.585+0000 7f23cb62b640 1 -- 172.21.15.6:0/327780097 shutdown_connections 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.585+0000 7f23cb62b640 1 -- 172.21.15.6:0/327780097 wait complete. 2024-09-11T23:49:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.585+0000 7f23cb62b640 1 Processor -- start 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.585+0000 7f23cb62b640 1 -- start start 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.585+0000 7f23cb62b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 0x7f23c4075620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.585+0000 7f23cb62b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f23c410aa20 con 0x7f23c4106470 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.586+0000 7f23c93c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 0x7f23c4075620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.586+0000 7f23c93c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 0x7f23c4075620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39900/0 (socket says 172.21.15.6:39900) 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.586+0000 7f23c93c7640 1 -- 172.21.15.6:0/1485733091 learned_addr learned my addr 172.21.15.6:0/1485733091 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.586+0000 7f23c93c7640 1 -- 172.21.15.6:0/1485733091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c419e360 con 0x7f23c4106470 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.586+0000 7f23c93c7640 1 --2- 172.21.15.6:0/1485733091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 0x7f23c4075620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f23b4007bb0 tx=0x7f23b4031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.586+0000 7f23c27fc640 1 -- 172.21.15.6:0/1485733091 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b4041020 con 0x7f23c4106470 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.586+0000 7f23c27fc640 1 -- 172.21.15.6:0/1485733091 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f23b403c900 con 0x7f23c4106470 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.586+0000 7f23cb62b640 1 -- 172.21.15.6:0/1485733091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c419e530 con 0x7f23c4106470 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.586+0000 7f23c27fc640 1 -- 172.21.15.6:0/1485733091 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b4036040 con 0x7f23c4106470 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.586+0000 7f23cb62b640 1 -- 172.21.15.6:0/1485733091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c419e950 con 0x7f23c4106470 2024-09-11T23:49:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.586+0000 7f23c27fc640 1 -- 172.21.15.6:0/1485733091 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f23b4044020 con 0x7f23c4106470 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.586+0000 7f23c27fc640 1 -- 172.21.15.6:0/1485733091 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f23b40468a0 con 0x7f23c4106470 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.587+0000 7f23cb62b640 1 -- 172.21.15.6:0/1485733091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c410aba0 con 0x7f23c4106470 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.589+0000 7f23c27fc640 1 -- 172.21.15.6:0/1485733091 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f23b404b020 con 0x7f23c4106470 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.649+0000 7f23cb62b640 1 -- 172.21.15.6:0/1485733091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f23c419eb50 con 0x7f23c4106470 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.649+0000 7f23c27fc640 1 -- 172.21.15.6:0/1485733091 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f23b4046400 con 0x7f23c4106470 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.650+0000 7f23cb62b640 1 -- 172.21.15.6:0/1485733091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 msgr2=0x7f23c4075620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.650+0000 7f23cb62b640 1 --2- 172.21.15.6:0/1485733091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 0x7f23c4075620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f23b4007bb0 tx=0x7f23b4031c70 comp rx=0 tx=0).stop 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.650+0000 7f23cb62b640 1 -- 172.21.15.6:0/1485733091 shutdown_connections 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.650+0000 7f23cb62b640 1 --2- 172.21.15.6:0/1485733091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4106470 0x7f23c4075620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.650+0000 7f23cb62b640 1 -- 172.21.15.6:0/1485733091 >> 172.21.15.6:0/1485733091 conn(0x7f23c4101c40 msgr2=0x7f23c41027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.650+0000 7f23cb62b640 1 -- 172.21.15.6:0/1485733091 shutdown_connections 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:16.650+0000 7f23cb62b640 1 -- 172.21.15.6:0/1485733091 wait complete. 2024-09-11T23:49:17.250 INFO:teuthology.orchestra.run.smithi006.stdout:Restarting the monitor... 2024-09-11T23:49:17.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:17 smithi006 systemd[1]: Stopping Ceph mon.a for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:49:17.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:17 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a[30576]: 2024-09-11T23:49:17.511+0000 7fc46c2ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:49:17.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:17 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a[30576]: 2024-09-11T23:49:17.511+0000 7fc46c2ce640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-11T23:49:17.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:17 smithi006 podman[30823]: 2024-09-11 23:49:17.603457124 +0000 UTC m=+0.191853715 container died 068fdf8faafaccb59b3aeebf63ff8a8e9db3ad8e84dd8c4ff226f023c9fa5f7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T23:49:18.419 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 podman[30823]: 2024-09-11 23:49:18.202560479 +0000 UTC m=+0.790957069 container cleanup 068fdf8faafaccb59b3aeebf63ff8a8e9db3ad8e84dd8c4ff226f023c9fa5f7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-11T23:49:18.419 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 bash[30823]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a 2024-09-11T23:49:18.761 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 podman[30835]: 2024-09-11 23:49:18.420474401 +0000 UTC m=+0.809745942 container remove 068fdf8faafaccb59b3aeebf63ff8a8e9db3ad8e84dd8c4ff226f023c9fa5f7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-11T23:49:18.762 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 systemd[1]: ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-11T23:49:18.762 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 systemd[1]: Stopped Ceph mon.a for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:49:18.762 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 systemd[1]: Starting Ceph mon.a for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:49:19.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 podman[30928]: 2024-09-11 23:49:18.762915092 +0000 UTC m=+0.112011927 container create 83d8db6a4319eed79704dd35066d2ac258d7f18be00d820bc74dd82fd2c16176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-11T23:49:19.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 podman[30928]: 2024-09-11 23:49:18.667055144 +0000 UTC m=+0.016151926 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:49:19.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 podman[30928]: 2024-09-11 23:49:18.956765707 +0000 UTC m=+0.305862477 container init 83d8db6a4319eed79704dd35066d2ac258d7f18be00d820bc74dd82fd2c16176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T23:49:19.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 podman[30928]: 2024-09-11 23:49:18.959946745 +0000 UTC m=+0.309043524 container start 83d8db6a4319eed79704dd35066d2ac258d7f18be00d820bc74dd82fd2c16176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T23:49:19.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T23:49:19.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T23:49:19.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: pidfile_write: ignore empty --pid-file 2024-09-11T23:49:19.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: load: jerasure load: lrc 2024-09-11T23:49:19.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: RocksDB version: 7.9.2 2024-09-11T23:49:19.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Git sha 0 2024-09-11T23:49:19.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T23:49:19.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: DB SUMMARY 2024-09-11T23:49:19.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: DB Session ID: KZ4LU7F15PAEB119UURW 2024-09-11T23:49:19.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: CURRENT file: CURRENT 2024-09-11T23:49:19.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T23:49:19.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-11T23:49:19.016 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-11T23:49:19.016 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105250 ; 2024-09-11T23:49:19.016 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.error_if_exists: 0 2024-09-11T23:49:19.017 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.create_if_missing: 0 2024-09-11T23:49:19.017 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.paranoid_checks: 1 2024-09-11T23:49:19.017 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T23:49:19.017 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T23:49:19.017 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T23:49:19.017 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.env: 0x55db8a367940 2024-09-11T23:49:19.017 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T23:49:19.017 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.info_log: 0x55db8acb96e0 2024-09-11T23:49:19.017 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T23:49:19.017 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.statistics: (nil) 2024-09-11T23:49:19.017 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.use_fsync: 0 2024-09-11T23:49:19.018 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_log_file_size: 0 2024-09-11T23:49:19.018 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T23:49:19.018 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T23:49:19.018 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T23:49:19.018 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T23:49:19.018 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.allow_fallocate: 1 2024-09-11T23:49:19.018 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T23:49:19.018 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T23:49:19.018 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.use_direct_reads: 0 2024-09-11T23:49:19.018 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T23:49:19.018 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T23:49:19.018 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.db_log_dir: 2024-09-11T23:49:19.019 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.wal_dir: 2024-09-11T23:49:19.019 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T23:49:19.019 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T23:49:19.019 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T23:49:19.019 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T23:49:19.019 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T23:49:19.019 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T23:49:19.019 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T23:49:19.019 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T23:49:19.019 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.write_buffer_manager: 0x55db8acc8dc0 2024-09-11T23:49:19.019 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T23:49:19.019 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T23:49:19.020 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T23:49:19.020 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T23:49:19.020 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T23:49:19.020 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T23:49:19.020 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T23:49:19.020 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T23:49:19.020 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.unordered_write: 0 2024-09-11T23:49:19.020 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T23:49:19.020 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T23:49:19.020 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T23:49:19.020 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T23:49:19.020 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.row_cache: None 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.wal_filter: None 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.two_write_queues: 0 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.wal_compression: 0 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.atomic_flush: 0 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.log_readahead_size: 0 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T23:49:19.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_background_jobs: 2 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_background_compactions: -1 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_subcompactions: 1 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T23:49:19.022 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_open_files: -1 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_background_flushes: -1 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Compression algorithms supported: 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: kZSTD supported: 0 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: kXpressCompression supported: 0 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: kBZip2Compression supported: 0 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: kLZ4Compression supported: 1 2024-09-11T23:49:19.023 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: kZlibCompression supported: 1 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: kSnappyCompression supported: 1 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.merge_operator: 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_filter: None 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T23:49:19.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55db8acb9320) 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: cache_index_and_filter_blocks: 1 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: pin_top_level_index_and_filter: 1 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_type: 0 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: data_block_index_type: 0 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_shortening: 1 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: checksum: 4 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: no_block_cache: 0 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache: 0x55db8acad1f0 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_name: BinnedLRUCache 2024-09-11T23:49:19.025 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_options: 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: capacity : 536870912 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: num_shard_bits : 4 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: strict_capacity_limit : 0 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: high_pri_pool_ratio: 0.000 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_compressed: (nil) 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: persistent_cache: (nil) 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_size: 4096 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_size_deviation: 10 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_restart_interval: 16 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_block_restart_interval: 1 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: metadata_block_size: 4096 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: partition_filters: 0 2024-09-11T23:49:19.026 INFO:journalctl@ceph.mon.a.smithi006.stdout: use_delta_encoding: 1 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout: filter_policy: bloomfilter 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout: whole_key_filtering: 1 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout: verify_compression: 0 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout: read_amp_bytes_per_bit: 0 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout: format_version: 5 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout: enable_index_compression: 1 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_align: 0 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout: max_auto_readahead_size: 262144 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout: prepopulate_block_cache: 0 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout: initial_auto_readahead_size: 8192 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T23:49:19.027 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compression: NoCompression 2024-09-11T23:49:19.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T23:49:19.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T23:49:19.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T23:49:19.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.num_levels: 7 2024-09-11T23:49:19.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T23:49:19.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T23:49:19.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T23:49:19.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T23:49:19.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T23:49:19.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T23:49:19.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T23:49:19.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:49:19.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T23:49:19.030 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T23:49:19.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T23:49:19.032 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T23:49:19.032 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T23:49:19.032 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T23:49:19.032 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T23:49:19.032 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T23:49:19.032 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.inplace_update_support: 0 2024-09-11T23:49:19.032 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T23:49:19.032 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T23:49:19.032 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T23:49:19.033 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T23:49:19.033 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.bloom_locality: 0 2024-09-11T23:49:19.033 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.max_successive_merges: 0 2024-09-11T23:49:19.033 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T23:49:19.033 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T23:49:19.033 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.ttl: 2592000 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.enable_blob_files: false 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.min_blob_size: 0 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T23:49:19.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: faf217f0-13cc-4c51-b3f0-a92abb4049d1 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098558988175, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098558989186, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100338, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98222, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14302, "raw_average_key_size": 49, "raw_value_size": 90463, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726098558, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "faf217f0-13cc-4c51-b3f0-a92abb4049d1", "db_session_id": "KZ4LU7F15PAEB119UURW", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098558989286, "job": 1, "event": "recovery_finished"} 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55db8acdae00 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: DB pointer 0x55db8add6000 2024-09-11T23:49:19.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** DB Stats ** 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** Compaction Stats [default] ** 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T23:49:19.036 INFO:journalctl@ceph.mon.a.smithi006.stdout: L0 2/0 99.85 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: Sum 2/0 99.85 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** Compaction Stats [default] ** 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 160.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T23:49:19.037 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative compaction: 0.00 GB write, 29.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval compaction: 0.00 GB write, 29.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout: Block cache BinnedLRUCache@0x55db8acad1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: starting mon.a rank 0 at public addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] at bind addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: mon.a@-1(???) e1 preinit fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:19.038 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: mon.a@-1(???).mds e1 new map 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: mon.a@-1(???).mds e1 print_map 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout: e1 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout: btime 2024-09-11T23:49:14:063630+0000 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout: legacy client fscid: -1 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout: No filesystems configured 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:18 smithi006 ceph-mon[30947]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-11T23:49:19.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 bash[30928]: 83d8db6a4319eed79704dd35066d2ac258d7f18be00d820bc74dd82fd2c16176 2024-09-11T23:49:19.040 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 systemd[1]: Started Ceph mon.a for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:49:19.040 INFO:teuthology.orchestra.run.smithi006.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-11T23:49:19.333 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 ceph-mon[30947]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T23:49:19.333 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 ceph-mon[30947]: monmap epoch 1 2024-09-11T23:49:19.333 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 ceph-mon[30947]: fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:19.333 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 ceph-mon[30947]: last_changed 2024-09-11T23:49:09.715349+0000 2024-09-11T23:49:19.334 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 ceph-mon[30947]: created 2024-09-11T23:49:09.715349+0000 2024-09-11T23:49:19.334 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 ceph-mon[30947]: min_mon_release 19 (squid) 2024-09-11T23:49:19.334 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 ceph-mon[30947]: election_strategy: 1 2024-09-11T23:49:19.334 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 ceph-mon[30947]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-11T23:49:19.334 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 ceph-mon[30947]: fsmap 2024-09-11T23:49:19.334 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 ceph-mon[30947]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T23:49:19.334 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:19 smithi006 ceph-mon[30947]: mgrmap e1: no daemons active 2024-09-11T23:49:20.027 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.417+0000 7f2d28d90640 1 Processor -- start 2024-09-11T23:49:20.027 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.418+0000 7f2d28d90640 1 -- start start 2024-09-11T23:49:20.027 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.418+0000 7f2d28d90640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 0x7f2d241079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:20.027 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.418+0000 7f2d28d90640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2d24107f90 con 0x7f2d241075c0 2024-09-11T23:49:20.027 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.418+0000 7f2d2259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 0x7f2d241079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:20.027 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.418+0000 7f2d2259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 0x7f2d241079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39916/0 (socket says 172.21.15.6:39916) 2024-09-11T23:49:20.027 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.418+0000 7f2d2259c640 1 -- 172.21.15.6:0/1942159143 learned_addr learned my addr 172.21.15.6:0/1942159143 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:20.027 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.418+0000 7f2d2259c640 1 -- 172.21.15.6:0/1942159143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d241087c0 con 0x7f2d241075c0 2024-09-11T23:49:20.027 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.420+0000 7f2d2259c640 1 --2- 172.21.15.6:0/1942159143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 0x7f2d241079c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009820 tx=0x7f2d1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8509379e2f70c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:20.028 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.420+0000 7f2d21d9b640 1 -- 172.21.15.6:0/1942159143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d14037070 con 0x7f2d241075c0 2024-09-11T23:49:20.028 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.420+0000 7f2d21d9b640 1 -- 172.21.15.6:0/1942159143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2d140328d0 con 0x7f2d241075c0 2024-09-11T23:49:20.028 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.420+0000 7f2d21d9b640 1 -- 172.21.15.6:0/1942159143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d140307d0 con 0x7f2d241075c0 2024-09-11T23:49:20.028 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.421+0000 7f2d28d90640 1 -- 172.21.15.6:0/1942159143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 msgr2=0x7f2d241079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:20.028 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.421+0000 7f2d28d90640 1 --2- 172.21.15.6:0/1942159143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 0x7f2d241079c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009820 tx=0x7f2d1402a270 comp rx=0 tx=0).stop 2024-09-11T23:49:20.028 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.421+0000 7f2d28d90640 1 -- 172.21.15.6:0/1942159143 shutdown_connections 2024-09-11T23:49:20.028 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.421+0000 7f2d28d90640 1 --2- 172.21.15.6:0/1942159143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 0x7f2d241079c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:20.028 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.421+0000 7f2d28d90640 1 -- 172.21.15.6:0/1942159143 >> 172.21.15.6:0/1942159143 conn(0x7f2d24102dd0 msgr2=0x7f2d241051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:20.028 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.421+0000 7f2d28d90640 1 -- 172.21.15.6:0/1942159143 shutdown_connections 2024-09-11T23:49:20.029 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.421+0000 7f2d28d90640 1 -- 172.21.15.6:0/1942159143 wait complete. 2024-09-11T23:49:20.029 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.422+0000 7f2d28d90640 1 Processor -- start 2024-09-11T23:49:20.029 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.422+0000 7f2d28d90640 1 -- start start 2024-09-11T23:49:20.029 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.422+0000 7f2d28d90640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 0x7f2d2419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:20.029 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.422+0000 7f2d28d90640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2410bb70 con 0x7f2d241075c0 2024-09-11T23:49:20.029 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.422+0000 7f2d2259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 0x7f2d2419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:20.029 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.422+0000 7f2d2259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 0x7f2d2419b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39930/0 (socket says 172.21.15.6:39930) 2024-09-11T23:49:20.029 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.422+0000 7f2d2259c640 1 -- 172.21.15.6:0/3198320343 learned_addr learned my addr 172.21.15.6:0/3198320343 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:20.030 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.422+0000 7f2d2259c640 1 -- 172.21.15.6:0/3198320343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2419bac0 con 0x7f2d241075c0 2024-09-11T23:49:20.030 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.422+0000 7f2d2259c640 1 --2- 172.21.15.6:0/3198320343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 0x7f2d2419b580 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2d140097f0 tx=0x7f2d14030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:20.030 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.423+0000 7f2d1b7fe640 1 -- 172.21.15.6:0/3198320343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d14037040 con 0x7f2d241075c0 2024-09-11T23:49:20.030 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.423+0000 7f2d1b7fe640 1 -- 172.21.15.6:0/3198320343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2d14032bb0 con 0x7f2d241075c0 2024-09-11T23:49:20.030 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.423+0000 7f2d28d90640 1 -- 172.21.15.6:0/3198320343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2419bd50 con 0x7f2d241075c0 2024-09-11T23:49:20.030 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.423+0000 7f2d1b7fe640 1 -- 172.21.15.6:0/3198320343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d1403a390 con 0x7f2d241075c0 2024-09-11T23:49:20.030 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.423+0000 7f2d28d90640 1 -- 172.21.15.6:0/3198320343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d2419ea40 con 0x7f2d241075c0 2024-09-11T23:49:20.030 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.423+0000 7f2d1b7fe640 1 -- 172.21.15.6:0/3198320343 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2d1403a580 con 0x7f2d241075c0 2024-09-11T23:49:20.031 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.423+0000 7f2d1b7fe640 1 -- 172.21.15.6:0/3198320343 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2d14044b50 con 0x7f2d241075c0 2024-09-11T23:49:20.031 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.424+0000 7f2d28d90640 1 -- 172.21.15.6:0/3198320343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d2410bcf0 con 0x7f2d241075c0 2024-09-11T23:49:20.031 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.426+0000 7f2d1b7fe640 1 -- 172.21.15.6:0/3198320343 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2d14032d60 con 0x7f2d241075c0 2024-09-11T23:49:20.031 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.486+0000 7f2d28d90640 1 -- 172.21.15.6:0/3198320343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f2d24107a40 con 0x7f2d241075c0 2024-09-11T23:49:20.031 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.490+0000 7f2d1b7fe640 1 -- 172.21.15.6:0/3198320343 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f2d14044d50 con 0x7f2d241075c0 2024-09-11T23:49:20.031 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.491+0000 7f2d28d90640 1 -- 172.21.15.6:0/3198320343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 msgr2=0x7f2d2419b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:20.031 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.491+0000 7f2d28d90640 1 --2- 172.21.15.6:0/3198320343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 0x7f2d2419b580 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2d140097f0 tx=0x7f2d14030d00 comp rx=0 tx=0).stop 2024-09-11T23:49:20.031 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.491+0000 7f2d28d90640 1 -- 172.21.15.6:0/3198320343 shutdown_connections 2024-09-11T23:49:20.032 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.491+0000 7f2d28d90640 1 --2- 172.21.15.6:0/3198320343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d241075c0 0x7f2d2419b580 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:20.032 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.491+0000 7f2d28d90640 1 -- 172.21.15.6:0/3198320343 >> 172.21.15.6:0/3198320343 conn(0x7f2d24102dd0 msgr2=0x7f2d241038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:20.032 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.491+0000 7f2d28d90640 1 -- 172.21.15.6:0/3198320343 shutdown_connections 2024-09-11T23:49:20.032 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:19.491+0000 7f2d28d90640 1 -- 172.21.15.6:0/3198320343 wait complete. 2024-09-11T23:49:20.032 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-11T23:49:20.045 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:49:20.045 INFO:teuthology.orchestra.run.smithi006.stdout:Creating mgr... 2024-09-11T23:49:20.045 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-11T23:49:20.046 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-11T23:49:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.x 2024-09-11T23:49:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-11T23:49:20.485 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4901345a-7098-11ef-bcea-c7b262605968.target.wants/ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-4901345a-7098-11ef-bcea-c7b262605968@.service. 2024-09-11T23:49:20.815 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:20 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3198320343' entity='client.admin' 2024-09-11T23:49:21.015 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:49:21.015 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2024-09-11T23:49:21.022 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:49:21.022 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-09-11T23:49:21.022 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2024-09-11T23:49:21.023 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T23:49:21.031 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:49:21.031 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2024-09-11T23:49:21.040 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:49:21.040 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-09-11T23:49:21.040 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2024-09-11T23:49:21.040 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-11T23:49:21.040 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr to start... 2024-09-11T23:49:21.040 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr... 2024-09-11T23:49:21.116 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:21 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:21.055+0000 7f26856a3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:49:21.116 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:21 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:21.116+0000 7f26856a3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:49:21.368 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:21 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:21.275+0000 7f26856a3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:49:21.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:21 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:21.345+0000 7f26856a3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:49:21.654 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:21 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3977934349' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T23:49:21.654 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:21 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:21.503+0000 7f26856a3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:49:21.654 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:21 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:21.654+0000 7f26856a3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:49:22.246 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:21 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:21.988+0000 7f26856a3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:49:22.246 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:22 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:22.052+0000 7f26856a3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:49:22.251 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:22.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:49:22.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:49:22.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T23:49:22.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T23:49:22.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T23:49:22.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T23:49:22.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:22.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T23:49:22.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:49:22.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T23:49:22.256 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T23:49:22.256 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T23:49:22.263 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T23:49:22.263 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:22.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T23:49:14:063630+0000", 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T23:49:22.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T23:49:14.064461+0000", 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.485+0000 7f77c9eb5640 1 Processor -- start 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.485+0000 7f77c9eb5640 1 -- start start 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.485+0000 7f77c9eb5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 0x7f77c410a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:22.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.485+0000 7f77c9eb5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f77c40759a0 con 0x7f77c41080c0 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.486+0000 7f77c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 0x7f77c410a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.486+0000 7f77c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 0x7f77c410a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51936/0 (socket says 172.21.15.6:51936) 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.486+0000 7f77c37fe640 1 -- 172.21.15.6:0/1470089389 learned_addr learned my addr 172.21.15.6:0/1470089389 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.486+0000 7f77c37fe640 1 -- 172.21.15.6:0/1470089389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c410a9f0 con 0x7f77c41080c0 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.486+0000 7f77c37fe640 1 --2- 172.21.15.6:0/1470089389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 0x7f77c410a4b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009820 tx=0x7f77b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69d056b832d5243 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.487+0000 7f77c27fc640 1 -- 172.21.15.6:0/1470089389 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4037070 con 0x7f77c41080c0 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.487+0000 7f77c27fc640 1 -- 172.21.15.6:0/1470089389 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f77b40328d0 con 0x7f77c41080c0 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.487+0000 7f77c27fc640 1 -- 172.21.15.6:0/1470089389 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b40307d0 con 0x7f77c41080c0 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.487+0000 7f77c9eb5640 1 -- 172.21.15.6:0/1470089389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 msgr2=0x7f77c410a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.487+0000 7f77c9eb5640 1 --2- 172.21.15.6:0/1470089389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 0x7f77c410a4b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009820 tx=0x7f77b402a270 comp rx=0 tx=0).stop 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.487+0000 7f77c9eb5640 1 -- 172.21.15.6:0/1470089389 shutdown_connections 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.487+0000 7f77c9eb5640 1 --2- 172.21.15.6:0/1470089389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 0x7f77c410a4b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:22.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.487+0000 7f77c9eb5640 1 -- 172.21.15.6:0/1470089389 >> 172.21.15.6:0/1470089389 conn(0x7f77c4101c40 msgr2=0x7f77c4104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:22.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.488+0000 7f77c9eb5640 1 -- 172.21.15.6:0/1470089389 shutdown_connections 2024-09-11T23:49:22.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.488+0000 7f77c9eb5640 1 -- 172.21.15.6:0/1470089389 wait complete. 2024-09-11T23:49:22.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.488+0000 7f77c9eb5640 1 Processor -- start 2024-09-11T23:49:22.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.489+0000 7f77c9eb5640 1 -- start start 2024-09-11T23:49:22.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.489+0000 7f77c9eb5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 0x7f77c419d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:22.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.489+0000 7f77c9eb5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f77c410b910 con 0x7f77c41080c0 2024-09-11T23:49:22.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.489+0000 7f77c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 0x7f77c419d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:22.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.489+0000 7f77c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 0x7f77c419d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51940/0 (socket says 172.21.15.6:51940) 2024-09-11T23:49:22.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.489+0000 7f77c37fe640 1 -- 172.21.15.6:0/3977934349 learned_addr learned my addr 172.21.15.6:0/3977934349 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:22.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.489+0000 7f77c37fe640 1 -- 172.21.15.6:0/3977934349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c419dd00 con 0x7f77c41080c0 2024-09-11T23:49:22.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.489+0000 7f77c37fe640 1 --2- 172.21.15.6:0/3977934349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 0x7f77c419d7c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f77b4030520 tx=0x7f77b4032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:22.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.489+0000 7f77c0ff9640 1 -- 172.21.15.6:0/3977934349 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4042070 con 0x7f77c41080c0 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.489+0000 7f77c0ff9640 1 -- 172.21.15.6:0/3977934349 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f77b4030cc0 con 0x7f77c41080c0 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.489+0000 7f77c9eb5640 1 -- 172.21.15.6:0/3977934349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c419df90 con 0x7f77c41080c0 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.489+0000 7f77c0ff9640 1 -- 172.21.15.6:0/3977934349 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4037040 con 0x7f77c41080c0 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.490+0000 7f77c9eb5640 1 -- 172.21.15.6:0/3977934349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c41a0c80 con 0x7f77c41080c0 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.490+0000 7f77c0ff9640 1 -- 172.21.15.6:0/3977934349 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f77b4045070 con 0x7f77c41080c0 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.490+0000 7f77c0ff9640 1 -- 172.21.15.6:0/3977934349 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f77b4047990 con 0x7f77c41080c0 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.490+0000 7f77c9eb5640 1 -- 172.21.15.6:0/3977934349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c4108520 con 0x7f77c41080c0 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.493+0000 7f77c0ff9640 1 -- 172.21.15.6:0/3977934349 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f77b403d430 con 0x7f77c41080c0 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.556+0000 7f77c9eb5640 1 -- 172.21.15.6:0/3977934349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f77c41a1200 con 0x7f77c41080c0 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.556+0000 7f77c0ff9640 1 -- 172.21.15.6:0/3977934349 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f77b403d610 con 0x7f77c41080c0 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.557+0000 7f77c9eb5640 1 -- 172.21.15.6:0/3977934349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 msgr2=0x7f77c419d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.557+0000 7f77c9eb5640 1 --2- 172.21.15.6:0/3977934349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 0x7f77c419d7c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f77b4030520 tx=0x7f77b4032dd0 comp rx=0 tx=0).stop 2024-09-11T23:49:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.557+0000 7f77c9eb5640 1 -- 172.21.15.6:0/3977934349 shutdown_connections 2024-09-11T23:49:22.270 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.557+0000 7f77c9eb5640 1 --2- 172.21.15.6:0/3977934349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c41080c0 0x7f77c419d7c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:22.270 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.557+0000 7f77c9eb5640 1 -- 172.21.15.6:0/3977934349 >> 172.21.15.6:0/3977934349 conn(0x7f77c4101c40 msgr2=0x7f77c41027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:22.270 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.557+0000 7f77c9eb5640 1 -- 172.21.15.6:0/3977934349 shutdown_connections 2024-09-11T23:49:22.270 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:21.557+0000 7f77c9eb5640 1 -- 172.21.15.6:0/3977934349 wait complete. 2024-09-11T23:49:22.270 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (1/15)... 2024-09-11T23:49:22.618 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:22 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:22.247+0000 7f26856a3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:49:23.368 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:23 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:23.183+0000 7f26856a3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:49:23.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:23 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:23.253+0000 7f26856a3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:49:24.306 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:24 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:24.029+0000 7f26856a3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:49:24.306 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:24 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:24.152+0000 7f26856a3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:49:24.604 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:24 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:24.306+0000 7f26856a3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:49:24.604 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:24 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:24.371+0000 7f26856a3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:49:24.604 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:24 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:24.533+0000 7f26856a3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:49:24.604 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:24 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:24.605+0000 7f26856a3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:49:24.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:24 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/218485847' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T23:49:24.869 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:24 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:24.670+0000 7f26856a3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:49:24.869 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:24 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:24.844+0000 7f26856a3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:49:25.195 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:24 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:24.914+0000 7f26856a3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:49:25.195 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:24 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:24.984+0000 7f26856a3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:49:25.196 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:25 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:25.071+0000 7f26856a3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:49:25.196 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:25 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:25.134+0000 7f26856a3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:49:25.196 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:25 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:25.196+0000 7f26856a3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:49:25.461 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:25.461 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:49:25.461 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-11T23:49:25.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T23:49:25.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:49:25.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T23:49:25.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T23:49:25.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:25.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T23:49:25.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:49:25.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T23:49:25.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T23:49:25.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T23:49:25.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T23:49:25.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T23:49:25.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T23:49:25.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:25.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T23:49:25.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T23:49:25.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T23:49:25.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T23:49:25.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T23:49:25.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T23:49:25.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T23:49:25.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T23:49:14:063630+0000", 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T23:49:25.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T23:49:14.064461+0000", 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.720+0000 7f0878e9b640 1 Processor -- start 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.720+0000 7f0878e9b640 1 -- start start 2024-09-11T23:49:25.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.721+0000 7f0878e9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 0x7f087410a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.721+0000 7f0878e9b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0874075a80 con 0x7f0874107fe0 2024-09-11T23:49:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.721+0000 7f087259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 0x7f087410a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.721+0000 7f087259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 0x7f087410a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51942/0 (socket says 172.21.15.6:51942) 2024-09-11T23:49:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.721+0000 7f087259c640 1 -- 172.21.15.6:0/1190434056 learned_addr learned my addr 172.21.15.6:0/1190434056 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.721+0000 7f087259c640 1 -- 172.21.15.6:0/1190434056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087410a910 con 0x7f0874107fe0 2024-09-11T23:49:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.722+0000 7f087259c640 1 --2- 172.21.15.6:0/1190434056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 0x7f087410a3d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f086c009e80 tx=0x7f086c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcdeb5228f40b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.722+0000 7f087159a640 1 -- 172.21.15.6:0/1190434056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c036070 con 0x7f0874107fe0 2024-09-11T23:49:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.722+0000 7f087159a640 1 -- 172.21.15.6:0/1190434056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f086c031890 con 0x7f0874107fe0 2024-09-11T23:49:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.722+0000 7f087159a640 1 -- 172.21.15.6:0/1190434056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c007980 con 0x7f0874107fe0 2024-09-11T23:49:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.723+0000 7f0878e9b640 1 -- 172.21.15.6:0/1190434056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 msgr2=0x7f087410a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.723+0000 7f0878e9b640 1 --2- 172.21.15.6:0/1190434056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 0x7f087410a3d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f086c009e80 tx=0x7f086c02a7a0 comp rx=0 tx=0).stop 2024-09-11T23:49:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.723+0000 7f0878e9b640 1 -- 172.21.15.6:0/1190434056 shutdown_connections 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.723+0000 7f0878e9b640 1 --2- 172.21.15.6:0/1190434056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 0x7f087410a3d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.723+0000 7f0878e9b640 1 -- 172.21.15.6:0/1190434056 >> 172.21.15.6:0/1190434056 conn(0x7f0874101c40 msgr2=0x7f0874104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.723+0000 7f0878e9b640 1 -- 172.21.15.6:0/1190434056 shutdown_connections 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.723+0000 7f0878e9b640 1 -- 172.21.15.6:0/1190434056 wait complete. 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.724+0000 7f0878e9b640 1 Processor -- start 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.724+0000 7f0878e9b640 1 -- start start 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.724+0000 7f0878e9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 0x7f0874107860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.724+0000 7f0878e9b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f087410b950 con 0x7f0874107fe0 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.724+0000 7f087259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 0x7f0874107860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.724+0000 7f087259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 0x7f0874107860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51946/0 (socket says 172.21.15.6:51946) 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.724+0000 7f087259c640 1 -- 172.21.15.6:0/218485847 learned_addr learned my addr 172.21.15.6:0/218485847 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.724+0000 7f087259c640 1 -- 172.21.15.6:0/218485847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0874107da0 con 0x7f0874107fe0 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.725+0000 7f087259c640 1 --2- 172.21.15.6:0/218485847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 0x7f0874107860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f086c009680 tx=0x7f086c031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:25.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.725+0000 7f086b7fe640 1 -- 172.21.15.6:0/218485847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c041020 con 0x7f0874107fe0 2024-09-11T23:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.725+0000 7f0878e9b640 1 -- 172.21.15.6:0/218485847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0874105f90 con 0x7f0874107fe0 2024-09-11T23:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.725+0000 7f086b7fe640 1 -- 172.21.15.6:0/218485847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f086c03c900 con 0x7f0874107fe0 2024-09-11T23:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.725+0000 7f086b7fe640 1 -- 172.21.15.6:0/218485847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c036040 con 0x7f0874107fe0 2024-09-11T23:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.725+0000 7f0878e9b640 1 -- 172.21.15.6:0/218485847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08741064d0 con 0x7f0874107fe0 2024-09-11T23:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.726+0000 7f086b7fe640 1 -- 172.21.15.6:0/218485847 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f086c044020 con 0x7f0874107fe0 2024-09-11T23:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.726+0000 7f086b7fe640 1 -- 172.21.15.6:0/218485847 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f086c046930 con 0x7f0874107fe0 2024-09-11T23:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.726+0000 7f0878e9b640 1 -- 172.21.15.6:0/218485847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0874108440 con 0x7f0874107fe0 2024-09-11T23:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.730+0000 7f086b7fe640 1 -- 172.21.15.6:0/218485847 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f086c04b020 con 0x7f0874107fe0 2024-09-11T23:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.793+0000 7f0878e9b640 1 -- 172.21.15.6:0/218485847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0874106810 con 0x7f0874107fe0 2024-09-11T23:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.794+0000 7f086b7fe640 1 -- 172.21.15.6:0/218485847 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f086c031830 con 0x7f0874107fe0 2024-09-11T23:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.795+0000 7f0878e9b640 1 -- 172.21.15.6:0/218485847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 msgr2=0x7f0874107860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.795+0000 7f0878e9b640 1 --2- 172.21.15.6:0/218485847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 0x7f0874107860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f086c009680 tx=0x7f086c031c70 comp rx=0 tx=0).stop 2024-09-11T23:49:25.477 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.795+0000 7f0878e9b640 1 -- 172.21.15.6:0/218485847 shutdown_connections 2024-09-11T23:49:25.477 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.795+0000 7f0878e9b640 1 --2- 172.21.15.6:0/218485847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0874107fe0 0x7f0874107860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:25.477 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.795+0000 7f0878e9b640 1 -- 172.21.15.6:0/218485847 >> 172.21.15.6:0/218485847 conn(0x7f0874101c40 msgr2=0x7f0874102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:25.477 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.795+0000 7f0878e9b640 1 -- 172.21.15.6:0/218485847 shutdown_connections 2024-09-11T23:49:25.477 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:24.795+0000 7f0878e9b640 1 -- 172.21.15.6:0/218485847 wait complete. 2024-09-11T23:49:25.477 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (2/15)... 2024-09-11T23:49:26.368 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:26.037+0000 7f26856a3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:49:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: Activating manager daemon x 2024-09-11T23:49:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: mgrmap e2: x(active, starting, since 0.00299235s) 2024-09-11T23:49:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: from='mgr.14100 172.21.15.6:0/84879853' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:49:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: from='mgr.14100 172.21.15.6:0/84879853' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:49:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: from='mgr.14100 172.21.15.6:0/84879853' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:49:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: from='mgr.14100 172.21.15.6:0/84879853' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:49:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: from='mgr.14100 172.21.15.6:0/84879853' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:49:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: Manager daemon x is now available 2024-09-11T23:49:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: from='mgr.14100 172.21.15.6:0/84879853' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:49:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: from='mgr.14100 172.21.15.6:0/84879853' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:49:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: from='mgr.14100 172.21.15.6:0/84879853' entity='mgr.x' 2024-09-11T23:49:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: from='mgr.14100 172.21.15.6:0/84879853' entity='mgr.x' 2024-09-11T23:49:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:26 smithi006 ceph-mon[30947]: from='mgr.14100 172.21.15.6:0/84879853' entity='mgr.x' 2024-09-11T23:49:28.112 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:28 smithi006 ceph-mon[30947]: mgrmap e3: x(active, since 1.00713s) 2024-09-11T23:49:28.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:28.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:49:28.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:49:28.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T23:49:28.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T23:49:28.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T23:49:28.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T23:49:28.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:28.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T23:49:28.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T23:49:28.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2024-09-11T23:49:28.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:49:28.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T23:49:28.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T23:49:28.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T23:49:28.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T23:49:28.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T23:49:28.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:28.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T23:49:28.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T23:49:28.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T23:49:28.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T23:49:28.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T23:49:28.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T23:49:14:063630+0000", 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T23:49:28.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T23:49:14.064461+0000", 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:49:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.856+0000 7fa788cd0640 1 Processor -- start 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.856+0000 7fa788cd0640 1 -- start start 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.857+0000 7fa788cd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 0x7fa784105c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.857+0000 7fa788cd0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa784106260 con 0x7fa784105890 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.857+0000 7fa78259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 0x7fa784105c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.857+0000 7fa78259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 0x7fa784105c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51998/0 (socket says 172.21.15.6:51998) 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.857+0000 7fa78259c640 1 -- 172.21.15.6:0/1113313879 learned_addr learned my addr 172.21.15.6:0/1113313879 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.857+0000 7fa78259c640 1 -- 172.21.15.6:0/1113313879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa784108870 con 0x7fa784105890 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.858+0000 7fa78259c640 1 --2- 172.21.15.6:0/1113313879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 0x7fa784105c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa774009820 tx=0x7fa77402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9ad13987d4bd64 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.858+0000 7fa78159a640 1 -- 172.21.15.6:0/1113313879 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa774037070 con 0x7fa784105890 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.858+0000 7fa78159a640 1 -- 172.21.15.6:0/1113313879 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa7740328d0 con 0x7fa784105890 2024-09-11T23:49:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.858+0000 7fa78159a640 1 -- 172.21.15.6:0/1113313879 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7740307d0 con 0x7fa784105890 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.859+0000 7fa788cd0640 1 -- 172.21.15.6:0/1113313879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 msgr2=0x7fa784105c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.859+0000 7fa788cd0640 1 --2- 172.21.15.6:0/1113313879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 0x7fa784105c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa774009820 tx=0x7fa77402a270 comp rx=0 tx=0).stop 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.859+0000 7fa788cd0640 1 -- 172.21.15.6:0/1113313879 shutdown_connections 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.859+0000 7fa788cd0640 1 --2- 172.21.15.6:0/1113313879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 0x7fa784105c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.859+0000 7fa788cd0640 1 -- 172.21.15.6:0/1113313879 >> 172.21.15.6:0/1113313879 conn(0x7fa784101440 msgr2=0x7fa784103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.859+0000 7fa788cd0640 1 -- 172.21.15.6:0/1113313879 shutdown_connections 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.859+0000 7fa788cd0640 1 -- 172.21.15.6:0/1113313879 wait complete. 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.860+0000 7fa788cd0640 1 Processor -- start 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.860+0000 7fa788cd0640 1 -- start start 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.860+0000 7fa788cd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 0x7fa7841080f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.860+0000 7fa788cd0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa78410baa0 con 0x7fa784105890 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.861+0000 7fa78259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 0x7fa7841080f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.861+0000 7fa78259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 0x7fa7841080f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52010/0 (socket says 172.21.15.6:52010) 2024-09-11T23:49:28.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.861+0000 7fa78259c640 1 -- 172.21.15.6:0/3725425853 learned_addr learned my addr 172.21.15.6:0/3725425853 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:28.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.861+0000 7fa78259c640 1 -- 172.21.15.6:0/3725425853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa784108630 con 0x7fa784105890 2024-09-11T23:49:28.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.861+0000 7fa78259c640 1 --2- 172.21.15.6:0/3725425853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 0x7fa7841080f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa774030520 tx=0x7fa774032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:28.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.861+0000 7fa7737fe640 1 -- 172.21.15.6:0/3725425853 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa774042070 con 0x7fa784105890 2024-09-11T23:49:28.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.861+0000 7fa7737fe640 1 -- 172.21.15.6:0/3725425853 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa774030cc0 con 0x7fa784105890 2024-09-11T23:49:28.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.861+0000 7fa788cd0640 1 -- 172.21.15.6:0/3725425853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa784106820 con 0x7fa784105890 2024-09-11T23:49:28.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.861+0000 7fa7737fe640 1 -- 172.21.15.6:0/3725425853 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa774037040 con 0x7fa784105890 2024-09-11T23:49:28.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.861+0000 7fa788cd0640 1 -- 172.21.15.6:0/3725425853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa784106d60 con 0x7fa784105890 2024-09-11T23:49:28.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.862+0000 7fa7737fe640 1 -- 172.21.15.6:0/3725425853 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7fa774045070 con 0x7fa784105890 2024-09-11T23:49:28.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.862+0000 7fa7737fe640 1 --2- 172.21.15.6:0/3725425853 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fa76c038e60 0x7fa76c03b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:28.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.862+0000 7fa788cd0640 1 -- 172.21.15.6:0/3725425853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa784105d10 con 0x7fa784105890 2024-09-11T23:49:28.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.862+0000 7fa7737fe640 1 -- 172.21.15.6:0/3725425853 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa77406bd20 con 0x7fa784105890 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.863+0000 7fa781d9b640 1 --2- 172.21.15.6:0/3725425853 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fa76c038e60 0x7fa76c03b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.863+0000 7fa781d9b640 1 --2- 172.21.15.6:0/3725425853 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fa76c038e60 0x7fa76c03b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa7780098c0 tx=0x7fa778006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:27.868+0000 7fa7737fe640 1 -- 172.21.15.6:0/3725425853 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa774045360 con 0x7fa784105890 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.046+0000 7fa7737fe640 1 -- 172.21.15.6:0/3725425853 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fa77403cac0 con 0x7fa784105890 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.113+0000 7fa788cd0640 1 -- 172.21.15.6:0/3725425853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa784107520 con 0x7fa784105890 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.113+0000 7fa7737fe640 1 -- 172.21.15.6:0/3725425853 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fa77402f2a0 con 0x7fa784105890 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.116+0000 7fa788cd0640 1 -- 172.21.15.6:0/3725425853 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fa76c038e60 msgr2=0x7fa76c03b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.116+0000 7fa788cd0640 1 --2- 172.21.15.6:0/3725425853 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fa76c038e60 0x7fa76c03b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa7780098c0 tx=0x7fa778006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.116+0000 7fa788cd0640 1 -- 172.21.15.6:0/3725425853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 msgr2=0x7fa7841080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.116+0000 7fa788cd0640 1 --2- 172.21.15.6:0/3725425853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 0x7fa7841080f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa774030520 tx=0x7fa774032dd0 comp rx=0 tx=0).stop 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.116+0000 7fa788cd0640 1 -- 172.21.15.6:0/3725425853 shutdown_connections 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.116+0000 7fa788cd0640 1 --2- 172.21.15.6:0/3725425853 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fa76c038e60 0x7fa76c03b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:28.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.116+0000 7fa788cd0640 1 --2- 172.21.15.6:0/3725425853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa784105890 0x7fa7841080f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:28.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.116+0000 7fa788cd0640 1 -- 172.21.15.6:0/3725425853 >> 172.21.15.6:0/3725425853 conn(0x7fa784101440 msgr2=0x7fa784101fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:28.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.116+0000 7fa788cd0640 1 -- 172.21.15.6:0/3725425853 shutdown_connections 2024-09-11T23:49:28.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:28.116+0000 7fa788cd0640 1 -- 172.21.15.6:0/3725425853 wait complete. 2024-09-11T23:49:28.718 INFO:teuthology.orchestra.run.smithi006.stdout:mgr is available 2024-09-11T23:49:29.291 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:29 smithi006 ceph-mon[30947]: mgrmap e4: x(active, since 2s) 2024-09-11T23:49:29.292 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:29 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3725425853' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T23:49:29.869 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout fsid = 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T23:49:29.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.108+0000 7f55e7d92640 1 Processor -- start 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.108+0000 7f55e7d92640 1 -- start start 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.109+0000 7f55e7d92640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 0x7f55e0106870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.109+0000 7f55e7d92640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f55e0106e40 con 0x7f55e0106470 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.109+0000 7f55e5b2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 0x7f55e0106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.109+0000 7f55e5b2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 0x7f55e0106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52016/0 (socket says 172.21.15.6:52016) 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.109+0000 7f55e5b2e640 1 -- 172.21.15.6:0/2458068241 learned_addr learned my addr 172.21.15.6:0/2458068241 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.109+0000 7f55e5b2e640 1 -- 172.21.15.6:0/2458068241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e0107670 con 0x7f55e0106470 2024-09-11T23:49:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.110+0000 7f55e5b2e640 1 --2- 172.21.15.6:0/2458068241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 0x7f55e0106870 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009820 tx=0x7f55d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35d715a0a078d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:29.872 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.110+0000 7f55e4b2c640 1 -- 172.21.15.6:0/2458068241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d8037070 con 0x7f55e0106470 2024-09-11T23:49:29.872 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.110+0000 7f55e4b2c640 1 -- 172.21.15.6:0/2458068241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f55d80328d0 con 0x7f55e0106470 2024-09-11T23:49:29.872 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.110+0000 7f55e4b2c640 1 -- 172.21.15.6:0/2458068241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d80307d0 con 0x7f55e0106470 2024-09-11T23:49:29.872 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.110+0000 7f55e7d92640 1 -- 172.21.15.6:0/2458068241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 msgr2=0x7f55e0106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:29.872 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.111+0000 7f55e7d92640 1 --2- 172.21.15.6:0/2458068241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 0x7f55e0106870 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009820 tx=0x7f55d802a270 comp rx=0 tx=0).stop 2024-09-11T23:49:29.872 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.111+0000 7f55e7d92640 1 -- 172.21.15.6:0/2458068241 shutdown_connections 2024-09-11T23:49:29.872 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.111+0000 7f55e7d92640 1 --2- 172.21.15.6:0/2458068241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 0x7f55e0106870 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:29.872 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.111+0000 7f55e7d92640 1 -- 172.21.15.6:0/2458068241 >> 172.21.15.6:0/2458068241 conn(0x7f55e0101c40 msgr2=0x7f55e0104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:29.872 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.111+0000 7f55e7d92640 1 -- 172.21.15.6:0/2458068241 shutdown_connections 2024-09-11T23:49:29.872 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.111+0000 7f55e7d92640 1 -- 172.21.15.6:0/2458068241 wait complete. 2024-09-11T23:49:29.872 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.111+0000 7f55e7d92640 1 Processor -- start 2024-09-11T23:49:29.872 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.111+0000 7f55e7d92640 1 -- start start 2024-09-11T23:49:29.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.112+0000 7f55e7d92640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 0x7f55e019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:29.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.112+0000 7f55e7d92640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f55e010aa20 con 0x7f55e0106470 2024-09-11T23:49:29.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.112+0000 7f55e5b2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 0x7f55e019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:29.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.112+0000 7f55e5b2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 0x7f55e019b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52020/0 (socket says 172.21.15.6:52020) 2024-09-11T23:49:29.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.112+0000 7f55e5b2e640 1 -- 172.21.15.6:0/1994897064 learned_addr learned my addr 172.21.15.6:0/1994897064 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:29.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.112+0000 7f55e5b2e640 1 -- 172.21.15.6:0/1994897064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e019bb00 con 0x7f55e0106470 2024-09-11T23:49:29.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.112+0000 7f55e5b2e640 1 --2- 172.21.15.6:0/1994897064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 0x7f55e019b5c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f55d80097f0 tx=0x7f55d8030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:29.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.112+0000 7f55deffd640 1 -- 172.21.15.6:0/1994897064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d8037040 con 0x7f55e0106470 2024-09-11T23:49:29.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.112+0000 7f55deffd640 1 -- 172.21.15.6:0/1994897064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f55d8032bb0 con 0x7f55e0106470 2024-09-11T23:49:29.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.112+0000 7f55e7d92640 1 -- 172.21.15.6:0/1994897064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e019bd90 con 0x7f55e0106470 2024-09-11T23:49:29.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.112+0000 7f55deffd640 1 -- 172.21.15.6:0/1994897064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d803a390 con 0x7f55e0106470 2024-09-11T23:49:29.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.112+0000 7f55e7d92640 1 -- 172.21.15.6:0/1994897064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e019ea80 con 0x7f55e0106470 2024-09-11T23:49:29.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.113+0000 7f55deffd640 1 -- 172.21.15.6:0/1994897064 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f55d803a580 con 0x7f55e0106470 2024-09-11T23:49:29.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.113+0000 7f55deffd640 1 --2- 172.21.15.6:0/1994897064 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f55c8038f70 0x7f55c803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:29.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.113+0000 7f55deffd640 1 -- 172.21.15.6:0/1994897064 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f55d806bfe0 con 0x7f55e0106470 2024-09-11T23:49:29.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.113+0000 7f55e532d640 1 --2- 172.21.15.6:0/1994897064 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f55c8038f70 0x7f55c803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:29.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.113+0000 7f55e7d92640 1 -- 172.21.15.6:0/1994897064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e010aba0 con 0x7f55e0106470 2024-09-11T23:49:29.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.114+0000 7f55e532d640 1 --2- 172.21.15.6:0/1994897064 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f55c8038f70 0x7f55c803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f55d40098c0 tx=0x7f55d4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:29.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.118+0000 7f55deffd640 1 -- 172.21.15.6:0/1994897064 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55d8040210 con 0x7f55e0106470 2024-09-11T23:49:29.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.292+0000 7f55e7d92640 1 -- 172.21.15.6:0/1994897064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f55e01068f0 con 0x7f55e0106470 2024-09-11T23:49:29.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.293+0000 7f55deffd640 1 -- 172.21.15.6:0/1994897064 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+452 (secure 0 0 0) 0x7f55d802c030 con 0x7f55e0106470 2024-09-11T23:49:29.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.296+0000 7f55e7d92640 1 -- 172.21.15.6:0/1994897064 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f55c8038f70 msgr2=0x7f55c803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:29.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.296+0000 7f55e7d92640 1 --2- 172.21.15.6:0/1994897064 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f55c8038f70 0x7f55c803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f55d40098c0 tx=0x7f55d4006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:29.875 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.296+0000 7f55e7d92640 1 -- 172.21.15.6:0/1994897064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 msgr2=0x7f55e019b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:29.875 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.296+0000 7f55e7d92640 1 --2- 172.21.15.6:0/1994897064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 0x7f55e019b5c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f55d80097f0 tx=0x7f55d8030d00 comp rx=0 tx=0).stop 2024-09-11T23:49:29.875 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.296+0000 7f55e7d92640 1 -- 172.21.15.6:0/1994897064 shutdown_connections 2024-09-11T23:49:29.875 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.296+0000 7f55e7d92640 1 --2- 172.21.15.6:0/1994897064 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f55c8038f70 0x7f55c803b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:29.875 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.296+0000 7f55e7d92640 1 --2- 172.21.15.6:0/1994897064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55e0106470 0x7f55e019b5c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:29.875 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.296+0000 7f55e7d92640 1 -- 172.21.15.6:0/1994897064 >> 172.21.15.6:0/1994897064 conn(0x7f55e0101c40 msgr2=0x7f55e0102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:29.875 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.296+0000 7f55e7d92640 1 -- 172.21.15.6:0/1994897064 shutdown_connections 2024-09-11T23:49:29.875 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:29.296+0000 7f55e7d92640 1 -- 172.21.15.6:0/1994897064 wait complete. 2024-09-11T23:49:29.875 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling cephadm module... 2024-09-11T23:49:30.093 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:30 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1994897064' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T23:49:31.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:31 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1944863636' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-11T23:49:31.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:31 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: ignoring --setuser ceph since I am not root 2024-09-11T23:49:31.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:31 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: ignoring --setgroup ceph since I am not root 2024-09-11T23:49:31.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:31 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:31.198+0000 7f32e85cc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:49:31.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:31 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:31.257+0000 7f32e85cc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:49:31.692 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:31 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:31.413+0000 7f32e85cc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:49:31.692 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:31 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:31.483+0000 7f32e85cc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:49:31.692 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:31 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:31.637+0000 7f32e85cc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:49:31.699 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.279+0000 7f460525a640 1 Processor -- start 2024-09-11T23:49:31.699 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.279+0000 7f460525a640 1 -- start start 2024-09-11T23:49:31.699 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.279+0000 7f460525a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 0x7f46001062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:31.699 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.279+0000 7f460525a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f460007bde0 con 0x7f4600105ed0 2024-09-11T23:49:31.699 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.279+0000 7f45fed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 0x7f46001062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:31.699 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.279+0000 7f45fed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 0x7f46001062d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52022/0 (socket says 172.21.15.6:52022) 2024-09-11T23:49:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.279+0000 7f45fed9d640 1 -- 172.21.15.6:0/1422077484 learned_addr learned my addr 172.21.15.6:0/1422077484 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.279+0000 7f45fed9d640 1 -- 172.21.15.6:0/1422077484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4600106810 con 0x7f4600105ed0 2024-09-11T23:49:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.280+0000 7f45fed9d640 1 --2- 172.21.15.6:0/1422077484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 0x7f46001062d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009820 tx=0x7f45f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c854c63bc9f51dad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.280+0000 7f45fe59c640 1 -- 172.21.15.6:0/1422077484 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f0037070 con 0x7f4600105ed0 2024-09-11T23:49:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.280+0000 7f45fe59c640 1 -- 172.21.15.6:0/1422077484 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f45f00328d0 con 0x7f4600105ed0 2024-09-11T23:49:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.280+0000 7f45fe59c640 1 -- 172.21.15.6:0/1422077484 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f00307d0 con 0x7f4600105ed0 2024-09-11T23:49:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.281+0000 7f460525a640 1 -- 172.21.15.6:0/1422077484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 msgr2=0x7f46001062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.281+0000 7f460525a640 1 --2- 172.21.15.6:0/1422077484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 0x7f46001062d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009820 tx=0x7f45f002a270 comp rx=0 tx=0).stop 2024-09-11T23:49:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.281+0000 7f460525a640 1 -- 172.21.15.6:0/1422077484 shutdown_connections 2024-09-11T23:49:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.281+0000 7f460525a640 1 --2- 172.21.15.6:0/1422077484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 0x7f46001062d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.281+0000 7f460525a640 1 -- 172.21.15.6:0/1422077484 >> 172.21.15.6:0/1422077484 conn(0x7f4600101ca0 msgr2=0x7f46001040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.281+0000 7f460525a640 1 -- 172.21.15.6:0/1422077484 shutdown_connections 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.281+0000 7f460525a640 1 -- 172.21.15.6:0/1422077484 wait complete. 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.282+0000 7f460525a640 1 Processor -- start 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.282+0000 7f460525a640 1 -- start start 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.282+0000 7f460525a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 0x7f460019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.282+0000 7f460525a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f46001078b0 con 0x7f4600105ed0 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.282+0000 7f45fed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 0x7f460019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.282+0000 7f45fed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 0x7f460019d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52032/0 (socket says 172.21.15.6:52032) 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.282+0000 7f45fed9d640 1 -- 172.21.15.6:0/1944863636 learned_addr learned my addr 172.21.15.6:0/1944863636 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.282+0000 7f45fed9d640 1 -- 172.21.15.6:0/1944863636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460019dc60 con 0x7f4600105ed0 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.282+0000 7f45fed9d640 1 --2- 172.21.15.6:0/1944863636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 0x7f460019d720 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f45f0032e10 tx=0x7f45f0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.282+0000 7f45fcd99640 1 -- 172.21.15.6:0/1944863636 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f0042070 con 0x7f4600105ed0 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.282+0000 7f45fcd99640 1 -- 172.21.15.6:0/1944863636 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f45f0030c80 con 0x7f4600105ed0 2024-09-11T23:49:31.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.282+0000 7f460525a640 1 -- 172.21.15.6:0/1944863636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460019def0 con 0x7f4600105ed0 2024-09-11T23:49:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.283+0000 7f45fcd99640 1 -- 172.21.15.6:0/1944863636 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f0037040 con 0x7f4600105ed0 2024-09-11T23:49:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.283+0000 7f460525a640 1 -- 172.21.15.6:0/1944863636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46001a0be0 con 0x7f4600105ed0 2024-09-11T23:49:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.284+0000 7f45fcd99640 1 -- 172.21.15.6:0/1944863636 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f45f0045070 con 0x7f4600105ed0 2024-09-11T23:49:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.284+0000 7f460525a640 1 -- 172.21.15.6:0/1944863636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46001062d0 con 0x7f4600105ed0 2024-09-11T23:49:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.284+0000 7f45fcd99640 1 --2- 172.21.15.6:0/1944863636 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f45ec038f70 0x7f45ec03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.284+0000 7f45fcd99640 1 -- 172.21.15.6:0/1944863636 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f45f006bfb0 con 0x7f4600105ed0 2024-09-11T23:49:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.284+0000 7f45f7fff640 1 --2- 172.21.15.6:0/1944863636 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f45ec038f70 0x7f45ec03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.284+0000 7f45f7fff640 1 --2- 172.21.15.6:0/1944863636 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f45ec038f70 0x7f45ec03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45e80098c0 tx=0x7f45e8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.289+0000 7f45fcd99640 1 -- 172.21.15.6:0/1944863636 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45f0045360 con 0x7f4600105ed0 2024-09-11T23:49:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:30.514+0000 7f460525a640 1 -- 172.21.15.6:0/1944863636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f460002da40 con 0x7f4600105ed0 2024-09-11T23:49:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:31.049+0000 7f45fcd99640 1 -- 172.21.15.6:0/1944863636 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f45f006b9d0 con 0x7f4600105ed0 2024-09-11T23:49:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:31.052+0000 7f45fcd99640 1 -- 172.21.15.6:0/1944863636 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f45f005a6f0 con 0x7f4600105ed0 2024-09-11T23:49:31.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:31.053+0000 7f460525a640 1 -- 172.21.15.6:0/1944863636 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f45ec038f70 msgr2=0x7f45ec03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:31.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:31.053+0000 7f460525a640 1 --2- 172.21.15.6:0/1944863636 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f45ec038f70 0x7f45ec03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45e80098c0 tx=0x7f45e8006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:31.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:31.053+0000 7f460525a640 1 -- 172.21.15.6:0/1944863636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 msgr2=0x7f460019d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:31.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:31.053+0000 7f460525a640 1 --2- 172.21.15.6:0/1944863636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 0x7f460019d720 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f45f0032e10 tx=0x7f45f0032e40 comp rx=0 tx=0).stop 2024-09-11T23:49:31.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:31.053+0000 7f460525a640 1 -- 172.21.15.6:0/1944863636 shutdown_connections 2024-09-11T23:49:31.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:31.053+0000 7f460525a640 1 --2- 172.21.15.6:0/1944863636 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f45ec038f70 0x7f45ec03b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:31.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:31.053+0000 7f460525a640 1 --2- 172.21.15.6:0/1944863636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600105ed0 0x7f460019d720 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:31.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:31.053+0000 7f460525a640 1 -- 172.21.15.6:0/1944863636 >> 172.21.15.6:0/1944863636 conn(0x7f4600101ca0 msgr2=0x7f4600194380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:31.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:31.053+0000 7f460525a640 1 -- 172.21.15.6:0/1944863636 shutdown_connections 2024-09-11T23:49:31.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:31.054+0000 7f460525a640 1 -- 172.21.15.6:0/1944863636 wait complete. 2024-09-11T23:49:31.947 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:31 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:31.787+0000 7f32e85cc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:49:32.339 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:32 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1944863636' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-11T23:49:32.339 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:32 smithi006 ceph-mon[30947]: mgrmap e5: x(active, since 5s) 2024-09-11T23:49:32.339 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:32 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:32.120+0000 7f32e85cc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:49:32.339 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:32 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:32.186+0000 7f32e85cc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:49:32.618 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:32 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:32.382+0000 7f32e85cc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:49:32.941 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:49:32.941 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-11T23:49:32.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T23:49:32.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T23:49:32.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T23:49:32.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:49:32.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.134+0000 7f50f5e9b640 1 Processor -- start 2024-09-11T23:49:32.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.134+0000 7f50f5e9b640 1 -- start start 2024-09-11T23:49:32.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.134+0000 7f50f5e9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 0x7f50f010a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:32.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.134+0000 7f50f5e9b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f50f0075a80 con 0x7f50f0107fe0 2024-09-11T23:49:32.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.134+0000 7f50ef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 0x7f50f010a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:32.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.134+0000 7f50ef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 0x7f50f010a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44506/0 (socket says 172.21.15.6:44506) 2024-09-11T23:49:32.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.134+0000 7f50ef7fe640 1 -- 172.21.15.6:0/475456908 learned_addr learned my addr 172.21.15.6:0/475456908 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:32.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.134+0000 7f50ef7fe640 1 -- 172.21.15.6:0/475456908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f010a910 con 0x7f50f0107fe0 2024-09-11T23:49:32.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.135+0000 7f50ef7fe640 1 --2- 172.21.15.6:0/475456908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 0x7f50f010a3d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009820 tx=0x7f50e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3257e39e86e29e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:32.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.135+0000 7f50eeffd640 1 -- 172.21.15.6:0/475456908 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e0037070 con 0x7f50f0107fe0 2024-09-11T23:49:32.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.135+0000 7f50eeffd640 1 -- 172.21.15.6:0/475456908 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f50e00328d0 con 0x7f50f0107fe0 2024-09-11T23:49:32.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.135+0000 7f50eeffd640 1 -- 172.21.15.6:0/475456908 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e00307d0 con 0x7f50f0107fe0 2024-09-11T23:49:32.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.136+0000 7f50f5e9b640 1 -- 172.21.15.6:0/475456908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 msgr2=0x7f50f010a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:32.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.136+0000 7f50f5e9b640 1 --2- 172.21.15.6:0/475456908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 0x7f50f010a3d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009820 tx=0x7f50e002a270 comp rx=0 tx=0).stop 2024-09-11T23:49:32.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.136+0000 7f50f5e9b640 1 -- 172.21.15.6:0/475456908 shutdown_connections 2024-09-11T23:49:32.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.136+0000 7f50f5e9b640 1 --2- 172.21.15.6:0/475456908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 0x7f50f010a3d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:32.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.136+0000 7f50f5e9b640 1 -- 172.21.15.6:0/475456908 >> 172.21.15.6:0/475456908 conn(0x7f50f0101c40 msgr2=0x7f50f0104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:32.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.136+0000 7f50f5e9b640 1 -- 172.21.15.6:0/475456908 shutdown_connections 2024-09-11T23:49:32.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.136+0000 7f50f5e9b640 1 -- 172.21.15.6:0/475456908 wait complete. 2024-09-11T23:49:32.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.137+0000 7f50f5e9b640 1 Processor -- start 2024-09-11T23:49:32.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.137+0000 7f50f5e9b640 1 -- start start 2024-09-11T23:49:32.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.137+0000 7f50f5e9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 0x7f50f019d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:32.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.137+0000 7f50f5e9b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f50f010b950 con 0x7f50f0107fe0 2024-09-11T23:49:32.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.137+0000 7f50ef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 0x7f50f019d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:32.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.137+0000 7f50ef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 0x7f50f019d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44512/0 (socket says 172.21.15.6:44512) 2024-09-11T23:49:32.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.137+0000 7f50ef7fe640 1 -- 172.21.15.6:0/1771919770 learned_addr learned my addr 172.21.15.6:0/1771919770 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:32.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.137+0000 7f50ef7fe640 1 -- 172.21.15.6:0/1771919770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f019dce0 con 0x7f50f0107fe0 2024-09-11T23:49:32.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.137+0000 7f50ef7fe640 1 --2- 172.21.15.6:0/1771919770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 0x7f50f019d7a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f50e0030520 tx=0x7f50e0032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:32.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.138+0000 7f50ed7fa640 1 -- 172.21.15.6:0/1771919770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e0042070 con 0x7f50f0107fe0 2024-09-11T23:49:32.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.138+0000 7f50ed7fa640 1 -- 172.21.15.6:0/1771919770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f50e0030cc0 con 0x7f50f0107fe0 2024-09-11T23:49:32.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.138+0000 7f50f5e9b640 1 -- 172.21.15.6:0/1771919770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f019df70 con 0x7f50f0107fe0 2024-09-11T23:49:32.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.138+0000 7f50ed7fa640 1 -- 172.21.15.6:0/1771919770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e0037040 con 0x7f50f0107fe0 2024-09-11T23:49:32.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.138+0000 7f50f5e9b640 1 -- 172.21.15.6:0/1771919770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f01a0c60 con 0x7f50f0107fe0 2024-09-11T23:49:32.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.139+0000 7f50ed7fa640 1 -- 172.21.15.6:0/1771919770 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f50e0045070 con 0x7f50f0107fe0 2024-09-11T23:49:32.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.139+0000 7f50f5e9b640 1 -- 172.21.15.6:0/1771919770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f0108440 con 0x7f50f0107fe0 2024-09-11T23:49:32.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.139+0000 7f50ed7fa640 1 --2- 172.21.15.6:0/1771919770 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f50dc038fc0 0x7f50dc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:32.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.139+0000 7f50ed7fa640 1 -- 172.21.15.6:0/1771919770 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f50e006caf0 con 0x7f50f0107fe0 2024-09-11T23:49:32.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.139+0000 7f50e7fff640 1 -- 172.21.15.6:0/1771919770 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f50dc038fc0 msgr2=0x7f50dc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1826197239 2024-09-11T23:49:32.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.139+0000 7f50e7fff640 1 --2- 172.21.15.6:0/1771919770 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f50dc038fc0 0x7f50dc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:49:32.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.143+0000 7f50ed7fa640 1 -- 172.21.15.6:0/1771919770 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f50e0046e00 con 0x7f50f0107fe0 2024-09-11T23:49:32.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.340+0000 7f50e7fff640 1 -- 172.21.15.6:0/1771919770 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f50dc038fc0 msgr2=0x7f50dc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1826197239 2024-09-11T23:49:32.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.340+0000 7f50e7fff640 1 --2- 172.21.15.6:0/1771919770 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f50dc038fc0 0x7f50dc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:49:32.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.367+0000 7f50f5e9b640 1 -- 172.21.15.6:0/1771919770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f50f01a12e0 con 0x7f50f0107fe0 2024-09-11T23:49:32.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.367+0000 7f50ed7fa640 1 -- 172.21.15.6:0/1771919770 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f50e0045360 con 0x7f50f0107fe0 2024-09-11T23:49:32.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.369+0000 7f50f5e9b640 1 -- 172.21.15.6:0/1771919770 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f50dc038fc0 msgr2=0x7f50dc03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:49:32.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.369+0000 7f50f5e9b640 1 --2- 172.21.15.6:0/1771919770 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f50dc038fc0 0x7f50dc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:32.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.369+0000 7f50f5e9b640 1 -- 172.21.15.6:0/1771919770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 msgr2=0x7f50f019d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:32.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.369+0000 7f50f5e9b640 1 --2- 172.21.15.6:0/1771919770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 0x7f50f019d7a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f50e0030520 tx=0x7f50e0032dd0 comp rx=0 tx=0).stop 2024-09-11T23:49:32.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.369+0000 7f50f5e9b640 1 -- 172.21.15.6:0/1771919770 shutdown_connections 2024-09-11T23:49:32.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.369+0000 7f50f5e9b640 1 --2- 172.21.15.6:0/1771919770 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7f50dc038fc0 0x7f50dc03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:32.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.369+0000 7f50f5e9b640 1 --2- 172.21.15.6:0/1771919770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0107fe0 0x7f50f019d7a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:32.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.369+0000 7f50f5e9b640 1 -- 172.21.15.6:0/1771919770 >> 172.21.15.6:0/1771919770 conn(0x7f50f0101c40 msgr2=0x7f50f01027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:32.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.370+0000 7f50f5e9b640 1 -- 172.21.15.6:0/1771919770 shutdown_connections 2024-09-11T23:49:32.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:32.370+0000 7f50f5e9b640 1 -- 172.21.15.6:0/1771919770 wait complete. 2024-09-11T23:49:32.947 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for the mgr to restart... 2024-09-11T23:49:32.947 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr epoch 5... 2024-09-11T23:49:33.192 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:33 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1771919770' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T23:49:33.605 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:33 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:33.318+0000 7f32e85cc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:49:33.605 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:33 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:33.391+0000 7f32e85cc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:49:34.280 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:34 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:34.160+0000 7f32e85cc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:49:34.280 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:34 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:34.280+0000 7f32e85cc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:49:34.618 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:34 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:34.429+0000 7f32e85cc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:49:34.618 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:34 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:34.492+0000 7f32e85cc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:49:34.951 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:34 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:34.648+0000 7f32e85cc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:49:34.951 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:34 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:34.722+0000 7f32e85cc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:49:34.952 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:34 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:34.785+0000 7f32e85cc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:49:34.952 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:34 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:34.951+0000 7f32e85cc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:49:35.237 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:35 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:35.019+0000 7f32e85cc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:49:35.237 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:35 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:35.088+0000 7f32e85cc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:49:35.237 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:35 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:35.175+0000 7f32e85cc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:49:35.237 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:35 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:35.237+0000 7f32e85cc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:49:35.618 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:35 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:35.298+0000 7f32e85cc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:49:36.618 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:36.124+0000 7f32e85cc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:49:36.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: Active manager daemon x restarted 2024-09-11T23:49:36.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: Activating manager daemon x 2024-09-11T23:49:36.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: osdmap e2: 0 total, 0 up, 0 in 2024-09-11T23:49:36.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: mgrmap e6: x(active, starting, since 0.00345153s) 2024-09-11T23:49:36.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:49:36.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:49:36.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:49:36.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:49:36.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:49:36.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: Manager daemon x is now available 2024-09-11T23:49:36.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:36.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:36.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:49:36.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:49:36.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:49:36.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:36 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:49:37.780 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:37 smithi006 ceph-mon[30947]: Found migration_current of "None". Setting to last migration. 2024-09-11T23:49:37.781 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:37 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:37.781 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:37 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:37.781 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:37 smithi006 ceph-mon[30947]: mgrmap e7: x(active, since 1.0052s) 2024-09-11T23:49:37.790 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:49:37.790 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-11T23:49:37.790 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T23:49:37.790 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:49:37.790 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.399+0000 7fc220c19640 1 Processor -- start 2024-09-11T23:49:37.790 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.400+0000 7fc220c19640 1 -- start start 2024-09-11T23:49:37.790 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.400+0000 7fc220c19640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 0x7fc21c10a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:37.790 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.400+0000 7fc220c19640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c075a40 con 0x7fc21c108020 2024-09-11T23:49:37.790 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.400+0000 7fc21a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 0x7fc21c10a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:37.790 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.400+0000 7fc21a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 0x7fc21c10a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44520/0 (socket says 172.21.15.6:44520) 2024-09-11T23:49:37.790 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.400+0000 7fc21a59c640 1 -- 172.21.15.6:0/292382368 learned_addr learned my addr 172.21.15.6:0/292382368 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:37.791 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.400+0000 7fc21a59c640 1 -- 172.21.15.6:0/292382368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c10a950 con 0x7fc21c108020 2024-09-11T23:49:37.791 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.401+0000 7fc21a59c640 1 --2- 172.21.15.6:0/292382368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 0x7fc21c10a410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009820 tx=0x7fc20c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9024f12f121b23fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:37.791 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.401+0000 7fc21959a640 1 -- 172.21.15.6:0/292382368 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc20c037070 con 0x7fc21c108020 2024-09-11T23:49:37.791 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.401+0000 7fc21959a640 1 -- 172.21.15.6:0/292382368 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc20c0328d0 con 0x7fc21c108020 2024-09-11T23:49:37.791 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.401+0000 7fc21959a640 1 -- 172.21.15.6:0/292382368 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc20c0307d0 con 0x7fc21c108020 2024-09-11T23:49:37.791 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.402+0000 7fc220c19640 1 -- 172.21.15.6:0/292382368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 msgr2=0x7fc21c10a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:37.791 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.402+0000 7fc220c19640 1 --2- 172.21.15.6:0/292382368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 0x7fc21c10a410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009820 tx=0x7fc20c02a270 comp rx=0 tx=0).stop 2024-09-11T23:49:37.791 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.402+0000 7fc220c19640 1 -- 172.21.15.6:0/292382368 shutdown_connections 2024-09-11T23:49:37.791 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.402+0000 7fc220c19640 1 --2- 172.21.15.6:0/292382368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 0x7fc21c10a410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:37.791 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.402+0000 7fc220c19640 1 -- 172.21.15.6:0/292382368 >> 172.21.15.6:0/292382368 conn(0x7fc21c101c40 msgr2=0x7fc21c104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:37.791 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.402+0000 7fc220c19640 1 -- 172.21.15.6:0/292382368 shutdown_connections 2024-09-11T23:49:37.791 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.402+0000 7fc220c19640 1 -- 172.21.15.6:0/292382368 wait complete. 2024-09-11T23:49:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.403+0000 7fc220c19640 1 Processor -- start 2024-09-11T23:49:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.403+0000 7fc220c19640 1 -- start start 2024-09-11T23:49:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.403+0000 7fc220c19640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 0x7fc21c19b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.403+0000 7fc220c19640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c10b930 con 0x7fc21c108020 2024-09-11T23:49:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.403+0000 7fc21a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 0x7fc21c19b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.403+0000 7fc21a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 0x7fc21c19b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44526/0 (socket says 172.21.15.6:44526) 2024-09-11T23:49:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.403+0000 7fc21a59c640 1 -- 172.21.15.6:0/3385161967 learned_addr learned my addr 172.21.15.6:0/3385161967 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.403+0000 7fc21a59c640 1 -- 172.21.15.6:0/3385161967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c19baa0 con 0x7fc21c108020 2024-09-11T23:49:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.404+0000 7fc21a59c640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 0x7fc21c19b560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc20c030520 tx=0x7fc20c032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.404+0000 7fc20b7fe640 1 -- 172.21.15.6:0/3385161967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc20c042070 con 0x7fc21c108020 2024-09-11T23:49:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.404+0000 7fc20b7fe640 1 -- 172.21.15.6:0/3385161967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc20c030cc0 con 0x7fc21c108020 2024-09-11T23:49:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.404+0000 7fc220c19640 1 -- 172.21.15.6:0/3385161967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21c19bd30 con 0x7fc21c108020 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.404+0000 7fc20b7fe640 1 -- 172.21.15.6:0/3385161967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc20c037040 con 0x7fc21c108020 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.404+0000 7fc220c19640 1 -- 172.21.15.6:0/3385161967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21c19ea20 con 0x7fc21c108020 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.405+0000 7fc20b7fe640 1 -- 172.21.15.6:0/3385161967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fc20c045070 con 0x7fc21c108020 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.405+0000 7fc20b7fe640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fc204038fc0 0x7fc20403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.405+0000 7fc20b7fe640 1 -- 172.21.15.6:0/3385161967 --> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc20403bb90 con 0x7fc204038fc0 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.405+0000 7fc20b7fe640 1 -- 172.21.15.6:0/3385161967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc20c06bf30 con 0x7fc21c108020 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.405+0000 7fc219d9b640 1 -- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fc204038fc0 msgr2=0x7fc20403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1826197239 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.405+0000 7fc219d9b640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fc204038fc0 0x7fc20403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.606+0000 7fc219d9b640 1 -- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fc204038fc0 msgr2=0x7fc20403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1826197239 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:33.606+0000 7fc219d9b640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fc204038fc0 0x7fc20403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:34.007+0000 7fc219d9b640 1 -- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fc204038fc0 msgr2=0x7fc20403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1826197239 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:34.007+0000 7fc219d9b640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fc204038fc0 0x7fc20403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:49:37.793 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:34.807+0000 7fc219d9b640 1 -- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fc204038fc0 msgr2=0x7fc20403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1826197239 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:34.807+0000 7fc219d9b640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fc204038fc0 0x7fc20403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:36.128+0000 7fc20b7fe640 1 -- 172.21.15.6:0/3385161967 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7fc20c06ad70 con 0x7fc21c108020 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:36.128+0000 7fc20b7fe640 1 -- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fc204038fc0 msgr2=0x7fc20403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:36.128+0000 7fc20b7fe640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fc204038fc0 0x7fc20403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.129+0000 7fc20b7fe640 1 -- 172.21.15.6:0/3385161967 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fc20c03da30 con 0x7fc21c108020 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.129+0000 7fc20b7fe640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fc20403c8f0 0x7fc20403ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.129+0000 7fc20b7fe640 1 -- 172.21.15.6:0/3385161967 --> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc20c00af30 con 0x7fc20403c8f0 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.129+0000 7fc219d9b640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fc20403c8f0 0x7fc20403ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.130+0000 7fc219d9b640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fc20403c8f0 0x7fc20403ece0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc210003980 tx=0x7fc2100092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.131+0000 7fc20b7fe640 1 -- 172.21.15.6:0/3385161967 <== mgr.14118 v2:172.21.15.6:6800/2279576750 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fc20c00af30 con 0x7fc20403c8f0 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.138+0000 7fc220c19640 1 -- 172.21.15.6:0/3385161967 --> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fc21c108480 con 0x7fc20403c8f0 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.138+0000 7fc20b7fe640 1 -- 172.21.15.6:0/3385161967 <== mgr.14118 v2:172.21.15.6:6800/2279576750 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fc21c108480 con 0x7fc20403c8f0 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.138+0000 7fc220c19640 1 -- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fc20403c8f0 msgr2=0x7fc20403ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:37.794 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.138+0000 7fc220c19640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fc20403c8f0 0x7fc20403ece0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc210003980 tx=0x7fc2100092b0 comp rx=0 tx=0).stop 2024-09-11T23:49:37.795 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.138+0000 7fc220c19640 1 -- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 msgr2=0x7fc21c19b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:37.795 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.138+0000 7fc220c19640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 0x7fc21c19b560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc20c030520 tx=0x7fc20c032dd0 comp rx=0 tx=0).stop 2024-09-11T23:49:37.795 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.138+0000 7fc220c19640 1 -- 172.21.15.6:0/3385161967 shutdown_connections 2024-09-11T23:49:37.795 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.138+0000 7fc220c19640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fc20403c8f0 0x7fc20403ece0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:37.795 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.139+0000 7fc220c19640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:6800/1826197239,v1:172.21.15.6:6801/1826197239] conn(0x7fc204038fc0 0x7fc20403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:37.795 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.139+0000 7fc220c19640 1 --2- 172.21.15.6:0/3385161967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c108020 0x7fc21c19b560 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:37.795 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.139+0000 7fc220c19640 1 -- 172.21.15.6:0/3385161967 >> 172.21.15.6:0/3385161967 conn(0x7fc21c101c40 msgr2=0x7fc21c1028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:37.795 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.139+0000 7fc220c19640 1 -- 172.21.15.6:0/3385161967 shutdown_connections 2024-09-11T23:49:37.795 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:37.139+0000 7fc220c19640 1 -- 172.21.15.6:0/3385161967 wait complete. 2024-09-11T23:49:37.795 INFO:teuthology.orchestra.run.smithi006.stdout:mgr epoch 5 is available 2024-09-11T23:49:37.795 INFO:teuthology.orchestra.run.smithi006.stdout:Setting orchestrator backend to cephadm... 2024-09-11T23:49:38.348 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:38.152+0000 7f324f926640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:23:49:38] ENGINE Error in HTTPServer.serve 2024-09-11T23:49:38.348 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: Traceback (most recent call last): 2024-09-11T23:49:38.348 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:49:38.348 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: self._connections.run(self.expiration_interval) 2024-09-11T23:49:38.349 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:49:38.349 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: self._run(expiration_interval) 2024-09-11T23:49:38.349 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:49:38.349 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:49:38.349 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:49:38.349 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:49:38.349 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:49:38.349 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: s = self.context.wrap_socket( 2024-09-11T23:49:38.349 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:49:38.349 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: return self.sslsocket_class._create( 2024-09-11T23:49:38.349 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:49:38.350 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: self.do_handshake() 2024-09-11T23:49:38.350 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:49:38.350 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: self._sslobj.do_handshake() 2024-09-11T23:49:38.350 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:49:38.350 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:38.912 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-mon[30947]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T23:49:38.912 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-mon[30947]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T23:49:38.912 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-mon[30947]: [11/Sep/2024:23:49:37] ENGINE Bus STARTING 2024-09-11T23:49:38.912 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-mon[30947]: [11/Sep/2024:23:49:38] ENGINE Serving on http://172.21.15.6:8765 2024-09-11T23:49:38.913 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:49:38.913 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:38.913 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:38 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:49:38.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.148+0000 7fbfcab9d640 1 Processor -- start 2024-09-11T23:49:38.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.148+0000 7fbfcab9d640 1 -- start start 2024-09-11T23:49:38.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.148+0000 7fbfcab9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 0x7fbfc407c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:38.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.148+0000 7fbfcab9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc407c880 con 0x7fbfc407de50 2024-09-11T23:49:38.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.148+0000 7fbfc8939640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 0x7fbfc407c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:38.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.148+0000 7fbfc8939640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 0x7fbfc407c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44608/0 (socket says 172.21.15.6:44608) 2024-09-11T23:49:38.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.148+0000 7fbfc8939640 1 -- 172.21.15.6:0/1487053743 learned_addr learned my addr 172.21.15.6:0/1487053743 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:38.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.148+0000 7fbfc8939640 1 -- 172.21.15.6:0/1487053743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc407ca00 con 0x7fbfc407de50 2024-09-11T23:49:38.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.149+0000 7fbfc8939640 1 --2- 172.21.15.6:0/1487053743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 0x7fbfc407c2b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009820 tx=0x7fbfb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83dff0ccb6f6936d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:38.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.149+0000 7fbfc37fe640 1 -- 172.21.15.6:0/1487053743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb8037070 con 0x7fbfc407de50 2024-09-11T23:49:38.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.149+0000 7fbfc37fe640 1 -- 172.21.15.6:0/1487053743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fbfb80328d0 con 0x7fbfc407de50 2024-09-11T23:49:38.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.149+0000 7fbfc37fe640 1 -- 172.21.15.6:0/1487053743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb80307d0 con 0x7fbfc407de50 2024-09-11T23:49:38.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.150+0000 7fbfcab9d640 1 -- 172.21.15.6:0/1487053743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 msgr2=0x7fbfc407c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:38.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.150+0000 7fbfcab9d640 1 --2- 172.21.15.6:0/1487053743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 0x7fbfc407c2b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009820 tx=0x7fbfb802a270 comp rx=0 tx=0).stop 2024-09-11T23:49:38.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.150+0000 7fbfcab9d640 1 -- 172.21.15.6:0/1487053743 shutdown_connections 2024-09-11T23:49:38.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.150+0000 7fbfcab9d640 1 --2- 172.21.15.6:0/1487053743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 0x7fbfc407c2b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:38.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.150+0000 7fbfcab9d640 1 -- 172.21.15.6:0/1487053743 >> 172.21.15.6:0/1487053743 conn(0x7fbfc4102db0 msgr2=0x7fbfc41051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:38.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.150+0000 7fbfcab9d640 1 -- 172.21.15.6:0/1487053743 shutdown_connections 2024-09-11T23:49:38.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.150+0000 7fbfcab9d640 1 -- 172.21.15.6:0/1487053743 wait complete. 2024-09-11T23:49:38.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.151+0000 7fbfcab9d640 1 Processor -- start 2024-09-11T23:49:38.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.151+0000 7fbfcab9d640 1 -- start start 2024-09-11T23:49:38.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.151+0000 7fbfcab9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 0x7fbfc419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:38.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.151+0000 7fbfcab9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc410db70 con 0x7fbfc407de50 2024-09-11T23:49:38.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.151+0000 7fbfc8939640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 0x7fbfc419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:38.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.151+0000 7fbfc8939640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 0x7fbfc419d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44618/0 (socket says 172.21.15.6:44618) 2024-09-11T23:49:38.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.151+0000 7fbfc8939640 1 -- 172.21.15.6:0/2768507136 learned_addr learned my addr 172.21.15.6:0/2768507136 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:38.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.152+0000 7fbfc8939640 1 -- 172.21.15.6:0/2768507136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc419dc70 con 0x7fbfc407de50 2024-09-11T23:49:38.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.152+0000 7fbfc8939640 1 --2- 172.21.15.6:0/2768507136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 0x7fbfc419d730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8032e10 tx=0x7fbfb8032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:38.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.152+0000 7fbfc1ffb640 1 -- 172.21.15.6:0/2768507136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb8042070 con 0x7fbfc407de50 2024-09-11T23:49:38.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.152+0000 7fbfc1ffb640 1 -- 172.21.15.6:0/2768507136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fbfb8030c80 con 0x7fbfc407de50 2024-09-11T23:49:38.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.152+0000 7fbfc1ffb640 1 -- 172.21.15.6:0/2768507136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb8037040 con 0x7fbfc407de50 2024-09-11T23:49:38.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.152+0000 7fbfcab9d640 1 -- 172.21.15.6:0/2768507136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc419df00 con 0x7fbfc407de50 2024-09-11T23:49:38.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.152+0000 7fbfcab9d640 1 -- 172.21.15.6:0/2768507136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc41a0bf0 con 0x7fbfc407de50 2024-09-11T23:49:38.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.153+0000 7fbfc1ffb640 1 -- 172.21.15.6:0/2768507136 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fbfb8045070 con 0x7fbfc407de50 2024-09-11T23:49:38.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.153+0000 7fbfcab9d640 1 -- 172.21.15.6:0/2768507136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc407c330 con 0x7fbfc407de50 2024-09-11T23:49:38.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.153+0000 7fbfc1ffb640 1 --2- 172.21.15.6:0/2768507136 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fbfb4038eb0 0x7fbfb403b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:38.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.153+0000 7fbfc1ffb640 1 -- 172.21.15.6:0/2768507136 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbfb806bcf0 con 0x7fbfc407de50 2024-09-11T23:49:38.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.154+0000 7fbfc3fff640 1 --2- 172.21.15.6:0/2768507136 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fbfb4038eb0 0x7fbfb403b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:38.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.154+0000 7fbfc3fff640 1 --2- 172.21.15.6:0/2768507136 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fbfb4038eb0 0x7fbfb403b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00098c0 tx=0x7fbfb0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:38.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.158+0000 7fbfc1ffb640 1 -- 172.21.15.6:0/2768507136 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbfb8045360 con 0x7fbfc407de50 2024-09-11T23:49:38.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.347+0000 7fbfcab9d640 1 -- 172.21.15.6:0/2768507136 --> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fbfc4104060 con 0x7fbfb4038eb0 2024-09-11T23:49:38.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.352+0000 7fbfc1ffb640 1 -- 172.21.15.6:0/2768507136 <== mgr.14118 v2:172.21.15.6:6800/2279576750 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbfc4104060 con 0x7fbfb4038eb0 2024-09-11T23:49:38.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.354+0000 7fbfcab9d640 1 -- 172.21.15.6:0/2768507136 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fbfb4038eb0 msgr2=0x7fbfb403b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:38.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.354+0000 7fbfcab9d640 1 --2- 172.21.15.6:0/2768507136 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fbfb4038eb0 0x7fbfb403b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00098c0 tx=0x7fbfb0006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:38.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.354+0000 7fbfcab9d640 1 -- 172.21.15.6:0/2768507136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 msgr2=0x7fbfc419d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:38.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.354+0000 7fbfcab9d640 1 --2- 172.21.15.6:0/2768507136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 0x7fbfc419d730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8032e10 tx=0x7fbfb8032e40 comp rx=0 tx=0).stop 2024-09-11T23:49:38.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.354+0000 7fbfcab9d640 1 -- 172.21.15.6:0/2768507136 shutdown_connections 2024-09-11T23:49:38.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.354+0000 7fbfcab9d640 1 --2- 172.21.15.6:0/2768507136 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fbfb4038eb0 0x7fbfb403b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:38.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.354+0000 7fbfcab9d640 1 --2- 172.21.15.6:0/2768507136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc407de50 0x7fbfc419d730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:38.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.354+0000 7fbfcab9d640 1 -- 172.21.15.6:0/2768507136 >> 172.21.15.6:0/2768507136 conn(0x7fbfc4102db0 msgr2=0x7fbfc4103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:38.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.355+0000 7fbfcab9d640 1 -- 172.21.15.6:0/2768507136 shutdown_connections 2024-09-11T23:49:38.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:38.355+0000 7fbfcab9d640 1 -- 172.21.15.6:0/2768507136 wait complete. 2024-09-11T23:49:39.802 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:39 smithi006 ceph-mon[30947]: [11/Sep/2024:23:49:38] ENGINE Serving on https://172.21.15.6:7150 2024-09-11T23:49:39.802 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:39 smithi006 ceph-mon[30947]: [11/Sep/2024:23:49:38] ENGINE Bus STARTED 2024-09-11T23:49:39.802 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:39 smithi006 ceph-mon[30947]: [11/Sep/2024:23:49:38] ENGINE Error in HTTPServer.serve 2024-09-11T23:49:39.802 INFO:journalctl@ceph.mon.a.smithi006.stdout: Traceback (most recent call last): 2024-09-11T23:49:39.802 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:49:39.802 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._connections.run(self.expiration_interval) 2024-09-11T23:49:39.802 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:49:39.802 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._run(expiration_interval) 2024-09-11T23:49:39.802 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:49:39.802 INFO:journalctl@ceph.mon.a.smithi006.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout: s = self.context.wrap_socket( 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout: return self.sslsocket_class._create( 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout: self.do_handshake() 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._sslobj.do_handshake() 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:39 smithi006 ceph-mon[30947]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:49:39.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:39 smithi006 ceph-mon[30947]: mgrmap e8: x(active, since 2s) 2024-09-11T23:49:40.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-11T23:49:40.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.309+0000 7f1e9be21640 1 Processor -- start 2024-09-11T23:49:40.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.309+0000 7f1e9be21640 1 -- start start 2024-09-11T23:49:40.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.310+0000 7f1e9be21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 0x7f1e94106870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:40.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.310+0000 7f1e9be21640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1e94106e40 con 0x7f1e94106470 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.310+0000 7f1e99bbd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 0x7f1e94106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.310+0000 7f1e99bbd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 0x7f1e94106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44632/0 (socket says 172.21.15.6:44632) 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.310+0000 7f1e99bbd640 1 -- 172.21.15.6:0/1195350410 learned_addr learned my addr 172.21.15.6:0/1195350410 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.310+0000 7f1e99bbd640 1 -- 172.21.15.6:0/1195350410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e94107670 con 0x7f1e94106470 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.311+0000 7f1e99bbd640 1 --2- 172.21.15.6:0/1195350410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 0x7f1e94106870 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009820 tx=0x7f1e9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b013aeb6781aa60e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.311+0000 7f1e98bbb640 1 -- 172.21.15.6:0/1195350410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e90037070 con 0x7f1e94106470 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.311+0000 7f1e98bbb640 1 -- 172.21.15.6:0/1195350410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f1e900328d0 con 0x7f1e94106470 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.311+0000 7f1e98bbb640 1 -- 172.21.15.6:0/1195350410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e900307d0 con 0x7f1e94106470 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.312+0000 7f1e9be21640 1 -- 172.21.15.6:0/1195350410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 msgr2=0x7f1e94106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.312+0000 7f1e9be21640 1 --2- 172.21.15.6:0/1195350410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 0x7f1e94106870 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009820 tx=0x7f1e9002a270 comp rx=0 tx=0).stop 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.312+0000 7f1e9be21640 1 -- 172.21.15.6:0/1195350410 shutdown_connections 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.312+0000 7f1e9be21640 1 --2- 172.21.15.6:0/1195350410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 0x7f1e94106870 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.312+0000 7f1e9be21640 1 -- 172.21.15.6:0/1195350410 >> 172.21.15.6:0/1195350410 conn(0x7f1e94101c40 msgr2=0x7f1e94104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.312+0000 7f1e9be21640 1 -- 172.21.15.6:0/1195350410 shutdown_connections 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.312+0000 7f1e9be21640 1 -- 172.21.15.6:0/1195350410 wait complete. 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.312+0000 7f1e9be21640 1 Processor -- start 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.313+0000 7f1e9be21640 1 -- start start 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.313+0000 7f1e9be21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 0x7f1e9419b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.313+0000 7f1e9be21640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9410aa20 con 0x7f1e94106470 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.313+0000 7f1e99bbd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 0x7f1e9419b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.313+0000 7f1e99bbd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 0x7f1e9419b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44636/0 (socket says 172.21.15.6:44636) 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.313+0000 7f1e99bbd640 1 -- 172.21.15.6:0/4093079046 learned_addr learned my addr 172.21.15.6:0/4093079046 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.313+0000 7f1e99bbd640 1 -- 172.21.15.6:0/4093079046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9419baf0 con 0x7f1e94106470 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.313+0000 7f1e99bbd640 1 --2- 172.21.15.6:0/4093079046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 0x7f1e9419b5b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1e90030520 tx=0x7f1e90032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.313+0000 7f1e8affd640 1 -- 172.21.15.6:0/4093079046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e90042070 con 0x7f1e94106470 2024-09-11T23:49:40.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.314+0000 7f1e8affd640 1 -- 172.21.15.6:0/4093079046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f1e90030cc0 con 0x7f1e94106470 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.314+0000 7f1e9be21640 1 -- 172.21.15.6:0/4093079046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9419bd80 con 0x7f1e94106470 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.314+0000 7f1e8affd640 1 -- 172.21.15.6:0/4093079046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e90037040 con 0x7f1e94106470 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.314+0000 7f1e9be21640 1 -- 172.21.15.6:0/4093079046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e9419ea70 con 0x7f1e94106470 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.314+0000 7f1e8affd640 1 -- 172.21.15.6:0/4093079046 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f1e90045070 con 0x7f1e94106470 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.315+0000 7f1e9be21640 1 -- 172.21.15.6:0/4093079046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e9410aba0 con 0x7f1e94106470 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.315+0000 7f1e8affd640 1 --2- 172.21.15.6:0/4093079046 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1e80038f70 0x7f1e8003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.315+0000 7f1e8affd640 1 -- 172.21.15.6:0/4093079046 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1e9006bf80 con 0x7f1e94106470 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.315+0000 7f1e993bc640 1 --2- 172.21.15.6:0/4093079046 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1e80038f70 0x7f1e8003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.315+0000 7f1e993bc640 1 --2- 172.21.15.6:0/4093079046 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1e80038f70 0x7f1e8003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e840098c0 tx=0x7f1e84006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.320+0000 7f1e8affd640 1 -- 172.21.15.6:0/4093079046 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e90045360 con 0x7f1e94106470 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.496+0000 7f1e9be21640 1 -- 172.21.15.6:0/4093079046 --> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f1e940008d0 con 0x7f1e80038f70 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.497+0000 7f1e8affd640 1 -- 172.21.15.6:0/4093079046 <== mgr.14118 v2:172.21.15.6:6800/2279576750 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f1e940008d0 con 0x7f1e80038f70 2024-09-11T23:49:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.499+0000 7f1e9be21640 1 -- 172.21.15.6:0/4093079046 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1e80038f70 msgr2=0x7f1e8003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:40.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.499+0000 7f1e9be21640 1 --2- 172.21.15.6:0/4093079046 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1e80038f70 0x7f1e8003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e840098c0 tx=0x7f1e84006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:40.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.499+0000 7f1e9be21640 1 -- 172.21.15.6:0/4093079046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 msgr2=0x7f1e9419b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:40.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.499+0000 7f1e9be21640 1 --2- 172.21.15.6:0/4093079046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 0x7f1e9419b5b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1e90030520 tx=0x7f1e90032dd0 comp rx=0 tx=0).stop 2024-09-11T23:49:40.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.499+0000 7f1e9be21640 1 -- 172.21.15.6:0/4093079046 shutdown_connections 2024-09-11T23:49:40.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.499+0000 7f1e9be21640 1 --2- 172.21.15.6:0/4093079046 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1e80038f70 0x7f1e8003b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:40.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.499+0000 7f1e9be21640 1 --2- 172.21.15.6:0/4093079046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e94106470 0x7f1e9419b5b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:40.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.499+0000 7f1e9be21640 1 -- 172.21.15.6:0/4093079046 >> 172.21.15.6:0/4093079046 conn(0x7f1e94101c40 msgr2=0x7f1e94102b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:40.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.499+0000 7f1e9be21640 1 -- 172.21.15.6:0/4093079046 shutdown_connections 2024-09-11T23:49:40.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:39.499+0000 7f1e9be21640 1 -- 172.21.15.6:0/4093079046 wait complete. 2024-09-11T23:49:40.080 INFO:teuthology.orchestra.run.smithi006.stdout:Generating ssh key... 2024-09-11T23:49:41.100 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-mon[30947]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:49:41.100 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: Generating public/private rsa key pair. 2024-09-11T23:49:41.100 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: Your identification has been saved in /tmp/tmpu1uu_na0/key 2024-09-11T23:49:41.100 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: Your public key has been saved in /tmp/tmpu1uu_na0/key.pub 2024-09-11T23:49:41.100 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: The key fingerprint is: 2024-09-11T23:49:41.100 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: SHA256:wOyRPS05Sl5/WdTfU+fDpzUxD+5pVf9bE3deEa3q2Cw ceph-4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:41.100 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: The key's randomart image is: 2024-09-11T23:49:41.100 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: +---[RSA 3072]----+ 2024-09-11T23:49:41.101 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: | .oo| 2024-09-11T23:49:41.101 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: | o o o ..+*| 2024-09-11T23:49:41.101 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: | B B . .o+%| 2024-09-11T23:49:41.101 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: | + = = oo*&| 2024-09-11T23:49:41.101 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: | + S . oo *@| 2024-09-11T23:49:41.101 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: | .. =.+| 2024-09-11T23:49:41.101 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: | = . +| 2024-09-11T23:49:41.101 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: | E + . | 2024-09-11T23:49:41.101 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: | . | 2024-09-11T23:49:41.101 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: +----[SHA256]-----+ 2024-09-11T23:49:41.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.497+0000 7f5a4db8a640 1 Processor -- start 2024-09-11T23:49:41.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.497+0000 7f5a4db8a640 1 -- start start 2024-09-11T23:49:41.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.498+0000 7f5a4db8a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 0x7f5a481079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:41.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.498+0000 7f5a4db8a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48107f70 con 0x7f5a481075a0 2024-09-11T23:49:41.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.498+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 0x7f5a481079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:41.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.498+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 0x7f5a481079a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56218/0 (socket says 172.21.15.6:56218) 2024-09-11T23:49:41.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.498+0000 7f5a477fe640 1 -- 172.21.15.6:0/3477516613 learned_addr learned my addr 172.21.15.6:0/3477516613 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:41.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.498+0000 7f5a477fe640 1 -- 172.21.15.6:0/3477516613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a481087a0 con 0x7f5a481075a0 2024-09-11T23:49:41.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.499+0000 7f5a477fe640 1 --2- 172.21.15.6:0/3477516613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 0x7f5a481079a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009820 tx=0x7f5a3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3878ba1e1a23e3e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:41.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.499+0000 7f5a467fc640 1 -- 172.21.15.6:0/3477516613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a38037070 con 0x7f5a481075a0 2024-09-11T23:49:41.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.499+0000 7f5a467fc640 1 -- 172.21.15.6:0/3477516613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5a380328d0 con 0x7f5a481075a0 2024-09-11T23:49:41.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.499+0000 7f5a467fc640 1 -- 172.21.15.6:0/3477516613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a380307d0 con 0x7f5a481075a0 2024-09-11T23:49:41.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.500+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3477516613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 msgr2=0x7f5a481079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:41.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.500+0000 7f5a4db8a640 1 --2- 172.21.15.6:0/3477516613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 0x7f5a481079a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009820 tx=0x7f5a3802a270 comp rx=0 tx=0).stop 2024-09-11T23:49:41.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.500+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3477516613 shutdown_connections 2024-09-11T23:49:41.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.500+0000 7f5a4db8a640 1 --2- 172.21.15.6:0/3477516613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 0x7f5a481079a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:41.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.500+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3477516613 >> 172.21.15.6:0/3477516613 conn(0x7f5a48102d50 msgr2=0x7f5a48105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:41.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.500+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3477516613 shutdown_connections 2024-09-11T23:49:41.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.500+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3477516613 wait complete. 2024-09-11T23:49:41.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.500+0000 7f5a4db8a640 1 Processor -- start 2024-09-11T23:49:41.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.501+0000 7f5a4db8a640 1 -- start start 2024-09-11T23:49:41.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.501+0000 7f5a4db8a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 0x7f5a4819b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:41.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.501+0000 7f5a4db8a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4810bb50 con 0x7f5a481075a0 2024-09-11T23:49:41.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.501+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 0x7f5a4819b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:41.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.501+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 0x7f5a4819b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56222/0 (socket says 172.21.15.6:56222) 2024-09-11T23:49:41.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.501+0000 7f5a477fe640 1 -- 172.21.15.6:0/3253885311 learned_addr learned my addr 172.21.15.6:0/3253885311 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:41.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.501+0000 7f5a477fe640 1 -- 172.21.15.6:0/3253885311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4819bab0 con 0x7f5a481075a0 2024-09-11T23:49:41.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.501+0000 7f5a477fe640 1 --2- 172.21.15.6:0/3253885311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 0x7f5a4819b570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5a380097f0 tx=0x7f5a38030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:41.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.502+0000 7f5a44ff9640 1 -- 172.21.15.6:0/3253885311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a38037040 con 0x7f5a481075a0 2024-09-11T23:49:41.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.502+0000 7f5a44ff9640 1 -- 172.21.15.6:0/3253885311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5a38032bb0 con 0x7f5a481075a0 2024-09-11T23:49:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.502+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3253885311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4819bd40 con 0x7f5a481075a0 2024-09-11T23:49:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.502+0000 7f5a44ff9640 1 -- 172.21.15.6:0/3253885311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a3803a390 con 0x7f5a481075a0 2024-09-11T23:49:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.502+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3253885311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4819ea30 con 0x7f5a481075a0 2024-09-11T23:49:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.503+0000 7f5a44ff9640 1 -- 172.21.15.6:0/3253885311 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5a3803b3f0 con 0x7f5a481075a0 2024-09-11T23:49:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.503+0000 7f5a44ff9640 1 --2- 172.21.15.6:0/3253885311 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f5a34038fc0 0x7f5a3403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.503+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3253885311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4810bcd0 con 0x7f5a481075a0 2024-09-11T23:49:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.503+0000 7f5a44ff9640 1 -- 172.21.15.6:0/3253885311 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5a3806c190 con 0x7f5a481075a0 2024-09-11T23:49:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.503+0000 7f5a46ffd640 1 --2- 172.21.15.6:0/3253885311 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f5a34038fc0 0x7f5a3403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.503+0000 7f5a46ffd640 1 --2- 172.21.15.6:0/3253885311 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f5a34038fc0 0x7f5a3403b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5a300098c0 tx=0x7f5a30006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.508+0000 7f5a44ff9640 1 -- 172.21.15.6:0/3253885311 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a380691e0 con 0x7f5a481075a0 2024-09-11T23:49:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.688+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3253885311 --> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f5a48103f90 con 0x7f5a34038fc0 2024-09-11T23:49:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.860+0000 7f5a44ff9640 1 -- 172.21.15.6:0/3253885311 <== mgr.14118 v2:172.21.15.6:6800/2279576750 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5a48103f90 con 0x7f5a34038fc0 2024-09-11T23:49:41.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.862+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3253885311 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f5a34038fc0 msgr2=0x7f5a3403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:41.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.862+0000 7f5a4db8a640 1 --2- 172.21.15.6:0/3253885311 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f5a34038fc0 0x7f5a3403b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5a300098c0 tx=0x7f5a30006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:41.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.862+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3253885311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 msgr2=0x7f5a4819b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:41.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.862+0000 7f5a4db8a640 1 --2- 172.21.15.6:0/3253885311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 0x7f5a4819b570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5a380097f0 tx=0x7f5a38030d00 comp rx=0 tx=0).stop 2024-09-11T23:49:41.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.863+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3253885311 shutdown_connections 2024-09-11T23:49:41.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.863+0000 7f5a4db8a640 1 --2- 172.21.15.6:0/3253885311 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f5a34038fc0 0x7f5a3403b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:41.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.863+0000 7f5a4db8a640 1 --2- 172.21.15.6:0/3253885311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a481075a0 0x7f5a4819b570 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:41.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.863+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3253885311 >> 172.21.15.6:0/3253885311 conn(0x7f5a48102d50 msgr2=0x7f5a48103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:41.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.863+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3253885311 shutdown_connections 2024-09-11T23:49:41.397 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:40.863+0000 7f5a4db8a640 1 -- 172.21.15.6:0/3253885311 wait complete. 2024-09-11T23:49:41.994 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:41 smithi006 ceph-mon[30947]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:49:41.995 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:41 smithi006 ceph-mon[30947]: Generating ssh key... 2024-09-11T23:49:41.995 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:41 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:41.995 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:41 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:42.573 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMKSznTbaj43NO47zZiguxZ9B/YAh3607mdwd++zcKKL3EW8ojpGQj5zBpe3JssknDpbxHAz7S7jWxubMlKSMx8dMakzT3FXJlVXR2H0ePYWeUQPPAofo8AoeO5QoZz03pJ/psnj3iOA/EJEf7ZNtz4KOQcEVc0IFNcp0FDQAt7ZGg8iRHI6qVQoCCdNd5dAOtkrNaYgB+9PdfgZADBwUfpUvQnyaQZfy5VLEaqENuSQYCw3Hl+YBLD3ZsIBhV+C5U3AVRQ24qn8+l7dMo1bynV28LQP7cBLUE9Y9KxBxfXfJOhcjsg13G9sfxRtE846/AnXLnBYA57uavuHKQxDg3saG9Fax2IEV+EFcC0H1e1K1wKn3k5RQSwxkG1Pj1Lb8ey6/gqEUTwRx9Egw5Por2mf7NQYvpmMhU8/mTLO7ssEjtNFdC+iz9Hxr/02RX4eu7FgGp//bOgy6qXbl4l/ZGdJUO8ehRCwQpusO5THy+MxjMKZbs07m1z4gTjdflyAk= ceph-4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:42.573 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.806+0000 7f467de85640 1 Processor -- start 2024-09-11T23:49:42.573 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.806+0000 7f467de85640 1 -- start start 2024-09-11T23:49:42.573 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.806+0000 7f467de85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 0x7f46781068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:42.573 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.806+0000 7f467de85640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4678106ea0 con 0x7f46781064d0 2024-09-11T23:49:42.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.807+0000 7f46777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 0x7f46781068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:42.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.807+0000 7f46777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 0x7f46781068d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56230/0 (socket says 172.21.15.6:56230) 2024-09-11T23:49:42.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.807+0000 7f46777fe640 1 -- 172.21.15.6:0/4183548496 learned_addr learned my addr 172.21.15.6:0/4183548496 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:42.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.807+0000 7f46777fe640 1 -- 172.21.15.6:0/4183548496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46781076d0 con 0x7f46781064d0 2024-09-11T23:49:42.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.808+0000 7f46777fe640 1 --2- 172.21.15.6:0/4183548496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 0x7f46781068d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4668009820 tx=0x7f466802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c54cafa14640cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:42.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.808+0000 7f46767fc640 1 -- 172.21.15.6:0/4183548496 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4668037070 con 0x7f46781064d0 2024-09-11T23:49:42.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.808+0000 7f46767fc640 1 -- 172.21.15.6:0/4183548496 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f46680328d0 con 0x7f46781064d0 2024-09-11T23:49:42.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.808+0000 7f46767fc640 1 -- 172.21.15.6:0/4183548496 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46680307d0 con 0x7f46781064d0 2024-09-11T23:49:42.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.808+0000 7f467de85640 1 -- 172.21.15.6:0/4183548496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 msgr2=0x7f46781068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:42.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.808+0000 7f467de85640 1 --2- 172.21.15.6:0/4183548496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 0x7f46781068d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4668009820 tx=0x7f466802a270 comp rx=0 tx=0).stop 2024-09-11T23:49:42.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.809+0000 7f467de85640 1 -- 172.21.15.6:0/4183548496 shutdown_connections 2024-09-11T23:49:42.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.809+0000 7f467de85640 1 --2- 172.21.15.6:0/4183548496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 0x7f46781068d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:42.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.809+0000 7f467de85640 1 -- 172.21.15.6:0/4183548496 >> 172.21.15.6:0/4183548496 conn(0x7f4678101ca0 msgr2=0x7f46781040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:42.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.809+0000 7f467de85640 1 -- 172.21.15.6:0/4183548496 shutdown_connections 2024-09-11T23:49:42.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.809+0000 7f467de85640 1 -- 172.21.15.6:0/4183548496 wait complete. 2024-09-11T23:49:42.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.809+0000 7f467de85640 1 Processor -- start 2024-09-11T23:49:42.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.810+0000 7f467de85640 1 -- start start 2024-09-11T23:49:42.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.810+0000 7f467de85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 0x7f467819b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:42.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.810+0000 7f467de85640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f467810aa80 con 0x7f46781064d0 2024-09-11T23:49:42.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.810+0000 7f46777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 0x7f467819b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:42.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.810+0000 7f46777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 0x7f467819b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56234/0 (socket says 172.21.15.6:56234) 2024-09-11T23:49:42.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.810+0000 7f46777fe640 1 -- 172.21.15.6:0/2467333131 learned_addr learned my addr 172.21.15.6:0/2467333131 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:42.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.810+0000 7f46777fe640 1 -- 172.21.15.6:0/2467333131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467819bad0 con 0x7f46781064d0 2024-09-11T23:49:42.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.810+0000 7f46777fe640 1 --2- 172.21.15.6:0/2467333131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 0x7f467819b590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f46680097f0 tx=0x7f4668030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:42.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.811+0000 7f4674ff9640 1 -- 172.21.15.6:0/2467333131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4668037040 con 0x7f46781064d0 2024-09-11T23:49:42.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.811+0000 7f4674ff9640 1 -- 172.21.15.6:0/2467333131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4668032bb0 con 0x7f46781064d0 2024-09-11T23:49:42.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.811+0000 7f467de85640 1 -- 172.21.15.6:0/2467333131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467819bd60 con 0x7f46781064d0 2024-09-11T23:49:42.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.811+0000 7f4674ff9640 1 -- 172.21.15.6:0/2467333131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f466803a390 con 0x7f46781064d0 2024-09-11T23:49:42.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.811+0000 7f467de85640 1 -- 172.21.15.6:0/2467333131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467819ea50 con 0x7f46781064d0 2024-09-11T23:49:42.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.812+0000 7f4674ff9640 1 -- 172.21.15.6:0/2467333131 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f466803a5d0 con 0x7f46781064d0 2024-09-11T23:49:42.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.812+0000 7f467de85640 1 -- 172.21.15.6:0/2467333131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467810ac00 con 0x7f46781064d0 2024-09-11T23:49:42.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.812+0000 7f4674ff9640 1 --2- 172.21.15.6:0/2467333131 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f4660038f70 0x7f466003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:42.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.812+0000 7f4674ff9640 1 -- 172.21.15.6:0/2467333131 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f466806c470 con 0x7f46781064d0 2024-09-11T23:49:42.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.812+0000 7f4676ffd640 1 --2- 172.21.15.6:0/2467333131 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f4660038f70 0x7f466003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:42.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.812+0000 7f4676ffd640 1 --2- 172.21.15.6:0/2467333131 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f4660038f70 0x7f466003b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f466c0098c0 tx=0x7f466c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:42.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.817+0000 7f4674ff9640 1 -- 172.21.15.6:0/2467333131 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4668040210 con 0x7f46781064d0 2024-09-11T23:49:42.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.994+0000 7f467de85640 1 -- 172.21.15.6:0/2467333131 --> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f46780008d0 con 0x7f4660038f70 2024-09-11T23:49:42.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.995+0000 7f4674ff9640 1 -- 172.21.15.6:0/2467333131 <== mgr.14118 v2:172.21.15.6:6800/2279576750 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f46780008d0 con 0x7f4660038f70 2024-09-11T23:49:42.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.997+0000 7f467de85640 1 -- 172.21.15.6:0/2467333131 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f4660038f70 msgr2=0x7f466003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:42.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.997+0000 7f467de85640 1 --2- 172.21.15.6:0/2467333131 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f4660038f70 0x7f466003b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f466c0098c0 tx=0x7f466c006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:42.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.997+0000 7f467de85640 1 -- 172.21.15.6:0/2467333131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 msgr2=0x7f467819b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:42.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.997+0000 7f467de85640 1 --2- 172.21.15.6:0/2467333131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 0x7f467819b590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f46680097f0 tx=0x7f4668030d00 comp rx=0 tx=0).stop 2024-09-11T23:49:42.578 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.997+0000 7f467de85640 1 -- 172.21.15.6:0/2467333131 shutdown_connections 2024-09-11T23:49:42.578 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.997+0000 7f467de85640 1 --2- 172.21.15.6:0/2467333131 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f4660038f70 0x7f466003b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:42.578 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.997+0000 7f467de85640 1 --2- 172.21.15.6:0/2467333131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46781064d0 0x7f467819b590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:42.578 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.997+0000 7f467de85640 1 -- 172.21.15.6:0/2467333131 >> 172.21.15.6:0/2467333131 conn(0x7f4678101ca0 msgr2=0x7f4678102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:42.578 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.998+0000 7f467de85640 1 -- 172.21.15.6:0/2467333131 shutdown_connections 2024-09-11T23:49:42.578 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:41.998+0000 7f467de85640 1 -- 172.21.15.6:0/2467333131 wait complete. 2024-09-11T23:49:42.578 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-11T23:49:42.578 INFO:teuthology.orchestra.run.smithi006.stdout:Adding key to root@localhost authorized_keys... 2024-09-11T23:49:42.579 INFO:teuthology.orchestra.run.smithi006.stdout:Adding host smithi006... 2024-09-11T23:49:43.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:42 smithi006 ceph-mon[30947]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:49:44.505 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:44 smithi006 ceph-mon[30947]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi006", "addr": "172.21.15.6", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:49:45.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:45 smithi006 ceph-mon[30947]: Deploying cephadm binary to smithi006 2024-09-11T23:49:47.647 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Added host 'smithi006' with addr '172.21.15.6' 2024-09-11T23:49:47.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.977+0000 7fd5d63cf640 1 Processor -- start 2024-09-11T23:49:47.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.977+0000 7fd5d63cf640 1 -- start start 2024-09-11T23:49:47.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.977+0000 7fd5d63cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 0x7fd5d01079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:47.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.977+0000 7fd5d63cf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d0107f90 con 0x7fd5d01075c0 2024-09-11T23:49:47.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.977+0000 7fd5cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 0x7fd5d01079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:47.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.977+0000 7fd5cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 0x7fd5d01079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56248/0 (socket says 172.21.15.6:56248) 2024-09-11T23:49:47.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.977+0000 7fd5cffff640 1 -- 172.21.15.6:0/3738436360 learned_addr learned my addr 172.21.15.6:0/3738436360 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:47.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.977+0000 7fd5cffff640 1 -- 172.21.15.6:0/3738436360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d01087c0 con 0x7fd5d01075c0 2024-09-11T23:49:47.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.978+0000 7fd5cffff640 1 --2- 172.21.15.6:0/3738436360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 0x7fd5d01079c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009820 tx=0x7fd5c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ef5eac32a71260 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:47.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.978+0000 7fd5ceffd640 1 -- 172.21.15.6:0/3738436360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5c0037070 con 0x7fd5d01075c0 2024-09-11T23:49:47.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.978+0000 7fd5ceffd640 1 -- 172.21.15.6:0/3738436360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd5c00328d0 con 0x7fd5d01075c0 2024-09-11T23:49:47.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.978+0000 7fd5ceffd640 1 -- 172.21.15.6:0/3738436360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5c00307d0 con 0x7fd5d01075c0 2024-09-11T23:49:47.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.979+0000 7fd5d63cf640 1 -- 172.21.15.6:0/3738436360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 msgr2=0x7fd5d01079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:47.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.979+0000 7fd5d63cf640 1 --2- 172.21.15.6:0/3738436360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 0x7fd5d01079c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009820 tx=0x7fd5c002a270 comp rx=0 tx=0).stop 2024-09-11T23:49:47.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.979+0000 7fd5d63cf640 1 -- 172.21.15.6:0/3738436360 shutdown_connections 2024-09-11T23:49:47.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.979+0000 7fd5d63cf640 1 --2- 172.21.15.6:0/3738436360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 0x7fd5d01079c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:47.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.979+0000 7fd5d63cf640 1 -- 172.21.15.6:0/3738436360 >> 172.21.15.6:0/3738436360 conn(0x7fd5d0102dd0 msgr2=0x7fd5d01051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:47.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.979+0000 7fd5d63cf640 1 -- 172.21.15.6:0/3738436360 shutdown_connections 2024-09-11T23:49:47.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.979+0000 7fd5d63cf640 1 -- 172.21.15.6:0/3738436360 wait complete. 2024-09-11T23:49:47.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.980+0000 7fd5d63cf640 1 Processor -- start 2024-09-11T23:49:47.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.980+0000 7fd5d63cf640 1 -- start start 2024-09-11T23:49:47.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.980+0000 7fd5d63cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 0x7fd5d019b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:47.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.980+0000 7fd5d63cf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d010bb70 con 0x7fd5d01075c0 2024-09-11T23:49:47.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.980+0000 7fd5cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 0x7fd5d019b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.980+0000 7fd5cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 0x7fd5d019b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56252/0 (socket says 172.21.15.6:56252) 2024-09-11T23:49:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.980+0000 7fd5cffff640 1 -- 172.21.15.6:0/2606491255 learned_addr learned my addr 172.21.15.6:0/2606491255 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.980+0000 7fd5cffff640 1 -- 172.21.15.6:0/2606491255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d019bac0 con 0x7fd5d01075c0 2024-09-11T23:49:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.981+0000 7fd5cffff640 1 --2- 172.21.15.6:0/2606491255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 0x7fd5d019b580 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009940 tx=0x7fd5c0032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.981+0000 7fd5cd7fa640 1 -- 172.21.15.6:0/2606491255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5c0042070 con 0x7fd5d01075c0 2024-09-11T23:49:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.981+0000 7fd5cd7fa640 1 -- 172.21.15.6:0/2606491255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd5c0030c80 con 0x7fd5d01075c0 2024-09-11T23:49:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.981+0000 7fd5d63cf640 1 -- 172.21.15.6:0/2606491255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d019bd50 con 0x7fd5d01075c0 2024-09-11T23:49:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.981+0000 7fd5cd7fa640 1 -- 172.21.15.6:0/2606491255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5c0037040 con 0x7fd5d01075c0 2024-09-11T23:49:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.981+0000 7fd5d63cf640 1 -- 172.21.15.6:0/2606491255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d019ea40 con 0x7fd5d01075c0 2024-09-11T23:49:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.982+0000 7fd5cd7fa640 1 -- 172.21.15.6:0/2606491255 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd5c0045070 con 0x7fd5d01075c0 2024-09-11T23:49:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.982+0000 7fd5cd7fa640 1 --2- 172.21.15.6:0/2606491255 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd5b8038fc0 0x7fd5b803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.982+0000 7fd5cd7fa640 1 -- 172.21.15.6:0/2606491255 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd5c006beb0 con 0x7fd5d01075c0 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.982+0000 7fd5cf7fe640 1 --2- 172.21.15.6:0/2606491255 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd5b8038fc0 0x7fd5b803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.982+0000 7fd5d63cf640 1 -- 172.21.15.6:0/2606491255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d010bcf0 con 0x7fd5d01075c0 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.982+0000 7fd5cf7fe640 1 --2- 172.21.15.6:0/2606491255 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd5b8038fc0 0x7fd5b803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40098c0 tx=0x7fd5c4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:42.987+0000 7fd5cd7fa640 1 -- 172.21.15.6:0/2606491255 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5c0045360 con 0x7fd5d01075c0 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:43.166+0000 7fd5d63cf640 1 -- 172.21.15.6:0/2606491255 --> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi006", "addr": "172.21.15.6", "target": ["mon-mgr", ""]}) -- 0x7fd5d0103fd0 con 0x7fd5b8038fc0 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:47.054+0000 7fd5cd7fa640 1 -- 172.21.15.6:0/2606491255 <== mgr.14118 v2:172.21.15.6:6800/2279576750 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fd5d0103fd0 con 0x7fd5b8038fc0 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:47.057+0000 7fd5d63cf640 1 -- 172.21.15.6:0/2606491255 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd5b8038fc0 msgr2=0x7fd5b803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:47.057+0000 7fd5d63cf640 1 --2- 172.21.15.6:0/2606491255 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd5b8038fc0 0x7fd5b803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40098c0 tx=0x7fd5c4006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:47.057+0000 7fd5d63cf640 1 -- 172.21.15.6:0/2606491255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 msgr2=0x7fd5d019b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:47.057+0000 7fd5d63cf640 1 --2- 172.21.15.6:0/2606491255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 0x7fd5d019b580 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009940 tx=0x7fd5c0032e10 comp rx=0 tx=0).stop 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:47.057+0000 7fd5d63cf640 1 -- 172.21.15.6:0/2606491255 shutdown_connections 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:47.057+0000 7fd5d63cf640 1 --2- 172.21.15.6:0/2606491255 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd5b8038fc0 0x7fd5b803b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:47.057+0000 7fd5d63cf640 1 --2- 172.21.15.6:0/2606491255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5d01075c0 0x7fd5d019b580 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:47.652 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:47.057+0000 7fd5d63cf640 1 -- 172.21.15.6:0/2606491255 >> 172.21.15.6:0/2606491255 conn(0x7fd5d0102dd0 msgr2=0x7fd5d01038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:47.652 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:47.057+0000 7fd5d63cf640 1 -- 172.21.15.6:0/2606491255 shutdown_connections 2024-09-11T23:49:47.652 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:47.057+0000 7fd5d63cf640 1 -- 172.21.15.6:0/2606491255 wait complete. 2024-09-11T23:49:47.652 INFO:teuthology.orchestra.run.smithi006.stdout:Deploying unmanaged mon service... 2024-09-11T23:49:48.214 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:48 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:48.214 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:48 smithi006 ceph-mon[30947]: Added host smithi006 2024-09-11T23:49:48.214 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:48 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:49:48.969 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-11T23:49:48.969 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.013+0000 7fcb9a8e5640 1 Processor -- start 2024-09-11T23:49:48.969 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.013+0000 7fcb9a8e5640 1 -- start start 2024-09-11T23:49:48.969 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.013+0000 7fcb9a8e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 0x7fcb94106250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:48.969 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.013+0000 7fcb9a8e5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcb94075a00 con 0x7fcb94105e50 2024-09-11T23:49:48.969 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.013+0000 7fcb93fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 0x7fcb94106250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:48.969 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.013+0000 7fcb93fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 0x7fcb94106250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56262/0 (socket says 172.21.15.6:56262) 2024-09-11T23:49:48.969 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.013+0000 7fcb93fff640 1 -- 172.21.15.6:0/3882516173 learned_addr learned my addr 172.21.15.6:0/3882516173 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:48.969 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.014+0000 7fcb93fff640 1 -- 172.21.15.6:0/3882516173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb94106790 con 0x7fcb94105e50 2024-09-11T23:49:48.969 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.014+0000 7fcb93fff640 1 --2- 172.21.15.6:0/3882516173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 0x7fcb94106250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009820 tx=0x7fcb8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe67baa29eb74f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:48.969 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.015+0000 7fcb92ffd640 1 -- 172.21.15.6:0/3882516173 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb84037070 con 0x7fcb94105e50 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.015+0000 7fcb92ffd640 1 -- 172.21.15.6:0/3882516173 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fcb840328d0 con 0x7fcb94105e50 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.015+0000 7fcb92ffd640 1 -- 172.21.15.6:0/3882516173 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb840307d0 con 0x7fcb94105e50 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.015+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3882516173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 msgr2=0x7fcb94106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.015+0000 7fcb9a8e5640 1 --2- 172.21.15.6:0/3882516173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 0x7fcb94106250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009820 tx=0x7fcb8402a270 comp rx=0 tx=0).stop 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.015+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3882516173 shutdown_connections 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.015+0000 7fcb9a8e5640 1 --2- 172.21.15.6:0/3882516173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 0x7fcb94106250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.015+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3882516173 >> 172.21.15.6:0/3882516173 conn(0x7fcb94101c40 msgr2=0x7fcb94104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.015+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3882516173 shutdown_connections 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.015+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3882516173 wait complete. 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.016+0000 7fcb9a8e5640 1 Processor -- start 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.016+0000 7fcb9a8e5640 1 -- start start 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.016+0000 7fcb9a8e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 0x7fcb9419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.016+0000 7fcb9a8e5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcb94107830 con 0x7fcb94105e50 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.016+0000 7fcb93fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 0x7fcb9419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.016+0000 7fcb93fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 0x7fcb9419d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56276/0 (socket says 172.21.15.6:56276) 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.016+0000 7fcb93fff640 1 -- 172.21.15.6:0/3731053575 learned_addr learned my addr 172.21.15.6:0/3731053575 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.017+0000 7fcb93fff640 1 -- 172.21.15.6:0/3731053575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9419dc80 con 0x7fcb94105e50 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.017+0000 7fcb93fff640 1 --2- 172.21.15.6:0/3731053575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 0x7fcb9419d740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcb84030520 tx=0x7fcb84032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.017+0000 7fcb917fa640 1 -- 172.21.15.6:0/3731053575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb84042070 con 0x7fcb94105e50 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.017+0000 7fcb917fa640 1 -- 172.21.15.6:0/3731053575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fcb84030cc0 con 0x7fcb94105e50 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.017+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3731053575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb9419df10 con 0x7fcb94105e50 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.017+0000 7fcb917fa640 1 -- 172.21.15.6:0/3731053575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb84037040 con 0x7fcb94105e50 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.017+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3731053575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb941a0c00 con 0x7fcb94105e50 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.018+0000 7fcb917fa640 1 -- 172.21.15.6:0/3731053575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fcb84045070 con 0x7fcb94105e50 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.018+0000 7fcb917fa640 1 --2- 172.21.15.6:0/3731053575 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fcb7c038fc0 0x7fcb7c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.018+0000 7fcb917fa640 1 -- 172.21.15.6:0/3731053575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcb8406bf40 con 0x7fcb94105e50 2024-09-11T23:49:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.018+0000 7fcb937fe640 1 --2- 172.21.15.6:0/3731053575 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fcb7c038fc0 0x7fcb7c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:48.972 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.019+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3731053575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb94106250 con 0x7fcb94105e50 2024-09-11T23:49:48.972 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.019+0000 7fcb937fe640 1 --2- 172.21.15.6:0/3731053575 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fcb7c038fc0 0x7fcb7c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcb880098c0 tx=0x7fcb88006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:48.972 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.024+0000 7fcb917fa640 1 -- 172.21.15.6:0/3731053575 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb84046e00 con 0x7fcb94105e50 2024-09-11T23:49:48.972 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.213+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3731053575 --> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fcb9402d900 con 0x7fcb7c038fc0 2024-09-11T23:49:48.972 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.218+0000 7fcb917fa640 1 -- 172.21.15.6:0/3731053575 <== mgr.14118 v2:172.21.15.6:6800/2279576750 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fcb9402d900 con 0x7fcb7c038fc0 2024-09-11T23:49:48.972 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.220+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3731053575 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fcb7c038fc0 msgr2=0x7fcb7c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:48.972 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.220+0000 7fcb9a8e5640 1 --2- 172.21.15.6:0/3731053575 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fcb7c038fc0 0x7fcb7c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcb880098c0 tx=0x7fcb88006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:48.972 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.220+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3731053575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 msgr2=0x7fcb9419d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:48.973 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.220+0000 7fcb9a8e5640 1 --2- 172.21.15.6:0/3731053575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 0x7fcb9419d740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcb84030520 tx=0x7fcb84032dd0 comp rx=0 tx=0).stop 2024-09-11T23:49:48.973 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.220+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3731053575 shutdown_connections 2024-09-11T23:49:48.973 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.220+0000 7fcb9a8e5640 1 --2- 172.21.15.6:0/3731053575 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fcb7c038fc0 0x7fcb7c03b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:48.973 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.220+0000 7fcb9a8e5640 1 --2- 172.21.15.6:0/3731053575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb94105e50 0x7fcb9419d740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:48.973 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.220+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3731053575 >> 172.21.15.6:0/3731053575 conn(0x7fcb94101c40 msgr2=0x7fcb941943a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:48.973 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.221+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3731053575 shutdown_connections 2024-09-11T23:49:48.973 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:48.221+0000 7fcb9a8e5640 1 -- 172.21.15.6:0/3731053575 wait complete. 2024-09-11T23:49:48.973 INFO:teuthology.orchestra.run.smithi006.stdout:Deploying unmanaged mgr service... 2024-09-11T23:49:49.611 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:49 smithi006 ceph-mon[30947]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:49:49.611 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:49 smithi006 ceph-mon[30947]: Saving service mon spec with placement count:5 2024-09-11T23:49:49.611 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:49 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:50.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:50 smithi006 ceph-mon[30947]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:49:50.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:50 smithi006 ceph-mon[30947]: Saving service mgr spec with placement count:2 2024-09-11T23:49:50.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:50 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:51.228 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-11T23:49:51.228 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.428+0000 7f199257a640 1 Processor -- start 2024-09-11T23:49:51.228 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.428+0000 7f199257a640 1 -- start start 2024-09-11T23:49:51.228 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.428+0000 7f199257a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 0x7f198c1079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:51.228 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.428+0000 7f199257a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f198c107f90 con 0x7f198c1075c0 2024-09-11T23:49:51.228 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.429+0000 7f198bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 0x7f198c1079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:51.228 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.429+0000 7f198bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 0x7f198c1079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56292/0 (socket says 172.21.15.6:56292) 2024-09-11T23:49:51.228 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.429+0000 7f198bfff640 1 -- 172.21.15.6:0/2807789831 learned_addr learned my addr 172.21.15.6:0/2807789831 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:51.228 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.429+0000 7f198bfff640 1 -- 172.21.15.6:0/2807789831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198c1087c0 con 0x7f198c1075c0 2024-09-11T23:49:51.228 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.430+0000 7f198bfff640 1 --2- 172.21.15.6:0/2807789831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 0x7f198c1079c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f197c009820 tx=0x7f197c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7dc2b08afbefa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.430+0000 7f198affd640 1 -- 172.21.15.6:0/2807789831 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f197c037070 con 0x7f198c1075c0 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.430+0000 7f198affd640 1 -- 172.21.15.6:0/2807789831 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f197c0328d0 con 0x7f198c1075c0 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.430+0000 7f198affd640 1 -- 172.21.15.6:0/2807789831 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f197c0307d0 con 0x7f198c1075c0 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.430+0000 7f199257a640 1 -- 172.21.15.6:0/2807789831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 msgr2=0x7f198c1079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.430+0000 7f199257a640 1 --2- 172.21.15.6:0/2807789831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 0x7f198c1079c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f197c009820 tx=0x7f197c02a270 comp rx=0 tx=0).stop 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.431+0000 7f199257a640 1 -- 172.21.15.6:0/2807789831 shutdown_connections 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.431+0000 7f199257a640 1 --2- 172.21.15.6:0/2807789831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 0x7f198c1079c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.431+0000 7f199257a640 1 -- 172.21.15.6:0/2807789831 >> 172.21.15.6:0/2807789831 conn(0x7f198c102dd0 msgr2=0x7f198c1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.431+0000 7f199257a640 1 -- 172.21.15.6:0/2807789831 shutdown_connections 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.431+0000 7f199257a640 1 -- 172.21.15.6:0/2807789831 wait complete. 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.431+0000 7f199257a640 1 Processor -- start 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.431+0000 7f199257a640 1 -- start start 2024-09-11T23:49:51.229 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.431+0000 7f199257a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 0x7f198c19b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.431+0000 7f199257a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f198c10bb70 con 0x7f198c1075c0 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.432+0000 7f198bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 0x7f198c19b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.432+0000 7f198bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 0x7f198c19b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56300/0 (socket says 172.21.15.6:56300) 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.432+0000 7f198bfff640 1 -- 172.21.15.6:0/1378420211 learned_addr learned my addr 172.21.15.6:0/1378420211 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.432+0000 7f198bfff640 1 -- 172.21.15.6:0/1378420211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198c19bac0 con 0x7f198c1075c0 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.432+0000 7f198bfff640 1 --2- 172.21.15.6:0/1378420211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 0x7f198c19b580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f197c009940 tx=0x7f197c032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.432+0000 7f19897fa640 1 -- 172.21.15.6:0/1378420211 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f197c042070 con 0x7f198c1075c0 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.432+0000 7f199257a640 1 -- 172.21.15.6:0/1378420211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f198c19bd50 con 0x7f198c1075c0 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.432+0000 7f19897fa640 1 -- 172.21.15.6:0/1378420211 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f197c030c80 con 0x7f198c1075c0 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.432+0000 7f19897fa640 1 -- 172.21.15.6:0/1378420211 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f197c037040 con 0x7f198c1075c0 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.432+0000 7f199257a640 1 -- 172.21.15.6:0/1378420211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f198c19ea40 con 0x7f198c1075c0 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.433+0000 7f19897fa640 1 -- 172.21.15.6:0/1378420211 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f197c045070 con 0x7f198c1075c0 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.433+0000 7f19897fa640 1 --2- 172.21.15.6:0/1378420211 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1974038f70 0x7f197403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:51.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.433+0000 7f199257a640 1 -- 172.21.15.6:0/1378420211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f198c10bcf0 con 0x7f198c1075c0 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.433+0000 7f19897fa640 1 -- 172.21.15.6:0/1378420211 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f197c06bff0 con 0x7f198c1075c0 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.434+0000 7f198b7fe640 1 --2- 172.21.15.6:0/1378420211 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1974038f70 0x7f197403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.434+0000 7f198b7fe640 1 --2- 172.21.15.6:0/1378420211 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1974038f70 0x7f197403b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f19800098c0 tx=0x7f1980006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.438+0000 7f19897fa640 1 -- 172.21.15.6:0/1378420211 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f197c045360 con 0x7f198c1075c0 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.627+0000 7f199257a640 1 -- 172.21.15.6:0/1378420211 --> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f198c104010 con 0x7f1974038f70 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.633+0000 7f19897fa640 1 -- 172.21.15.6:0/1378420211 <== mgr.14118 v2:172.21.15.6:6800/2279576750 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f198c104010 con 0x7f1974038f70 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.636+0000 7f199257a640 1 -- 172.21.15.6:0/1378420211 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1974038f70 msgr2=0x7f197403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.636+0000 7f199257a640 1 --2- 172.21.15.6:0/1378420211 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1974038f70 0x7f197403b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f19800098c0 tx=0x7f1980006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.636+0000 7f199257a640 1 -- 172.21.15.6:0/1378420211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 msgr2=0x7f198c19b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.636+0000 7f199257a640 1 --2- 172.21.15.6:0/1378420211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 0x7f198c19b580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f197c009940 tx=0x7f197c032e10 comp rx=0 tx=0).stop 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.636+0000 7f199257a640 1 -- 172.21.15.6:0/1378420211 shutdown_connections 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.636+0000 7f199257a640 1 --2- 172.21.15.6:0/1378420211 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1974038f70 0x7f197403b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.636+0000 7f199257a640 1 --2- 172.21.15.6:0/1378420211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c1075c0 0x7f198c19b580 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:51.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.636+0000 7f199257a640 1 -- 172.21.15.6:0/1378420211 >> 172.21.15.6:0/1378420211 conn(0x7f198c102dd0 msgr2=0x7f198c103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:51.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.636+0000 7f199257a640 1 -- 172.21.15.6:0/1378420211 shutdown_connections 2024-09-11T23:49:51.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:49.636+0000 7f199257a640 1 -- 172.21.15.6:0/1378420211 wait complete. 2024-09-11T23:49:52.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:51 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:52.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:51 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:52.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:51 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1478081206' entity='client.admin' 2024-09-11T23:49:52.435 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.590+0000 7f565ac20640 1 Processor -- start 2024-09-11T23:49:52.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.590+0000 7f565ac20640 1 -- start start 2024-09-11T23:49:52.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.590+0000 7f565ac20640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 0x7f565407c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:52.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.590+0000 7f565ac20640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f565407c880 con 0x7f565407de50 2024-09-11T23:49:52.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.590+0000 7f56589bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 0x7f565407c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:52.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.590+0000 7f56589bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 0x7f565407c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41508/0 (socket says 172.21.15.6:41508) 2024-09-11T23:49:52.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.590+0000 7f56589bc640 1 -- 172.21.15.6:0/1991026754 learned_addr learned my addr 172.21.15.6:0/1991026754 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:52.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.590+0000 7f56589bc640 1 -- 172.21.15.6:0/1991026754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565407ca00 con 0x7f565407de50 2024-09-11T23:49:52.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.591+0000 7f56589bc640 1 --2- 172.21.15.6:0/1991026754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 0x7f565407c2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5648009820 tx=0x7f564802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c07f166cad4f22f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:52.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.591+0000 7f56537fe640 1 -- 172.21.15.6:0/1991026754 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5648037070 con 0x7f565407de50 2024-09-11T23:49:52.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.591+0000 7f56537fe640 1 -- 172.21.15.6:0/1991026754 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56480328f0 con 0x7f565407de50 2024-09-11T23:49:52.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.591+0000 7f56537fe640 1 -- 172.21.15.6:0/1991026754 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5648030740 con 0x7f565407de50 2024-09-11T23:49:52.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.592+0000 7f565ac20640 1 -- 172.21.15.6:0/1991026754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 msgr2=0x7f565407c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:52.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.592+0000 7f565ac20640 1 --2- 172.21.15.6:0/1991026754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 0x7f565407c2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5648009820 tx=0x7f564802a270 comp rx=0 tx=0).stop 2024-09-11T23:49:52.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.592+0000 7f565ac20640 1 -- 172.21.15.6:0/1991026754 shutdown_connections 2024-09-11T23:49:52.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.592+0000 7f565ac20640 1 --2- 172.21.15.6:0/1991026754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 0x7f565407c2b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:52.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.592+0000 7f565ac20640 1 -- 172.21.15.6:0/1991026754 >> 172.21.15.6:0/1991026754 conn(0x7f5654102dd0 msgr2=0x7f56541051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:52.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.592+0000 7f565ac20640 1 -- 172.21.15.6:0/1991026754 shutdown_connections 2024-09-11T23:49:52.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.592+0000 7f565ac20640 1 -- 172.21.15.6:0/1991026754 wait complete. 2024-09-11T23:49:52.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.592+0000 7f565ac20640 1 Processor -- start 2024-09-11T23:49:52.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.592+0000 7f565ac20640 1 -- start start 2024-09-11T23:49:52.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.593+0000 7f565ac20640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 0x7f565419d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.593+0000 7f565ac20640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f565410dbf0 con 0x7f565407de50 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.593+0000 7f56589bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 0x7f565419d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.593+0000 7f56589bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 0x7f565419d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41512/0 (socket says 172.21.15.6:41512) 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.593+0000 7f56589bc640 1 -- 172.21.15.6:0/1478081206 learned_addr learned my addr 172.21.15.6:0/1478081206 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.593+0000 7f56589bc640 1 -- 172.21.15.6:0/1478081206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565419dcc0 con 0x7f565407de50 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.593+0000 7f56589bc640 1 --2- 172.21.15.6:0/1478081206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 0x7f565419d780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5648030cc0 tx=0x7f5648030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.593+0000 7f5651ffb640 1 -- 172.21.15.6:0/1478081206 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5648042070 con 0x7f565407de50 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.593+0000 7f5651ffb640 1 -- 172.21.15.6:0/1478081206 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5648030e60 con 0x7f565407de50 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.593+0000 7f565ac20640 1 -- 172.21.15.6:0/1478081206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f565419df50 con 0x7f565407de50 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.593+0000 7f5651ffb640 1 -- 172.21.15.6:0/1478081206 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5648037040 con 0x7f565407de50 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.594+0000 7f565ac20640 1 -- 172.21.15.6:0/1478081206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56541a0c40 con 0x7f565407de50 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.594+0000 7f5651ffb640 1 -- 172.21.15.6:0/1478081206 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5648045070 con 0x7f565407de50 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.595+0000 7f565ac20640 1 -- 172.21.15.6:0/1478081206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f565407c330 con 0x7f565407de50 2024-09-11T23:49:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.595+0000 7f5651ffb640 1 --2- 172.21.15.6:0/1478081206 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f5644038f70 0x7f564403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.595+0000 7f5651ffb640 1 -- 172.21.15.6:0/1478081206 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f564806c040 con 0x7f565407de50 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.595+0000 7f5653fff640 1 --2- 172.21.15.6:0/1478081206 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f5644038f70 0x7f564403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.595+0000 7f5653fff640 1 --2- 172.21.15.6:0/1478081206 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f5644038f70 0x7f564403b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f56400098c0 tx=0x7f5640006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.599+0000 7f5651ffb640 1 -- 172.21.15.6:0/1478081206 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f564804b170 con 0x7f565407de50 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.776+0000 7f565ac20640 1 -- 172.21.15.6:0/1478081206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f56541a1240 con 0x7f565407de50 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.781+0000 7f5651ffb640 1 -- 172.21.15.6:0/1478081206 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f564802fd90 con 0x7f565407de50 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.783+0000 7f565ac20640 1 -- 172.21.15.6:0/1478081206 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f5644038f70 msgr2=0x7f564403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.783+0000 7f565ac20640 1 --2- 172.21.15.6:0/1478081206 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f5644038f70 0x7f564403b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f56400098c0 tx=0x7f5640006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.783+0000 7f565ac20640 1 -- 172.21.15.6:0/1478081206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 msgr2=0x7f565419d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.783+0000 7f565ac20640 1 --2- 172.21.15.6:0/1478081206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 0x7f565419d780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5648030cc0 tx=0x7f5648030cf0 comp rx=0 tx=0).stop 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.783+0000 7f565ac20640 1 -- 172.21.15.6:0/1478081206 shutdown_connections 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.783+0000 7f565ac20640 1 --2- 172.21.15.6:0/1478081206 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f5644038f70 0x7f564403b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.783+0000 7f565ac20640 1 --2- 172.21.15.6:0/1478081206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565407de50 0x7f565419d780 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.783+0000 7f565ac20640 1 -- 172.21.15.6:0/1478081206 >> 172.21.15.6:0/1478081206 conn(0x7f5654102dd0 msgr2=0x7f5654103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:52.440 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.783+0000 7f565ac20640 1 -- 172.21.15.6:0/1478081206 shutdown_connections 2024-09-11T23:49:52.440 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:51.783+0000 7f565ac20640 1 -- 172.21.15.6:0/1478081206 wait complete. 2024-09-11T23:49:54.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:54 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1591075244' entity='client.admin' 2024-09-11T23:49:54.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:54 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:54.238 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.830+0000 7fa25bd0e640 1 Processor -- start 2024-09-11T23:49:54.239 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.830+0000 7fa25bd0e640 1 -- start start 2024-09-11T23:49:54.239 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.831+0000 7fa25bd0e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 0x7fa2541079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:54.239 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.831+0000 7fa25bd0e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa254107f90 con 0x7fa2541075c0 2024-09-11T23:49:54.239 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.831+0000 7fa259aaa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 0x7fa2541079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:54.239 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.831+0000 7fa259aaa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 0x7fa2541079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41514/0 (socket says 172.21.15.6:41514) 2024-09-11T23:49:54.239 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.831+0000 7fa259aaa640 1 -- 172.21.15.6:0/4081396319 learned_addr learned my addr 172.21.15.6:0/4081396319 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:54.239 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.831+0000 7fa259aaa640 1 -- 172.21.15.6:0/4081396319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2541087c0 con 0x7fa2541075c0 2024-09-11T23:49:54.239 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.832+0000 7fa259aaa640 1 --2- 172.21.15.6:0/4081396319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 0x7fa2541079c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa250009820 tx=0x7fa25002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f334114af1ea2c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:54.239 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.832+0000 7fa258aa8640 1 -- 172.21.15.6:0/4081396319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa250037070 con 0x7fa2541075c0 2024-09-11T23:49:54.239 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.832+0000 7fa258aa8640 1 -- 172.21.15.6:0/4081396319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2500328f0 con 0x7fa2541075c0 2024-09-11T23:49:54.239 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.832+0000 7fa258aa8640 1 -- 172.21.15.6:0/4081396319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa250030740 con 0x7fa2541075c0 2024-09-11T23:49:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.832+0000 7fa25bd0e640 1 -- 172.21.15.6:0/4081396319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 msgr2=0x7fa2541079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.832+0000 7fa25bd0e640 1 --2- 172.21.15.6:0/4081396319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 0x7fa2541079c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa250009820 tx=0x7fa25002a270 comp rx=0 tx=0).stop 2024-09-11T23:49:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.833+0000 7fa25bd0e640 1 -- 172.21.15.6:0/4081396319 shutdown_connections 2024-09-11T23:49:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.833+0000 7fa25bd0e640 1 --2- 172.21.15.6:0/4081396319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 0x7fa2541079c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.833+0000 7fa25bd0e640 1 -- 172.21.15.6:0/4081396319 >> 172.21.15.6:0/4081396319 conn(0x7fa254102dd0 msgr2=0x7fa2541051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.833+0000 7fa25bd0e640 1 -- 172.21.15.6:0/4081396319 shutdown_connections 2024-09-11T23:49:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.833+0000 7fa25bd0e640 1 -- 172.21.15.6:0/4081396319 wait complete. 2024-09-11T23:49:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.833+0000 7fa25bd0e640 1 Processor -- start 2024-09-11T23:49:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.833+0000 7fa25bd0e640 1 -- start start 2024-09-11T23:49:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.833+0000 7fa25bd0e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 0x7fa25407db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.833+0000 7fa25bd0e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa25410bb70 con 0x7fa2541075c0 2024-09-11T23:49:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.834+0000 7fa259aaa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 0x7fa25407db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.834+0000 7fa259aaa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 0x7fa25407db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41526/0 (socket says 172.21.15.6:41526) 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.834+0000 7fa259aaa640 1 -- 172.21.15.6:0/1591075244 learned_addr learned my addr 172.21.15.6:0/1591075244 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.834+0000 7fa259aaa640 1 -- 172.21.15.6:0/1591075244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25407e080 con 0x7fa2541075c0 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.834+0000 7fa259aaa640 1 --2- 172.21.15.6:0/1591075244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 0x7fa25407db40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa250009940 tx=0x7fa250030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.834+0000 7fa24affd640 1 -- 172.21.15.6:0/1591075244 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa250042070 con 0x7fa2541075c0 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.834+0000 7fa24affd640 1 -- 172.21.15.6:0/1591075244 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa250030e30 con 0x7fa2541075c0 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.834+0000 7fa25bd0e640 1 -- 172.21.15.6:0/1591075244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25407c270 con 0x7fa2541075c0 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.834+0000 7fa24affd640 1 -- 172.21.15.6:0/1591075244 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa250037040 con 0x7fa2541075c0 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.834+0000 7fa25bd0e640 1 -- 172.21.15.6:0/1591075244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa25407c7b0 con 0x7fa2541075c0 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.835+0000 7fa24affd640 1 -- 172.21.15.6:0/1591075244 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa250045070 con 0x7fa2541075c0 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.835+0000 7fa25bd0e640 1 -- 172.21.15.6:0/1591075244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa25410bcf0 con 0x7fa2541075c0 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.835+0000 7fa24affd640 1 --2- 172.21.15.6:0/1591075244 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fa240038fc0 0x7fa24003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:54.241 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.835+0000 7fa24affd640 1 -- 172.21.15.6:0/1591075244 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa25006bf80 con 0x7fa2541075c0 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.835+0000 7fa2592a9640 1 --2- 172.21.15.6:0/1591075244 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fa240038fc0 0x7fa24003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.836+0000 7fa2592a9640 1 --2- 172.21.15.6:0/1591075244 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fa240038fc0 0x7fa24003b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa2440098c0 tx=0x7fa244006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:52.840+0000 7fa24affd640 1 -- 172.21.15.6:0/1591075244 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa25002fd90 con 0x7fa2541075c0 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.024+0000 7fa25bd0e640 1 -- 172.21.15.6:0/1591075244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fa254107a40 con 0x7fa2541075c0 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.026+0000 7fa24affd640 1 -- 172.21.15.6:0/1591075244 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fa25003d950 con 0x7fa2541075c0 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.029+0000 7fa25bd0e640 1 -- 172.21.15.6:0/1591075244 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fa240038fc0 msgr2=0x7fa24003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.029+0000 7fa25bd0e640 1 --2- 172.21.15.6:0/1591075244 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fa240038fc0 0x7fa24003b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa2440098c0 tx=0x7fa244006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.029+0000 7fa25bd0e640 1 -- 172.21.15.6:0/1591075244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 msgr2=0x7fa25407db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.029+0000 7fa25bd0e640 1 --2- 172.21.15.6:0/1591075244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 0x7fa25407db40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa250009940 tx=0x7fa250030cc0 comp rx=0 tx=0).stop 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.029+0000 7fa25bd0e640 1 -- 172.21.15.6:0/1591075244 shutdown_connections 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.029+0000 7fa25bd0e640 1 --2- 172.21.15.6:0/1591075244 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fa240038fc0 0x7fa24003b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.029+0000 7fa25bd0e640 1 --2- 172.21.15.6:0/1591075244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2541075c0 0x7fa25407db40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.029+0000 7fa25bd0e640 1 -- 172.21.15.6:0/1591075244 >> 172.21.15.6:0/1591075244 conn(0x7fa254102dd0 msgr2=0x7fa2541038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:54.243 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.029+0000 7fa25bd0e640 1 -- 172.21.15.6:0/1591075244 shutdown_connections 2024-09-11T23:49:54.243 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.029+0000 7fa25bd0e640 1 -- 172.21.15.6:0/1591075244 wait complete. 2024-09-11T23:49:54.243 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling the dashboard module... 2024-09-11T23:49:56.116 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:55 smithi006 ceph-mon[30947]: from='mgr.14118 172.21.15.6:0/1018961743' entity='mgr.x' 2024-09-11T23:49:56.116 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:55 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/924581833' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-11T23:49:56.116 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:55 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: ignoring --setuser ceph since I am not root 2024-09-11T23:49:56.117 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:55 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: ignoring --setgroup ceph since I am not root 2024-09-11T23:49:56.117 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:55 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:55.929+0000 7fa56d704040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:49:56.117 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:55 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:55.989+0000 7fa56d704040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:49:56.368 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:56 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:56.145+0000 7fa56d704040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:49:56.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:56 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:56.214+0000 7fa56d704040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:49:56.769 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:56 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:56.369+0000 7fa56d704040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:49:56.769 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:56 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:56.516+0000 7fa56d704040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:49:56.776 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.710+0000 7f0803098640 1 Processor -- start 2024-09-11T23:49:56.776 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.710+0000 7f0803098640 1 -- start start 2024-09-11T23:49:56.776 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.710+0000 7f0803098640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 0x7f07fc07c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:56.776 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.710+0000 7f0803098640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc07c8a0 con 0x7f07fc07de70 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.711+0000 7f0800e34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 0x7f07fc07c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.711+0000 7f0800e34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 0x7f07fc07c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41532/0 (socket says 172.21.15.6:41532) 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.711+0000 7f0800e34640 1 -- 172.21.15.6:0/3216681109 learned_addr learned my addr 172.21.15.6:0/3216681109 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.711+0000 7f0800e34640 1 -- 172.21.15.6:0/3216681109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc07ca20 con 0x7f07fc07de70 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.711+0000 7f0800e34640 1 --2- 172.21.15.6:0/3216681109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 0x7f07fc07c2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009820 tx=0x7f07f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b41fd47e5d647 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.712+0000 7f07fb7fe640 1 -- 172.21.15.6:0/3216681109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f0037070 con 0x7f07fc07de70 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.712+0000 7f07fb7fe640 1 -- 172.21.15.6:0/3216681109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f07f00328f0 con 0x7f07fc07de70 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.712+0000 7f07fb7fe640 1 -- 172.21.15.6:0/3216681109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f0030740 con 0x7f07fc07de70 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.712+0000 7f0803098640 1 -- 172.21.15.6:0/3216681109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 msgr2=0x7f07fc07c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.712+0000 7f0803098640 1 --2- 172.21.15.6:0/3216681109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 0x7f07fc07c2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009820 tx=0x7f07f002a270 comp rx=0 tx=0).stop 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.712+0000 7f0803098640 1 -- 172.21.15.6:0/3216681109 shutdown_connections 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.712+0000 7f0803098640 1 --2- 172.21.15.6:0/3216681109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 0x7f07fc07c2d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.712+0000 7f0803098640 1 -- 172.21.15.6:0/3216681109 >> 172.21.15.6:0/3216681109 conn(0x7f07fc102dd0 msgr2=0x7f07fc1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.712+0000 7f0803098640 1 -- 172.21.15.6:0/3216681109 shutdown_connections 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.712+0000 7f0803098640 1 -- 172.21.15.6:0/3216681109 wait complete. 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.713+0000 7f0803098640 1 Processor -- start 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.713+0000 7f0803098640 1 -- start start 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.713+0000 7f0803098640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 0x7f07fc19d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.713+0000 7f0803098640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc10dc30 con 0x7f07fc07de70 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.713+0000 7f0800e34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 0x7f07fc19d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.713+0000 7f0800e34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 0x7f07fc19d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41540/0 (socket says 172.21.15.6:41540) 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.713+0000 7f0800e34640 1 -- 172.21.15.6:0/924581833 learned_addr learned my addr 172.21.15.6:0/924581833 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.714+0000 7f0800e34640 1 -- 172.21.15.6:0/924581833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc19dc80 con 0x7f07fc07de70 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.714+0000 7f0800e34640 1 --2- 172.21.15.6:0/924581833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 0x7f07fc19d740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07f0030cc0 tx=0x7f07f0030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.714+0000 7f07f9ffb640 1 -- 172.21.15.6:0/924581833 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f0042070 con 0x7f07fc07de70 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.714+0000 7f0803098640 1 -- 172.21.15.6:0/924581833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07fc19df10 con 0x7f07fc07de70 2024-09-11T23:49:56.778 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.714+0000 7f07f9ffb640 1 -- 172.21.15.6:0/924581833 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f07f0030e60 con 0x7f07fc07de70 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.714+0000 7f07f9ffb640 1 -- 172.21.15.6:0/924581833 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f0037040 con 0x7f07fc07de70 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.714+0000 7f0803098640 1 -- 172.21.15.6:0/924581833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07fc1a0c00 con 0x7f07fc07de70 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.715+0000 7f07f9ffb640 1 -- 172.21.15.6:0/924581833 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f07f0045070 con 0x7f07fc07de70 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.715+0000 7f07f9ffb640 1 --2- 172.21.15.6:0/924581833 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f07ec038fc0 0x7f07ec03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.715+0000 7f0803098640 1 -- 172.21.15.6:0/924581833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07fc07c350 con 0x7f07fc07de70 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.715+0000 7f07f9ffb640 1 -- 172.21.15.6:0/924581833 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f07f006c100 con 0x7f07fc07de70 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.715+0000 7f07fbfff640 1 --2- 172.21.15.6:0/924581833 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f07ec038fc0 0x7f07ec03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.716+0000 7f07fbfff640 1 --2- 172.21.15.6:0/924581833 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f07ec038fc0 0x7f07ec03b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f07e80098c0 tx=0x7f07e8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.720+0000 7f07f9ffb640 1 -- 172.21.15.6:0/924581833 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07f004b170 con 0x7f07fc07de70 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.964+0000 7f0803098640 1 -- 172.21.15.6:0/924581833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f07fc1a1150 con 0x7f07fc07de70 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:55.774+0000 7f07f9ffb640 1 -- 172.21.15.6:0/924581833 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f07f003c6b0 con 0x7f07fc07de70 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:55.776+0000 7f07f9ffb640 1 -- 172.21.15.6:0/924581833 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f07f003d950 con 0x7f07fc07de70 2024-09-11T23:49:56.779 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:55.778+0000 7f0803098640 1 -- 172.21.15.6:0/924581833 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f07ec038fc0 msgr2=0x7f07ec03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:56.780 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:55.778+0000 7f0803098640 1 --2- 172.21.15.6:0/924581833 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f07ec038fc0 0x7f07ec03b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f07e80098c0 tx=0x7f07e8006db0 comp rx=0 tx=0).stop 2024-09-11T23:49:56.780 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:55.778+0000 7f0803098640 1 -- 172.21.15.6:0/924581833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 msgr2=0x7f07fc19d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:56.780 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:55.778+0000 7f0803098640 1 --2- 172.21.15.6:0/924581833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 0x7f07fc19d740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07f0030cc0 tx=0x7f07f0030cf0 comp rx=0 tx=0).stop 2024-09-11T23:49:56.780 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:55.778+0000 7f0803098640 1 -- 172.21.15.6:0/924581833 shutdown_connections 2024-09-11T23:49:56.780 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:55.778+0000 7f0803098640 1 --2- 172.21.15.6:0/924581833 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f07ec038fc0 0x7f07ec03b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:56.780 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:55.778+0000 7f0803098640 1 --2- 172.21.15.6:0/924581833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07fc07de70 0x7f07fc19d740 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:56.780 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:55.778+0000 7f0803098640 1 -- 172.21.15.6:0/924581833 >> 172.21.15.6:0/924581833 conn(0x7f07fc102dd0 msgr2=0x7f07fc103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:56.780 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:55.778+0000 7f0803098640 1 -- 172.21.15.6:0/924581833 shutdown_connections 2024-09-11T23:49:56.780 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:55.778+0000 7f0803098640 1 -- 172.21.15.6:0/924581833 wait complete. 2024-09-11T23:49:57.041 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:56 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/924581833' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-11T23:49:57.041 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:56 smithi006 ceph-mon[30947]: mgrmap e9: x(active, since 19s) 2024-09-11T23:49:57.041 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:56 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:56.847+0000 7fa56d704040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:49:57.041 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:56 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:56.911+0000 7fa56d704040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:49:57.368 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:57 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:57.107+0000 7fa56d704040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:49:58.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:49:57 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1502665970' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T23:49:58.036 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:49:58.042 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-11T23:49:58.042 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T23:49:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T23:49:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T23:49:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:49:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.228+0000 7fd15a870640 1 Processor -- start 2024-09-11T23:49:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.228+0000 7fd15a870640 1 -- start start 2024-09-11T23:49:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.228+0000 7fd15a870640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 0x7fd15410a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.228+0000 7fd15a870640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd154075a80 con 0x7fd154107fe0 2024-09-11T23:49:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.228+0000 7fd153fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 0x7fd15410a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.228+0000 7fd153fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 0x7fd15410a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41582/0 (socket says 172.21.15.6:41582) 2024-09-11T23:49:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.228+0000 7fd153fff640 1 -- 172.21.15.6:0/3430396830 learned_addr learned my addr 172.21.15.6:0/3430396830 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.228+0000 7fd153fff640 1 -- 172.21.15.6:0/3430396830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15410a910 con 0x7fd154107fe0 2024-09-11T23:49:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.229+0000 7fd153fff640 1 --2- 172.21.15.6:0/3430396830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 0x7fd15410a3d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd144009820 tx=0x7fd14402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4131981b395596c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.229+0000 7fd152ffd640 1 -- 172.21.15.6:0/3430396830 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd144037070 con 0x7fd154107fe0 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.229+0000 7fd152ffd640 1 -- 172.21.15.6:0/3430396830 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1440328f0 con 0x7fd154107fe0 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.229+0000 7fd152ffd640 1 -- 172.21.15.6:0/3430396830 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd144030740 con 0x7fd154107fe0 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.230+0000 7fd15a870640 1 -- 172.21.15.6:0/3430396830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 msgr2=0x7fd15410a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.230+0000 7fd15a870640 1 --2- 172.21.15.6:0/3430396830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 0x7fd15410a3d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd144009820 tx=0x7fd14402a270 comp rx=0 tx=0).stop 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.230+0000 7fd15a870640 1 -- 172.21.15.6:0/3430396830 shutdown_connections 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.230+0000 7fd15a870640 1 --2- 172.21.15.6:0/3430396830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 0x7fd15410a3d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.230+0000 7fd15a870640 1 -- 172.21.15.6:0/3430396830 >> 172.21.15.6:0/3430396830 conn(0x7fd154101c40 msgr2=0x7fd154104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.230+0000 7fd15a870640 1 -- 172.21.15.6:0/3430396830 shutdown_connections 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.230+0000 7fd15a870640 1 -- 172.21.15.6:0/3430396830 wait complete. 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.231+0000 7fd15a870640 1 Processor -- start 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.231+0000 7fd15a870640 1 -- start start 2024-09-11T23:49:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.231+0000 7fd15a870640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 0x7fd154107860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.231+0000 7fd15a870640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd15410b990 con 0x7fd154107fe0 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.231+0000 7fd153fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 0x7fd154107860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.231+0000 7fd153fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 0x7fd154107860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41592/0 (socket says 172.21.15.6:41592) 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.231+0000 7fd153fff640 1 -- 172.21.15.6:0/1502665970 learned_addr learned my addr 172.21.15.6:0/1502665970 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.232+0000 7fd153fff640 1 -- 172.21.15.6:0/1502665970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd154107da0 con 0x7fd154107fe0 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.232+0000 7fd153fff640 1 --2- 172.21.15.6:0/1502665970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 0x7fd154107860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd1440097f0 tx=0x7fd144030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.232+0000 7fd1517fa640 1 -- 172.21.15.6:0/1502665970 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd144042070 con 0x7fd154107fe0 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.232+0000 7fd1517fa640 1 -- 172.21.15.6:0/1502665970 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd144030e80 con 0x7fd154107fe0 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.232+0000 7fd15a870640 1 -- 172.21.15.6:0/1502665970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd154105f90 con 0x7fd154107fe0 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.232+0000 7fd1517fa640 1 -- 172.21.15.6:0/1502665970 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd144037040 con 0x7fd154107fe0 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.232+0000 7fd15a870640 1 -- 172.21.15.6:0/1502665970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1541064d0 con 0x7fd154107fe0 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.233+0000 7fd1517fa640 1 -- 172.21.15.6:0/1502665970 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fd144045070 con 0x7fd154107fe0 2024-09-11T23:49:58.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.233+0000 7fd15a870640 1 -- 172.21.15.6:0/1502665970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd154108440 con 0x7fd154107fe0 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.233+0000 7fd1517fa640 1 --2- 172.21.15.6:0/1502665970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd13c039020 0x7fd13c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.233+0000 7fd1517fa640 1 -- 172.21.15.6:0/1502665970 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd14406c0d0 con 0x7fd154107fe0 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.233+0000 7fd1537fe640 1 -- 172.21.15.6:0/1502665970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd13c039020 msgr2=0x7fd13c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2279576750 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.233+0000 7fd1537fe640 1 --2- 172.21.15.6:0/1502665970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd13c039020 0x7fd13c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.238+0000 7fd1517fa640 1 -- 172.21.15.6:0/1502665970 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd144045360 con 0x7fd154107fe0 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.434+0000 7fd1537fe640 1 -- 172.21.15.6:0/1502665970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd13c039020 msgr2=0x7fd13c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2279576750 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.434+0000 7fd1537fe640 1 --2- 172.21.15.6:0/1502665970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd13c039020 0x7fd13c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.461+0000 7fd15a870640 1 -- 172.21.15.6:0/1502665970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd154106c70 con 0x7fd154107fe0 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.462+0000 7fd1517fa640 1 -- 172.21.15.6:0/1502665970 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fd14402ed90 con 0x7fd154107fe0 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.464+0000 7fd15a870640 1 -- 172.21.15.6:0/1502665970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd13c039020 msgr2=0x7fd13c03b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.464+0000 7fd15a870640 1 --2- 172.21.15.6:0/1502665970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd13c039020 0x7fd13c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.464+0000 7fd15a870640 1 -- 172.21.15.6:0/1502665970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 msgr2=0x7fd154107860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:58.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.464+0000 7fd15a870640 1 --2- 172.21.15.6:0/1502665970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 0x7fd154107860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd1440097f0 tx=0x7fd144030c70 comp rx=0 tx=0).stop 2024-09-11T23:49:58.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.464+0000 7fd15a870640 1 -- 172.21.15.6:0/1502665970 shutdown_connections 2024-09-11T23:49:58.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.464+0000 7fd15a870640 1 --2- 172.21.15.6:0/1502665970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7fd13c039020 0x7fd13c03b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:58.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.464+0000 7fd15a870640 1 --2- 172.21.15.6:0/1502665970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd154107fe0 0x7fd154107860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:58.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.464+0000 7fd15a870640 1 -- 172.21.15.6:0/1502665970 >> 172.21.15.6:0/1502665970 conn(0x7fd154101c40 msgr2=0x7fd154102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:58.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.464+0000 7fd15a870640 1 -- 172.21.15.6:0/1502665970 shutdown_connections 2024-09-11T23:49:58.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.464+0000 7fd15a870640 1 -- 172.21.15.6:0/1502665970 wait complete. 2024-09-11T23:49:58.047 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for the mgr to restart... 2024-09-11T23:49:58.047 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr epoch 9... 2024-09-11T23:49:58.286 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:58 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:58.048+0000 7fa56d704040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:49:58.286 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:58 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:58.122+0000 7fa56d704040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:49:59.005 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:58 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:58.884+0000 7fa56d704040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:49:59.005 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:59 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:59.004+0000 7fa56d704040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:49:59.368 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:59 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:59.153+0000 7fa56d704040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:49:59.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:59 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:59.217+0000 7fa56d704040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:49:59.671 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:59 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:59.372+0000 7fa56d704040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:49:59.672 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:59 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:59.443+0000 7fa56d704040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:49:59.672 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:59 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:59.506+0000 7fa56d704040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:49:59.672 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:59 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:59.671+0000 7fa56d704040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:49:59.957 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:59 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:59.739+0000 7fa56d704040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:49:59.957 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:59 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:59.808+0000 7fa56d704040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:49:59.957 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:59 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:59.895+0000 7fa56d704040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:49:59.957 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:49:59 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:49:59.956+0000 7fa56d704040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:50:00.368 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:50:00.018+0000 7fa56d704040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:50:01.105 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:50:00.844+0000 7fa56d704040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:50:01.105 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: Active manager daemon x restarted 2024-09-11T23:50:01.105 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: Activating manager daemon x 2024-09-11T23:50:01.105 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: osdmap e3: 0 total, 0 up, 0 in 2024-09-11T23:50:01.105 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: mgrmap e10: x(active, starting, since 0.00357925s) 2024-09-11T23:50:01.105 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:50:01.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:50:01.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:50:01.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:50:01.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:50:01.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: Manager daemon x is now available 2024-09-11T23:50:01.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:01.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:50:01.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:50:02.811 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:50:02.811 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-11T23:50:02.811 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T23:50:02.811 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:50:02.811 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.467+0000 7f155af8e640 1 Processor -- start 2024-09-11T23:50:02.811 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.467+0000 7f155af8e640 1 -- start start 2024-09-11T23:50:02.811 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.467+0000 7f155af8e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 0x7f155410a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:02.812 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.467+0000 7f155af8e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f155407be40 con 0x7f1554108060 2024-09-11T23:50:02.812 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.468+0000 7f1558d2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 0x7f155410a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:02.812 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.468+0000 7f1558d2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 0x7f155410a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41594/0 (socket says 172.21.15.6:41594) 2024-09-11T23:50:02.812 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.468+0000 7f1558d2a640 1 -- 172.21.15.6:0/3544605615 learned_addr learned my addr 172.21.15.6:0/3544605615 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:02.812 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.468+0000 7f1558d2a640 1 -- 172.21.15.6:0/3544605615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155410a990 con 0x7f1554108060 2024-09-11T23:50:02.812 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.469+0000 7f1558d2a640 1 --2- 172.21.15.6:0/3544605615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 0x7f155410a450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f153c009820 tx=0x7f153c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691cdc8827330b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:02.812 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.469+0000 7f15537fe640 1 -- 172.21.15.6:0/3544605615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f153c037070 con 0x7f1554108060 2024-09-11T23:50:02.812 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.469+0000 7f15537fe640 1 -- 172.21.15.6:0/3544605615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f153c0328f0 con 0x7f1554108060 2024-09-11T23:50:02.812 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.469+0000 7f15537fe640 1 -- 172.21.15.6:0/3544605615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f153c030740 con 0x7f1554108060 2024-09-11T23:50:02.812 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.470+0000 7f155af8e640 1 -- 172.21.15.6:0/3544605615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 msgr2=0x7f155410a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:02.812 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.470+0000 7f155af8e640 1 --2- 172.21.15.6:0/3544605615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 0x7f155410a450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f153c009820 tx=0x7f153c02a270 comp rx=0 tx=0).stop 2024-09-11T23:50:02.812 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.470+0000 7f155af8e640 1 -- 172.21.15.6:0/3544605615 shutdown_connections 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.470+0000 7f155af8e640 1 --2- 172.21.15.6:0/3544605615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 0x7f155410a450 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.470+0000 7f155af8e640 1 -- 172.21.15.6:0/3544605615 >> 172.21.15.6:0/3544605615 conn(0x7f1554101c80 msgr2=0x7f15541040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.470+0000 7f155af8e640 1 -- 172.21.15.6:0/3544605615 shutdown_connections 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.470+0000 7f155af8e640 1 -- 172.21.15.6:0/3544605615 wait complete. 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.470+0000 7f155af8e640 1 Processor -- start 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.470+0000 7f155af8e640 1 -- start start 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.471+0000 7f155af8e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 0x7f155419d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.471+0000 7f155af8e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f155410b9b0 con 0x7f1554108060 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.471+0000 7f1558d2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 0x7f155419d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.471+0000 7f1558d2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 0x7f155419d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41596/0 (socket says 172.21.15.6:41596) 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.471+0000 7f1558d2a640 1 -- 172.21.15.6:0/949872970 learned_addr learned my addr 172.21.15.6:0/949872970 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.471+0000 7f1558d2a640 1 -- 172.21.15.6:0/949872970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155419dcb0 con 0x7f1554108060 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.471+0000 7f1558d2a640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 0x7f155419d770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f153c030cc0 tx=0x7f153c030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:02.813 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.471+0000 7f1551ffb640 1 -- 172.21.15.6:0/949872970 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f153c042070 con 0x7f1554108060 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.471+0000 7f1551ffb640 1 -- 172.21.15.6:0/949872970 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f153c030e60 con 0x7f1554108060 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.471+0000 7f1551ffb640 1 -- 172.21.15.6:0/949872970 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f153c037040 con 0x7f1554108060 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.471+0000 7f155af8e640 1 -- 172.21.15.6:0/949872970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155419df40 con 0x7f1554108060 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.472+0000 7f155af8e640 1 -- 172.21.15.6:0/949872970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15541a0c30 con 0x7f1554108060 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.473+0000 7f1551ffb640 1 -- 172.21.15.6:0/949872970 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f153c045070 con 0x7f1554108060 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.473+0000 7f1551ffb640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1540039020 0x7f154003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.473+0000 7f1551ffb640 1 -- 172.21.15.6:0/949872970 --> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f154003bbf0 con 0x7f1540039020 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.473+0000 7f1551ffb640 1 -- 172.21.15.6:0/949872970 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f153c06c020 con 0x7f1554108060 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.473+0000 7f1553fff640 1 -- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1540039020 msgr2=0x7f154003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2279576750 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.473+0000 7f1553fff640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1540039020 0x7f154003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.674+0000 7f1553fff640 1 -- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1540039020 msgr2=0x7f154003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2279576750 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:58.674+0000 7f1553fff640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1540039020 0x7f154003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:59.075+0000 7f1553fff640 1 -- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1540039020 msgr2=0x7f154003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2279576750 2024-09-11T23:50:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:59.075+0000 7f1553fff640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1540039020 0x7f154003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:59.876+0000 7f1553fff640 1 -- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1540039020 msgr2=0x7f154003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2279576750 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:59.876+0000 7f1553fff640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1540039020 0x7f154003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.847+0000 7f1551ffb640 1 -- 172.21.15.6:0/949872970 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f153c03d950 con 0x7f1554108060 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.847+0000 7f1551ffb640 1 -- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1540039020 msgr2=0x7f154003b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.847+0000 7f1551ffb640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1540039020 0x7f154003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.849+0000 7f1551ffb640 1 -- 172.21.15.6:0/949872970 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f153c03d430 con 0x7f1554108060 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.849+0000 7f1551ffb640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f154003cae0 0x7f154003eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.849+0000 7f1551ffb640 1 -- 172.21.15.6:0/949872970 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f153c02bba0 con 0x7f154003cae0 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.850+0000 7f1553fff640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f154003cae0 0x7f154003eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.850+0000 7f1553fff640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f154003cae0 0x7f154003eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1544003d00 tx=0x7f1544009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.851+0000 7f1551ffb640 1 -- 172.21.15.6:0/949872970 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f153c02bba0 con 0x7f154003cae0 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.858+0000 7f155af8e640 1 -- 172.21.15.6:0/949872970 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f15541084c0 con 0x7f154003cae0 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.858+0000 7f1551ffb640 1 -- 172.21.15.6:0/949872970 <== mgr.14150 v2:172.21.15.6:6800/306795778 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f15541084c0 con 0x7f154003cae0 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.859+0000 7f155af8e640 1 -- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f154003cae0 msgr2=0x7f154003eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.859+0000 7f155af8e640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f154003cae0 0x7f154003eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1544003d00 tx=0x7f1544009290 comp rx=0 tx=0).stop 2024-09-11T23:50:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.859+0000 7f155af8e640 1 -- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 msgr2=0x7f155419d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.859+0000 7f155af8e640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 0x7f155419d770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f153c030cc0 tx=0x7f153c030cf0 comp rx=0 tx=0).stop 2024-09-11T23:50:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.859+0000 7f155af8e640 1 -- 172.21.15.6:0/949872970 shutdown_connections 2024-09-11T23:50:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.859+0000 7f155af8e640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f154003cae0 0x7f154003eed0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.859+0000 7f155af8e640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:6800/2279576750,v1:172.21.15.6:6801/2279576750] conn(0x7f1540039020 0x7f154003b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.859+0000 7f155af8e640 1 --2- 172.21.15.6:0/949872970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1554108060 0x7f155419d770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.859+0000 7f155af8e640 1 -- 172.21.15.6:0/949872970 >> 172.21.15.6:0/949872970 conn(0x7f1554101c80 msgr2=0x7f1554102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.859+0000 7f155af8e640 1 -- 172.21.15.6:0/949872970 shutdown_connections 2024-09-11T23:50:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.859+0000 7f155af8e640 1 -- 172.21.15.6:0/949872970 wait complete. 2024-09-11T23:50:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:mgr epoch 9 is available 2024-09-11T23:50:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:Generating a dashboard self-signed certificate... 2024-09-11T23:50:03.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:02 smithi006 ceph-mon[30947]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T23:50:03.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:02 smithi006 ceph-mon[30947]: mgrmap e11: x(active, since 1.00589s) 2024-09-11T23:50:03.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:02 smithi006 ceph-mon[30947]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T23:50:03.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:03.063 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:50:03.027+0000 7fa4d8a18640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:23:50:03] ENGINE Error in HTTPServer.serve 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: Traceback (most recent call last): 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: self._connections.run(self.expiration_interval) 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: self._run(expiration_interval) 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: s = self.context.wrap_socket( 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: return self.sslsocket_class._create( 2024-09-11T23:50:03.064 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:50:03.065 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: self.do_handshake() 2024-09-11T23:50:03.065 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:50:03.065 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: self._sslobj.do_handshake() 2024-09-11T23:50:03.065 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:50:03.065 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:50:03 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:50:04.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-11T23:50:04.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.255+0000 7fcb76969640 1 Processor -- start 2024-09-11T23:50:04.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.255+0000 7fcb76969640 1 -- start start 2024-09-11T23:50:04.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.256+0000 7fcb76969640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 0x7fcb70106870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:04.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.256+0000 7fcb76969640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcb70106e40 con 0x7fcb70106470 2024-09-11T23:50:04.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.256+0000 7fcb6ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 0x7fcb70106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:04.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.256+0000 7fcb6ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 0x7fcb70106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34490/0 (socket says 172.21.15.6:34490) 2024-09-11T23:50:04.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.256+0000 7fcb6ffff640 1 -- 172.21.15.6:0/1777700448 learned_addr learned my addr 172.21.15.6:0/1777700448 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:04.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.256+0000 7fcb6ffff640 1 -- 172.21.15.6:0/1777700448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb70107670 con 0x7fcb70106470 2024-09-11T23:50:04.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.257+0000 7fcb6ffff640 1 --2- 172.21.15.6:0/1777700448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 0x7fcb70106870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009820 tx=0x7fcb6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba05259a67d5103 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:04.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.257+0000 7fcb6f7fe640 1 -- 172.21.15.6:0/1777700448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb60037070 con 0x7fcb70106470 2024-09-11T23:50:04.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.257+0000 7fcb6f7fe640 1 -- 172.21.15.6:0/1777700448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb600328f0 con 0x7fcb70106470 2024-09-11T23:50:04.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.257+0000 7fcb6f7fe640 1 -- 172.21.15.6:0/1777700448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb60030740 con 0x7fcb70106470 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.258+0000 7fcb76969640 1 -- 172.21.15.6:0/1777700448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 msgr2=0x7fcb70106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.258+0000 7fcb76969640 1 --2- 172.21.15.6:0/1777700448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 0x7fcb70106870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009820 tx=0x7fcb6002a270 comp rx=0 tx=0).stop 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.258+0000 7fcb76969640 1 -- 172.21.15.6:0/1777700448 shutdown_connections 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.258+0000 7fcb76969640 1 --2- 172.21.15.6:0/1777700448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 0x7fcb70106870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.258+0000 7fcb76969640 1 -- 172.21.15.6:0/1777700448 >> 172.21.15.6:0/1777700448 conn(0x7fcb70101c40 msgr2=0x7fcb70104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.258+0000 7fcb76969640 1 -- 172.21.15.6:0/1777700448 shutdown_connections 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.258+0000 7fcb76969640 1 -- 172.21.15.6:0/1777700448 wait complete. 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.259+0000 7fcb76969640 1 Processor -- start 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.259+0000 7fcb76969640 1 -- start start 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.259+0000 7fcb76969640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 0x7fcb7019b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.259+0000 7fcb76969640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7010aa20 con 0x7fcb70106470 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.260+0000 7fcb6ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 0x7fcb7019b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.260+0000 7fcb6ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 0x7fcb7019b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34506/0 (socket says 172.21.15.6:34506) 2024-09-11T23:50:04.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.260+0000 7fcb6ffff640 1 -- 172.21.15.6:0/2622596560 learned_addr learned my addr 172.21.15.6:0/2622596560 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.260+0000 7fcb6ffff640 1 -- 172.21.15.6:0/2622596560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7019bb40 con 0x7fcb70106470 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.260+0000 7fcb6ffff640 1 --2- 172.21.15.6:0/2622596560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 0x7fcb7019b600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009940 tx=0x7fcb600327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.260+0000 7fcb6dffb640 1 -- 172.21.15.6:0/2622596560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb60042070 con 0x7fcb70106470 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.260+0000 7fcb6dffb640 1 -- 172.21.15.6:0/2622596560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb60030d00 con 0x7fcb70106470 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.260+0000 7fcb6dffb640 1 -- 172.21.15.6:0/2622596560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb60037040 con 0x7fcb70106470 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.260+0000 7fcb76969640 1 -- 172.21.15.6:0/2622596560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7019bdd0 con 0x7fcb70106470 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.260+0000 7fcb76969640 1 -- 172.21.15.6:0/2622596560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7019eac0 con 0x7fcb70106470 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.261+0000 7fcb6dffb640 1 -- 172.21.15.6:0/2622596560 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fcb60045070 con 0x7fcb70106470 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.261+0000 7fcb76969640 1 -- 172.21.15.6:0/2622596560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7010aba0 con 0x7fcb70106470 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.261+0000 7fcb6dffb640 1 --2- 172.21.15.6:0/2622596560 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcb5c039020 0x7fcb5c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.262+0000 7fcb6dffb640 1 -- 172.21.15.6:0/2622596560 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcb6006c2a0 con 0x7fcb70106470 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.262+0000 7fcb67fff640 1 --2- 172.21.15.6:0/2622596560 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcb5c039020 0x7fcb5c03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:04.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.262+0000 7fcb67fff640 1 --2- 172.21.15.6:0/2622596560 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcb5c039020 0x7fcb5c03b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcb580098c0 tx=0x7fcb58006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:04.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.266+0000 7fcb6dffb640 1 -- 172.21.15.6:0/2622596560 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb60045360 con 0x7fcb70106470 2024-09-11T23:50:04.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.449+0000 7fcb76969640 1 -- 172.21.15.6:0/2622596560 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fcb7002da60 con 0x7fcb5c039020 2024-09-11T23:50:04.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.548+0000 7fcb6dffb640 1 -- 172.21.15.6:0/2622596560 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fcb7002da60 con 0x7fcb5c039020 2024-09-11T23:50:04.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.551+0000 7fcb76969640 1 -- 172.21.15.6:0/2622596560 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcb5c039020 msgr2=0x7fcb5c03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:04.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.552+0000 7fcb76969640 1 --2- 172.21.15.6:0/2622596560 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcb5c039020 0x7fcb5c03b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcb580098c0 tx=0x7fcb58006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:04.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.552+0000 7fcb76969640 1 -- 172.21.15.6:0/2622596560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 msgr2=0x7fcb7019b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:04.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.552+0000 7fcb76969640 1 --2- 172.21.15.6:0/2622596560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 0x7fcb7019b600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009940 tx=0x7fcb600327b0 comp rx=0 tx=0).stop 2024-09-11T23:50:04.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.552+0000 7fcb76969640 1 -- 172.21.15.6:0/2622596560 shutdown_connections 2024-09-11T23:50:04.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.552+0000 7fcb76969640 1 --2- 172.21.15.6:0/2622596560 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcb5c039020 0x7fcb5c03b4e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:04.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.552+0000 7fcb76969640 1 --2- 172.21.15.6:0/2622596560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb70106470 0x7fcb7019b600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:04.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.552+0000 7fcb76969640 1 -- 172.21.15.6:0/2622596560 >> 172.21.15.6:0/2622596560 conn(0x7fcb70101c40 msgr2=0x7fcb70102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:04.197 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.552+0000 7fcb76969640 1 -- 172.21.15.6:0/2622596560 shutdown_connections 2024-09-11T23:50:04.197 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:03.552+0000 7fcb76969640 1 -- 172.21.15.6:0/2622596560 wait complete. 2024-09-11T23:50:04.197 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial admin user... 2024-09-11T23:50:04.444 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:04 smithi006 ceph-mon[30947]: [11/Sep/2024:23:50:02] ENGINE Bus STARTING 2024-09-11T23:50:04.444 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:04 smithi006 ceph-mon[30947]: [11/Sep/2024:23:50:03] ENGINE Serving on https://172.21.15.6:7150 2024-09-11T23:50:04.444 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:04 smithi006 ceph-mon[30947]: [11/Sep/2024:23:50:03] ENGINE Error in HTTPServer.serve 2024-09-11T23:50:04.444 INFO:journalctl@ceph.mon.a.smithi006.stdout: Traceback (most recent call last): 2024-09-11T23:50:04.444 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:50:04.444 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._connections.run(self.expiration_interval) 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._run(expiration_interval) 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: s = self.context.wrap_socket( 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: return self.sslsocket_class._create( 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: self.do_handshake() 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._sslobj.do_handshake() 2024-09-11T23:50:04.445 INFO:journalctl@ceph.mon.a.smithi006.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:50:04.446 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:04 smithi006 ceph-mon[30947]: [11/Sep/2024:23:50:03] ENGINE Serving on http://172.21.15.6:8765 2024-09-11T23:50:04.446 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:04 smithi006 ceph-mon[30947]: [11/Sep/2024:23:50:03] ENGINE Bus STARTED 2024-09-11T23:50:04.446 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:04 smithi006 ceph-mon[30947]: mgrmap e12: x(active, since 2s) 2024-09-11T23:50:04.446 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:04 smithi006 ceph-mon[30947]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:04.446 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:04.446 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:04.446 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:06.347 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:06 smithi006 ceph-mon[30947]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:06.348 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:06.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$EruUFftGtJxTR.LKoofj5epPpAkIa1AoH3MVXabPFS/i2zVoze3fW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726098605, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-11T23:50:06.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.638+0000 7fd07ead4640 1 Processor -- start 2024-09-11T23:50:06.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.638+0000 7fd07ead4640 1 -- start start 2024-09-11T23:50:06.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.638+0000 7fd07ead4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 0x7fd07810a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:06.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.638+0000 7fd07ead4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd07807be20 con 0x7fd078108080 2024-09-11T23:50:06.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.638+0000 7fd07c870640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 0x7fd07810a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:06.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.638+0000 7fd07c870640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 0x7fd07810a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34512/0 (socket says 172.21.15.6:34512) 2024-09-11T23:50:06.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.638+0000 7fd07c870640 1 -- 172.21.15.6:0/2375477339 learned_addr learned my addr 172.21.15.6:0/2375477339 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:06.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.638+0000 7fd07c870640 1 -- 172.21.15.6:0/2375477339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07810a9b0 con 0x7fd078108080 2024-09-11T23:50:06.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.639+0000 7fd07c870640 1 --2- 172.21.15.6:0/2375477339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 0x7fd07810a470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009820 tx=0x7fd06c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cda87b1aa9dbbe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:06.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.639+0000 7fd0777fe640 1 -- 172.21.15.6:0/2375477339 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd06c037070 con 0x7fd078108080 2024-09-11T23:50:06.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.640+0000 7fd0777fe640 1 -- 172.21.15.6:0/2375477339 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd06c0328f0 con 0x7fd078108080 2024-09-11T23:50:06.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.640+0000 7fd0777fe640 1 -- 172.21.15.6:0/2375477339 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd06c030740 con 0x7fd078108080 2024-09-11T23:50:06.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.640+0000 7fd07ead4640 1 -- 172.21.15.6:0/2375477339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 msgr2=0x7fd07810a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:06.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.640+0000 7fd07ead4640 1 --2- 172.21.15.6:0/2375477339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 0x7fd07810a470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009820 tx=0x7fd06c02a270 comp rx=0 tx=0).stop 2024-09-11T23:50:06.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.640+0000 7fd07ead4640 1 -- 172.21.15.6:0/2375477339 shutdown_connections 2024-09-11T23:50:06.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.640+0000 7fd07ead4640 1 --2- 172.21.15.6:0/2375477339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 0x7fd07810a470 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:06.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.640+0000 7fd07ead4640 1 -- 172.21.15.6:0/2375477339 >> 172.21.15.6:0/2375477339 conn(0x7fd078101c60 msgr2=0x7fd078104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:06.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.640+0000 7fd07ead4640 1 -- 172.21.15.6:0/2375477339 shutdown_connections 2024-09-11T23:50:06.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.640+0000 7fd07ead4640 1 -- 172.21.15.6:0/2375477339 wait complete. 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.641+0000 7fd07ead4640 1 Processor -- start 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.641+0000 7fd07ead4640 1 -- start start 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.641+0000 7fd07ead4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 0x7fd07819b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.641+0000 7fd07ead4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd07810b9d0 con 0x7fd078108080 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.641+0000 7fd07c870640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 0x7fd07819b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.641+0000 7fd07c870640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 0x7fd07819b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34522/0 (socket says 172.21.15.6:34522) 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.641+0000 7fd07c870640 1 -- 172.21.15.6:0/1793748440 learned_addr learned my addr 172.21.15.6:0/1793748440 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.642+0000 7fd07c870640 1 -- 172.21.15.6:0/1793748440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07819ba80 con 0x7fd078108080 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.642+0000 7fd07c870640 1 --2- 172.21.15.6:0/1793748440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 0x7fd07819b540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd06c030cc0 tx=0x7fd06c030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.642+0000 7fd075ffb640 1 -- 172.21.15.6:0/1793748440 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd06c042070 con 0x7fd078108080 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.642+0000 7fd07ead4640 1 -- 172.21.15.6:0/1793748440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07819bd10 con 0x7fd078108080 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.642+0000 7fd075ffb640 1 -- 172.21.15.6:0/1793748440 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd06c030e60 con 0x7fd078108080 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.642+0000 7fd075ffb640 1 -- 172.21.15.6:0/1793748440 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd06c037040 con 0x7fd078108080 2024-09-11T23:50:06.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.642+0000 7fd07ead4640 1 -- 172.21.15.6:0/1793748440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd07819ea00 con 0x7fd078108080 2024-09-11T23:50:06.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.643+0000 7fd075ffb640 1 -- 172.21.15.6:0/1793748440 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fd06c045070 con 0x7fd078108080 2024-09-11T23:50:06.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.643+0000 7fd075ffb640 1 --2- 172.21.15.6:0/1793748440 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd068038fc0 0x7fd06803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:06.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.644+0000 7fd075ffb640 1 -- 172.21.15.6:0/1793748440 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd06c06c1a0 con 0x7fd078108080 2024-09-11T23:50:06.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.644+0000 7fd077fff640 1 --2- 172.21.15.6:0/1793748440 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd068038fc0 0x7fd06803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:06.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.644+0000 7fd07ead4640 1 -- 172.21.15.6:0/1793748440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0781084e0 con 0x7fd078108080 2024-09-11T23:50:06.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.644+0000 7fd077fff640 1 --2- 172.21.15.6:0/1793748440 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd068038fc0 0x7fd06803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0640098c0 tx=0x7fd064006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:06.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.649+0000 7fd075ffb640 1 -- 172.21.15.6:0/1793748440 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd06c045360 con 0x7fd078108080 2024-09-11T23:50:06.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.841+0000 7fd07ead4640 1 -- 172.21.15.6:0/1793748440 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fd078102f20 con 0x7fd068038fc0 2024-09-11T23:50:06.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:05.090+0000 7fd075ffb640 1 -- 172.21.15.6:0/1793748440 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fd078102f20 con 0x7fd068038fc0 2024-09-11T23:50:06.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:05.092+0000 7fd07ead4640 1 -- 172.21.15.6:0/1793748440 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd068038fc0 msgr2=0x7fd06803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:06.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:05.092+0000 7fd07ead4640 1 --2- 172.21.15.6:0/1793748440 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd068038fc0 0x7fd06803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0640098c0 tx=0x7fd064006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:06.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:05.092+0000 7fd07ead4640 1 -- 172.21.15.6:0/1793748440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 msgr2=0x7fd07819b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:06.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:05.092+0000 7fd07ead4640 1 --2- 172.21.15.6:0/1793748440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 0x7fd07819b540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd06c030cc0 tx=0x7fd06c030cf0 comp rx=0 tx=0).stop 2024-09-11T23:50:06.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:05.092+0000 7fd07ead4640 1 -- 172.21.15.6:0/1793748440 shutdown_connections 2024-09-11T23:50:06.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:05.092+0000 7fd07ead4640 1 --2- 172.21.15.6:0/1793748440 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd068038fc0 0x7fd06803b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:06.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:05.092+0000 7fd07ead4640 1 --2- 172.21.15.6:0/1793748440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078108080 0x7fd07819b540 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:06.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:05.092+0000 7fd07ead4640 1 -- 172.21.15.6:0/1793748440 >> 172.21.15.6:0/1793748440 conn(0x7fd078101c60 msgr2=0x7fd078102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:06.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:05.092+0000 7fd07ead4640 1 -- 172.21.15.6:0/1793748440 shutdown_connections 2024-09-11T23:50:06.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:05.092+0000 7fd07ead4640 1 -- 172.21.15.6:0/1793748440 wait complete. 2024-09-11T23:50:06.359 INFO:teuthology.orchestra.run.smithi006.stdout:Fetching dashboard port number... 2024-09-11T23:50:07.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:07 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3131842805' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-11T23:50:07.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 8443 2024-09-11T23:50:07.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.745+0000 7ff7ce373640 1 Processor -- start 2024-09-11T23:50:07.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.745+0000 7ff7ce373640 1 -- start start 2024-09-11T23:50:07.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.745+0000 7ff7ce373640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 0x7ff7c807c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:07.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.745+0000 7ff7ce373640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c807c880 con 0x7ff7c807de50 2024-09-11T23:50:07.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.746+0000 7ff7c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 0x7ff7c807c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.746+0000 7ff7c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 0x7ff7c807c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34534/0 (socket says 172.21.15.6:34534) 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.746+0000 7ff7c7fff640 1 -- 172.21.15.6:0/1368371648 learned_addr learned my addr 172.21.15.6:0/1368371648 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.746+0000 7ff7c7fff640 1 -- 172.21.15.6:0/1368371648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c807ca00 con 0x7ff7c807de50 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.746+0000 7ff7c7fff640 1 --2- 172.21.15.6:0/1368371648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 0x7ff7c807c2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009820 tx=0x7ff7b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8877df6ac9fc6bcf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.747+0000 7ff7c6ffd640 1 -- 172.21.15.6:0/1368371648 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b8037070 con 0x7ff7c807de50 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.747+0000 7ff7c6ffd640 1 -- 172.21.15.6:0/1368371648 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7b80328f0 con 0x7ff7c807de50 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.747+0000 7ff7c6ffd640 1 -- 172.21.15.6:0/1368371648 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b8030740 con 0x7ff7c807de50 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.747+0000 7ff7ce373640 1 -- 172.21.15.6:0/1368371648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 msgr2=0x7ff7c807c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.747+0000 7ff7ce373640 1 --2- 172.21.15.6:0/1368371648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 0x7ff7c807c2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009820 tx=0x7ff7b802a270 comp rx=0 tx=0).stop 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.747+0000 7ff7ce373640 1 -- 172.21.15.6:0/1368371648 shutdown_connections 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.747+0000 7ff7ce373640 1 --2- 172.21.15.6:0/1368371648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 0x7ff7c807c2b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.747+0000 7ff7ce373640 1 -- 172.21.15.6:0/1368371648 >> 172.21.15.6:0/1368371648 conn(0x7ff7c8102dd0 msgr2=0x7ff7c81051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.747+0000 7ff7ce373640 1 -- 172.21.15.6:0/1368371648 shutdown_connections 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.747+0000 7ff7ce373640 1 -- 172.21.15.6:0/1368371648 wait complete. 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.748+0000 7ff7ce373640 1 Processor -- start 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.748+0000 7ff7ce373640 1 -- start start 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.748+0000 7ff7ce373640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 0x7ff7c819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.748+0000 7ff7ce373640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c810dbf0 con 0x7ff7c807de50 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.749+0000 7ff7c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 0x7ff7c819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.749+0000 7ff7c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 0x7ff7c819d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34542/0 (socket says 172.21.15.6:34542) 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.749+0000 7ff7c7fff640 1 -- 172.21.15.6:0/3131842805 learned_addr learned my addr 172.21.15.6:0/3131842805 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.749+0000 7ff7c7fff640 1 -- 172.21.15.6:0/3131842805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c819dc90 con 0x7ff7c807de50 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.749+0000 7ff7c7fff640 1 --2- 172.21.15.6:0/3131842805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 0x7ff7c819d750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8030cc0 tx=0x7ff7b8030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.749+0000 7ff7c57fa640 1 -- 172.21.15.6:0/3131842805 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b8042070 con 0x7ff7c807de50 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.749+0000 7ff7ce373640 1 -- 172.21.15.6:0/3131842805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c819df20 con 0x7ff7c807de50 2024-09-11T23:50:07.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.749+0000 7ff7c57fa640 1 -- 172.21.15.6:0/3131842805 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7b8030e60 con 0x7ff7c807de50 2024-09-11T23:50:07.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.749+0000 7ff7ce373640 1 -- 172.21.15.6:0/3131842805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c81a0c10 con 0x7ff7c807de50 2024-09-11T23:50:07.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.749+0000 7ff7c57fa640 1 -- 172.21.15.6:0/3131842805 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b8037040 con 0x7ff7c807de50 2024-09-11T23:50:07.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.750+0000 7ff7c57fa640 1 -- 172.21.15.6:0/3131842805 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7ff7b8045070 con 0x7ff7c807de50 2024-09-11T23:50:07.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.751+0000 7ff7c57fa640 1 --2- 172.21.15.6:0/3131842805 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff7b00391a0 0x7ff7b003b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:07.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.750+0000 7ff7ce373640 1 -- 172.21.15.6:0/3131842805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c807c330 con 0x7ff7c807de50 2024-09-11T23:50:07.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.751+0000 7ff7c57fa640 1 -- 172.21.15.6:0/3131842805 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff7b806c2a0 con 0x7ff7c807de50 2024-09-11T23:50:07.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.751+0000 7ff7c77fe640 1 --2- 172.21.15.6:0/3131842805 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff7b00391a0 0x7ff7b003b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:07.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.751+0000 7ff7c77fe640 1 --2- 172.21.15.6:0/3131842805 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff7b00391a0 0x7ff7b003b660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0098c0 tx=0x7ff7bc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:07.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.756+0000 7ff7c57fa640 1 -- 172.21.15.6:0/3131842805 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7b8046e00 con 0x7ff7c807de50 2024-09-11T23:50:07.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.930+0000 7ff7ce373640 1 -- 172.21.15.6:0/3131842805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7ff7c81a1200 con 0x7ff7c807de50 2024-09-11T23:50:07.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.931+0000 7ff7c57fa640 1 -- 172.21.15.6:0/3131842805 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7ff7b8045360 con 0x7ff7c807de50 2024-09-11T23:50:07.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.934+0000 7ff7ce373640 1 -- 172.21.15.6:0/3131842805 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff7b00391a0 msgr2=0x7ff7b003b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:07.533 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.934+0000 7ff7ce373640 1 --2- 172.21.15.6:0/3131842805 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff7b00391a0 0x7ff7b003b660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0098c0 tx=0x7ff7bc006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:07.533 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.934+0000 7ff7ce373640 1 -- 172.21.15.6:0/3131842805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 msgr2=0x7ff7c819d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:07.533 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.934+0000 7ff7ce373640 1 --2- 172.21.15.6:0/3131842805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 0x7ff7c819d750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8030cc0 tx=0x7ff7b8030cf0 comp rx=0 tx=0).stop 2024-09-11T23:50:07.533 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.934+0000 7ff7ce373640 1 -- 172.21.15.6:0/3131842805 shutdown_connections 2024-09-11T23:50:07.533 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.934+0000 7ff7ce373640 1 --2- 172.21.15.6:0/3131842805 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff7b00391a0 0x7ff7b003b660 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:07.533 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.934+0000 7ff7ce373640 1 --2- 172.21.15.6:0/3131842805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c807de50 0x7ff7c819d750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:07.533 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.934+0000 7ff7ce373640 1 -- 172.21.15.6:0/3131842805 >> 172.21.15.6:0/3131842805 conn(0x7ff7c8102dd0 msgr2=0x7ff7c8103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:07.533 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.934+0000 7ff7ce373640 1 -- 172.21.15.6:0/3131842805 shutdown_connections 2024-09-11T23:50:07.533 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:06.934+0000 7ff7ce373640 1 -- 172.21.15.6:0/3131842805 wait complete. 2024-09-11T23:50:07.538 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:50:07.538 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2024-09-11T23:50:07.547 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:50:07.547 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-09-11T23:50:07.547 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2024-09-11T23:50:07.547 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-11T23:50:07.549 INFO:teuthology.orchestra.run.smithi006.stdout:Ceph Dashboard is now available at: 2024-09-11T23:50:07.549 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:07.549 INFO:teuthology.orchestra.run.smithi006.stdout: URL: https://smithi006.front.sepia.ceph.com:8443/ 2024-09-11T23:50:07.549 INFO:teuthology.orchestra.run.smithi006.stdout: User: admin 2024-09-11T23:50:07.549 INFO:teuthology.orchestra.run.smithi006.stdout: Password: yf64w274tb 2024-09-11T23:50:07.549 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:07.550 INFO:teuthology.orchestra.run.smithi006.stdout:Saving cluster configuration to /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config directory 2024-09-11T23:50:08.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:08 smithi006 ceph-mon[30947]: mgrmap e13: x(active, since 6s) 2024-09-11T23:50:08.835 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.991+0000 7f6db27e6640 1 Processor -- start 2024-09-11T23:50:08.835 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.991+0000 7f6db27e6640 1 -- start start 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.991+0000 7f6db27e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 0x7f6dac1079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.991+0000 7f6db27e6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac107f70 con 0x7f6dac1075a0 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.991+0000 7f6dabfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 0x7f6dac1079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.991+0000 7f6dabfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 0x7f6dac1079a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34556/0 (socket says 172.21.15.6:34556) 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.991+0000 7f6dabfff640 1 -- 172.21.15.6:0/2526054208 learned_addr learned my addr 172.21.15.6:0/2526054208 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.991+0000 7f6dabfff640 1 -- 172.21.15.6:0/2526054208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac1087a0 con 0x7f6dac1075a0 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.992+0000 7f6dabfff640 1 --2- 172.21.15.6:0/2526054208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 0x7f6dac1079a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009820 tx=0x7f6d9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74b88e902e88dbd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.992+0000 7f6daaffd640 1 -- 172.21.15.6:0/2526054208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c037070 con 0x7f6dac1075a0 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.993+0000 7f6daaffd640 1 -- 172.21.15.6:0/2526054208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d9c0328f0 con 0x7f6dac1075a0 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.993+0000 7f6daaffd640 1 -- 172.21.15.6:0/2526054208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c030740 con 0x7f6dac1075a0 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.993+0000 7f6db27e6640 1 -- 172.21.15.6:0/2526054208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 msgr2=0x7f6dac1079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.993+0000 7f6db27e6640 1 --2- 172.21.15.6:0/2526054208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 0x7f6dac1079a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009820 tx=0x7f6d9c02a270 comp rx=0 tx=0).stop 2024-09-11T23:50:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.993+0000 7f6db27e6640 1 -- 172.21.15.6:0/2526054208 shutdown_connections 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.993+0000 7f6db27e6640 1 --2- 172.21.15.6:0/2526054208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 0x7f6dac1079a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.993+0000 7f6db27e6640 1 -- 172.21.15.6:0/2526054208 >> 172.21.15.6:0/2526054208 conn(0x7f6dac102db0 msgr2=0x7f6dac1051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.993+0000 7f6db27e6640 1 -- 172.21.15.6:0/2526054208 shutdown_connections 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.993+0000 7f6db27e6640 1 -- 172.21.15.6:0/2526054208 wait complete. 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.994+0000 7f6db27e6640 1 Processor -- start 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.994+0000 7f6db27e6640 1 -- start start 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.994+0000 7f6db27e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 0x7f6dac19b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.994+0000 7f6db27e6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac10bb50 con 0x7f6dac1075a0 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.995+0000 7f6dabfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 0x7f6dac19b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.995+0000 7f6dabfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 0x7f6dac19b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34562/0 (socket says 172.21.15.6:34562) 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.995+0000 7f6dabfff640 1 -- 172.21.15.6:0/3544841839 learned_addr learned my addr 172.21.15.6:0/3544841839 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.995+0000 7f6dabfff640 1 -- 172.21.15.6:0/3544841839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac19bab0 con 0x7f6dac1075a0 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.995+0000 7f6dabfff640 1 --2- 172.21.15.6:0/3544841839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 0x7f6dac19b570 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009940 tx=0x7f6d9c030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:08.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.995+0000 7f6da97fa640 1 -- 172.21.15.6:0/3544841839 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c042070 con 0x7f6dac1075a0 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.995+0000 7f6da97fa640 1 -- 172.21.15.6:0/3544841839 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d9c030e30 con 0x7f6dac1075a0 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.995+0000 7f6db27e6640 1 -- 172.21.15.6:0/3544841839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dac19bd40 con 0x7f6dac1075a0 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.995+0000 7f6da97fa640 1 -- 172.21.15.6:0/3544841839 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c037040 con 0x7f6dac1075a0 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.995+0000 7f6db27e6640 1 -- 172.21.15.6:0/3544841839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dac19ea30 con 0x7f6dac1075a0 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.996+0000 7f6da97fa640 1 -- 172.21.15.6:0/3544841839 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f6d9c045070 con 0x7f6dac1075a0 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.996+0000 7f6db27e6640 1 -- 172.21.15.6:0/3544841839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dac10bcd0 con 0x7f6dac1075a0 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.997+0000 7f6da97fa640 1 --2- 172.21.15.6:0/3544841839 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6d94039060 0x7f6d9403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.997+0000 7f6da97fa640 1 -- 172.21.15.6:0/3544841839 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6d9c06c1f0 con 0x7f6dac1075a0 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.997+0000 7f6dab7fe640 1 --2- 172.21.15.6:0/3544841839 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6d94039060 0x7f6d9403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.997+0000 7f6dab7fe640 1 --2- 172.21.15.6:0/3544841839 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6d94039060 0x7f6d9403b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6da00098c0 tx=0x7f6da0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.001+0000 7f6da97fa640 1 -- 172.21.15.6:0/3544841839 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d9c03b330 con 0x7f6dac1075a0 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.268+0000 7f6db27e6640 1 -- 172.21.15.6:0/3544841839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f6dac19ec00 con 0x7f6dac1075a0 2024-09-11T23:50:08.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.270+0000 7f6da97fa640 1 -- 172.21.15.6:0/3544841839 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f6d9c03d950 con 0x7f6dac1075a0 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.272+0000 7f6db27e6640 1 -- 172.21.15.6:0/3544841839 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6d94039060 msgr2=0x7f6d9403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.272+0000 7f6db27e6640 1 --2- 172.21.15.6:0/3544841839 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6d94039060 0x7f6d9403b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6da00098c0 tx=0x7f6da0006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.272+0000 7f6db27e6640 1 -- 172.21.15.6:0/3544841839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 msgr2=0x7f6dac19b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.272+0000 7f6db27e6640 1 --2- 172.21.15.6:0/3544841839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 0x7f6dac19b570 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009940 tx=0x7f6d9c030cc0 comp rx=0 tx=0).stop 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.273+0000 7f6db27e6640 1 -- 172.21.15.6:0/3544841839 shutdown_connections 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.273+0000 7f6db27e6640 1 --2- 172.21.15.6:0/3544841839 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6d94039060 0x7f6d9403b520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.273+0000 7f6db27e6640 1 --2- 172.21.15.6:0/3544841839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dac1075a0 0x7f6dac19b570 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.273+0000 7f6db27e6640 1 -- 172.21.15.6:0/3544841839 >> 172.21.15.6:0/3544841839 conn(0x7f6dac102db0 msgr2=0x7f6dac103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.273+0000 7f6db27e6640 1 -- 172.21.15.6:0/3544841839 shutdown_connections 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.273+0000 7f6db27e6640 1 -- 172.21.15.6:0/3544841839 wait complete. 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:08.839 INFO:teuthology.orchestra.run.smithi006.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout:Or, if you are only running a single cluster on this host: 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout: ceph telemetry on 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout:For more information see: 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:08.840 INFO:teuthology.orchestra.run.smithi006.stdout:Bootstrap complete. 2024-09-11T23:50:08.881 INFO:tasks.cephadm:Fetching config... 2024-09-11T23:50:08.881 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:50:08.881 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-11T23:50:08.899 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-11T23:50:08.899 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:50:08.899 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-11T23:50:08.956 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-11T23:50:08.956 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:50:08.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-11T23:50:09.023 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-11T23:50:09.023 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:50:09.024 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-11T23:50:09.080 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-11T23:50:09.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMKSznTbaj43NO47zZiguxZ9B/YAh3607mdwd++zcKKL3EW8ojpGQj5zBpe3JssknDpbxHAz7S7jWxubMlKSMx8dMakzT3FXJlVXR2H0ePYWeUQPPAofo8AoeO5QoZz03pJ/psnj3iOA/EJEf7ZNtz4KOQcEVc0IFNcp0FDQAt7ZGg8iRHI6qVQoCCdNd5dAOtkrNaYgB+9PdfgZADBwUfpUvQnyaQZfy5VLEaqENuSQYCw3Hl+YBLD3ZsIBhV+C5U3AVRQ24qn8+l7dMo1bynV28LQP7cBLUE9Y9KxBxfXfJOhcjsg13G9sfxRtE846/AnXLnBYA57uavuHKQxDg3saG9Fax2IEV+EFcC0H1e1K1wKn3k5RQSwxkG1Pj1Lb8ey6/gqEUTwRx9Egw5Por2mf7NQYvpmMhU8/mTLO7ssEjtNFdC+iz9Hxr/02RX4eu7FgGp//bOgy6qXbl4l/ZGdJUO8ehRCwQpusO5THy+MxjMKZbs07m1z4gTjdflyAk= ceph-4901345a-7098-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T23:50:09.156 INFO:teuthology.orchestra.run.smithi006.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMKSznTbaj43NO47zZiguxZ9B/YAh3607mdwd++zcKKL3EW8ojpGQj5zBpe3JssknDpbxHAz7S7jWxubMlKSMx8dMakzT3FXJlVXR2H0ePYWeUQPPAofo8AoeO5QoZz03pJ/psnj3iOA/EJEf7ZNtz4KOQcEVc0IFNcp0FDQAt7ZGg8iRHI6qVQoCCdNd5dAOtkrNaYgB+9PdfgZADBwUfpUvQnyaQZfy5VLEaqENuSQYCw3Hl+YBLD3ZsIBhV+C5U3AVRQ24qn8+l7dMo1bynV28LQP7cBLUE9Y9KxBxfXfJOhcjsg13G9sfxRtE846/AnXLnBYA57uavuHKQxDg3saG9Fax2IEV+EFcC0H1e1K1wKn3k5RQSwxkG1Pj1Lb8ey6/gqEUTwRx9Egw5Por2mf7NQYvpmMhU8/mTLO7ssEjtNFdC+iz9Hxr/02RX4eu7FgGp//bOgy6qXbl4l/ZGdJUO8ehRCwQpusO5THy+MxjMKZbs07m1z4gTjdflyAk= ceph-4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:09.175 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMKSznTbaj43NO47zZiguxZ9B/YAh3607mdwd++zcKKL3EW8ojpGQj5zBpe3JssknDpbxHAz7S7jWxubMlKSMx8dMakzT3FXJlVXR2H0ePYWeUQPPAofo8AoeO5QoZz03pJ/psnj3iOA/EJEf7ZNtz4KOQcEVc0IFNcp0FDQAt7ZGg8iRHI6qVQoCCdNd5dAOtkrNaYgB+9PdfgZADBwUfpUvQnyaQZfy5VLEaqENuSQYCw3Hl+YBLD3ZsIBhV+C5U3AVRQ24qn8+l7dMo1bynV28LQP7cBLUE9Y9KxBxfXfJOhcjsg13G9sfxRtE846/AnXLnBYA57uavuHKQxDg3saG9Fax2IEV+EFcC0H1e1K1wKn3k5RQSwxkG1Pj1Lb8ey6/gqEUTwRx9Egw5Por2mf7NQYvpmMhU8/mTLO7ssEjtNFdC+iz9Hxr/02RX4eu7FgGp//bOgy6qXbl4l/ZGdJUO8ehRCwQpusO5THy+MxjMKZbs07m1z4gTjdflyAk= ceph-4901345a-7098-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T23:50:09.226 INFO:teuthology.orchestra.run.smithi039.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMKSznTbaj43NO47zZiguxZ9B/YAh3607mdwd++zcKKL3EW8ojpGQj5zBpe3JssknDpbxHAz7S7jWxubMlKSMx8dMakzT3FXJlVXR2H0ePYWeUQPPAofo8AoeO5QoZz03pJ/psnj3iOA/EJEf7ZNtz4KOQcEVc0IFNcp0FDQAt7ZGg8iRHI6qVQoCCdNd5dAOtkrNaYgB+9PdfgZADBwUfpUvQnyaQZfy5VLEaqENuSQYCw3Hl+YBLD3ZsIBhV+C5U3AVRQ24qn8+l7dMo1bynV28LQP7cBLUE9Y9KxBxfXfJOhcjsg13G9sfxRtE846/AnXLnBYA57uavuHKQxDg3saG9Fax2IEV+EFcC0H1e1K1wKn3k5RQSwxkG1Pj1Lb8ey6/gqEUTwRx9Egw5Por2mf7NQYvpmMhU8/mTLO7ssEjtNFdC+iz9Hxr/02RX4eu7FgGp//bOgy6qXbl4l/ZGdJUO8ehRCwQpusO5THy+MxjMKZbs07m1z4gTjdflyAk= ceph-4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:09.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMKSznTbaj43NO47zZiguxZ9B/YAh3607mdwd++zcKKL3EW8ojpGQj5zBpe3JssknDpbxHAz7S7jWxubMlKSMx8dMakzT3FXJlVXR2H0ePYWeUQPPAofo8AoeO5QoZz03pJ/psnj3iOA/EJEf7ZNtz4KOQcEVc0IFNcp0FDQAt7ZGg8iRHI6qVQoCCdNd5dAOtkrNaYgB+9PdfgZADBwUfpUvQnyaQZfy5VLEaqENuSQYCw3Hl+YBLD3ZsIBhV+C5U3AVRQ24qn8+l7dMo1bynV28LQP7cBLUE9Y9KxBxfXfJOhcjsg13G9sfxRtE846/AnXLnBYA57uavuHKQxDg3saG9Fax2IEV+EFcC0H1e1K1wKn3k5RQSwxkG1Pj1Lb8ey6/gqEUTwRx9Egw5Por2mf7NQYvpmMhU8/mTLO7ssEjtNFdC+iz9Hxr/02RX4eu7FgGp//bOgy6qXbl4l/ZGdJUO8ehRCwQpusO5THy+MxjMKZbs07m1z4gTjdflyAk= ceph-4901345a-7098-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T23:50:09.290 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMKSznTbaj43NO47zZiguxZ9B/YAh3607mdwd++zcKKL3EW8ojpGQj5zBpe3JssknDpbxHAz7S7jWxubMlKSMx8dMakzT3FXJlVXR2H0ePYWeUQPPAofo8AoeO5QoZz03pJ/psnj3iOA/EJEf7ZNtz4KOQcEVc0IFNcp0FDQAt7ZGg8iRHI6qVQoCCdNd5dAOtkrNaYgB+9PdfgZADBwUfpUvQnyaQZfy5VLEaqENuSQYCw3Hl+YBLD3ZsIBhV+C5U3AVRQ24qn8+l7dMo1bynV28LQP7cBLUE9Y9KxBxfXfJOhcjsg13G9sfxRtE846/AnXLnBYA57uavuHKQxDg3saG9Fax2IEV+EFcC0H1e1K1wKn3k5RQSwxkG1Pj1Lb8ey6/gqEUTwRx9Egw5Por2mf7NQYvpmMhU8/mTLO7ssEjtNFdC+iz9Hxr/02RX4eu7FgGp//bOgy6qXbl4l/ZGdJUO8ehRCwQpusO5THy+MxjMKZbs07m1z4gTjdflyAk= ceph-4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:09.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-11T23:50:09.565 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:09.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:09 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3544841839' entity='client.admin' 2024-09-11T23:50:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.077+0000 7f47916f7640 1 -- 172.21.15.6:0/2910866556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f478c0ffe90 msgr2=0x7f478c1022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.077+0000 7f47916f7640 1 --2- 172.21.15.6:0/2910866556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f478c0ffe90 0x7f478c1022a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f477c009880 tx=0x7f477c02a5d0 comp rx=0 tx=0).stop 2024-09-11T23:50:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.077+0000 7f47916f7640 1 -- 172.21.15.6:0/2910866556 shutdown_connections 2024-09-11T23:50:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.077+0000 7f47916f7640 1 --2- 172.21.15.6:0/2910866556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f478c0ffe90 0x7f478c1022a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.077+0000 7f47916f7640 1 -- 172.21.15.6:0/2910866556 >> 172.21.15.6:0/2910866556 conn(0x7f478c0fbc80 msgr2=0x7f478c0fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.077+0000 7f47916f7640 1 -- 172.21.15.6:0/2910866556 shutdown_connections 2024-09-11T23:50:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.078+0000 7f47916f7640 1 -- 172.21.15.6:0/2910866556 wait complete. 2024-09-11T23:50:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.078+0000 7f47916f7640 1 Processor -- start 2024-09-11T23:50:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.078+0000 7f47916f7640 1 -- start start 2024-09-11T23:50:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.079+0000 7f47916f7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f478c0ffe90 0x7f478c19d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.079+0000 7f47916f7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f478c105480 con 0x7f478c0ffe90 2024-09-11T23:50:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.079+0000 7f478affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f478c0ffe90 0x7f478c19d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.079+0000 7f478affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f478c0ffe90 0x7f478c19d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34580/0 (socket says 172.21.15.6:34580) 2024-09-11T23:50:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.079+0000 7f478affd640 1 -- 172.21.15.6:0/3487276103 learned_addr learned my addr 172.21.15.6:0/3487276103 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.079+0000 7f478affd640 1 -- 172.21.15.6:0/3487276103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c19d7b0 con 0x7f478c0ffe90 2024-09-11T23:50:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.079+0000 7f478affd640 1 --2- 172.21.15.6:0/3487276103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f478c0ffe90 0x7f478c19d270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f477c009230 tx=0x7f477c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.079+0000 7f4773fff640 1 -- 172.21.15.6:0/3487276103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477c03f070 con 0x7f478c0ffe90 2024-09-11T23:50:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.079+0000 7f47916f7640 1 -- 172.21.15.6:0/3487276103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478c19da40 con 0x7f478c0ffe90 2024-09-11T23:50:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.079+0000 7f4773fff640 1 -- 172.21.15.6:0/3487276103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f477c003aa0 con 0x7f478c0ffe90 2024-09-11T23:50:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.079+0000 7f4773fff640 1 -- 172.21.15.6:0/3487276103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477c035030 con 0x7f478c0ffe90 2024-09-11T23:50:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.079+0000 7f47916f7640 1 -- 172.21.15.6:0/3487276103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f478c1a0730 con 0x7f478c0ffe90 2024-09-11T23:50:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.080+0000 7f4773fff640 1 -- 172.21.15.6:0/3487276103 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f477c042070 con 0x7f478c0ffe90 2024-09-11T23:50:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.080+0000 7f47916f7640 1 -- 172.21.15.6:0/3487276103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478c105c00 con 0x7f478c0ffe90 2024-09-11T23:50:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.080+0000 7f4773fff640 1 --2- 172.21.15.6:0/3487276103 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4774039060 0x7f477403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.081+0000 7f4773fff640 1 -- 172.21.15.6:0/3487276103 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f477c06cf10 con 0x7f478c0ffe90 2024-09-11T23:50:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.081+0000 7f478a7fc640 1 --2- 172.21.15.6:0/3487276103 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4774039060 0x7f477403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.081+0000 7f478a7fc640 1 --2- 172.21.15.6:0/3487276103 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4774039060 0x7f477403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f47800098c0 tx=0x7f4780006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.085+0000 7f4773fff640 1 -- 172.21.15.6:0/3487276103 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f477c039350 con 0x7f478c0ffe90 2024-09-11T23:50:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.264+0000 7f47916f7640 1 -- 172.21.15.6:0/3487276103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f478c02d830 con 0x7f478c0ffe90 2024-09-11T23:50:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.267+0000 7f4773fff640 1 -- 172.21.15.6:0/3487276103 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f477c02f300 con 0x7f478c0ffe90 2024-09-11T23:50:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.269+0000 7f47916f7640 1 -- 172.21.15.6:0/3487276103 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4774039060 msgr2=0x7f477403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.269+0000 7f47916f7640 1 --2- 172.21.15.6:0/3487276103 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4774039060 0x7f477403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f47800098c0 tx=0x7f4780006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.269+0000 7f47916f7640 1 -- 172.21.15.6:0/3487276103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f478c0ffe90 msgr2=0x7f478c19d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.269+0000 7f47916f7640 1 --2- 172.21.15.6:0/3487276103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f478c0ffe90 0x7f478c19d270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f477c009230 tx=0x7f477c0048f0 comp rx=0 tx=0).stop 2024-09-11T23:50:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.269+0000 7f47916f7640 1 -- 172.21.15.6:0/3487276103 shutdown_connections 2024-09-11T23:50:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.269+0000 7f47916f7640 1 --2- 172.21.15.6:0/3487276103 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4774039060 0x7f477403b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.269+0000 7f47916f7640 1 --2- 172.21.15.6:0/3487276103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f478c0ffe90 0x7f478c19d270 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.269+0000 7f47916f7640 1 -- 172.21.15.6:0/3487276103 >> 172.21.15.6:0/3487276103 conn(0x7f478c0fbc80 msgr2=0x7f478c0fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.269+0000 7f47916f7640 1 -- 172.21.15.6:0/3487276103 shutdown_connections 2024-09-11T23:50:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:10.269+0000 7f47916f7640 1 -- 172.21.15.6:0/3487276103 wait complete. 2024-09-11T23:50:11.600 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:11 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3487276103' entity='client.admin' 2024-09-11T23:50:11.600 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:11 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:11.600 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:11 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:11.600 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:11 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi006", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:50:11.600 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:11 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:11.600 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:11 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:11.600 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:11 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:11.883 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-11T23:50:11.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-11T23:50:12.652 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.107+0000 7f95a9940640 1 -- 172.21.15.6:0/2428301575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95a41015e0 msgr2=0x7f95a41019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.107+0000 7f95a9940640 1 --2- 172.21.15.6:0/2428301575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95a41015e0 0x7f95a41019e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9594009880 tx=0x7f959402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:50:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.107+0000 7f95a9940640 1 -- 172.21.15.6:0/2428301575 shutdown_connections 2024-09-11T23:50:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.107+0000 7f95a9940640 1 --2- 172.21.15.6:0/2428301575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95a41015e0 0x7f95a41019e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.107+0000 7f95a9940640 1 -- 172.21.15.6:0/2428301575 >> 172.21.15.6:0/2428301575 conn(0x7f95a40fcd70 msgr2=0x7f95a40ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.107+0000 7f95a9940640 1 -- 172.21.15.6:0/2428301575 shutdown_connections 2024-09-11T23:50:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.107+0000 7f95a9940640 1 -- 172.21.15.6:0/2428301575 wait complete. 2024-09-11T23:50:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.108+0000 7f95a9940640 1 Processor -- start 2024-09-11T23:50:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.108+0000 7f95a9940640 1 -- start start 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.108+0000 7f95a9940640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95a41015e0 0x7f95a4075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.108+0000 7f95a9940640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f95a41075a0 con 0x7f95a41015e0 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.108+0000 7f95a2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95a41015e0 0x7f95a4075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.108+0000 7f95a2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95a41015e0 0x7f95a4075eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54770/0 (socket says 172.21.15.6:54770) 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.108+0000 7f95a2ffd640 1 -- 172.21.15.6:0/834720612 learned_addr learned my addr 172.21.15.6:0/834720612 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.109+0000 7f95a2ffd640 1 -- 172.21.15.6:0/834720612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a40763f0 con 0x7f95a41015e0 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.109+0000 7f95a2ffd640 1 --2- 172.21.15.6:0/834720612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95a41015e0 0x7f95a4075eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9594005ec0 tx=0x7f95940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.109+0000 7f95a893e640 1 -- 172.21.15.6:0/834720612 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f959403f070 con 0x7f95a41015e0 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.109+0000 7f95a893e640 1 -- 172.21.15.6:0/834720612 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9594003aa0 con 0x7f95a41015e0 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.109+0000 7f95a9940640 1 -- 172.21.15.6:0/834720612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a40745e0 con 0x7f95a41015e0 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.109+0000 7f95a893e640 1 -- 172.21.15.6:0/834720612 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9594035030 con 0x7f95a41015e0 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.109+0000 7f95a9940640 1 -- 172.21.15.6:0/834720612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a4074b20 con 0x7f95a41015e0 2024-09-11T23:50:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.110+0000 7f95a893e640 1 -- 172.21.15.6:0/834720612 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f9594042070 con 0x7f95a41015e0 2024-09-11T23:50:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.110+0000 7f95a9940640 1 -- 172.21.15.6:0/834720612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a4107d20 con 0x7f95a41015e0 2024-09-11T23:50:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.110+0000 7f95a893e640 1 --2- 172.21.15.6:0/834720612 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f95900390c0 0x7f959003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.110+0000 7f95a893e640 1 -- 172.21.15.6:0/834720612 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f959406cd60 con 0x7f95a41015e0 2024-09-11T23:50:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.110+0000 7f95a27fc640 1 --2- 172.21.15.6:0/834720612 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f95900390c0 0x7f959003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.111+0000 7f95a27fc640 1 --2- 172.21.15.6:0/834720612 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f95900390c0 0x7f959003b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f958c0098c0 tx=0x7f958c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.115+0000 7f95a893e640 1 -- 172.21.15.6:0/834720612 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95940433b0 con 0x7f95a41015e0 2024-09-11T23:50:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.296+0000 7f95a9940640 1 -- 172.21.15.6:0/834720612 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f95a4190060 con 0x7f95900390c0 2024-09-11T23:50:13.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.299+0000 7f95a893e640 1 -- 172.21.15.6:0/834720612 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f95a4190060 con 0x7f95900390c0 2024-09-11T23:50:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.301+0000 7f95a9940640 1 -- 172.21.15.6:0/834720612 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f95900390c0 msgr2=0x7f959003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.301+0000 7f95a9940640 1 --2- 172.21.15.6:0/834720612 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f95900390c0 0x7f959003b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f958c0098c0 tx=0x7f958c006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.301+0000 7f95a9940640 1 -- 172.21.15.6:0/834720612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95a41015e0 msgr2=0x7f95a4075eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.301+0000 7f95a9940640 1 --2- 172.21.15.6:0/834720612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95a41015e0 0x7f95a4075eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9594005ec0 tx=0x7f95940048f0 comp rx=0 tx=0).stop 2024-09-11T23:50:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.302+0000 7f95a9940640 1 -- 172.21.15.6:0/834720612 shutdown_connections 2024-09-11T23:50:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.302+0000 7f95a9940640 1 --2- 172.21.15.6:0/834720612 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f95900390c0 0x7f959003b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.302+0000 7f95a9940640 1 --2- 172.21.15.6:0/834720612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95a41015e0 0x7f95a4075eb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.302+0000 7f95a9940640 1 -- 172.21.15.6:0/834720612 >> 172.21.15.6:0/834720612 conn(0x7f95a40fcd70 msgr2=0x7f95a40fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.302+0000 7f95a9940640 1 -- 172.21.15.6:0/834720612 shutdown_connections 2024-09-11T23:50:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:13.302+0000 7f95a9940640 1 -- 172.21.15.6:0/834720612 wait complete. 2024-09-11T23:50:14.074 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi039 2024-09-11T23:50:14.074 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-11T23:50:14.074 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/etc/ceph/ceph.conf 2024-09-11T23:50:14.094 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-11T23:50:14.094 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:14.153 INFO:tasks.cephadm:Adding host smithi039 to orchestrator... 2024-09-11T23:50:14.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch host add smithi039 2024-09-11T23:50:14.409 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:14.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:14 smithi006 ceph-mon[30947]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:14.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:14.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:14.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:14.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:50:14.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:14 smithi006 ceph-mon[30947]: Updating smithi006:/etc/ceph/ceph.conf 2024-09-11T23:50:14.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:14 smithi006 ceph-mon[30947]: Updating smithi006:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:14.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:14 smithi006 ceph-mon[30947]: Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:14.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:14.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:14.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:14.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.879+0000 7f5d58d01640 1 -- 172.21.15.6:0/1788548872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d54102800 msgr2=0x7f5d54102be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.880+0000 7f5d58d01640 1 --2- 172.21.15.6:0/1788548872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d54102800 0x7f5d54102be0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009880 tx=0x7f5d4402a670 comp rx=0 tx=0).stop 2024-09-11T23:50:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.880+0000 7f5d58d01640 1 -- 172.21.15.6:0/1788548872 shutdown_connections 2024-09-11T23:50:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.880+0000 7f5d58d01640 1 --2- 172.21.15.6:0/1788548872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d54102800 0x7f5d54102be0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.880+0000 7f5d58d01640 1 -- 172.21.15.6:0/1788548872 >> 172.21.15.6:0/1788548872 conn(0x7f5d540fc180 msgr2=0x7f5d540fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.880+0000 7f5d58d01640 1 -- 172.21.15.6:0/1788548872 shutdown_connections 2024-09-11T23:50:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.880+0000 7f5d58d01640 1 -- 172.21.15.6:0/1788548872 wait complete. 2024-09-11T23:50:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.880+0000 7f5d58d01640 1 Processor -- start 2024-09-11T23:50:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.880+0000 7f5d58d01640 1 -- start start 2024-09-11T23:50:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.881+0000 7f5d58d01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d54102800 0x7f5d54197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.881+0000 7f5d58d01640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5410bb80 con 0x7f5d54102800 2024-09-11T23:50:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.881+0000 7f5d5259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d54102800 0x7f5d54197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.881+0000 7f5d5259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d54102800 0x7f5d54197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54798/0 (socket says 172.21.15.6:54798) 2024-09-11T23:50:14.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.881+0000 7f5d5259c640 1 -- 172.21.15.6:0/2411534432 learned_addr learned my addr 172.21.15.6:0/2411534432 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:14.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.881+0000 7f5d5259c640 1 -- 172.21.15.6:0/2411534432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d541975d0 con 0x7f5d54102800 2024-09-11T23:50:14.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.881+0000 7f5d5259c640 1 --2- 172.21.15.6:0/2411534432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d54102800 0x7f5d54197090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009230 tx=0x7f5d440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:14.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.881+0000 7f5d437fe640 1 -- 172.21.15.6:0/2411534432 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d4403f070 con 0x7f5d54102800 2024-09-11T23:50:14.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.881+0000 7f5d437fe640 1 -- 172.21.15.6:0/2411534432 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d44004d10 con 0x7f5d54102800 2024-09-11T23:50:14.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.881+0000 7f5d58d01640 1 -- 172.21.15.6:0/2411534432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d54197860 con 0x7f5d54102800 2024-09-11T23:50:14.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.882+0000 7f5d437fe640 1 -- 172.21.15.6:0/2411534432 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d44035030 con 0x7f5d54102800 2024-09-11T23:50:14.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.882+0000 7f5d58d01640 1 -- 172.21.15.6:0/2411534432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d54197cc0 con 0x7f5d54102800 2024-09-11T23:50:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.882+0000 7f5d437fe640 1 -- 172.21.15.6:0/2411534432 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f5d44042070 con 0x7f5d54102800 2024-09-11T23:50:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.883+0000 7f5d437fe640 1 --2- 172.21.15.6:0/2411534432 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5d3c039060 0x7f5d3c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.883+0000 7f5d58d01640 1 -- 172.21.15.6:0/2411534432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d5406a710 con 0x7f5d54102800 2024-09-11T23:50:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.883+0000 7f5d437fe640 1 -- 172.21.15.6:0/2411534432 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5d4406cd10 con 0x7f5d54102800 2024-09-11T23:50:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.883+0000 7f5d51d9b640 1 --2- 172.21.15.6:0/2411534432 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5d3c039060 0x7f5d3c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.883+0000 7f5d51d9b640 1 --2- 172.21.15.6:0/2411534432 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5d3c039060 0x7f5d3c03b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5d480098c0 tx=0x7f5d48006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:14.887+0000 7f5d437fe640 1 -- 172.21.15.6:0/2411534432 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d44042c60 con 0x7f5d54102800 2024-09-11T23:50:15.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:15.068+0000 7f5d58d01640 1 -- 172.21.15.6:0/2411534432 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi039", "target": ["mon-mgr", ""]}) -- 0x7f5d54198450 con 0x7f5d3c039060 2024-09-11T23:50:15.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:15 smithi006 ceph-mon[30947]: Updating smithi006:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:50:16.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:16 smithi006 ceph-mon[30947]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi039", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:17.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:17 smithi006 ceph-mon[30947]: Deploying cephadm binary to smithi039 2024-09-11T23:50:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:18.978+0000 7f5d437fe640 1 -- 172.21.15.6:0/2411534432 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f5d54198450 con 0x7f5d3c039060 2024-09-11T23:50:18.978 INFO:teuthology.orchestra.run.smithi006.stdout:Added host 'smithi039' with addr '172.21.15.39' 2024-09-11T23:50:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:18.980+0000 7f5d58d01640 1 -- 172.21.15.6:0/2411534432 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5d3c039060 msgr2=0x7f5d3c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:18.980+0000 7f5d58d01640 1 --2- 172.21.15.6:0/2411534432 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5d3c039060 0x7f5d3c03b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5d480098c0 tx=0x7f5d48006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:18.980+0000 7f5d58d01640 1 -- 172.21.15.6:0/2411534432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d54102800 msgr2=0x7f5d54197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:18.980+0000 7f5d58d01640 1 --2- 172.21.15.6:0/2411534432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d54102800 0x7f5d54197090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009230 tx=0x7f5d440048f0 comp rx=0 tx=0).stop 2024-09-11T23:50:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:18.980+0000 7f5d58d01640 1 -- 172.21.15.6:0/2411534432 shutdown_connections 2024-09-11T23:50:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:18.980+0000 7f5d58d01640 1 --2- 172.21.15.6:0/2411534432 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5d3c039060 0x7f5d3c03b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:18.980+0000 7f5d58d01640 1 --2- 172.21.15.6:0/2411534432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d54102800 0x7f5d54197090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:18.980+0000 7f5d58d01640 1 -- 172.21.15.6:0/2411534432 >> 172.21.15.6:0/2411534432 conn(0x7f5d540fc180 msgr2=0x7f5d541055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:18.981+0000 7f5d58d01640 1 -- 172.21.15.6:0/2411534432 shutdown_connections 2024-09-11T23:50:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:18.981+0000 7f5d58d01640 1 -- 172.21.15.6:0/2411534432 wait complete. 2024-09-11T23:50:19.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T23:50:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:20.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:20.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:19 smithi006 ceph-mon[30947]: Added host smithi039 2024-09-11T23:50:20.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:20.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:20.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.453+0000 7fd4bc930640 1 -- 172.21.15.6:0/1129190784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b8102730 msgr2=0x7fd4b8102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.453+0000 7fd4bc930640 1 --2- 172.21.15.6:0/1129190784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b8102730 0x7fd4b8102b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009810 tx=0x7fd4a802a540 comp rx=0 tx=0).stop 2024-09-11T23:50:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.453+0000 7fd4bc930640 1 -- 172.21.15.6:0/1129190784 shutdown_connections 2024-09-11T23:50:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.453+0000 7fd4bc930640 1 --2- 172.21.15.6:0/1129190784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b8102730 0x7fd4b8102b10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.453+0000 7fd4bc930640 1 -- 172.21.15.6:0/1129190784 >> 172.21.15.6:0/1129190784 conn(0x7fd4b8077310 msgr2=0x7fd4b80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.453+0000 7fd4bc930640 1 -- 172.21.15.6:0/1129190784 shutdown_connections 2024-09-11T23:50:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.453+0000 7fd4bc930640 1 -- 172.21.15.6:0/1129190784 wait complete. 2024-09-11T23:50:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.453+0000 7fd4bc930640 1 Processor -- start 2024-09-11T23:50:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.454+0000 7fd4bc930640 1 -- start start 2024-09-11T23:50:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.454+0000 7fd4bc930640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b8102730 0x7fd4b8100390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.454+0000 7fd4bc930640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b810bb30 con 0x7fd4b8102730 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.454+0000 7fd4b659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b8102730 0x7fd4b8100390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.454+0000 7fd4b659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b8102730 0x7fd4b8100390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37542/0 (socket says 172.21.15.6:37542) 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.454+0000 7fd4b659c640 1 -- 172.21.15.6:0/3549299837 learned_addr learned my addr 172.21.15.6:0/3549299837 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.454+0000 7fd4b659c640 1 -- 172.21.15.6:0/3549299837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b8102280 con 0x7fd4b8102730 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.454+0000 7fd4b659c640 1 --2- 172.21.15.6:0/3549299837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b8102730 0x7fd4b8100390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8030b30 tx=0x7fd4a8030b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.454+0000 7fd4af7fe640 1 -- 172.21.15.6:0/3549299837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a8040070 con 0x7fd4b8102730 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.454+0000 7fd4af7fe640 1 -- 172.21.15.6:0/3549299837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4a80318b0 con 0x7fd4b8102730 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.455+0000 7fd4bc930640 1 -- 172.21.15.6:0/3549299837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b81008d0 con 0x7fd4b8102730 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.455+0000 7fd4af7fe640 1 -- 172.21.15.6:0/3549299837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a8004950 con 0x7fd4b8102730 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.455+0000 7fd4bc930640 1 -- 172.21.15.6:0/3549299837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b8100d90 con 0x7fd4b8102730 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.455+0000 7fd4af7fe640 1 -- 172.21.15.6:0/3549299837 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fd4a8039040 con 0x7fd4b8102730 2024-09-11T23:50:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.455+0000 7fd4bc930640 1 -- 172.21.15.6:0/3549299837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b8069f90 con 0x7fd4b8102730 2024-09-11T23:50:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.456+0000 7fd4af7fe640 1 --2- 172.21.15.6:0/3549299837 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd4a40390c0 0x7fd4a403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.456+0000 7fd4af7fe640 1 -- 172.21.15.6:0/3549299837 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd4a806d000 con 0x7fd4b8102730 2024-09-11T23:50:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.456+0000 7fd4b5d9b640 1 --2- 172.21.15.6:0/3549299837 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd4a40390c0 0x7fd4a403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.456+0000 7fd4b5d9b640 1 --2- 172.21.15.6:0/3549299837 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd4a40390c0 0x7fd4a403b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00098c0 tx=0x7fd4a0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.460+0000 7fd4af7fe640 1 -- 172.21.15.6:0/3549299837 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4a80051f0 con 0x7fd4b8102730 2024-09-11T23:50:20.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.640+0000 7fd4bc930640 1 -- 172.21.15.6:0/3549299837 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4b81018c0 con 0x7fd4a40390c0 2024-09-11T23:50:20.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.641+0000 7fd4af7fe640 1 -- 172.21.15.6:0/3549299837 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7fd4b81018c0 con 0x7fd4a40390c0 2024-09-11T23:50:20.641 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:20.641 INFO:teuthology.orchestra.run.smithi006.stdout:[{"addr": "172.21.15.6", "hostname": "smithi006", "labels": [], "status": ""}, {"addr": "172.21.15.39", "hostname": "smithi039", "labels": [], "status": ""}] 2024-09-11T23:50:20.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.643+0000 7fd4bc930640 1 -- 172.21.15.6:0/3549299837 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd4a40390c0 msgr2=0x7fd4a403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:20.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.643+0000 7fd4bc930640 1 --2- 172.21.15.6:0/3549299837 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd4a40390c0 0x7fd4a403b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00098c0 tx=0x7fd4a0006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:20.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.643+0000 7fd4bc930640 1 -- 172.21.15.6:0/3549299837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b8102730 msgr2=0x7fd4b8100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:20.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.643+0000 7fd4bc930640 1 --2- 172.21.15.6:0/3549299837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b8102730 0x7fd4b8100390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8030b30 tx=0x7fd4a8030b60 comp rx=0 tx=0).stop 2024-09-11T23:50:20.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.643+0000 7fd4bc930640 1 -- 172.21.15.6:0/3549299837 shutdown_connections 2024-09-11T23:50:20.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.643+0000 7fd4bc930640 1 --2- 172.21.15.6:0/3549299837 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd4a40390c0 0x7fd4a403b580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:20.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.643+0000 7fd4bc930640 1 --2- 172.21.15.6:0/3549299837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b8102730 0x7fd4b8100390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:20.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.643+0000 7fd4bc930640 1 -- 172.21.15.6:0/3549299837 >> 172.21.15.6:0/3549299837 conn(0x7fd4b8077310 msgr2=0x7fd4b81034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:20.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.643+0000 7fd4bc930640 1 -- 172.21.15.6:0/3549299837 shutdown_connections 2024-09-11T23:50:20.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:20.643+0000 7fd4bc930640 1 -- 172.21.15.6:0/3549299837 wait complete. 2024-09-11T23:50:21.327 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi134 2024-09-11T23:50:21.328 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-11T23:50:21.328 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.conf 2024-09-11T23:50:21.347 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-11T23:50:21.347 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:21.405 INFO:tasks.cephadm:Adding host smithi134 to orchestrator... 2024-09-11T23:50:21.405 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch host add smithi134 2024-09-11T23:50:21.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:21 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:21.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:21 smithi006 ceph-mon[30947]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:50:21.662 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:22.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.094+0000 7f652a428640 1 -- 172.21.15.6:0/4117241221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6524102750 msgr2=0x7f6524102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.094+0000 7f652a428640 1 --2- 172.21.15.6:0/4117241221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6524102750 0x7f6524102b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6514009880 tx=0x7f651402a670 comp rx=0 tx=0).stop 2024-09-11T23:50:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.094+0000 7f652a428640 1 -- 172.21.15.6:0/4117241221 shutdown_connections 2024-09-11T23:50:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.094+0000 7f652a428640 1 --2- 172.21.15.6:0/4117241221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6524102750 0x7f6524102b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.094+0000 7f652a428640 1 -- 172.21.15.6:0/4117241221 >> 172.21.15.6:0/4117241221 conn(0x7f65240fc1b0 msgr2=0x7f65240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.094+0000 7f652a428640 1 -- 172.21.15.6:0/4117241221 shutdown_connections 2024-09-11T23:50:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.094+0000 7f652a428640 1 -- 172.21.15.6:0/4117241221 wait complete. 2024-09-11T23:50:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.095+0000 7f652a428640 1 Processor -- start 2024-09-11T23:50:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.095+0000 7f652a428640 1 -- start start 2024-09-11T23:50:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.095+0000 7f652a428640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6524102750 0x7f65241970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.095+0000 7f652a428640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f652410bb70 con 0x7f6524102750 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.095+0000 7f6523fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6524102750 0x7f65241970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.095+0000 7f6523fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6524102750 0x7f65241970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37566/0 (socket says 172.21.15.6:37566) 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.095+0000 7f6523fff640 1 -- 172.21.15.6:0/1749651720 learned_addr learned my addr 172.21.15.6:0/1749651720 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.095+0000 7f6523fff640 1 -- 172.21.15.6:0/1749651720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6524197630 con 0x7f6524102750 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.096+0000 7f6523fff640 1 --2- 172.21.15.6:0/1749651720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6524102750 0x7f65241970f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6514009230 tx=0x7f65140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.096+0000 7f65217fa640 1 -- 172.21.15.6:0/1749651720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f651403f070 con 0x7f6524102750 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.096+0000 7f652a428640 1 -- 172.21.15.6:0/1749651720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65241978c0 con 0x7f6524102750 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.096+0000 7f65217fa640 1 -- 172.21.15.6:0/1749651720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6514004d10 con 0x7f6524102750 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.096+0000 7f65217fa640 1 -- 172.21.15.6:0/1749651720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6514035030 con 0x7f6524102750 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.096+0000 7f652a428640 1 -- 172.21.15.6:0/1749651720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6524197d20 con 0x7f6524102750 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.097+0000 7f65217fa640 1 -- 172.21.15.6:0/1749651720 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f6514042070 con 0x7f6524102750 2024-09-11T23:50:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.097+0000 7f65217fa640 1 --2- 172.21.15.6:0/1749651720 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f650c039060 0x7f650c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:22.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.097+0000 7f65217fa640 1 -- 172.21.15.6:0/1749651720 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f651406cd00 con 0x7f6524102750 2024-09-11T23:50:22.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.097+0000 7f652a428640 1 -- 172.21.15.6:0/1749651720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652406a7b0 con 0x7f6524102750 2024-09-11T23:50:22.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.097+0000 7f65237fe640 1 --2- 172.21.15.6:0/1749651720 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f650c039060 0x7f650c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:22.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.097+0000 7f65237fe640 1 --2- 172.21.15.6:0/1749651720 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f650c039060 0x7f650c03b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f65180098c0 tx=0x7f6518006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:22.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.102+0000 7f65217fa640 1 -- 172.21.15.6:0/1749651720 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f651402f300 con 0x7f6524102750 2024-09-11T23:50:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:22.284+0000 7f652a428640 1 -- 172.21.15.6:0/1749651720 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}) -- 0x7f6524198480 con 0x7f650c039060 2024-09-11T23:50:22.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:22 smithi006 ceph-mon[30947]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:23.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:23 smithi006 ceph-mon[30947]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:23.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:23.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:23.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:23.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:23.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi039", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:50:23.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:23.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:50:24.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:24 smithi006 ceph-mon[30947]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:24.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:24 smithi006 ceph-mon[30947]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-11T23:50:24.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:24 smithi006 ceph-mon[30947]: Updating smithi039:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:24.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:24 smithi006 ceph-mon[30947]: Deploying cephadm binary to smithi134 2024-09-11T23:50:24.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:24 smithi006 ceph-mon[30947]: Updating smithi039:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:24.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:24 smithi006 ceph-mon[30947]: Updating smithi039:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:50:24.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:24.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:24.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:26.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:26.177+0000 7f65217fa640 1 -- 172.21.15.6:0/1749651720 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f6524198480 con 0x7f650c039060 2024-09-11T23:50:26.178 INFO:teuthology.orchestra.run.smithi006.stdout:Added host 'smithi134' with addr '172.21.15.134' 2024-09-11T23:50:26.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:26.179+0000 7f652a428640 1 -- 172.21.15.6:0/1749651720 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f650c039060 msgr2=0x7f650c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:26.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:26.179+0000 7f652a428640 1 --2- 172.21.15.6:0/1749651720 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f650c039060 0x7f650c03b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f65180098c0 tx=0x7f6518006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:26.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:26.179+0000 7f652a428640 1 -- 172.21.15.6:0/1749651720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6524102750 msgr2=0x7f65241970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:26.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:26.179+0000 7f652a428640 1 --2- 172.21.15.6:0/1749651720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6524102750 0x7f65241970f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6514009230 tx=0x7f65140048f0 comp rx=0 tx=0).stop 2024-09-11T23:50:26.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:26.180+0000 7f652a428640 1 -- 172.21.15.6:0/1749651720 shutdown_connections 2024-09-11T23:50:26.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:26.180+0000 7f652a428640 1 --2- 172.21.15.6:0/1749651720 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f650c039060 0x7f650c03b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:26.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:26.180+0000 7f652a428640 1 --2- 172.21.15.6:0/1749651720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6524102750 0x7f65241970f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:26.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:26.180+0000 7f652a428640 1 -- 172.21.15.6:0/1749651720 >> 172.21.15.6:0/1749651720 conn(0x7f65240fc1b0 msgr2=0x7f6524105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:26.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:26.180+0000 7f652a428640 1 -- 172.21.15.6:0/1749651720 shutdown_connections 2024-09-11T23:50:26.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:26.180+0000 7f652a428640 1 -- 172.21.15.6:0/1749651720 wait complete. 2024-09-11T23:50:26.489 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:26 smithi006 ceph-mon[30947]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:26.489 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:26.489 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:26.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T23:50:27.078 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.545+0000 7f1b33e42640 1 -- 172.21.15.6:0/1871619986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b2c106540 msgr2=0x7f1b2c106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.545+0000 7f1b33e42640 1 --2- 172.21.15.6:0/1871619986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b2c106540 0x7f1b2c106920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009c10 tx=0x7f1b2802aa10 comp rx=0 tx=0).stop 2024-09-11T23:50:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.545+0000 7f1b33e42640 1 -- 172.21.15.6:0/1871619986 shutdown_connections 2024-09-11T23:50:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.545+0000 7f1b33e42640 1 --2- 172.21.15.6:0/1871619986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b2c106540 0x7f1b2c106920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.545+0000 7f1b33e42640 1 -- 172.21.15.6:0/1871619986 >> 172.21.15.6:0/1871619986 conn(0x7f1b2c077310 msgr2=0x7f1b2c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.545+0000 7f1b33e42640 1 -- 172.21.15.6:0/1871619986 shutdown_connections 2024-09-11T23:50:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.545+0000 7f1b33e42640 1 -- 172.21.15.6:0/1871619986 wait complete. 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.546+0000 7f1b33e42640 1 Processor -- start 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.546+0000 7f1b33e42640 1 -- start start 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.546+0000 7f1b33e42640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b2c106540 0x7f1b2c197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.546+0000 7f1b33e42640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c10aa20 con 0x7f1b2c106540 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.546+0000 7f1b31bde640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b2c106540 0x7f1b2c197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.546+0000 7f1b31bde640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b2c106540 0x7f1b2c197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37586/0 (socket says 172.21.15.6:37586) 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.546+0000 7f1b31bde640 1 -- 172.21.15.6:0/1919540285 learned_addr learned my addr 172.21.15.6:0/1919540285 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.546+0000 7f1b31bde640 1 -- 172.21.15.6:0/1919540285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2c1975d0 con 0x7f1b2c106540 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.546+0000 7f1b31bde640 1 --2- 172.21.15.6:0/1919540285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b2c106540 0x7f1b2c197090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b28005dd0 tx=0x7f1b2802f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.547+0000 7f1b22ffd640 1 -- 172.21.15.6:0/1919540285 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b28034070 con 0x7f1b2c106540 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.547+0000 7f1b33e42640 1 -- 172.21.15.6:0/1919540285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b2c197860 con 0x7f1b2c106540 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.547+0000 7f1b22ffd640 1 -- 172.21.15.6:0/1919540285 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b2802feb0 con 0x7f1b2c106540 2024-09-11T23:50:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.547+0000 7f1b22ffd640 1 -- 172.21.15.6:0/1919540285 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b28004360 con 0x7f1b2c106540 2024-09-11T23:50:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.547+0000 7f1b33e42640 1 -- 172.21.15.6:0/1919540285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b2c197ce0 con 0x7f1b2c106540 2024-09-11T23:50:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.547+0000 7f1b22ffd640 1 -- 172.21.15.6:0/1919540285 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f1b28037020 con 0x7f1b2c106540 2024-09-11T23:50:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.548+0000 7f1b33e42640 1 -- 172.21.15.6:0/1919540285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b2c101bb0 con 0x7f1b2c106540 2024-09-11T23:50:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.548+0000 7f1b22ffd640 1 --2- 172.21.15.6:0/1919540285 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1b18039060 0x7f1b1803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.548+0000 7f1b22ffd640 1 -- 172.21.15.6:0/1919540285 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1b2806cf40 con 0x7f1b2c106540 2024-09-11T23:50:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.548+0000 7f1b313dd640 1 --2- 172.21.15.6:0/1919540285 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1b18039060 0x7f1b1803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.548+0000 7f1b313dd640 1 --2- 172.21.15.6:0/1919540285 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1b18039060 0x7f1b1803b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0098c0 tx=0x7f1b1c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.553+0000 7f1b22ffd640 1 -- 172.21.15.6:0/1919540285 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b2803f070 con 0x7f1b2c106540 2024-09-11T23:50:27.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.731+0000 7f1b33e42640 1 -- 172.21.15.6:0/1919540285 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b2c069dc0 con 0x7f1b18039060 2024-09-11T23:50:27.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:27 smithi006 ceph-mon[30947]: Added host smithi134 2024-09-11T23:50:27.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:27 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:27.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:27 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:27.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.733+0000 7f1b22ffd640 1 -- 172.21.15.6:0/1919540285 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7f1b2c069dc0 con 0x7f1b18039060 2024-09-11T23:50:27.733 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:27.733 INFO:teuthology.orchestra.run.smithi006.stdout:[{"addr": "172.21.15.6", "hostname": "smithi006", "labels": [], "status": ""}, {"addr": "172.21.15.39", "hostname": "smithi039", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}] 2024-09-11T23:50:27.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.735+0000 7f1b33e42640 1 -- 172.21.15.6:0/1919540285 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1b18039060 msgr2=0x7f1b1803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:27.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.735+0000 7f1b33e42640 1 --2- 172.21.15.6:0/1919540285 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1b18039060 0x7f1b1803b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0098c0 tx=0x7f1b1c006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:27.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.735+0000 7f1b33e42640 1 -- 172.21.15.6:0/1919540285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b2c106540 msgr2=0x7f1b2c197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:27.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.735+0000 7f1b33e42640 1 --2- 172.21.15.6:0/1919540285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b2c106540 0x7f1b2c197090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b28005dd0 tx=0x7f1b2802f980 comp rx=0 tx=0).stop 2024-09-11T23:50:27.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.735+0000 7f1b33e42640 1 -- 172.21.15.6:0/1919540285 shutdown_connections 2024-09-11T23:50:27.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.735+0000 7f1b33e42640 1 --2- 172.21.15.6:0/1919540285 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1b18039060 0x7f1b1803b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:27.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.735+0000 7f1b33e42640 1 --2- 172.21.15.6:0/1919540285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b2c106540 0x7f1b2c197090 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:27.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.735+0000 7f1b33e42640 1 -- 172.21.15.6:0/1919540285 >> 172.21.15.6:0/1919540285 conn(0x7f1b2c077310 msgr2=0x7f1b2c0696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:27.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.735+0000 7f1b33e42640 1 -- 172.21.15.6:0/1919540285 shutdown_connections 2024-09-11T23:50:27.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:27.735+0000 7f1b33e42640 1 -- 172.21.15.6:0/1919540285 wait complete. 2024-09-11T23:50:28.328 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-11T23:50:28.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-11T23:50:28.583 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:28.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:28 smithi006 ceph-mon[30947]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:28.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:28 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:28.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:28 smithi006 ceph-mon[30947]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:50:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.059+0000 7ff9b7476640 1 -- 172.21.15.6:0/1451526054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0106560 msgr2=0x7ff9b0106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.059+0000 7ff9b7476640 1 --2- 172.21.15.6:0/1451526054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0106560 0x7ff9b0106940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009880 tx=0x7ff9ac02a5d0 comp rx=0 tx=0).stop 2024-09-11T23:50:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.059+0000 7ff9b7476640 1 -- 172.21.15.6:0/1451526054 shutdown_connections 2024-09-11T23:50:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.059+0000 7ff9b7476640 1 --2- 172.21.15.6:0/1451526054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0106560 0x7ff9b0106940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.059+0000 7ff9b7476640 1 -- 172.21.15.6:0/1451526054 >> 172.21.15.6:0/1451526054 conn(0x7ff9b00fc1b0 msgr2=0x7ff9b00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.059+0000 7ff9b7476640 1 -- 172.21.15.6:0/1451526054 shutdown_connections 2024-09-11T23:50:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.059+0000 7ff9b7476640 1 -- 172.21.15.6:0/1451526054 wait complete. 2024-09-11T23:50:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.060+0000 7ff9b7476640 1 Processor -- start 2024-09-11T23:50:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.060+0000 7ff9b7476640 1 -- start start 2024-09-11T23:50:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.060+0000 7ff9b7476640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0106560 0x7ff9b0197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.060+0000 7ff9b7476640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b010aa40 con 0x7ff9b0106560 2024-09-11T23:50:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.060+0000 7ff9b5212640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0106560 0x7ff9b0197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.060+0000 7ff9b5212640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0106560 0x7ff9b0197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37598/0 (socket says 172.21.15.6:37598) 2024-09-11T23:50:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.060+0000 7ff9b5212640 1 -- 172.21.15.6:0/2520122034 learned_addr learned my addr 172.21.15.6:0/2520122034 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.060+0000 7ff9b5212640 1 -- 172.21.15.6:0/2520122034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b01983d0 con 0x7ff9b0106560 2024-09-11T23:50:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.060+0000 7ff9b5212640 1 --2- 172.21.15.6:0/2520122034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0106560 0x7ff9b0197e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009230 tx=0x7ff9ac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.061+0000 7ff9a67fc640 1 -- 172.21.15.6:0/2520122034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9ac03f070 con 0x7ff9b0106560 2024-09-11T23:50:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.061+0000 7ff9a67fc640 1 -- 172.21.15.6:0/2520122034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9ac004d10 con 0x7ff9b0106560 2024-09-11T23:50:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.061+0000 7ff9b7476640 1 -- 172.21.15.6:0/2520122034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b0198660 con 0x7ff9b0106560 2024-09-11T23:50:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.061+0000 7ff9a67fc640 1 -- 172.21.15.6:0/2520122034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9ac035030 con 0x7ff9b0106560 2024-09-11T23:50:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.061+0000 7ff9b7476640 1 -- 172.21.15.6:0/2520122034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b0198ac0 con 0x7ff9b0106560 2024-09-11T23:50:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.062+0000 7ff9a67fc640 1 -- 172.21.15.6:0/2520122034 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7ff9ac042070 con 0x7ff9b0106560 2024-09-11T23:50:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.062+0000 7ff9a67fc640 1 --2- 172.21.15.6:0/2520122034 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff99c0390c0 0x7ff99c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.062+0000 7ff9b7476640 1 -- 172.21.15.6:0/2520122034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b0101bd0 con 0x7ff9b0106560 2024-09-11T23:50:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.062+0000 7ff9a67fc640 1 -- 172.21.15.6:0/2520122034 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff9ac06cc60 con 0x7ff9b0106560 2024-09-11T23:50:29.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.062+0000 7ff9b4a11640 1 --2- 172.21.15.6:0/2520122034 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff99c0390c0 0x7ff99c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:29.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.062+0000 7ff9b4a11640 1 --2- 172.21.15.6:0/2520122034 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff99c0390c0 0x7ff99c03b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00098c0 tx=0x7ff9a0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:29.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.067+0000 7ff9a67fc640 1 -- 172.21.15.6:0/2520122034 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9ac0372d0 con 0x7ff9b0106560 2024-09-11T23:50:29.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.246+0000 7ff9b7476640 1 -- 172.21.15.6:0/2520122034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff9b01069c0 con 0x7ff9b0106560 2024-09-11T23:50:29.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.526+0000 7ff9a67fc640 1 -- 172.21.15.6:0/2520122034 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7ff9ac003920 con 0x7ff9b0106560 2024-09-11T23:50:29.525 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2024-09-11T23:50:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.529+0000 7ff9b7476640 1 -- 172.21.15.6:0/2520122034 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff99c0390c0 msgr2=0x7ff99c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.529+0000 7ff9b7476640 1 --2- 172.21.15.6:0/2520122034 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff99c0390c0 0x7ff99c03b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00098c0 tx=0x7ff9a0006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.529+0000 7ff9b7476640 1 -- 172.21.15.6:0/2520122034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0106560 msgr2=0x7ff9b0197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.529+0000 7ff9b7476640 1 --2- 172.21.15.6:0/2520122034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0106560 0x7ff9b0197e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009230 tx=0x7ff9ac0048f0 comp rx=0 tx=0).stop 2024-09-11T23:50:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.529+0000 7ff9b7476640 1 -- 172.21.15.6:0/2520122034 shutdown_connections 2024-09-11T23:50:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.529+0000 7ff9b7476640 1 --2- 172.21.15.6:0/2520122034 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff99c0390c0 0x7ff99c03b580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.529+0000 7ff9b7476640 1 --2- 172.21.15.6:0/2520122034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0106560 0x7ff9b0197e90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.529+0000 7ff9b7476640 1 -- 172.21.15.6:0/2520122034 >> 172.21.15.6:0/2520122034 conn(0x7ff9b00fc1b0 msgr2=0x7ff9b00fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.529+0000 7ff9b7476640 1 -- 172.21.15.6:0/2520122034 shutdown_connections 2024-09-11T23:50:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:29.529+0000 7ff9b7476640 1 -- 172.21.15.6:0/2520122034 wait complete. 2024-09-11T23:50:29.827 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:29 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2520122034' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T23:50:30.169 INFO:tasks.cephadm:Adding mon.a on smithi006 2024-09-11T23:50:30.170 INFO:tasks.cephadm:Adding mon.b on smithi039 2024-09-11T23:50:30.170 INFO:tasks.cephadm:Adding mon.c on smithi134 2024-09-11T23:50:30.170 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi006:172.21.15.6=a;smithi039:172.21.15.39=b;smithi134:172.21.15.134=c' 2024-09-11T23:50:30.413 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-11T23:50:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-11T23:50:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:30 smithi006 ceph-mon[30947]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:30 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2520122034' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T23:50:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:30 smithi006 ceph-mon[30947]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:50:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:30 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:30 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:30 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:30 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:30 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:50:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:30 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:30 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:50:30.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.956+0000 7f307cc86640 1 -- 172.21.15.134:0/377085654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3078100540 msgr2=0x7f3078100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.956+0000 7f307cc86640 1 --2- 172.21.15.134:0/377085654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3078100540 0x7f3078100940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3068009880 tx=0x7f306802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.957+0000 7f307cc86640 1 -- 172.21.15.134:0/377085654 shutdown_connections 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.957+0000 7f307cc86640 1 --2- 172.21.15.134:0/377085654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3078100540 0x7f3078100940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.957+0000 7f307cc86640 1 -- 172.21.15.134:0/377085654 >> 172.21.15.134:0/377085654 conn(0x7f30780fbcd0 msgr2=0x7f30780fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.957+0000 7f307cc86640 1 -- 172.21.15.134:0/377085654 shutdown_connections 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.957+0000 7f307cc86640 1 -- 172.21.15.134:0/377085654 wait complete. 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.957+0000 7f307cc86640 1 Processor -- start 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.957+0000 7f307cc86640 1 -- start start 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.958+0000 7f307cc86640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3078100540 0x7f3078195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.958+0000 7f307cc86640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f30781064a0 con 0x7f3078100540 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.958+0000 7f307659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3078100540 0x7f3078195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.958+0000 7f307659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3078100540 0x7f3078195bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:59446/0 (socket says 172.21.15.134:59446) 2024-09-11T23:50:30.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.958+0000 7f307659c640 1 -- 172.21.15.134:0/3236945725 learned_addr learned my addr 172.21.15.134:0/3236945725 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-11T23:50:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.958+0000 7f307659c640 1 -- 172.21.15.134:0/3236945725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3078196100 con 0x7f3078100540 2024-09-11T23:50:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.958+0000 7f307659c640 1 --2- 172.21.15.134:0/3236945725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3078100540 0x7f3078195bc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3068009230 tx=0x7f30680048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.958+0000 7f30677fe640 1 -- 172.21.15.134:0/3236945725 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f306803f070 con 0x7f3078100540 2024-09-11T23:50:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.959+0000 7f30677fe640 1 -- 172.21.15.134:0/3236945725 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3068003aa0 con 0x7f3078100540 2024-09-11T23:50:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.959+0000 7f307cc86640 1 -- 172.21.15.134:0/3236945725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3078196390 con 0x7f3078100540 2024-09-11T23:50:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.959+0000 7f30677fe640 1 -- 172.21.15.134:0/3236945725 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3068035030 con 0x7f3078100540 2024-09-11T23:50:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.959+0000 7f307cc86640 1 -- 172.21.15.134:0/3236945725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3078199080 con 0x7f3078100540 2024-09-11T23:50:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.959+0000 7f30677fe640 1 -- 172.21.15.134:0/3236945725 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f3068042070 con 0x7f3078100540 2024-09-11T23:50:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.960+0000 7f307cc86640 1 -- 172.21.15.134:0/3236945725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3078106c20 con 0x7f3078100540 2024-09-11T23:50:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.960+0000 7f30677fe640 1 --2- 172.21.15.134:0/3236945725 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f3060039060 0x7f306003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.960+0000 7f30677fe640 1 -- 172.21.15.134:0/3236945725 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f306806ced0 con 0x7f3078100540 2024-09-11T23:50:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.960+0000 7f3075d9b640 1 --2- 172.21.15.134:0/3236945725 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f3060039060 0x7f306003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:30.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.960+0000 7f3075d9b640 1 --2- 172.21.15.134:0/3236945725 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f3060039060 0x7f306003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f306c0098c0 tx=0x7f306c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:30.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:30.964+0000 7f30677fe640 1 -- 172.21.15.134:0/3236945725 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f306802f300 con 0x7f3078100540 2024-09-11T23:50:31.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:31.157+0000 7f307cc86640 1 -- 172.21.15.134:0/3236945725 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi039:172.21.15.39=b;smithi134:172.21.15.134=c", "target": ["mon-mgr", ""]}) -- 0x7f307802d8e0 con 0x7f3060039060 2024-09-11T23:50:31.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:31.163+0000 7f30677fe640 1 -- 172.21.15.134:0/3236945725 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f307802d8e0 con 0x7f3060039060 2024-09-11T23:50:31.163 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mon update... 2024-09-11T23:50:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:31.166+0000 7f307cc86640 1 -- 172.21.15.134:0/3236945725 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f3060039060 msgr2=0x7f306003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:31.166+0000 7f307cc86640 1 --2- 172.21.15.134:0/3236945725 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f3060039060 0x7f306003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f306c0098c0 tx=0x7f306c006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:31.166+0000 7f307cc86640 1 -- 172.21.15.134:0/3236945725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3078100540 msgr2=0x7f3078195bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:31.166+0000 7f307cc86640 1 --2- 172.21.15.134:0/3236945725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3078100540 0x7f3078195bc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3068009230 tx=0x7f30680048f0 comp rx=0 tx=0).stop 2024-09-11T23:50:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:31.166+0000 7f307cc86640 1 -- 172.21.15.134:0/3236945725 shutdown_connections 2024-09-11T23:50:31.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:31.166+0000 7f307cc86640 1 --2- 172.21.15.134:0/3236945725 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f3060039060 0x7f306003b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:31.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:31.166+0000 7f307cc86640 1 --2- 172.21.15.134:0/3236945725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3078100540 0x7f3078195bc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:31.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:31.166+0000 7f307cc86640 1 -- 172.21.15.134:0/3236945725 >> 172.21.15.134:0/3236945725 conn(0x7f30780fbcd0 msgr2=0x7f30780fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:31.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:31.166+0000 7f307cc86640 1 -- 172.21.15.134:0/3236945725 shutdown_connections 2024-09-11T23:50:31.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:31.166+0000 7f307cc86640 1 -- 172.21.15.134:0/3236945725 wait complete. 2024-09-11T23:50:31.779 DEBUG:teuthology.orchestra.run.smithi039:mon.b> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.b.service 2024-09-11T23:50:31.782 DEBUG:teuthology.orchestra.run.smithi134:mon.c> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.c.service 2024-09-11T23:50:31.785 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:50:31.785 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:50:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:31 smithi006 ceph-mon[30947]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-11T23:50:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:31 smithi006 ceph-mon[30947]: Updating smithi134:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:31 smithi006 ceph-mon[30947]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:32.415 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:32 smithi006 ceph-mon[30947]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:32 smithi006 ceph-mon[30947]: Updating smithi134:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:50:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:32 smithi006 ceph-mon[30947]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi039:172.21.15.39=b;smithi134:172.21.15.134=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:32 smithi006 ceph-mon[30947]: Saving service mon spec with placement smithi006:172.21.15.6=a;smithi039:172.21.15.39=b;smithi134:172.21.15.134=c;count:3 2024-09-11T23:50:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:32 smithi006 ceph-mon[30947]: Deploying daemon mon.c on smithi134 2024-09-11T23:50:33.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.283+0000 7f2d4412c640 1 -- 172.21.15.134:0/2596148731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d3c107660 msgr2=0x7f2d3c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:33.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.283+0000 7f2d4412c640 1 --2- 172.21.15.134:0/2596148731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d3c107660 0x7f2d3c107a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009880 tx=0x7f2d3802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:50:33.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.283+0000 7f2d4412c640 1 -- 172.21.15.134:0/2596148731 shutdown_connections 2024-09-11T23:50:33.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.283+0000 7f2d4412c640 1 --2- 172.21.15.134:0/2596148731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d3c107660 0x7f2d3c107a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:33.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.283+0000 7f2d4412c640 1 -- 172.21.15.134:0/2596148731 >> 172.21.15.134:0/2596148731 conn(0x7f2d3c0fd290 msgr2=0x7f2d3c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:33.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.283+0000 7f2d4412c640 1 -- 172.21.15.134:0/2596148731 shutdown_connections 2024-09-11T23:50:33.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.283+0000 7f2d4412c640 1 -- 172.21.15.134:0/2596148731 wait complete. 2024-09-11T23:50:33.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.284+0000 7f2d4412c640 1 Processor -- start 2024-09-11T23:50:33.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.284+0000 7f2d4412c640 1 -- start start 2024-09-11T23:50:33.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.284+0000 7f2d4412c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d3c107660 0x7f2d3c197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:33.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.284+0000 7f2d4412c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c10bb40 con 0x7f2d3c107660 2024-09-11T23:50:33.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.284+0000 7f2d41ec8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d3c107660 0x7f2d3c197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:33.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.284+0000 7f2d41ec8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d3c107660 0x7f2d3c197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:59460/0 (socket says 172.21.15.134:59460) 2024-09-11T23:50:33.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.284+0000 7f2d41ec8640 1 -- 172.21.15.134:0/4291330486 learned_addr learned my addr 172.21.15.134:0/4291330486 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-11T23:50:33.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.285+0000 7f2d41ec8640 1 -- 172.21.15.134:0/4291330486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c197560 con 0x7f2d3c107660 2024-09-11T23:50:33.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.285+0000 7f2d41ec8640 1 --2- 172.21.15.134:0/4291330486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d3c107660 0x7f2d3c197020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009230 tx=0x7f2d380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:33.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.285+0000 7f2d32ffd640 1 -- 172.21.15.134:0/4291330486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3803f070 con 0x7f2d3c107660 2024-09-11T23:50:33.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.285+0000 7f2d4412c640 1 -- 172.21.15.134:0/4291330486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3c1977f0 con 0x7f2d3c107660 2024-09-11T23:50:33.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.285+0000 7f2d32ffd640 1 -- 172.21.15.134:0/4291330486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d38004d10 con 0x7f2d3c107660 2024-09-11T23:50:33.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.285+0000 7f2d32ffd640 1 -- 172.21.15.134:0/4291330486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d38035030 con 0x7f2d3c107660 2024-09-11T23:50:33.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.285+0000 7f2d4412c640 1 -- 172.21.15.134:0/4291330486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d3c19b8f0 con 0x7f2d3c107660 2024-09-11T23:50:33.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.286+0000 7f2d4412c640 1 -- 172.21.15.134:0/4291330486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3c102cd0 con 0x7f2d3c107660 2024-09-11T23:50:33.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.286+0000 7f2d32ffd640 1 -- 172.21.15.134:0/4291330486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f2d38042070 con 0x7f2d3c107660 2024-09-11T23:50:33.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.286+0000 7f2d32ffd640 1 --2- 172.21.15.134:0/4291330486 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2d28039060 0x7f2d2803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:33.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.286+0000 7f2d32ffd640 1 -- 172.21.15.134:0/4291330486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2d3806ccc0 con 0x7f2d3c107660 2024-09-11T23:50:33.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.287+0000 7f2d416c7640 1 --2- 172.21.15.134:0/4291330486 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2d28039060 0x7f2d2803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:33.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.287+0000 7f2d416c7640 1 --2- 172.21.15.134:0/4291330486 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2d28039060 0x7f2d2803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0098c0 tx=0x7f2d2c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:33.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.291+0000 7f2d32ffd640 1 -- 172.21.15.134:0/4291330486 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d3802fdc0 con 0x7f2d3c107660 2024-09-11T23:50:33.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.530+0000 7f2d4412c640 1 -- 172.21.15.134:0/4291330486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2d3c107ac0 con 0x7f2d3c107660 2024-09-11T23:50:33.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.530+0000 7f2d32ffd640 1 -- 172.21.15.134:0/4291330486 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f2d3804c350 con 0x7f2d3c107660 2024-09-11T23:50:33.530 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:50:33.530 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","modified":"2024-09-11T23:49:09.715349Z","created":"2024-09-11T23:49:09.715349Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T23:50:33.530 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-11T23:50:33.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.532+0000 7f2d4412c640 1 -- 172.21.15.134:0/4291330486 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2d28039060 msgr2=0x7f2d2803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:33.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.532+0000 7f2d4412c640 1 --2- 172.21.15.134:0/4291330486 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2d28039060 0x7f2d2803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0098c0 tx=0x7f2d2c006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:33.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.532+0000 7f2d4412c640 1 -- 172.21.15.134:0/4291330486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d3c107660 msgr2=0x7f2d3c197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:33.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.532+0000 7f2d4412c640 1 --2- 172.21.15.134:0/4291330486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d3c107660 0x7f2d3c197020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009230 tx=0x7f2d380048f0 comp rx=0 tx=0).stop 2024-09-11T23:50:33.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.532+0000 7f2d4412c640 1 -- 172.21.15.134:0/4291330486 shutdown_connections 2024-09-11T23:50:33.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.532+0000 7f2d4412c640 1 --2- 172.21.15.134:0/4291330486 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2d28039060 0x7f2d2803b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:33.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.532+0000 7f2d4412c640 1 --2- 172.21.15.134:0/4291330486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d3c107660 0x7f2d3c197020 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:33.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.532+0000 7f2d4412c640 1 -- 172.21.15.134:0/4291330486 >> 172.21.15.134:0/4291330486 conn(0x7f2d3c0fd290 msgr2=0x7f2d3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:33.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.532+0000 7f2d4412c640 1 -- 172.21.15.134:0/4291330486 shutdown_connections 2024-09-11T23:50:33.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:33.533+0000 7f2d4412c640 1 -- 172.21.15.134:0/4291330486 wait complete. 2024-09-11T23:50:33.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:33 smithi006 ceph-mon[30947]: from='client.? 172.21.15.134:0/4291330486' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:50:34.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:34 smithi006 ceph-mon[30947]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:35.170 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:50:35.170 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:50:35.442 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:50:35.754 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:35 smithi134 systemd[1]: Starting Ceph mon.c for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:50:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.951+0000 7f736a0d9640 1 -- 172.21.15.134:0/72330100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7364106660 msgr2=0x7f7364106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.951+0000 7f736a0d9640 1 --2- 172.21.15.134:0/72330100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7364106660 0x7f7364106a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7354009880 tx=0x7f735402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:50:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.951+0000 7f736a0d9640 1 -- 172.21.15.134:0/72330100 shutdown_connections 2024-09-11T23:50:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.951+0000 7f736a0d9640 1 --2- 172.21.15.134:0/72330100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7364106660 0x7f7364106a40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.951+0000 7f736a0d9640 1 -- 172.21.15.134:0/72330100 >> 172.21.15.134:0/72330100 conn(0x7f73640fc250 msgr2=0x7f73640fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.951+0000 7f736a0d9640 1 -- 172.21.15.134:0/72330100 shutdown_connections 2024-09-11T23:50:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.951+0000 7f736a0d9640 1 -- 172.21.15.134:0/72330100 wait complete. 2024-09-11T23:50:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.951+0000 7f736a0d9640 1 Processor -- start 2024-09-11T23:50:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.952+0000 7f736a0d9640 1 -- start start 2024-09-11T23:50:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.952+0000 7f736a0d9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7364106660 0x7f7364198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.952+0000 7f736a0d9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f736410ab40 con 0x7f7364106660 2024-09-11T23:50:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.952+0000 7f73637fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7364106660 0x7f7364198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.952+0000 7f73637fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7364106660 0x7f7364198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:59484/0 (socket says 172.21.15.134:59484) 2024-09-11T23:50:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.952+0000 7f73637fe640 1 -- 172.21.15.134:0/4254738576 learned_addr learned my addr 172.21.15.134:0/4254738576 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-11T23:50:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.952+0000 7f73637fe640 1 -- 172.21.15.134:0/4254738576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73641985d0 con 0x7f7364106660 2024-09-11T23:50:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.953+0000 7f73637fe640 1 --2- 172.21.15.134:0/4254738576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7364106660 0x7f7364198090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7354009230 tx=0x7f73540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.953+0000 7f7360ff9640 1 -- 172.21.15.134:0/4254738576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f735403f070 con 0x7f7364106660 2024-09-11T23:50:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.953+0000 7f736a0d9640 1 -- 172.21.15.134:0/4254738576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7364198860 con 0x7f7364106660 2024-09-11T23:50:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.953+0000 7f7360ff9640 1 -- 172.21.15.134:0/4254738576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7354004d10 con 0x7f7364106660 2024-09-11T23:50:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.953+0000 7f7360ff9640 1 -- 172.21.15.134:0/4254738576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7354035030 con 0x7f7364106660 2024-09-11T23:50:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.953+0000 7f736a0d9640 1 -- 172.21.15.134:0/4254738576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7364198cc0 con 0x7f7364106660 2024-09-11T23:50:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.954+0000 7f736a0d9640 1 -- 172.21.15.134:0/4254738576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7364101cd0 con 0x7f7364106660 2024-09-11T23:50:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.954+0000 7f7360ff9640 1 -- 172.21.15.134:0/4254738576 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f7354042070 con 0x7f7364106660 2024-09-11T23:50:35.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.954+0000 7f7360ff9640 1 --2- 172.21.15.134:0/4254738576 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f734c0390c0 0x7f734c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:35.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.954+0000 7f7360ff9640 1 -- 172.21.15.134:0/4254738576 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f735406cc90 con 0x7f7364106660 2024-09-11T23:50:35.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.955+0000 7f7362ffd640 1 --2- 172.21.15.134:0/4254738576 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f734c0390c0 0x7f734c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:35.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.955+0000 7f7362ffd640 1 --2- 172.21.15.134:0/4254738576 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f734c0390c0 0x7f734c03b580 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f73580098c0 tx=0x7f7358006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:35.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:35.960+0000 7f7360ff9640 1 -- 172.21.15.134:0/4254738576 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73540372d0 con 0x7f7364106660 2024-09-11T23:50:36.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:36.199+0000 7f736a0d9640 1 -- 172.21.15.134:0/4254738576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7364106ac0 con 0x7f7364106660 2024-09-11T23:50:36.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:36.200+0000 7f7360ff9640 1 -- 172.21.15.134:0/4254738576 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f7354042360 con 0x7f7364106660 2024-09-11T23:50:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:50:36.200 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","modified":"2024-09-11T23:49:09.715349Z","created":"2024-09-11T23:49:09.715349Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T23:50:36.200 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-11T23:50:36.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:36.202+0000 7f736a0d9640 1 -- 172.21.15.134:0/4254738576 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f734c0390c0 msgr2=0x7f734c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:36.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:36.202+0000 7f736a0d9640 1 --2- 172.21.15.134:0/4254738576 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f734c0390c0 0x7f734c03b580 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f73580098c0 tx=0x7f7358006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:36.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:36.202+0000 7f736a0d9640 1 -- 172.21.15.134:0/4254738576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7364106660 msgr2=0x7f7364198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:36.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:36.202+0000 7f736a0d9640 1 --2- 172.21.15.134:0/4254738576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7364106660 0x7f7364198090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7354009230 tx=0x7f73540048f0 comp rx=0 tx=0).stop 2024-09-11T23:50:36.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:36.202+0000 7f736a0d9640 1 -- 172.21.15.134:0/4254738576 shutdown_connections 2024-09-11T23:50:36.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:36.202+0000 7f736a0d9640 1 --2- 172.21.15.134:0/4254738576 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f734c0390c0 0x7f734c03b580 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:36.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:36.202+0000 7f736a0d9640 1 --2- 172.21.15.134:0/4254738576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7364106660 0x7f7364198090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:36.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:36.202+0000 7f736a0d9640 1 -- 172.21.15.134:0/4254738576 >> 172.21.15.134:0/4254738576 conn(0x7f73640fc250 msgr2=0x7f7364104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:36.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:36.202+0000 7f736a0d9640 1 -- 172.21.15.134:0/4254738576 shutdown_connections 2024-09-11T23:50:36.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:36.202+0000 7f736a0d9640 1 -- 172.21.15.134:0/4254738576 wait complete. 2024-09-11T23:50:36.299 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 podman[34842]: 2024-09-11 23:50:36.037798695 +0000 UTC m=+0.101172883 container create e1bedf32451d4e9a4291ca7c14041b7723204a901d5d9d8528de454d6c0a3bd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T23:50:36.299 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 podman[34842]: 2024-09-11 23:50:35.953048733 +0000 UTC m=+0.016422927 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:50:36.299 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 podman[34842]: 2024-09-11 23:50:36.249035101 +0000 UTC m=+0.312409283 container init e1bedf32451d4e9a4291ca7c14041b7723204a901d5d9d8528de454d6c0a3bd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-11T23:50:36.299 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 podman[34842]: 2024-09-11 23:50:36.252494654 +0000 UTC m=+0.315868843 container start e1bedf32451d4e9a4291ca7c14041b7723204a901d5d9d8528de454d6c0a3bd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-c, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T23:50:36.299 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T23:50:36.299 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T23:50:36.299 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: pidfile_write: ignore empty --pid-file 2024-09-11T23:50:36.299 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: load: jerasure load: lrc 2024-09-11T23:50:36.299 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: RocksDB version: 7.9.2 2024-09-11T23:50:36.299 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Git sha 0 2024-09-11T23:50:36.300 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T23:50:36.300 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: DB SUMMARY 2024-09-11T23:50:36.300 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: DB Session ID: GJF14NNOTP6UJVHRWPQ1 2024-09-11T23:50:36.300 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: CURRENT file: CURRENT 2024-09-11T23:50:36.300 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T23:50:36.300 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-11T23:50:36.300 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-11T23:50:36.300 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-11T23:50:36.300 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.error_if_exists: 0 2024-09-11T23:50:36.300 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.create_if_missing: 0 2024-09-11T23:50:36.300 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.paranoid_checks: 1 2024-09-11T23:50:36.300 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.env: 0x55f2570f7940 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.info_log: 0x55f25960f6e0 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.statistics: (nil) 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.use_fsync: 0 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_log_file_size: 0 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T23:50:36.301 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.allow_fallocate: 1 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.use_direct_reads: 0 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.db_log_dir: 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.wal_dir: 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T23:50:36.302 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.write_buffer_manager: 0x55f25961edc0 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.unordered_write: 0 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T23:50:36.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.row_cache: None 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.wal_filter: None 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.two_write_queues: 0 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.wal_compression: 0 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.atomic_flush: 0 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.log_readahead_size: 0 2024-09-11T23:50:36.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_background_jobs: 2 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_background_compactions: -1 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_subcompactions: 1 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T23:50:36.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T23:50:36.306 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T23:50:36.306 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T23:50:36.306 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T23:50:36.306 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_open_files: -1 2024-09-11T23:50:36.306 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T23:50:36.307 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T23:50:36.307 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T23:50:36.307 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T23:50:36.307 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_background_flushes: -1 2024-09-11T23:50:36.307 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Compression algorithms supported: 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: kZSTD supported: 0 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: kXpressCompression supported: 0 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: kBZip2Compression supported: 0 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: kLZ4Compression supported: 1 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: kZlibCompression supported: 1 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: kSnappyCompression supported: 1 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T23:50:36.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.merge_operator: 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_filter: None 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f25960f320) 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout: index_type: 0 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout: data_block_index_type: 0 2024-09-11T23:50:36.309 INFO:journalctl@ceph.mon.c.smithi134.stdout: index_shortening: 1 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: checksum: 4 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: no_block_cache: 0 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_cache: 0x55f2596031f0 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_cache_options: 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: capacity : 536870912 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: num_shard_bits : 4 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: strict_capacity_limit : 0 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_cache_compressed: (nil) 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: persistent_cache: (nil) 2024-09-11T23:50:36.310 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_size: 4096 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_size_deviation: 10 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_restart_interval: 16 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: index_block_restart_interval: 1 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: metadata_block_size: 4096 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: partition_filters: 0 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: use_delta_encoding: 1 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: filter_policy: bloomfilter 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: whole_key_filtering: 1 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: verify_compression: 0 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: format_version: 5 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: enable_index_compression: 1 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_align: 0 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: max_auto_readahead_size: 262144 2024-09-11T23:50:36.311 INFO:journalctl@ceph.mon.c.smithi134.stdout: prepopulate_block_cache: 0 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout: initial_auto_readahead_size: 8192 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compression: NoCompression 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.num_levels: 7 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T23:50:36.312 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:50:36.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T23:50:36.314 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T23:50:36.315 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.inplace_update_support: 0 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.bloom_locality: 0 2024-09-11T23:50:36.316 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.max_successive_merges: 0 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.ttl: 2592000 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.enable_blob_files: false 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.min_blob_size: 0 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T23:50:36.317 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T23:50:36.318 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T23:50:36.318 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T23:50:36.318 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T23:50:36.318 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-11T23:50:36.318 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-11T23:50:36.318 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0a8085c5-0c84-46c9-a329-3574f4bd9b12 2024-09-11T23:50:36.318 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098636279480, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-11T23:50:36.318 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-11T23:50:36.318 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098636279908, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726098636, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0a8085c5-0c84-46c9-a329-3574f4bd9b12", "db_session_id": "GJF14NNOTP6UJVHRWPQ1", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-11T23:50:36.318 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098636280001, "job": 1, "event": "recovery_finished"} 2024-09-11T23:50:36.318 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-11T23:50:36.318 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f259630e00 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: DB pointer 0x55f25972c000 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout: ** DB Stats ** 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-09-11T23:50:36.319 INFO:journalctl@ceph.mon.c.smithi134.stdout: ** Compaction Stats [default] ** 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: ** Compaction Stats [default] ** 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-09-11T23:50:36.320 INFO:journalctl@ceph.mon.c.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout: Block cache BinnedLRUCache@0x55f2596031f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: using public_addr v2:172.21.15.134:0/0 -> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2024-09-11T23:50:36.321 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: starting mon.c rank -1 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(???) e0 preinit fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).mds e1 new map 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout: e1 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout: btime 2024-09-11T23:49:14:063630+0000 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout: legacy client fscid: -1 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout: No filesystems configured 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-11T23:50:36.322 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-11T23:50:36.323 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-11T23:50:36.323 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-11T23:50:36.323 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-11T23:50:36.323 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T23:50:36.323 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:50:36.323 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:50:36.323 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:50:36.323 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: Added host smithi134 2024-09-11T23:50:36.323 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:36.323 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:36.323 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:36.323 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2520122034' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2520122034' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:50:36.324 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: Updating smithi134:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: Updating smithi134:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi039:172.21.15.39=b;smithi134:172.21.15.134=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: Saving service mon spec with placement smithi006:172.21.15.6=a;smithi039:172.21.15.39=b;smithi134:172.21.15.134=c;count:3 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: Deploying daemon mon.c on smithi134 2024-09-11T23:50:36.325 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: from='client.? 172.21.15.134:0/4291330486' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:50:36.326 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:36.326 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 ceph-mon[34893]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-11T23:50:36.659 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 bash[34842]: e1bedf32451d4e9a4291ca7c14041b7723204a901d5d9d8528de454d6c0a3bd4 2024-09-11T23:50:36.659 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:36 smithi134 systemd[1]: Started Ceph mon.c for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:50:37.937 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:50:37.937 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:50:38.200 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:50:41.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.611+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2422788878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cdc003530 msgr2=0x7f7cdc0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:41.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.611+0000 7f7cfa99b640 1 --2- 172.21.15.134:0/2422788878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cdc003530 0x7f7cdc0059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7cf41016c0 tx=0x7f7ce402bce0 comp rx=0 tx=0).stop 2024-09-11T23:50:41.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.611+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2422788878 shutdown_connections 2024-09-11T23:50:41.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.611+0000 7f7cfa99b640 1 --2- 172.21.15.134:0/2422788878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cdc003530 0x7f7cdc0059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:41.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.611+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2422788878 >> 172.21.15.134:0/2422788878 conn(0x7f7cf40fc280 msgr2=0x7f7cf40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:41.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.611+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2422788878 shutdown_connections 2024-09-11T23:50:41.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.611+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2422788878 wait complete. 2024-09-11T23:50:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.612+0000 7f7cfa99b640 1 Processor -- start 2024-09-11T23:50:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.612+0000 7f7cfa99b640 1 -- start start 2024-09-11T23:50:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.613+0000 7f7cfa99b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cdc003530 0x7f7cf4197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.613+0000 7f7cfa99b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf4197770 0x7f7cf419bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.613+0000 7f7cfa99b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf4108540 con 0x7f7cf4197770 2024-09-11T23:50:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.613+0000 7f7cfa99b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf41083c0 con 0x7f7cdc003530 2024-09-11T23:50:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.613+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cdc003530 0x7f7cf4197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.613+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cdc003530 0x7f7cf4197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36536/0 (socket says 172.21.15.134:36536) 2024-09-11T23:50:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.613+0000 7f7cf3fff640 1 -- 172.21.15.134:0/2706951264 learned_addr learned my addr 172.21.15.134:0/2706951264 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-11T23:50:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.613+0000 7f7cf3fff640 1 -- 172.21.15.134:0/2706951264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cdc003530 msgr2=0x7f7cf4197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T23:50:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.613+0000 7f7cf3fff640 1 -- 172.21.15.134:0/2706951264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cdc003530 msgr2=0x7f7cf4197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:50:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.613+0000 7f7cf3fff640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cdc003530 0x7f7cf4197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:50:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.613+0000 7f7cf3fff640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cdc003530 0x7f7cf4197230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:50:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.613+0000 7f7cf37fe640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf4197770 0x7f7cf419bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.614+0000 7f7cf37fe640 1 -- 172.21.15.134:0/2706951264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cdc003530 msgr2=0x7f7cf4197230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:50:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.614+0000 7f7cf37fe640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cdc003530 0x7f7cf4197230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.614+0000 7f7cf37fe640 1 -- 172.21.15.134:0/2706951264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf4197d90 con 0x7f7cf4197770 2024-09-11T23:50:41.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.614+0000 7f7cf37fe640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf4197770 0x7f7cf419bb00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800b3d0 tx=0x7f7ce800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:41.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.614+0000 7f7cf17fa640 1 -- 172.21.15.134:0/2706951264 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7ce8011630 con 0x7f7cf4197770 2024-09-11T23:50:41.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.614+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2706951264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf419c040 con 0x7f7cf4197770 2024-09-11T23:50:41.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.614+0000 7f7cf17fa640 1 -- 172.21.15.134:0/2706951264 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ce8011c80 con 0x7f7cf4197770 2024-09-11T23:50:41.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.614+0000 7f7cf17fa640 1 -- 172.21.15.134:0/2706951264 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7ce8010d80 con 0x7f7cf4197770 2024-09-11T23:50:41.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.614+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2706951264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf419c600 con 0x7f7cf4197770 2024-09-11T23:50:41.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.615+0000 7f7cf17fa640 1 -- 172.21.15.134:0/2706951264 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f7ce8018020 con 0x7f7cf4197770 2024-09-11T23:50:41.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.615+0000 7f7cf17fa640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7ce0038df0 0x7f7ce003b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:41.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.615+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2706951264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf419c910 con 0x7f7cf4197770 2024-09-11T23:50:41.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.616+0000 7f7cf17fa640 1 -- 172.21.15.134:0/2706951264 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7ce804bd10 con 0x7f7cf4197770 2024-09-11T23:50:41.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.616+0000 7f7cf3fff640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7ce0038df0 0x7f7ce003b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:41.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.616+0000 7f7cf3fff640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7ce0038df0 0x7f7ce003b2b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4005940 tx=0x7f7ce40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:41.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.621+0000 7f7cf17fa640 1 -- 172.21.15.134:0/2706951264 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ce801f020 con 0x7f7cf4197770 2024-09-11T23:50:41.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: mon.a calling monitor election 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: mon.c calling monitor election 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: monmap epoch 2 2024-09-11T23:50:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: last_changed 2024-09-11T23:50:36.304915+0000 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: created 2024-09-11T23:49:09.715349+0000 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: min_mon_release 19 (squid) 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: election_strategy: 1 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: fsmap 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: mgrmap e13: x(active, since 40s) 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: overall HEALTH_OK 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:41.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:41.706 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:41.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.853+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2706951264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7cf41985c0 con 0x7f7cf4197770 2024-09-11T23:50:41.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.854+0000 7f7cf17fa640 1 -- 172.21.15.134:0/2706951264 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f7ce8018310 con 0x7f7cf4197770 2024-09-11T23:50:41.853 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:50:41.853 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":2,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","modified":"2024-09-11T23:50:36.304915Z","created":"2024-09-11T23:49:09.715349Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T23:50:41.854 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 2 2024-09-11T23:50:41.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.856+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2706951264 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7ce0038df0 msgr2=0x7f7ce003b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:41.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.856+0000 7f7cfa99b640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7ce0038df0 0x7f7ce003b2b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4005940 tx=0x7f7ce40058d0 comp rx=0 tx=0).stop 2024-09-11T23:50:41.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.856+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2706951264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf4197770 msgr2=0x7f7cf419bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:41.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.856+0000 7f7cfa99b640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf4197770 0x7f7cf419bb00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800b3d0 tx=0x7f7ce800b890 comp rx=0 tx=0).stop 2024-09-11T23:50:41.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.856+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2706951264 shutdown_connections 2024-09-11T23:50:41.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.856+0000 7f7cfa99b640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7ce0038df0 0x7f7ce003b2b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:41.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.856+0000 7f7cfa99b640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf4197770 0x7f7cf419bb00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:41.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.856+0000 7f7cfa99b640 1 --2- 172.21.15.134:0/2706951264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cdc003530 0x7f7cf4197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:41.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.856+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2706951264 >> 172.21.15.134:0/2706951264 conn(0x7f7cf40fc280 msgr2=0x7f7cf40fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:41.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.856+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2706951264 shutdown_connections 2024-09-11T23:50:41.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:41.856+0000 7f7cfa99b640 1 -- 172.21.15.134:0/2706951264 wait complete. 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: mon.a calling monitor election 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: mon.c calling monitor election 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:50:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: monmap epoch 2 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: last_changed 2024-09-11T23:50:36.304915+0000 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: created 2024-09-11T23:49:09.715349+0000 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: min_mon_release 19 (squid) 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: election_strategy: 1 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: fsmap 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: mgrmap e13: x(active, since 40s) 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: overall HEALTH_OK 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:41.871 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:41.871 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:42.407 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:42 smithi134 ceph-mon[34893]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:42.408 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:42 smithi134 ceph-mon[34893]: Deploying daemon mon.b on smithi039 2024-09-11T23:50:42.408 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:42 smithi134 ceph-mon[34893]: from='client.? 172.21.15.134:0/2706951264' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:50:42.408 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:42 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:42.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:42 smithi006 ceph-mon[30947]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:42.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:42 smithi006 ceph-mon[30947]: Deploying daemon mon.b on smithi039 2024-09-11T23:50:42.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:42 smithi006 ceph-mon[30947]: from='client.? 172.21.15.134:0/2706951264' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:50:42.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:42 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:43.435 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:50:43.436 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:50:43.686 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:50:44.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.065+0000 7f9681155640 1 -- 172.21.15.134:0/4263625727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f967c106630 msgr2=0x7f967c106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:44.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.065+0000 7f9681155640 1 --2- 172.21.15.134:0/4263625727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f967c106630 0x7f967c106a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9674009880 tx=0x7f967402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:50:44.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.065+0000 7f9681155640 1 -- 172.21.15.134:0/4263625727 shutdown_connections 2024-09-11T23:50:44.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.065+0000 7f9681155640 1 --2- 172.21.15.134:0/4263625727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f967c106630 0x7f967c106a10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:44.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.065+0000 7f9681155640 1 -- 172.21.15.134:0/4263625727 >> 172.21.15.134:0/4263625727 conn(0x7f967c0fc220 msgr2=0x7f967c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:44.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.066+0000 7f9681155640 1 -- 172.21.15.134:0/4263625727 shutdown_connections 2024-09-11T23:50:44.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.066+0000 7f9681155640 1 -- 172.21.15.134:0/4263625727 wait complete. 2024-09-11T23:50:44.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.066+0000 7f9681155640 1 Processor -- start 2024-09-11T23:50:44.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.066+0000 7f9681155640 1 -- start start 2024-09-11T23:50:44.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f9681155640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967c106630 0x7f967c197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:44.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f9681155640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f967c197740 0x7f967c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:44.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f9681155640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f967c10ab10 con 0x7f967c197740 2024-09-11T23:50:44.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f9681155640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f967c10a990 con 0x7f967c106630 2024-09-11T23:50:44.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f967ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967c106630 0x7f967c197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:44.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f967ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967c106630 0x7f967c197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36540/0 (socket says 172.21.15.134:36540) 2024-09-11T23:50:44.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f967ad9d640 1 -- 172.21.15.134:0/2413825755 learned_addr learned my addr 172.21.15.134:0/2413825755 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-11T23:50:44.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f967a59c640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f967c197740 0x7f967c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:44.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f967ad9d640 1 -- 172.21.15.134:0/2413825755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967c106630 msgr2=0x7f967c197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T23:50:44.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f967ad9d640 1 -- 172.21.15.134:0/2413825755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967c106630 msgr2=0x7f967c197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:50:44.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f967ad9d640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967c106630 0x7f967c197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:50:44.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f967ad9d640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967c106630 0x7f967c197200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:50:44.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f967a59c640 1 -- 172.21.15.134:0/2413825755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967c106630 msgr2=0x7f967c197200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:50:44.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f967a59c640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967c106630 0x7f967c197200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:44.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.067+0000 7f967a59c640 1 -- 172.21.15.134:0/2413825755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967c197d60 con 0x7f967c197740 2024-09-11T23:50:44.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.068+0000 7f967a59c640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f967c197740 0x7f967c19bad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f966400b3d0 tx=0x7f966400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:44.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.068+0000 7f9673fff640 1 -- 172.21.15.134:0/2413825755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9664011630 con 0x7f967c197740 2024-09-11T23:50:44.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.068+0000 7f9681155640 1 -- 172.21.15.134:0/2413825755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f967c19c010 con 0x7f967c197740 2024-09-11T23:50:44.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.068+0000 7f9681155640 1 -- 172.21.15.134:0/2413825755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f967c19c5d0 con 0x7f967c197740 2024-09-11T23:50:44.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.068+0000 7f9673fff640 1 -- 172.21.15.134:0/2413825755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9664011c80 con 0x7f967c197740 2024-09-11T23:50:44.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.068+0000 7f9673fff640 1 -- 172.21.15.134:0/2413825755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f966401ad80 con 0x7f967c197740 2024-09-11T23:50:44.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.069+0000 7f9673fff640 1 -- 172.21.15.134:0/2413825755 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f9664018020 con 0x7f967c197740 2024-09-11T23:50:44.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.069+0000 7f9681155640 1 -- 172.21.15.134:0/2413825755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f965c005290 con 0x7f967c197740 2024-09-11T23:50:44.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.069+0000 7f9673fff640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9668038e00 0x7f966803b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:44.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.069+0000 7f9673fff640 1 -- 172.21.15.134:0/2413825755 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f966404bdd0 con 0x7f967c197740 2024-09-11T23:50:44.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.070+0000 7f967ad9d640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9668038e00 0x7f966803b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:44.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.070+0000 7f967ad9d640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9668038e00 0x7f966803b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f96740314f0 tx=0x7f9674031420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:44.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.075+0000 7f9673fff640 1 -- 172.21.15.134:0/2413825755 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f966404f030 con 0x7f967c197740 2024-09-11T23:50:44.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.303+0000 7f9681155640 1 -- 172.21.15.134:0/2413825755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f965c005580 con 0x7f967c197740 2024-09-11T23:50:44.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.303+0000 7f9673fff640 1 -- 172.21.15.134:0/2413825755 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f966401f020 con 0x7f967c197740 2024-09-11T23:50:44.303 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:50:44.303 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":2,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","modified":"2024-09-11T23:50:36.304915Z","created":"2024-09-11T23:49:09.715349Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T23:50:44.303 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 2 2024-09-11T23:50:44.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.305+0000 7f9681155640 1 -- 172.21.15.134:0/2413825755 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9668038e00 msgr2=0x7f966803b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:44.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.305+0000 7f9681155640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9668038e00 0x7f966803b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f96740314f0 tx=0x7f9674031420 comp rx=0 tx=0).stop 2024-09-11T23:50:44.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.305+0000 7f9681155640 1 -- 172.21.15.134:0/2413825755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f967c197740 msgr2=0x7f967c19bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:44.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.305+0000 7f9681155640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f967c197740 0x7f967c19bad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f966400b3d0 tx=0x7f966400b890 comp rx=0 tx=0).stop 2024-09-11T23:50:44.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.305+0000 7f9681155640 1 -- 172.21.15.134:0/2413825755 shutdown_connections 2024-09-11T23:50:44.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.305+0000 7f9681155640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9668038e00 0x7f966803b2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:44.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.305+0000 7f9681155640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f967c197740 0x7f967c19bad0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:44.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.305+0000 7f9681155640 1 --2- 172.21.15.134:0/2413825755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967c106630 0x7f967c197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:44.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.305+0000 7f9681155640 1 -- 172.21.15.134:0/2413825755 >> 172.21.15.134:0/2413825755 conn(0x7f967c0fc220 msgr2=0x7f967c104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:44.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.305+0000 7f9681155640 1 -- 172.21.15.134:0/2413825755 shutdown_connections 2024-09-11T23:50:44.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:44.305+0000 7f9681155640 1 -- 172.21.15.134:0/2413825755 wait complete. 2024-09-11T23:50:44.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:44 smithi134 ceph-mon[34893]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:44.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:44 smithi134 ceph-mon[34893]: from='client.? 172.21.15.134:0/2413825755' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:50:44.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:44 smithi006 ceph-mon[30947]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:44.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:44 smithi006 ceph-mon[30947]: from='client.? 172.21.15.134:0/2413825755' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:50:44.936 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:44 smithi039 ceph-mon[34543]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-11T23:50:44.936 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:44 smithi039 bash[34524]: 5251c8b9cc65fbefb3aff73c7502c41a37a036b50a635945a586d7590d131cd8 2024-09-11T23:50:45.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:44 smithi039 systemd[1]: Started Ceph mon.b for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:50:45.859 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:50:45.859 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:50:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:50:50.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.125+0000 7fbb440b6640 1 -- 172.21.15.134:0/4180205982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb28003530 msgr2=0x7fbb280059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:50.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.125+0000 7fbb440b6640 1 --2- 172.21.15.134:0/4180205982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb28003530 0x7fbb280059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c1016d0 tx=0x7fbb2c02c3f0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.125+0000 7fbb440b6640 1 -- 172.21.15.134:0/4180205982 shutdown_connections 2024-09-11T23:50:50.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.125+0000 7fbb440b6640 1 --2- 172.21.15.134:0/4180205982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb28003530 0x7fbb280059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.125+0000 7fbb440b6640 1 -- 172.21.15.134:0/4180205982 >> 172.21.15.134:0/4180205982 conn(0x7fbb3c0fc250 msgr2=0x7fbb3c0fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:50.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.126+0000 7fbb440b6640 1 -- 172.21.15.134:0/4180205982 shutdown_connections 2024-09-11T23:50:50.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.126+0000 7fbb440b6640 1 -- 172.21.15.134:0/4180205982 wait complete. 2024-09-11T23:50:50.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.127+0000 7fbb440b6640 1 Processor -- start 2024-09-11T23:50:50.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.127+0000 7fbb440b6640 1 -- start start 2024-09-11T23:50:50.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.127+0000 7fbb440b6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb28003530 0x7fbb3c1972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:50.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.127+0000 7fbb440b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c197820 0x7fbb3c19bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:50.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.127+0000 7fbb440b6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3c19c0f0 0x7fbb3c19c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:50.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.127+0000 7fbb440b6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c108550 con 0x7fbb3c197820 2024-09-11T23:50:50.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.127+0000 7fbb440b6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c1083d0 con 0x7fbb3c19c0f0 2024-09-11T23:50:50.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.127+0000 7fbb440b6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c1086d0 con 0x7fbb28003530 2024-09-11T23:50:50.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.127+0000 7fbb41e52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb28003530 0x7fbb3c1972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:50.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41e52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb28003530 0x7fbb3c1972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36228/0 (socket says 172.21.15.134:36228) 2024-09-11T23:50:50.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41e52640 1 -- 172.21.15.134:0/1200565172 learned_addr learned my addr 172.21.15.134:0/1200565172 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-11T23:50:50.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41651640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c197820 0x7fbb3c19bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:50.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb42653640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3c19c0f0 0x7fbb3c19c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:50.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41e52640 1 -- 172.21.15.134:0/1200565172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb28003530 msgr2=0x7fbb3c1972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T23:50:50.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41e52640 1 -- 172.21.15.134:0/1200565172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb28003530 msgr2=0x7fbb3c1972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:50:50.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41e52640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb28003530 0x7fbb3c1972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:50:50.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41e52640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb28003530 0x7fbb3c1972e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:50:50.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb42653640 1 -- 172.21.15.134:0/1200565172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3c19c0f0 msgr2=0x7fbb3c19c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-11T23:50:50.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb42653640 1 -- 172.21.15.134:0/1200565172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3c19c0f0 msgr2=0x7fbb3c19c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:50:50.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb42653640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3c19c0f0 0x7fbb3c19c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:50:50.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb42653640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3c19c0f0 0x7fbb3c19c5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:50:50.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41651640 1 -- 172.21.15.134:0/1200565172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb28003530 msgr2=0x7fbb3c1972e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:50:50.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41651640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb28003530 0x7fbb3c1972e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41651640 1 -- 172.21.15.134:0/1200565172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3c19c0f0 msgr2=0x7fbb3c19c5a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:50:50.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41651640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3c19c0f0 0x7fbb3c19c5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41651640 1 -- 172.21.15.134:0/1200565172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3c1a3e60 con 0x7fbb3c197820 2024-09-11T23:50:50.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb41651640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c197820 0x7fbb3c19bbb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800b450 tx=0x7fbb3800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:50.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb32ffd640 1 -- 172.21.15.134:0/1200565172 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38004230 con 0x7fbb3c197820 2024-09-11T23:50:50.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb32ffd640 1 -- 172.21.15.134:0/1200565172 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb380043d0 con 0x7fbb3c197820 2024-09-11T23:50:50.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.128+0000 7fbb440b6640 1 -- 172.21.15.134:0/1200565172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3c1a4090 con 0x7fbb3c197820 2024-09-11T23:50:50.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.129+0000 7fbb32ffd640 1 -- 172.21.15.134:0/1200565172 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38003be0 con 0x7fbb3c197820 2024-09-11T23:50:50.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.129+0000 7fbb440b6640 1 -- 172.21.15.134:0/1200565172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3c1a45f0 con 0x7fbb3c197820 2024-09-11T23:50:50.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.130+0000 7fbb32ffd640 1 -- 172.21.15.134:0/1200565172 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fbb3800f050 con 0x7fbb3c197820 2024-09-11T23:50:50.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.130+0000 7fbb32ffd640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbb200394f0 0x7fbb2003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:50.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.130+0000 7fbb32ffd640 1 -- 172.21.15.134:0/1200565172 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbb3804bd20 con 0x7fbb3c197820 2024-09-11T23:50:50.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.130+0000 7fbb440b6640 1 -- 172.21.15.134:0/1200565172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb3c109600 con 0x7fbb3c197820 2024-09-11T23:50:50.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.130+0000 7fbb41e52640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbb200394f0 0x7fbb2003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:50.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.131+0000 7fbb41e52640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbb200394f0 0x7fbb2003b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c014040 tx=0x7fbb2c014930 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:50.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.139+0000 7fbb32ffd640 1 -- 172.21.15.134:0/1200565172 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb3800d040 con 0x7fbb3c197820 2024-09-11T23:50:50.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:50.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:50:50.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: mon.a calling monitor election 2024-09-11T23:50:50.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: mon.c calling monitor election 2024-09-11T23:50:50.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:50.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:50.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: monmap epoch 3 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: last_changed 2024-09-11T23:50:44.909231+0000 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: created 2024-09-11T23:49:09.715349+0000 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: min_mon_release 19 (squid) 2024-09-11T23:50:50.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: election_strategy: 1 2024-09-11T23:50:50.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-11T23:50:50.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-11T23:50:50.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: 2: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.b 2024-09-11T23:50:50.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: fsmap 2024-09-11T23:50:50.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:50:50.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: mgrmap e13: x(active, since 49s) 2024-09-11T23:50:50.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: overall HEALTH_OK 2024-09-11T23:50:50.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:50.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:50.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:50.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:50.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.386+0000 7fbb440b6640 1 -- 172.21.15.134:0/1200565172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbb3c1a48d0 con 0x7fbb3c197820 2024-09-11T23:50:50.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.387+0000 7fbb32ffd640 1 -- 172.21.15.134:0/1200565172 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1275 (secure 0 0 0) 0x7fbb38014160 con 0x7fbb3c197820 2024-09-11T23:50:50.387 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:50:50.387 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":3,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","modified":"2024-09-11T23:50:44.909231Z","created":"2024-09-11T23:49:09.715349Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T23:50:50.387 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 3 2024-09-11T23:50:50.387 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:50.388 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:50:50.388 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: mon.a calling monitor election 2024-09-11T23:50:50.388 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: mon.c calling monitor election 2024-09-11T23:50:50.388 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:50.388 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:50.388 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:50.388 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:50.388 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:50.388 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:50.388 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:50.388 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:50.388 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: monmap epoch 3 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: last_changed 2024-09-11T23:50:44.909231+0000 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: created 2024-09-11T23:49:09.715349+0000 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: min_mon_release 19 (squid) 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: election_strategy: 1 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: 2: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.b 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: fsmap 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:50:50.389 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: mgrmap e13: x(active, since 49s) 2024-09-11T23:50:50.390 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: overall HEALTH_OK 2024-09-11T23:50:50.390 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:50.390 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:50.390 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:50.390 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:50.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.389+0000 7fbb440b6640 1 -- 172.21.15.134:0/1200565172 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbb200394f0 msgr2=0x7fbb2003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:50.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.389+0000 7fbb440b6640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbb200394f0 0x7fbb2003b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c014040 tx=0x7fbb2c014930 comp rx=0 tx=0).stop 2024-09-11T23:50:50.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.389+0000 7fbb440b6640 1 -- 172.21.15.134:0/1200565172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c197820 msgr2=0x7fbb3c19bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:50.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.389+0000 7fbb440b6640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c197820 0x7fbb3c19bbb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800b450 tx=0x7fbb3800b910 comp rx=0 tx=0).stop 2024-09-11T23:50:50.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.389+0000 7fbb440b6640 1 -- 172.21.15.134:0/1200565172 shutdown_connections 2024-09-11T23:50:50.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.389+0000 7fbb440b6640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbb200394f0 0x7fbb2003b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.389+0000 7fbb440b6640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3c19c0f0 0x7fbb3c19c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.389+0000 7fbb440b6640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c197820 0x7fbb3c19bbb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.389+0000 7fbb440b6640 1 --2- 172.21.15.134:0/1200565172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb28003530 0x7fbb3c1972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.389+0000 7fbb440b6640 1 -- 172.21.15.134:0/1200565172 >> 172.21.15.134:0/1200565172 conn(0x7fbb3c0fc250 msgr2=0x7fbb3c0fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:50.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.389+0000 7fbb440b6640 1 -- 172.21.15.134:0/1200565172 shutdown_connections 2024-09-11T23:50:50.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:50.389+0000 7fbb440b6640 1 -- 172.21.15.134:0/1200565172 wait complete. 2024-09-11T23:50:50.926 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-11T23:50:50.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-11T23:50:51.156 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:51.157 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:50 smithi134 ceph-mon[34893]: from='client.? 172.21.15.134:0/1200565172' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:50:51.157 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:51.157 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:51.194 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:51.316 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:51.316 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:50 smithi006 ceph-mon[30947]: from='client.? 172.21.15.134:0/1200565172' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:50:51.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:51.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.660+0000 7f2a75f30640 1 -- 172.21.15.6:0/1648043329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a70106540 msgr2=0x7f2a70106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.660+0000 7f2a75f30640 1 --2- 172.21.15.6:0/1648043329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a70106540 0x7f2a70106920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009810 tx=0x7f2a6002a540 comp rx=0 tx=0).stop 2024-09-11T23:50:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.660+0000 7f2a75f30640 1 -- 172.21.15.6:0/1648043329 shutdown_connections 2024-09-11T23:50:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.660+0000 7f2a75f30640 1 --2- 172.21.15.6:0/1648043329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a70106540 0x7f2a70106920 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.660+0000 7f2a75f30640 1 -- 172.21.15.6:0/1648043329 >> 172.21.15.6:0/1648043329 conn(0x7f2a70077310 msgr2=0x7f2a700fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.660+0000 7f2a75f30640 1 -- 172.21.15.6:0/1648043329 shutdown_connections 2024-09-11T23:50:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.660+0000 7f2a75f30640 1 -- 172.21.15.6:0/1648043329 wait complete. 2024-09-11T23:50:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.661+0000 7f2a75f30640 1 Processor -- start 2024-09-11T23:50:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.661+0000 7f2a75f30640 1 -- start start 2024-09-11T23:50:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.661+0000 7f2a75f30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a70106540 0x7f2a70198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.661+0000 7f2a75f30640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a70198680 0x7f2a70198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.661+0000 7f2a75f30640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a701a11b0 0x7f2a701a35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.661+0000 7f2a75f30640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7010a9d0 con 0x7f2a70106540 2024-09-11T23:50:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.661+0000 7f2a75f30640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7010a850 con 0x7f2a70198680 2024-09-11T23:50:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.661+0000 7f2a75f30640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7010ab50 con 0x7f2a701a11b0 2024-09-11T23:50:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a70106540 0x7f2a70198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a70106540 0x7f2a70198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58114/0 (socket says 172.21.15.6:58114) 2024-09-11T23:50:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6f7fe640 1 -- 172.21.15.6:0/95277256 learned_addr learned my addr 172.21.15.6:0/95277256 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:50:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6ffff640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a701a11b0 0x7f2a701a35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6effd640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a70198680 0x7f2a70198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6f7fe640 1 -- 172.21.15.6:0/95277256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a701a11b0 msgr2=0x7f2a701a35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6f7fe640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a701a11b0 0x7f2a701a35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6f7fe640 1 -- 172.21.15.6:0/95277256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a70198680 msgr2=0x7f2a70198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6f7fe640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a70198680 0x7f2a70198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6f7fe640 1 -- 172.21.15.6:0/95277256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a701a3d40 con 0x7f2a70106540 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6f7fe640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a70106540 0x7f2a70198140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a60000c00 tx=0x7f2a60032f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6cff9640 1 -- 172.21.15.6:0/95277256 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60040070 con 0x7f2a70106540 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6cff9640 1 -- 172.21.15.6:0/95277256 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a600318b0 con 0x7f2a70106540 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a6cff9640 1 -- 172.21.15.6:0/95277256 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60045460 con 0x7f2a70106540 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.662+0000 7f2a75f30640 1 -- 172.21.15.6:0/95277256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a701a3fd0 con 0x7f2a70106540 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.663+0000 7f2a75f30640 1 -- 172.21.15.6:0/95277256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a701a43d0 con 0x7f2a70106540 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.664+0000 7f2a6cff9640 1 -- 172.21.15.6:0/95277256 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f2a60039040 con 0x7f2a70106540 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.664+0000 7f2a75f30640 1 -- 172.21.15.6:0/95277256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a70101bb0 con 0x7f2a70106540 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.664+0000 7f2a6cff9640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2a580394f0 0x7f2a5803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.664+0000 7f2a6cff9640 1 -- 172.21.15.6:0/95277256 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2a6006d450 con 0x7f2a70106540 2024-09-11T23:50:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.664+0000 7f2a6effd640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2a580394f0 0x7f2a5803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.665+0000 7f2a6effd640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2a580394f0 0x7f2a5803b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009950 tx=0x7f2a64008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.669+0000 7f2a6cff9640 1 -- 172.21.15.6:0/95277256 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a6004ac10 con 0x7f2a70106540 2024-09-11T23:50:51.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.880+0000 7f2a75f30640 1 -- 172.21.15.6:0/95277256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f2a701a4730 con 0x7f2a70106540 2024-09-11T23:50:51.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.881+0000 7f2a6cff9640 1 -- 172.21.15.6:0/95277256 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7f2a6004d7a0 con 0x7f2a70106540 2024-09-11T23:50:51.880 INFO:teuthology.orchestra.run.smithi006.stdout:# minimal ceph.conf for 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:51.880 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2024-09-11T23:50:51.881 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:51.881 INFO:teuthology.orchestra.run.smithi006.stdout: mon_host = [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2024-09-11T23:50:51.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.884+0000 7f2a75f30640 1 -- 172.21.15.6:0/95277256 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2a580394f0 msgr2=0x7f2a5803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:51.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.884+0000 7f2a75f30640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2a580394f0 0x7f2a5803b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009950 tx=0x7f2a64008040 comp rx=0 tx=0).stop 2024-09-11T23:50:51.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.884+0000 7f2a75f30640 1 -- 172.21.15.6:0/95277256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a70106540 msgr2=0x7f2a70198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:51.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.884+0000 7f2a75f30640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a70106540 0x7f2a70198140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a60000c00 tx=0x7f2a60032f50 comp rx=0 tx=0).stop 2024-09-11T23:50:51.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.884+0000 7f2a75f30640 1 -- 172.21.15.6:0/95277256 shutdown_connections 2024-09-11T23:50:51.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.884+0000 7f2a75f30640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2a580394f0 0x7f2a5803b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.884+0000 7f2a75f30640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a701a11b0 0x7f2a701a35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.884+0000 7f2a75f30640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a70198680 0x7f2a70198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.884+0000 7f2a75f30640 1 --2- 172.21.15.6:0/95277256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a70106540 0x7f2a70198140 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.884+0000 7f2a75f30640 1 -- 172.21.15.6:0/95277256 >> 172.21.15.6:0/95277256 conn(0x7f2a70077310 msgr2=0x7f2a700fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.884+0000 7f2a75f30640 1 -- 172.21.15.6:0/95277256 shutdown_connections 2024-09-11T23:50:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:50:51.884+0000 7f2a75f30640 1 -- 172.21.15.6:0/95277256 wait complete. 2024-09-11T23:50:52.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:52.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:50:52.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: mon.a calling monitor election 2024-09-11T23:50:52.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: mon.c calling monitor election 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: monmap epoch 3 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:52.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: last_changed 2024-09-11T23:50:44.909231+0000 2024-09-11T23:50:52.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: created 2024-09-11T23:49:09.715349+0000 2024-09-11T23:50:52.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: min_mon_release 19 (squid) 2024-09-11T23:50:52.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: election_strategy: 1 2024-09-11T23:50:52.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-11T23:50:52.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-11T23:50:52.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: 2: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.b 2024-09-11T23:50:52.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: fsmap 2024-09-11T23:50:52.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:50:52.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: mgrmap e13: x(active, since 49s) 2024-09-11T23:50:52.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: overall HEALTH_OK 2024-09-11T23:50:52.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.297 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.297 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.297 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:52.297 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='client.? 172.21.15.134:0/1200565172' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:50:52.297 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.297 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:52.604 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-11T23:50:52.604 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:50:52.604 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T23:50:52.633 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:50:52.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:52.699 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-11T23:50:52.699 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T23:50:52.729 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-11T23:50:52.729 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:52.795 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-11T23:50:52.795 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T23:50:52.823 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-11T23:50:52.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:52.863 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: mon.b calling monitor election 2024-09-11T23:50:52.863 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: mon.b calling monitor election 2024-09-11T23:50:52.863 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: mon.c calling monitor election 2024-09-11T23:50:52.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: mon.a calling monitor election 2024-09-11T23:50:52.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T23:50:52.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: monmap epoch 3 2024-09-11T23:50:52.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:52.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: last_changed 2024-09-11T23:50:44.909231+0000 2024-09-11T23:50:52.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: created 2024-09-11T23:49:09.715349+0000 2024-09-11T23:50:52.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: min_mon_release 19 (squid) 2024-09-11T23:50:52.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: election_strategy: 1 2024-09-11T23:50:52.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-11T23:50:52.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-11T23:50:52.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: 2: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.b 2024-09-11T23:50:52.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: fsmap 2024-09-11T23:50:52.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:50:52.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: mgrmap e13: x(active, since 51s) 2024-09-11T23:50:52.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: overall HEALTH_OK 2024-09-11T23:50:52.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.866 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.866 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.866 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.866 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:52.866 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:50:52.866 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:52.888 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: mon.b calling monitor election 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: mon.b calling monitor election 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: mon.c calling monitor election 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: mon.a calling monitor election 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: monmap epoch 3 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: last_changed 2024-09-11T23:50:44.909231+0000 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: created 2024-09-11T23:49:09.715349+0000 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: min_mon_release 19 (squid) 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: election_strategy: 1 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-11T23:50:52.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: 2: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.b 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: fsmap 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: mgrmap e13: x(active, since 51s) 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: overall HEALTH_OK 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.890 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.891 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.891 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:52.891 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:52.891 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:50:52.891 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:52.892 INFO:tasks.cephadm:Adding mgr.x on smithi006 2024-09-11T23:50:52.892 INFO:tasks.cephadm:Adding mgr.y on smithi039 2024-09-11T23:50:52.892 INFO:tasks.cephadm:Adding mgr.z on smithi134 2024-09-11T23:50:52.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi006=x;smithi039=y;smithi134=z' 2024-09-11T23:50:53.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: mon.b calling monitor election 2024-09-11T23:50:53.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: mon.b calling monitor election 2024-09-11T23:50:53.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: mon.c calling monitor election 2024-09-11T23:50:53.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: mon.a calling monitor election 2024-09-11T23:50:53.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T23:50:53.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: monmap epoch 3 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: last_changed 2024-09-11T23:50:44.909231+0000 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: created 2024-09-11T23:49:09.715349+0000 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: min_mon_release 19 (squid) 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: election_strategy: 1 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: 2: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.b 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: fsmap 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: mgrmap e13: x(active, since 51s) 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: overall HEALTH_OK 2024-09-11T23:50:53.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:50:53.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:53.170 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:50:53.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.586+0000 7fc646013640 1 -- 172.21.15.134:0/3493084667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401005f0 msgr2=0x7fc6401009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:53.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.586+0000 7fc646013640 1 --2- 172.21.15.134:0/3493084667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401005f0 0x7fc6401009f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc630009c20 tx=0x7fc63002aa90 comp rx=0 tx=0).stop 2024-09-11T23:50:53.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.586+0000 7fc646013640 1 -- 172.21.15.134:0/3493084667 shutdown_connections 2024-09-11T23:50:53.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.586+0000 7fc646013640 1 --2- 172.21.15.134:0/3493084667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401005f0 0x7fc6401009f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:53.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.586+0000 7fc646013640 1 -- 172.21.15.134:0/3493084667 >> 172.21.15.134:0/3493084667 conn(0x7fc6400fbda0 msgr2=0x7fc6400fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:53.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.586+0000 7fc646013640 1 -- 172.21.15.134:0/3493084667 shutdown_connections 2024-09-11T23:50:53.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.586+0000 7fc646013640 1 -- 172.21.15.134:0/3493084667 wait complete. 2024-09-11T23:50:53.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.586+0000 7fc646013640 1 Processor -- start 2024-09-11T23:50:53.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc646013640 1 -- start start 2024-09-11T23:50:53.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc646013640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6401005f0 0x7fc640199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:53.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc646013640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc640199660 0x7fc64019e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:53.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc646013640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc640199ae0 0x7fc6401a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:53.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc646013640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc640109880 con 0x7fc640199ae0 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc646013640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc640109700 con 0x7fc6401005f0 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc646013640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc640109a00 con 0x7fc640199660 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc63effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc640199660 0x7fc64019e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc63effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc640199660 0x7fc64019e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36234/0 (socket says 172.21.15.134:36234) 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc63effd640 1 -- 172.21.15.134:0/2664262838 learned_addr learned my addr 172.21.15.134:0/2664262838 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc63ffff640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc640199ae0 0x7fc6401a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc63f7fe640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6401005f0 0x7fc640199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc63effd640 1 -- 172.21.15.134:0/2664262838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6401005f0 msgr2=0x7fc640199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc63effd640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6401005f0 0x7fc640199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc63effd640 1 -- 172.21.15.134:0/2664262838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc640199ae0 msgr2=0x7fc6401a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc63effd640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc640199ae0 0x7fc6401a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.587+0000 7fc63effd640 1 -- 172.21.15.134:0/2664262838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6401a1520 con 0x7fc640199660 2024-09-11T23:50:53.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.588+0000 7fc63effd640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc640199660 0x7fc64019e6d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc63400b520 tx=0x7fc63400b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:53.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.588+0000 7fc63cff9640 1 -- 172.21.15.134:0/2664262838 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634004230 con 0x7fc640199660 2024-09-11T23:50:53.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.588+0000 7fc63cff9640 1 -- 172.21.15.134:0/2664262838 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc6340043d0 con 0x7fc640199660 2024-09-11T23:50:53.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.588+0000 7fc63cff9640 1 -- 172.21.15.134:0/2664262838 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634003cf0 con 0x7fc640199660 2024-09-11T23:50:53.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.588+0000 7fc646013640 1 -- 172.21.15.134:0/2664262838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6401a1810 con 0x7fc640199660 2024-09-11T23:50:53.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.588+0000 7fc646013640 1 -- 172.21.15.134:0/2664262838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6401a1d80 con 0x7fc640199660 2024-09-11T23:50:53.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.589+0000 7fc63cff9640 1 -- 172.21.15.134:0/2664262838 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fc63400e070 con 0x7fc640199660 2024-09-11T23:50:53.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.589+0000 7fc646013640 1 -- 172.21.15.134:0/2664262838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc640192640 con 0x7fc640199660 2024-09-11T23:50:53.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.589+0000 7fc63cff9640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc6280394f0 0x7fc62803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:53.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.589+0000 7fc63cff9640 1 -- 172.21.15.134:0/2664262838 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc63404ba80 con 0x7fc640199660 2024-09-11T23:50:53.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.589+0000 7fc63f7fe640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc6280394f0 0x7fc62803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:53.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.590+0000 7fc63f7fe640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc6280394f0 0x7fc62803b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc630000f80 tx=0x7fc63003a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:53.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.594+0000 7fc63cff9640 1 -- 172.21.15.134:0/2664262838 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc634014020 con 0x7fc640199660 2024-09-11T23:50:53.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.773+0000 7fc646013640 1 -- 172.21.15.134:0/2664262838 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi039=y;smithi134=z", "target": ["mon-mgr", ""]}) -- 0x7fc6400626c0 con 0x7fc6280394f0 2024-09-11T23:50:53.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.778+0000 7fc63cff9640 1 -- 172.21.15.134:0/2664262838 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc6400626c0 con 0x7fc6280394f0 2024-09-11T23:50:53.777 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mgr update... 2024-09-11T23:50:53.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.780+0000 7fc646013640 1 -- 172.21.15.134:0/2664262838 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc6280394f0 msgr2=0x7fc62803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:53.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.780+0000 7fc646013640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc6280394f0 0x7fc62803b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc630000f80 tx=0x7fc63003a040 comp rx=0 tx=0).stop 2024-09-11T23:50:53.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.780+0000 7fc646013640 1 -- 172.21.15.134:0/2664262838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc640199660 msgr2=0x7fc64019e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:53.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.780+0000 7fc646013640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc640199660 0x7fc64019e6d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc63400b520 tx=0x7fc63400b9e0 comp rx=0 tx=0).stop 2024-09-11T23:50:53.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.780+0000 7fc646013640 1 -- 172.21.15.134:0/2664262838 shutdown_connections 2024-09-11T23:50:53.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.780+0000 7fc646013640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc6280394f0 0x7fc62803b9b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:53.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.780+0000 7fc646013640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc640199ae0 0x7fc6401a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:53.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.780+0000 7fc646013640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc640199660 0x7fc64019e6d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:53.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.780+0000 7fc646013640 1 --2- 172.21.15.134:0/2664262838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6401005f0 0x7fc640199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:53.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.780+0000 7fc646013640 1 -- 172.21.15.134:0/2664262838 >> 172.21.15.134:0/2664262838 conn(0x7fc6400fbda0 msgr2=0x7fc6400fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:53.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.780+0000 7fc646013640 1 -- 172.21.15.134:0/2664262838 shutdown_connections 2024-09-11T23:50:53.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:50:53.780+0000 7fc646013640 1 -- 172.21.15.134:0/2664262838 wait complete. 2024-09-11T23:50:53.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:53 smithi006 ceph-mon[30947]: Updating smithi134:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:53.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:53 smithi006 ceph-mon[30947]: Updating smithi039:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:53.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:53 smithi006 ceph-mon[30947]: Updating smithi006:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:53.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:53 smithi006 ceph-mon[30947]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T23:50:53.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:53 smithi006 ceph-mon[30947]: Reconfiguring daemon mon.a on smithi006 2024-09-11T23:50:53.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:53 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:53.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:53 smithi134 ceph-mon[34893]: Updating smithi134:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:53.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:53 smithi134 ceph-mon[34893]: Updating smithi039:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:53.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:53 smithi134 ceph-mon[34893]: Updating smithi006:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:53.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:53 smithi134 ceph-mon[34893]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T23:50:53.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:53 smithi134 ceph-mon[34893]: Reconfiguring daemon mon.a on smithi006 2024-09-11T23:50:53.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:53 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:54.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:53 smithi039 ceph-mon[34543]: Updating smithi134:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:54.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:53 smithi039 ceph-mon[34543]: Updating smithi039:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:54.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:53 smithi039 ceph-mon[34543]: Updating smithi006:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:54.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:53 smithi039 ceph-mon[34543]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T23:50:54.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:53 smithi039 ceph-mon[34543]: Reconfiguring daemon mon.a on smithi006 2024-09-11T23:50:54.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:53 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:50:54.311 DEBUG:teuthology.orchestra.run.smithi039:mgr.y> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.y.service 2024-09-11T23:50:54.314 DEBUG:teuthology.orchestra.run.smithi134:mgr.z> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.z.service 2024-09-11T23:50:54.316 INFO:tasks.cephadm:Deploying OSDs... 2024-09-11T23:50:54.317 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:50:54.317 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:50:54.334 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:50:54.334 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2024-09-11T23:50:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:50:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:50:54.393 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-11T23:50:54.393 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:50:54.393 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:50:54.393 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-11 23:50:11.678609501 +0000 2024-09-11T23:50:54.393 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-11 23:45:59.817164606 +0000 2024-09-11T23:50:54.393 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-11 23:45:59.817164606 +0000 2024-09-11T23:50:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-09-11 23:45:59.817164606 +0000 2024-09-11T23:50:54.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:50:54.462 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-11T23:50:54.462 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-11T23:50:54.462 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000269312 s, 1.9 MB/s 2024-09-11T23:50:54.463 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:50:54.521 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2024-09-11T23:50:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:50:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:50:54.578 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T23:50:54.578 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:50:54.578 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:50:54.578 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-11 23:50:11.715609116 +0000 2024-09-11T23:50:54.578 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-11 23:46:00.147161184 +0000 2024-09-11T23:50:54.578 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-11 23:46:00.147161184 +0000 2024-09-11T23:50:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-09-11 23:46:00.147161184 +0000 2024-09-11T23:50:54.578 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:50:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-11T23:50:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-11T23:50:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000169265 s, 3.0 MB/s 2024-09-11T23:50:54.644 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:50:54.701 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2024-09-11T23:50:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:50:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:50:54.757 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-11T23:50:54.757 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:50:54.757 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:50:54.757 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-11 23:50:11.752608731 +0000 2024-09-11T23:50:54.757 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-11 23:46:00.481157721 +0000 2024-09-11T23:50:54.757 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-11 23:46:00.481157721 +0000 2024-09-11T23:50:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-09-11 23:46:00.481157721 +0000 2024-09-11T23:50:54.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:50:54.821 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-11T23:50:54.821 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-11T23:50:54.822 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000256792 s, 2.0 MB/s 2024-09-11T23:50:54.823 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:50:54.879 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2024-09-11T23:50:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:50:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:50:54.936 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-11T23:50:54.936 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:50:54.936 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:50:54.936 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-11 23:50:11.788608357 +0000 2024-09-11T23:50:54.936 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-11 23:46:00.822154185 +0000 2024-09-11T23:50:54.936 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-11 23:46:00.822154185 +0000 2024-09-11T23:50:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-09-11 23:46:00.822154185 +0000 2024-09-11T23:50:54.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:50:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-11T23:50:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-11T23:50:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000261751 s, 2.0 MB/s 2024-09-11T23:50:55.001 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:50:55.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:54 smithi039 ceph-mon[34543]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:55.048 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:54 smithi039 ceph-mon[34543]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi039=y;smithi134=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:55.048 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:54 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:55.048 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:54 smithi039 ceph-mon[34543]: Saving service mgr spec with placement smithi006=x;smithi039=y;smithi134=z;count:3 2024-09-11T23:50:55.048 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:54 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:55.048 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:54 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:55.048 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:54 smithi039 ceph-mon[34543]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T23:50:55.048 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:54 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:50:55.048 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:54 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:50:55.048 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:54 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:55.048 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:54 smithi039 ceph-mon[34543]: Reconfiguring daemon mgr.x on smithi006 2024-09-11T23:50:55.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-11T23:50:55.058 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:50:55.078 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:50:55.078 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2024-09-11T23:50:55.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:54 smithi006 ceph-mon[30947]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:55.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:54 smithi006 ceph-mon[30947]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi039=y;smithi134=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:55.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:54 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:55.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:54 smithi006 ceph-mon[30947]: Saving service mgr spec with placement smithi006=x;smithi039=y;smithi134=z;count:3 2024-09-11T23:50:55.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:54 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:55.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:54 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:55.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:54 smithi006 ceph-mon[30947]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T23:50:55.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:54 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:50:55.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:54 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:50:55.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:54 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:55.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:54 smithi006 ceph-mon[30947]: Reconfiguring daemon mgr.x on smithi006 2024-09-11T23:50:55.138 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:50:55.138 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:50:55.138 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-11T23:50:55.138 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:50:55.138 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:50:55.138 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-11 23:50:44.376523501 +0000 2024-09-11T23:50:55.138 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-11 23:46:00.244160384 +0000 2024-09-11T23:50:55.138 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-11 23:46:00.244160384 +0000 2024-09-11T23:50:55.138 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-11 23:46:00.244160384 +0000 2024-09-11T23:50:55.139 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:50:55.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:54 smithi134 ceph-mon[34893]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:55.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:54 smithi134 ceph-mon[34893]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi039=y;smithi134=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:55.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:54 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:55.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:54 smithi134 ceph-mon[34893]: Saving service mgr spec with placement smithi006=x;smithi039=y;smithi134=z;count:3 2024-09-11T23:50:55.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:54 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:55.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:54 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:55.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:54 smithi134 ceph-mon[34893]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T23:50:55.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:54 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:50:55.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:54 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:50:55.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:54 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:55.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:54 smithi134 ceph-mon[34893]: Reconfiguring daemon mgr.x on smithi006 2024-09-11T23:50:55.206 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-11T23:50:55.206 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-11T23:50:55.206 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000307721 s, 1.7 MB/s 2024-09-11T23:50:55.207 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:50:55.270 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2024-09-11T23:50:55.327 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:50:55.327 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:50:55.327 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-11T23:50:55.327 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:50:55.328 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:50:55.328 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-11 23:50:44.376523501 +0000 2024-09-11T23:50:55.328 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-11 23:46:00.590154143 +0000 2024-09-11T23:50:55.328 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-11 23:46:00.590154143 +0000 2024-09-11T23:50:55.328 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-11 23:46:00.590154143 +0000 2024-09-11T23:50:55.328 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:50:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-11T23:50:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-11T23:50:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000294272 s, 1.7 MB/s 2024-09-11T23:50:55.393 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:50:55.450 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2024-09-11T23:50:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:50:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:50:55.508 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-11T23:50:55.508 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:50:55.508 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:50:55.508 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-11 23:50:44.376523501 +0000 2024-09-11T23:50:55.508 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-11 23:46:00.929148029 +0000 2024-09-11T23:50:55.508 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-11 23:46:00.929148029 +0000 2024-09-11T23:50:55.508 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-11 23:46:00.929148029 +0000 2024-09-11T23:50:55.508 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:50:55.573 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-11T23:50:55.573 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-11T23:50:55.573 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000293764 s, 1.7 MB/s 2024-09-11T23:50:55.574 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:50:55.632 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2024-09-11T23:50:55.689 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:50:55.689 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:50:55.689 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-11T23:50:55.689 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:50:55.689 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:50:55.689 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-11 23:50:44.377523483 +0000 2024-09-11T23:50:55.689 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-11 23:46:01.285141608 +0000 2024-09-11T23:50:55.689 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-11 23:46:01.285141608 +0000 2024-09-11T23:50:55.689 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-11 23:46:01.285141608 +0000 2024-09-11T23:50:55.690 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:50:55.754 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-11T23:50:55.754 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-11T23:50:55.754 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000300249 s, 1.7 MB/s 2024-09-11T23:50:55.755 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:50:55.813 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-11T23:50:55.813 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:50:55.832 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:50:55.833 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-11T23:50:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:50:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:50:55.892 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-11T23:50:55.892 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:50:55.892 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:50:55.892 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-11 23:50:35.602684907 +0000 2024-09-11T23:50:55.892 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-11 23:45:55.373741706 +0000 2024-09-11T23:50:55.892 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-11 23:45:55.373741706 +0000 2024-09-11T23:50:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-11 23:45:55.373741706 +0000 2024-09-11T23:50:55.893 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:50:55.959 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-11T23:50:55.959 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-11T23:50:55.959 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000230737 s, 2.2 MB/s 2024-09-11T23:50:55.961 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:50:56.019 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-11T23:50:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:50:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:50:56.077 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T23:50:56.077 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:50:56.078 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:50:56.078 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-11 23:50:35.602684907 +0000 2024-09-11T23:50:56.078 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-11 23:45:55.704733550 +0000 2024-09-11T23:50:56.078 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-11 23:45:55.704733550 +0000 2024-09-11T23:50:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-11 23:45:55.704733550 +0000 2024-09-11T23:50:56.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:50:56.142 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-11T23:50:56.143 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-11T23:50:56.143 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000185234 s, 2.8 MB/s 2024-09-11T23:50:56.144 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:50:56.201 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-11T23:50:56.258 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:50:56.259 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:50:56.259 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-11T23:50:56.259 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:50:56.259 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:50:56.259 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-11 23:50:35.603684884 +0000 2024-09-11T23:50:56.259 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-11 23:45:56.022725713 +0000 2024-09-11T23:50:56.259 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-11 23:45:56.022725713 +0000 2024-09-11T23:50:56.259 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-11 23:45:56.022725713 +0000 2024-09-11T23:50:56.260 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:50:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-11T23:50:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-11T23:50:56.324 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000199717 s, 2.6 MB/s 2024-09-11T23:50:56.325 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:50:56.382 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-11T23:50:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:50:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:50:56.438 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-11T23:50:56.438 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:50:56.438 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:50:56.438 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-11 23:50:35.603684884 +0000 2024-09-11T23:50:56.438 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-11 23:45:56.353717557 +0000 2024-09-11T23:50:56.438 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-11 23:45:56.353717557 +0000 2024-09-11T23:50:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-11 23:45:56.353717557 +0000 2024-09-11T23:50:56.439 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:50:56.502 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:56 smithi134 ceph-mon[34893]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:56.502 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:56 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:56.502 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:56 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:56.502 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:56 smithi134 ceph-mon[34893]: Reconfiguring mon.b (monmap changed)... 2024-09-11T23:50:56.502 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:56 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:56.502 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:56 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:50:56.502 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:56 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:56.502 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:56 smithi134 ceph-mon[34893]: Reconfiguring daemon mon.b on smithi039 2024-09-11T23:50:56.504 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-11T23:50:56.504 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-11T23:50:56.504 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000187372 s, 2.7 MB/s 2024-09-11T23:50:56.506 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:50:56.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:56 smithi039 ceph-mon[34543]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:56.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:56 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:56.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:56 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:56.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:56 smithi039 ceph-mon[34543]: Reconfiguring mon.b (monmap changed)... 2024-09-11T23:50:56.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:56 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:56.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:56 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:50:56.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:56 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:56.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:56 smithi039 ceph-mon[34543]: Reconfiguring daemon mon.b on smithi039 2024-09-11T23:50:56.562 INFO:tasks.cephadm:Deploying osd.0 on smithi006 with /dev/vg_nvme/lv_4... 2024-09-11T23:50:56.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T23:50:56.588 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:56 smithi006 ceph-mon[30947]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:56.589 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:56 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:56.589 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:56 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:56.589 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:56 smithi006 ceph-mon[30947]: Reconfiguring mon.b (monmap changed)... 2024-09-11T23:50:56.589 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:56 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:56.589 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:56 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:50:56.589 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:56 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:56.589 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:56 smithi006 ceph-mon[30947]: Reconfiguring daemon mon.b on smithi039 2024-09-11T23:50:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:57.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:57.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:57.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:57 smithi006 ceph-mon[30947]: Reconfiguring mon.c (monmap changed)... 2024-09-11T23:50:57.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:57.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:50:57.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:57.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:57 smithi006 ceph-mon[30947]: Reconfiguring daemon mon.c on smithi134 2024-09-11T23:50:57.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:57.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:57.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:57 smithi039 ceph-mon[34543]: Reconfiguring mon.c (monmap changed)... 2024-09-11T23:50:57.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:57.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:50:57.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:57.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:57 smithi039 ceph-mon[34543]: Reconfiguring daemon mon.c on smithi134 2024-09-11T23:50:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:57 smithi134 ceph-mon[34893]: Reconfiguring mon.c (monmap changed)... 2024-09-11T23:50:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:50:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:50:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:57 smithi134 ceph-mon[34893]: Reconfiguring daemon mon.c on smithi134 2024-09-11T23:50:58.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:58 smithi006 ceph-mon[30947]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:58.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:58.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:58.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:58.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:58.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:50:58.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:58.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:50:58.871 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:50:58.871 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:50:58.871 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:58.871 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:50:58 smithi006 ceph-mon[30947]: Deploying daemon mgr.z on smithi134 2024-09-11T23:50:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:58 smithi134 ceph-mon[34893]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:50:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:50:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:50:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:50:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:50:58 smithi134 ceph-mon[34893]: Deploying daemon mgr.z on smithi134 2024-09-11T23:50:59.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:58 smithi039 ceph-mon[34543]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:50:59.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:59.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:59.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:59.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:59.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:50:59.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:50:59.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:50:59.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:50:59.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:50:59.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:59.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:50:58 smithi039 ceph-mon[34543]: Deploying daemon mgr.z on smithi134 2024-09-11T23:50:59.291 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:50:59.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi006:vg_nvme/lv_4 2024-09-11T23:50:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:59.672 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:50:59 smithi134 systemd[1]: Starting Ceph mgr.z for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:50:59.953 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:50:59 smithi134 podman[36689]: 2024-09-11 23:50:59.575908715 +0000 UTC m=+0.015943248 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:50:59.954 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:50:59 smithi134 podman[36689]: 2024-09-11 23:50:59.673903705 +0000 UTC m=+0.113938228 container create 8d7ce96313ecc51db189c15c76805520e3939dc087809860887b58f3d14f330f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T23:50:59.954 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:50:59 smithi134 podman[36689]: 2024-09-11 23:50:59.843187242 +0000 UTC m=+0.283221762 container init 8d7ce96313ecc51db189c15c76805520e3939dc087809860887b58f3d14f330f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T23:50:59.954 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:50:59 smithi134 podman[36689]: 2024-09-11 23:50:59.845893964 +0000 UTC m=+0.285928484 container start 8d7ce96313ecc51db189c15c76805520e3939dc087809860887b58f3d14f330f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-11T23:50:59.954 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:50:59 smithi134 ceph-mgr[36708]: -- 172.21.15.134:0/3162789604 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5568ed15f0e0 con 0x5568ed13c800 2024-09-11T23:50:59.954 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:50:59 smithi134 bash[36689]: 8d7ce96313ecc51db189c15c76805520e3939dc087809860887b58f3d14f330f 2024-09-11T23:50:59.954 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:50:59 smithi134 systemd[1]: Started Ceph mgr.z for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:51:00.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.057+0000 7fbca7279640 1 -- 172.21.15.6:0/3993254201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca01014d0 msgr2=0x7fbca0101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:00.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.057+0000 7fbca7279640 1 --2- 172.21.15.6:0/3993254201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca01014d0 0x7fbca0101950 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009900 tx=0x7fbc9002a410 comp rx=0 tx=0).stop 2024-09-11T23:51:00.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.057+0000 7fbca7279640 1 -- 172.21.15.6:0/3993254201 shutdown_connections 2024-09-11T23:51:00.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.057+0000 7fbca7279640 1 --2- 172.21.15.6:0/3993254201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbca0101e90 0x7fbca0108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.057+0000 7fbca7279640 1 --2- 172.21.15.6:0/3993254201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca01014d0 0x7fbca0101950 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.057+0000 7fbca7279640 1 --2- 172.21.15.6:0/3993254201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbca01002d0 0x7fbca01006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.057+0000 7fbca7279640 1 -- 172.21.15.6:0/3993254201 >> 172.21.15.6:0/3993254201 conn(0x7fbca00fba80 msgr2=0x7fbca00fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.057+0000 7fbca7279640 1 -- 172.21.15.6:0/3993254201 shutdown_connections 2024-09-11T23:51:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.057+0000 7fbca7279640 1 -- 172.21.15.6:0/3993254201 wait complete. 2024-09-11T23:51:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.057+0000 7fbca7279640 1 Processor -- start 2024-09-11T23:51:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.057+0000 7fbca7279640 1 -- start start 2024-09-11T23:51:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca7279640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbca01002d0 0x7fbca0104260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca7279640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbca01014d0 0x7fbca01028b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca7279640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca0101e90 0x7fbca0102df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca7279640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbca010c620 con 0x7fbca0101e90 2024-09-11T23:51:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca7279640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbca010c4a0 con 0x7fbca01014d0 2024-09-11T23:51:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca7279640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbca010c7a0 con 0x7fbca01002d0 2024-09-11T23:51:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca5015640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbca01002d0 0x7fbca0104260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca5816640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca0101e90 0x7fbca0102df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca5015640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbca01002d0 0x7fbca0104260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:57442/0 (socket says 172.21.15.6:57442) 2024-09-11T23:51:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca4814640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbca01014d0 0x7fbca01028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca5015640 1 -- 172.21.15.6:0/1761452343 learned_addr learned my addr 172.21.15.6:0/1761452343 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:51:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca5816640 1 -- 172.21.15.6:0/1761452343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbca01002d0 msgr2=0x7fbca0104260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca5816640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbca01002d0 0x7fbca0104260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca5816640 1 -- 172.21.15.6:0/1761452343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbca01014d0 msgr2=0x7fbca01028b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca5816640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbca01014d0 0x7fbca01028b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca5816640 1 -- 172.21.15.6:0/1761452343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca01036b0 con 0x7fbca0101e90 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca4814640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbca01014d0 0x7fbca01028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbca5816640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca0101e90 0x7fbca0102df0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009fd0 tx=0x7fbc9800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.058+0000 7fbc967fc640 1 -- 172.21.15.6:0/1761452343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9800ce20 con 0x7fbca0101e90 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.059+0000 7fbca7279640 1 -- 172.21.15.6:0/1761452343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca01a1fd0 con 0x7fbca0101e90 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.059+0000 7fbc967fc640 1 -- 172.21.15.6:0/1761452343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc98005020 con 0x7fbca0101e90 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.059+0000 7fbc967fc640 1 -- 172.21.15.6:0/1761452343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc98010690 con 0x7fbca0101e90 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.059+0000 7fbca7279640 1 -- 172.21.15.6:0/1761452343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca01a2480 con 0x7fbca0101e90 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.059+0000 7fbc967fc640 1 -- 172.21.15.6:0/1761452343 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fbc98010830 con 0x7fbca0101e90 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.060+0000 7fbc967fc640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbc8c039290 0x7fbc8c03b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.060+0000 7fbc967fc640 1 -- 172.21.15.6:0/1761452343 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbc9804c9f0 con 0x7fbca0101e90 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.060+0000 7fbca7279640 1 -- 172.21.15.6:0/1761452343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca01098d0 con 0x7fbca0101e90 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.060+0000 7fbca5015640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbc8c039290 0x7fbc8c03b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.060+0000 7fbca5015640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbc8c039290 0x7fbc8c03b750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0058c0 tx=0x7fbc9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:00.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.064+0000 7fbc967fc640 1 -- 172.21.15.6:0/1761452343 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc98014230 con 0x7fbca0101e90 2024-09-11T23:51:00.242 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:50:59 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:50:59.968+0000 7f8e2cf85040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:51:00.243 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:00.028+0000 7f8e2cf85040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:51:00.243 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:00.176+0000 7f8e2cf85040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:51:00.243 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:00.243+0000 7f8e2cf85040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:51:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:00.254+0000 7fbca7279640 1 -- 172.21.15.6:0/1761452343 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fbca0062630 con 0x7fbc8c039290 2024-09-11T23:51:00.526 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:00.389+0000 7f8e2cf85040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:51:00.527 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:00.527+0000 7f8e2cf85040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:51:00.839 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-mon[34893]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:00.840 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:00.840 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:00.840 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:00.840 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:51:00.840 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:51:00.840 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:51:00.840 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:00.840 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:51:00.840 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:51:00.840 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:00.978 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:00 smithi006 ceph-mon[30947]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:00.978 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:00.978 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:00.978 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:00.978 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:51:00.978 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:51:00.978 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:51:00.978 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:00.978 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:51:00.979 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:51:00.979 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:00 smithi039 ceph-mon[34543]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:51:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:51:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:51:01.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:01.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:51:01.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:51:01.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:01.203 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:00.840+0000 7f8e2cf85040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:51:01.203 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:00 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:00.901+0000 7f8e2cf85040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:51:01.203 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:01 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:01.083+0000 7f8e2cf85040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:51:01.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:01 smithi006 ceph-mon[30947]: Deploying daemon mgr.y on smithi039 2024-09-11T23:51:01.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:01 smithi006 ceph-mon[30947]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:01.931 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:01 smithi039 ceph-mon[34543]: Deploying daemon mgr.y on smithi039 2024-09-11T23:51:01.931 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:01 smithi039 ceph-mon[34543]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:02.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:01 smithi134 ceph-mon[34893]: Deploying daemon mgr.y on smithi039 2024-09-11T23:51:02.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:01 smithi134 ceph-mon[34893]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:02.033 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:01 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:01.966+0000 7f8e2cf85040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:51:02.033 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:02.033+0000 7f8e2cf85040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:51:02.266 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:02 smithi039 systemd[1]: Started Ceph mgr.y for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:51:02.544 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:02.266+0000 7f341c533040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:51:02.544 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:02.326+0000 7f341c533040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:51:02.544 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:02.485+0000 7f341c533040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:51:02.873 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:02.556+0000 7f341c533040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:51:02.873 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:02.721+0000 7f341c533040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:51:02.873 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:02.873+0000 7f341c533040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:51:02.873 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-mon[34543]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:02.873 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:02.873 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:02.873 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:02.874 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:02.874 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:02.874 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1041963696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32cb5f2f-250f-4cf6-ad78-a79f03f5cc10"}]: dispatch 2024-09-11T23:51:02.874 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1041963696' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32cb5f2f-250f-4cf6-ad78-a79f03f5cc10"}]': finished 2024-09-11T23:51:02.874 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-mon[34543]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T23:51:02.874 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:03.037 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:02.790+0000 7f8e2cf85040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:51:03.037 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:02.907+0000 7f8e2cf85040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:51:03.037 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-mon[34893]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:03.037 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.037 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.037 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.038 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.038 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:03.038 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1041963696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32cb5f2f-250f-4cf6-ad78-a79f03f5cc10"}]: dispatch 2024-09-11T23:51:03.038 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1041963696' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32cb5f2f-250f-4cf6-ad78-a79f03f5cc10"}]': finished 2024-09-11T23:51:03.038 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-mon[34893]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T23:51:03.038 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:03.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:02 smithi006 ceph-mon[30947]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:03.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:03.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:02 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1041963696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32cb5f2f-250f-4cf6-ad78-a79f03f5cc10"}]: dispatch 2024-09-11T23:51:03.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:02 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1041963696' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32cb5f2f-250f-4cf6-ad78-a79f03f5cc10"}]': finished 2024-09-11T23:51:03.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:02 smithi006 ceph-mon[30947]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T23:51:03.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:03.212 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:03 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:03.213+0000 7f341c533040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:51:03.342 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:03.058+0000 7f8e2cf85040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:51:03.342 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:03.120+0000 7f8e2cf85040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:51:03.342 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:03.269+0000 7f8e2cf85040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:51:03.342 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:03.342+0000 7f8e2cf85040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:51:03.480 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:03 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:03.277+0000 7f341c533040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:51:03.641 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:03.407+0000 7f8e2cf85040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:51:03.641 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:03.574+0000 7f8e2cf85040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:51:03.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1220317142' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:51:03.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.928 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.928 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.928 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:03.928 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:03.928 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:03.928 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:03.928 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:03.643+0000 7f8e2cf85040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:51:03.928 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:03.712+0000 7f8e2cf85040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:51:03.928 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:03.801+0000 7f8e2cf85040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:51:03.928 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:03.865+0000 7f8e2cf85040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:51:03.929 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:03.928+0000 7f8e2cf85040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:51:04.044 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:03 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:03.480+0000 7f341c533040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:51:04.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:03 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1220317142' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:51:04.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:04.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:04.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:04.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:04.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:04.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:04.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:04.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:03 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1220317142' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:51:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:04.786 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:04 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:04.414+0000 7f341c533040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:51:04.786 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:04 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:04.484+0000 7f341c533040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:51:04.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:04.906+0000 7fbc967fc640 1 -- 172.21.15.6:0/1761452343 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 14) ==== 92059+0+0 (secure 0 0 0) 0x7fbc9800f8e0 con 0x7fbca0101e90 2024-09-11T23:51:04.953 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 11 23:51:04 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z[36704]: 2024-09-11T23:51:04.732+0000 7f8e2cf85040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:51:04.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:04 smithi134 ceph-mon[34893]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:04.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:04 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:04.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:04 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:04.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:04 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:04.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:04 smithi134 ceph-mon[34893]: Standby manager daemon z started 2024-09-11T23:51:04.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:04 smithi134 ceph-mon[34893]: from='mgr.? 172.21.15.134:0/974663388' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:51:04.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:04 smithi134 ceph-mon[34893]: from='mgr.? 172.21.15.134:0/974663388' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:51:04.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:04 smithi134 ceph-mon[34893]: from='mgr.? 172.21.15.134:0/974663388' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:51:04.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:04 smithi134 ceph-mon[34893]: from='mgr.? 172.21.15.134:0/974663388' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:51:05.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:04 smithi006 ceph-mon[30947]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:05.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:05.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:05.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:05.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:04 smithi006 ceph-mon[30947]: Standby manager daemon z started 2024-09-11T23:51:05.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:04 smithi006 ceph-mon[30947]: from='mgr.? 172.21.15.134:0/974663388' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:51:05.040 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:04 smithi006 ceph-mon[30947]: from='mgr.? 172.21.15.134:0/974663388' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:51:05.040 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:04 smithi006 ceph-mon[30947]: from='mgr.? 172.21.15.134:0/974663388' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:51:05.040 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:04 smithi006 ceph-mon[30947]: from='mgr.? 172.21.15.134:0/974663388' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:51:05.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:04 smithi039 ceph-mon[34543]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:05.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:04 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:05.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:04 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:05.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:04 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:05.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:04 smithi039 ceph-mon[34543]: Standby manager daemon z started 2024-09-11T23:51:05.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:04 smithi039 ceph-mon[34543]: from='mgr.? 172.21.15.134:0/974663388' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:51:05.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:04 smithi039 ceph-mon[34543]: from='mgr.? 172.21.15.134:0/974663388' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:51:05.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:04 smithi039 ceph-mon[34543]: from='mgr.? 172.21.15.134:0/974663388' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:51:05.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:04 smithi039 ceph-mon[34543]: from='mgr.? 172.21.15.134:0/974663388' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:51:05.512 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:05 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:05.243+0000 7f341c533040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:51:05.513 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:05 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:05.364+0000 7f341c533040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:51:05.794 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:05 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:05.513+0000 7f341c533040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:51:05.794 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:05 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:05.577+0000 7f341c533040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:51:05.794 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:05 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:05.733+0000 7f341c533040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:51:06.102 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:05 smithi039 ceph-mon[34543]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:06.102 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:05 smithi039 ceph-mon[34543]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-11T23:51:06.102 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:51:06.102 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:06.102 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:05 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:05.805+0000 7f341c533040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:51:06.102 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:05 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:05.867+0000 7f341c533040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:51:06.102 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:06 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:06.034+0000 7f341c533040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:51:06.103 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:06 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:06.102+0000 7f341c533040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:51:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:05 smithi134 ceph-mon[34893]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:05 smithi134 ceph-mon[34893]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-11T23:51:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:51:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:06.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:05 smithi006 ceph-mon[30947]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:06.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:05 smithi006 ceph-mon[30947]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-11T23:51:06.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:51:06.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:06.382 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:06 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:06.172+0000 7f341c533040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:51:06.382 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:06 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:06.259+0000 7f341c533040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:51:06.382 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:06 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:06.321+0000 7f341c533040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:51:06.382 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:06 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:06.383+0000 7f341c533040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:51:07.544 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 11 23:51:07 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y[35911]: 2024-09-11T23:51:07.213+0000 7f341c533040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:51:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:07.919+0000 7fbc967fc640 1 -- 172.21.15.6:0/1761452343 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7fbc9800f3c0 con 0x7fbca0101e90 2024-09-11T23:51:08.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:07 smithi006 ceph-mon[30947]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:08.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:07 smithi006 ceph-mon[30947]: Standby manager daemon y started 2024-09-11T23:51:08.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:07 smithi006 ceph-mon[30947]: from='mgr.? 172.21.15.39:0/1461054780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:51:08.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:07 smithi006 ceph-mon[30947]: from='mgr.? 172.21.15.39:0/1461054780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:51:08.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:07 smithi006 ceph-mon[30947]: from='mgr.? 172.21.15.39:0/1461054780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:51:08.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:07 smithi006 ceph-mon[30947]: from='mgr.? 172.21.15.39:0/1461054780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:51:08.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:07 smithi134 ceph-mon[34893]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:08.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:07 smithi134 ceph-mon[34893]: Standby manager daemon y started 2024-09-11T23:51:08.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:07 smithi134 ceph-mon[34893]: from='mgr.? 172.21.15.39:0/1461054780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:51:08.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:07 smithi134 ceph-mon[34893]: from='mgr.? 172.21.15.39:0/1461054780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:51:08.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:07 smithi134 ceph-mon[34893]: from='mgr.? 172.21.15.39:0/1461054780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:51:08.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:07 smithi134 ceph-mon[34893]: from='mgr.? 172.21.15.39:0/1461054780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:51:08.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:07 smithi039 ceph-mon[34543]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:08.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:07 smithi039 ceph-mon[34543]: Standby manager daemon y started 2024-09-11T23:51:08.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:07 smithi039 ceph-mon[34543]: from='mgr.? 172.21.15.39:0/1461054780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:51:08.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:07 smithi039 ceph-mon[34543]: from='mgr.? 172.21.15.39:0/1461054780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:51:08.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:07 smithi039 ceph-mon[34543]: from='mgr.? 172.21.15.39:0/1461054780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:51:08.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:07 smithi039 ceph-mon[34543]: from='mgr.? 172.21.15.39:0/1461054780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:51:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:08 smithi134 ceph-mon[34893]: mgrmap e15: x(active, since 67s), standbys: z, y 2024-09-11T23:51:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:08 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:51:09.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:08 smithi039 ceph-mon[34543]: mgrmap e15: x(active, since 67s), standbys: z, y 2024-09-11T23:51:09.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:08 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:51:09.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:08 smithi006 ceph-mon[30947]: mgrmap e15: x(active, since 67s), standbys: z, y 2024-09-11T23:51:09.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:08 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:51:10.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:09 smithi134 ceph-mon[34893]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:10.227 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:09 smithi006 ceph-mon[30947]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:10.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:09 smithi039 ceph-mon[34543]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:11.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T23:51:11.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:11.195 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T23:51:11.195 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T23:51:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:12.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:11 smithi134 ceph-mon[34893]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:12.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:11 smithi134 ceph-mon[34893]: Deploying daemon osd.0 on smithi006 2024-09-11T23:51:12.225 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:11 smithi006 ceph-mon[30947]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:12.225 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:11 smithi006 ceph-mon[30947]: Deploying daemon osd.0 on smithi006 2024-09-11T23:51:12.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:11 smithi039 ceph-mon[34543]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:12.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:11 smithi039 ceph-mon[34543]: Deploying daemon osd.0 on smithi006 2024-09-11T23:51:14.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:13 smithi134 ceph-mon[34893]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:14.252 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:13 smithi006 ceph-mon[30947]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:14.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:13 smithi039 ceph-mon[34543]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:16.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:15 smithi006 ceph-mon[30947]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:16.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:15 smithi134 ceph-mon[34893]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:15 smithi039 ceph-mon[34543]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:17.996 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:17 smithi006 ceph-mon[30947]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:17.997 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:17 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:17.997 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:17 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:17.997 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:17 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:18.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:17 smithi134 ceph-mon[34893]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:18.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:17 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:18.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:17 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:18.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:17 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:18.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:17 smithi039 ceph-mon[34543]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:18.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:17 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:18.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:17 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:18.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:17 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:20.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:19 smithi006 ceph-mon[30947]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:20.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:20.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:20.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:20.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:20.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:20.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:19 smithi134 ceph-mon[34893]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:20.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:20.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:20.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:20.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:20.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:20.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:19 smithi039 ceph-mon[34543]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:20.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:20.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:20.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:20.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:20.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.552+0000 7fbc967fc640 1 -- 172.21.15.6:0/1761452343 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbca0062630 con 0x7fbc8c039290 2024-09-11T23:51:21.552 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 0 on host 'smithi006' 2024-09-11T23:51:21.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.555+0000 7fbca7279640 1 -- 172.21.15.6:0/1761452343 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbc8c039290 msgr2=0x7fbc8c03b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.555+0000 7fbca7279640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbc8c039290 0x7fbc8c03b750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0058c0 tx=0x7fbc9c005f90 comp rx=0 tx=0).stop 2024-09-11T23:51:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.555+0000 7fbca7279640 1 -- 172.21.15.6:0/1761452343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca0101e90 msgr2=0x7fbca0102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.555+0000 7fbca7279640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca0101e90 0x7fbca0102df0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009fd0 tx=0x7fbc9800ef10 comp rx=0 tx=0).stop 2024-09-11T23:51:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.555+0000 7fbca7279640 1 -- 172.21.15.6:0/1761452343 shutdown_connections 2024-09-11T23:51:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.556+0000 7fbca7279640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbc8c039290 0x7fbc8c03b750 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.556+0000 7fbca7279640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca0101e90 0x7fbca0102df0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.556+0000 7fbca7279640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbca01014d0 0x7fbca01028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.556+0000 7fbca7279640 1 --2- 172.21.15.6:0/1761452343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbca01002d0 0x7fbca0104260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.556+0000 7fbca7279640 1 -- 172.21.15.6:0/1761452343 >> 172.21.15.6:0/1761452343 conn(0x7fbca00fba80 msgr2=0x7fbca0106aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.556+0000 7fbca7279640 1 -- 172.21.15.6:0/1761452343 shutdown_connections 2024-09-11T23:51:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:51:21.556+0000 7fbca7279640 1 -- 172.21.15.6:0/1761452343 wait complete. 2024-09-11T23:51:22.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:21 smithi134 ceph-mon[34893]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:22.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:21 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:22.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:21 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:22.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:21 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:22.239 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:21 smithi006 ceph-mon[30947]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:22.239 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:21 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:22.239 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:21 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:22.239 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:21 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:22.267 DEBUG:teuthology.orchestra.run.smithi006:osd.0> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.0.service 2024-09-11T23:51:22.269 INFO:tasks.cephadm:Deploying osd.1 on smithi039 with /dev/vg_nvme/lv_4... 2024-09-11T23:51:22.269 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T23:51:22.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:21 smithi039 ceph-mon[34543]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:22.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:21 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:22.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:21 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:22.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:21 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:22.519 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:51:23.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:22 smithi006 ceph-mon[30947]: from='osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:51:23.119 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 11 23:51:22 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0[45313]: 2024-09-11T23:51:22.885+0000 7f7fd96e5640 -1 osd.0 0 log_to_monitors true 2024-09-11T23:51:23.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:22 smithi134 ceph-mon[34893]: from='osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:51:23.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:22 smithi039 ceph-mon[34543]: from='osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:51:24.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:23 smithi039 ceph-mon[34543]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:24.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:23 smithi039 ceph-mon[34543]: from='osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T23:51:24.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:23 smithi039 ceph-mon[34543]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T23:51:24.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:23 smithi039 ceph-mon[34543]: from='osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-09-11T23:51:24.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:24.369 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 11 23:51:23 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0[45313]: 2024-09-11T23:51:23.965+0000 7f7fd5668640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T23:51:24.369 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 11 23:51:23 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0[45313]: 2024-09-11T23:51:23.971+0000 7f7fd1490640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:51:24.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:23 smithi006 ceph-mon[30947]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:24.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:23 smithi006 ceph-mon[30947]: from='osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T23:51:24.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:23 smithi006 ceph-mon[30947]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T23:51:24.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:23 smithi006 ceph-mon[30947]: from='osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-09-11T23:51:24.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:23 smithi134 ceph-mon[34893]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:23 smithi134 ceph-mon[34893]: from='osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T23:51:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:23 smithi134 ceph-mon[34893]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T23:51:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:23 smithi134 ceph-mon[34893]: from='osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-09-11T23:51:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:24.804 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:51:24.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_4 2024-09-11T23:51:25.130 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:51:25.252 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:24 smithi039 ceph-mon[34543]: from='osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-11T23:51:25.252 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:24 smithi039 ceph-mon[34543]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T23:51:25.252 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:25.252 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:25.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:24 smithi006 ceph-mon[30947]: from='osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-11T23:51:25.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:24 smithi006 ceph-mon[30947]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T23:51:25.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:25.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:25.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:24 smithi134 ceph-mon[34893]: from='osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-11T23:51:25.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:24 smithi134 ceph-mon[34893]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T23:51:25.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:25.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:25.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.576+0000 7f29db3f4640 1 -- 172.21.15.39:0/10479401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29d4100ad0 msgr2=0x7f29d4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:25.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.576+0000 7f29db3f4640 1 --2- 172.21.15.39:0/10479401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29d4100ad0 0x7f29d4100ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009900 tx=0x7f29c402a410 comp rx=0 tx=0).stop 2024-09-11T23:51:25.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.576+0000 7f29db3f4640 1 -- 172.21.15.39:0/10479401 shutdown_connections 2024-09-11T23:51:25.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.576+0000 7f29db3f4640 1 --2- 172.21.15.39:0/10479401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29d4102690 0x7f29d4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:25.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.576+0000 7f29db3f4640 1 --2- 172.21.15.39:0/10479401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29d4101cd0 0x7f29d4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:25.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.576+0000 7f29db3f4640 1 --2- 172.21.15.39:0/10479401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29d4100ad0 0x7f29d4100ed0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:25.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.576+0000 7f29db3f4640 1 -- 172.21.15.39:0/10479401 >> 172.21.15.39:0/10479401 conn(0x7f29d40fc280 msgr2=0x7f29d40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:25.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.576+0000 7f29db3f4640 1 -- 172.21.15.39:0/10479401 shutdown_connections 2024-09-11T23:51:25.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.576+0000 7f29db3f4640 1 -- 172.21.15.39:0/10479401 wait complete. 2024-09-11T23:51:25.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29db3f4640 1 Processor -- start 2024-09-11T23:51:25.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29db3f4640 1 -- start start 2024-09-11T23:51:25.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29db3f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29d4100ad0 0x7f29d410b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:25.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29db3f4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29d4101cd0 0x7f29d4109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:25.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29db3f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29d4102690 0x7f29d4109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29db3f4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f29d410d790 con 0x7f29d4102690 2024-09-11T23:51:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29db3f4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f29d410d610 con 0x7f29d4101cd0 2024-09-11T23:51:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29db3f4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29d410d910 con 0x7f29d4100ad0 2024-09-11T23:51:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29d898f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29d4101cd0 0x7f29d4109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29d898f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29d4101cd0 0x7f29d4109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40362/0 (socket says 172.21.15.39:40362) 2024-09-11T23:51:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29d898f640 1 -- 172.21.15.39:0/1268178096 learned_addr learned my addr 172.21.15.39:0/1268178096 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-11T23:51:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29d9190640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29d4100ad0 0x7f29d410b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29d9991640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29d4102690 0x7f29d4109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29d898f640 1 -- 172.21.15.39:0/1268178096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29d4100ad0 msgr2=0x7f29d410b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29d898f640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29d4100ad0 0x7f29d410b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29d898f640 1 -- 172.21.15.39:0/1268178096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29d4102690 msgr2=0x7f29d4109fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29d898f640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29d4102690 0x7f29d4109fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29d898f640 1 -- 172.21.15.39:0/1268178096 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d410a8a0 con 0x7f29d4101cd0 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.577+0000 7f29d898f640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29d4101cd0 0x7f29d4109aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f29d000e9f0 tx=0x7f29d000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.578+0000 7f29ca7fc640 1 -- 172.21.15.39:0/1268178096 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d000cd80 con 0x7f29d4101cd0 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.578+0000 7f29ca7fc640 1 -- 172.21.15.39:0/1268178096 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29d00108e0 con 0x7f29d4101cd0 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.578+0000 7f29ca7fc640 1 -- 172.21.15.39:0/1268178096 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0018920 con 0x7f29d4101cd0 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.578+0000 7f29db3f4640 1 -- 172.21.15.39:0/1268178096 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d41a1fa0 con 0x7f29d4101cd0 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.578+0000 7f29db3f4640 1 -- 172.21.15.39:0/1268178096 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d41a2450 con 0x7f29d4101cd0 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.579+0000 7f29db3f4640 1 -- 172.21.15.39:0/1268178096 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d4107f90 con 0x7f29d4101cd0 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.580+0000 7f29ca7fc640 1 -- 172.21.15.39:0/1268178096 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f29d0010a90 con 0x7f29d4101cd0 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.580+0000 7f29ca7fc640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f29c00a2b70 0x7f29c00a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.581+0000 7f29ca7fc640 1 -- 172.21.15.39:0/1268178096 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7f29d00cdc50 con 0x7f29d4101cd0 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.581+0000 7f29d9190640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f29c00a2b70 0x7f29c00a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.581+0000 7f29d9190640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f29c00a2b70 0x7f29c00a5030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f29c4005ab0 tx=0x7f29c4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:25.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.584+0000 7f29ca7fc640 1 -- 172.21.15.39:0/1268178096 <== mon.2 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29d009bfd0 con 0x7f29d4101cd0 2024-09-11T23:51:25.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:25.768+0000 7f29db3f4640 1 -- 172.21.15.39:0/1268178096 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f29d4062630 con 0x7f29c00a2b70 2024-09-11T23:51:26.266 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: purged_snaps scrub starts 2024-09-11T23:51:26.266 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: purged_snaps scrub ok 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681] boot 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: Detected new or changed devices on smithi006 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi006 to 17092M 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:26.267 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:26.268 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:26.268 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:26.268 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:51:26.268 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:51:26.268 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: purged_snaps scrub starts 2024-09-11T23:51:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: purged_snaps scrub ok 2024-09-11T23:51:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681] boot 2024-09-11T23:51:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T23:51:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: Detected new or changed devices on smithi006 2024-09-11T23:51:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:51:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi006 to 17092M 2024-09-11T23:51:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:51:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:51:26.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:26.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: purged_snaps scrub starts 2024-09-11T23:51:26.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: purged_snaps scrub ok 2024-09-11T23:51:26.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:26.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:26.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: osd.0 [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681] boot 2024-09-11T23:51:26.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T23:51:26.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:26.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: Detected new or changed devices on smithi006 2024-09-11T23:51:26.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:26.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:26.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:51:26.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi006 to 17092M 2024-09-11T23:51:26.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:26.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:26.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:26.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:26.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:26.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:51:26.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:51:26.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:27.773 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:27 smithi039 ceph-mon[34543]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T23:51:27.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:27 smithi006 ceph-mon[30947]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T23:51:27.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:27 smithi134 ceph-mon[34893]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T23:51:28.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:28 smithi039 ceph-mon[34543]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:28.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:28 smithi039 ceph-mon[34543]: from='client.? 172.21.15.39:0/4004520279' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "748f368e-0065-4cd1-bf7d-09eb7144226a"}]: dispatch 2024-09-11T23:51:28.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:28 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "748f368e-0065-4cd1-bf7d-09eb7144226a"}]: dispatch 2024-09-11T23:51:28.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:28 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "748f368e-0065-4cd1-bf7d-09eb7144226a"}]': finished 2024-09-11T23:51:28.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:28 smithi039 ceph-mon[34543]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T23:51:28.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:28 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:28.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:28 smithi006 ceph-mon[30947]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:28.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:28 smithi006 ceph-mon[30947]: from='client.? 172.21.15.39:0/4004520279' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "748f368e-0065-4cd1-bf7d-09eb7144226a"}]: dispatch 2024-09-11T23:51:28.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:28 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "748f368e-0065-4cd1-bf7d-09eb7144226a"}]: dispatch 2024-09-11T23:51:28.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:28 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "748f368e-0065-4cd1-bf7d-09eb7144226a"}]': finished 2024-09-11T23:51:28.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:28 smithi006 ceph-mon[30947]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T23:51:28.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:28 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:28 smithi134 ceph-mon[34893]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:28 smithi134 ceph-mon[34893]: from='client.? 172.21.15.39:0/4004520279' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "748f368e-0065-4cd1-bf7d-09eb7144226a"}]: dispatch 2024-09-11T23:51:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:28 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "748f368e-0065-4cd1-bf7d-09eb7144226a"}]: dispatch 2024-09-11T23:51:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:28 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "748f368e-0065-4cd1-bf7d-09eb7144226a"}]': finished 2024-09-11T23:51:28.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:28 smithi134 ceph-mon[34893]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T23:51:28.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:28 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:29.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:29 smithi039 ceph-mon[34543]: from='client.? 172.21.15.39:0/1409678745' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:51:29.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:29 smithi006 ceph-mon[30947]: from='client.? 172.21.15.39:0/1409678745' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:51:29.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:29 smithi134 ceph-mon[34893]: from='client.? 172.21.15.39:0/1409678745' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:51:30.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:30 smithi039 ceph-mon[34543]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:30.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:30 smithi006 ceph-mon[30947]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:30.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:30 smithi134 ceph-mon[34893]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:32.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:32 smithi039 ceph-mon[34543]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:32.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:32 smithi006 ceph-mon[30947]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:32 smithi134 ceph-mon[34893]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:34.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:34 smithi039 ceph-mon[34543]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:34.755 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:34 smithi134 ceph-mon[34893]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:34.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:34 smithi006 ceph-mon[30947]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:36.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:36 smithi039 ceph-mon[34543]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:36.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T23:51:36.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:36 smithi006 ceph-mon[30947]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T23:51:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:36.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:36 smithi134 ceph-mon[34893]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:36.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T23:51:36.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:37.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:37 smithi039 ceph-mon[34543]: Deploying daemon osd.1 on smithi039 2024-09-11T23:51:37.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:37 smithi006 ceph-mon[30947]: Deploying daemon osd.1 on smithi039 2024-09-11T23:51:37.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:37 smithi134 ceph-mon[34893]: Deploying daemon osd.1 on smithi039 2024-09-11T23:51:38.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:38 smithi039 ceph-mon[34543]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:38.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:38 smithi006 ceph-mon[30947]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:38.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:38 smithi134 ceph-mon[34893]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:40.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:40 smithi039 ceph-mon[34543]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:40.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:40 smithi006 ceph-mon[30947]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:40.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:40 smithi134 ceph-mon[34893]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:42.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:42 smithi039 ceph-mon[34543]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:42.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:42 smithi006 ceph-mon[30947]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:42.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:42 smithi134 ceph-mon[34893]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:43.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:43 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:43.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:43 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:43.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:43 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:43.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:43 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:43.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:43 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:43.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:43 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:43.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:43 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:43.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:43 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:43.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:43 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:44.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:44 smithi134 ceph-mon[34893]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:44 smithi039 ceph-mon[34543]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:45.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:44 smithi006 ceph-mon[30947]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:46.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.223+0000 7f29ca7fc640 1 -- 172.21.15.39:0/1268178096 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f29d4062630 con 0x7f29c00a2b70 2024-09-11T23:51:46.223 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 1 on host 'smithi039' 2024-09-11T23:51:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.225+0000 7f29db3f4640 1 -- 172.21.15.39:0/1268178096 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f29c00a2b70 msgr2=0x7f29c00a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.225+0000 7f29db3f4640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f29c00a2b70 0x7f29c00a5030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f29c4005ab0 tx=0x7f29c4005a20 comp rx=0 tx=0).stop 2024-09-11T23:51:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.225+0000 7f29db3f4640 1 -- 172.21.15.39:0/1268178096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29d4101cd0 msgr2=0x7f29d4109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.225+0000 7f29db3f4640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29d4101cd0 0x7f29d4109aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f29d000e9f0 tx=0x7f29d000eeb0 comp rx=0 tx=0).stop 2024-09-11T23:51:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.225+0000 7f29db3f4640 1 -- 172.21.15.39:0/1268178096 shutdown_connections 2024-09-11T23:51:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.225+0000 7f29db3f4640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f29c00a2b70 0x7f29c00a5030 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.225+0000 7f29db3f4640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29d4102690 0x7f29d4109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.225+0000 7f29db3f4640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29d4101cd0 0x7f29d4109aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.225+0000 7f29db3f4640 1 --2- 172.21.15.39:0/1268178096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29d4100ad0 0x7f29d410b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.225+0000 7f29db3f4640 1 -- 172.21.15.39:0/1268178096 >> 172.21.15.39:0/1268178096 conn(0x7f29d40fc280 msgr2=0x7f29d4105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.226+0000 7f29db3f4640 1 -- 172.21.15.39:0/1268178096 shutdown_connections 2024-09-11T23:51:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:51:46.226+0000 7f29db3f4640 1 -- 172.21.15.39:0/1268178096 wait complete. 2024-09-11T23:51:46.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:46 smithi134 ceph-mon[34893]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:46.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:46 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:46.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:46 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:46.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:46 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:46.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:46 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:46.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:46 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:46.516 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:46 smithi039 ceph-mon[34543]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:46.517 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:46 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:46.517 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:46 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:46.517 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:46 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:46.517 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:46 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:46.517 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:46 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:46.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:46 smithi006 ceph-mon[30947]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:46.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:46 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:46.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:46 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:46.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:46 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:46.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:46 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:46.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:46 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:46.849 DEBUG:teuthology.orchestra.run.smithi039:osd.1> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.1.service 2024-09-11T23:51:46.851 INFO:tasks.cephadm:Deploying osd.2 on smithi134 with /dev/vg_nvme/lv_4... 2024-09-11T23:51:46.851 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T23:51:47.102 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:51:47.370 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:47 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:47.371 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:47 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:47.371 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:47 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:47.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:47 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:47.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:47 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:47.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:47 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:47.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:47 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:47.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:47 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:47.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:47 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:48.303 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:48 smithi039 ceph-mon[34543]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:48.402 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:48 smithi134 ceph-mon[34893]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:48.621 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:48 smithi006 ceph-mon[30947]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:49.044 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 11 23:51:48 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1[39003]: 2024-09-11T23:51:48.736+0000 7f2265f7a640 -1 osd.1 0 log_to_monitors true 2024-09-11T23:51:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:51:49.475 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:49 smithi134 ceph-mon[34893]: from='osd.1 [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:51:49.475 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:49 smithi134 ceph-mon[34893]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:51:49.477 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2024-09-11T23:51:49.532 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:49 smithi039 ceph-mon[34543]: from='osd.1 [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:51:49.532 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:49 smithi039 ceph-mon[34543]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:51:49.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:49 smithi006 ceph-mon[30947]: from='osd.1 [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:51:49.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:49 smithi006 ceph-mon[30947]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:51:49.733 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:51:50.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.162+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/1279238714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c04100b00 msgr2=0x7f7c04100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:50.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.162+0000 7f7c0b5bf640 1 --2- 172.21.15.134:0/1279238714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c04100b00 0x7f7c04100f00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009900 tx=0x7f7c0002a410 comp rx=0 tx=0).stop 2024-09-11T23:51:50.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.162+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/1279238714 shutdown_connections 2024-09-11T23:51:50.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.162+0000 7f7c0b5bf640 1 --2- 172.21.15.134:0/1279238714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c041026c0 0x7f7c04108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:50.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.162+0000 7f7c0b5bf640 1 --2- 172.21.15.134:0/1279238714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c04101d00 0x7f7c04102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:50.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.162+0000 7f7c0b5bf640 1 --2- 172.21.15.134:0/1279238714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c04100b00 0x7f7c04100f00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:50.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.162+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/1279238714 >> 172.21.15.134:0/1279238714 conn(0x7f7c040fc270 msgr2=0x7f7c040fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:50.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.162+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/1279238714 shutdown_connections 2024-09-11T23:51:50.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.162+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/1279238714 wait complete. 2024-09-11T23:51:50.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.162+0000 7f7c0b5bf640 1 Processor -- start 2024-09-11T23:51:50.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c0b5bf640 1 -- start start 2024-09-11T23:51:50.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c0b5bf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c04100b00 0x7f7c0406b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:50.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c0b5bf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c04101d00 0x7f7c0419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:50.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c0b5bf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c041026c0 0x7f7c0419f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:50.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c0b5bf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0410c690 con 0x7f7c04101d00 2024-09-11T23:51:50.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c0b5bf640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0410c510 con 0x7f7c04100b00 2024-09-11T23:51:50.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c0b5bf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0410c810 con 0x7f7c041026c0 2024-09-11T23:51:50.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c09b5c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c041026c0 0x7f7c0419f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:50.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c09b5c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c041026c0 0x7f7c0419f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49152/0 (socket says 172.21.15.134:49152) 2024-09-11T23:51:50.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c09b5c640 1 -- 172.21.15.134:0/3937327041 learned_addr learned my addr 172.21.15.134:0/3937327041 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-11T23:51:50.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c08b5a640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c04101d00 0x7f7c0419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:50.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c0935b640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c04100b00 0x7f7c0406b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:50.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c09b5c640 1 -- 172.21.15.134:0/3937327041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c04100b00 msgr2=0x7f7c0406b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:50.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c09b5c640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c04100b00 0x7f7c0406b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:50.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c09b5c640 1 -- 172.21.15.134:0/3937327041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c04101d00 msgr2=0x7f7c0419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:50.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c09b5c640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c04101d00 0x7f7c0419cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:50.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c09b5c640 1 -- 172.21.15.134:0/3937327041 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0419faa0 con 0x7f7c041026c0 2024-09-11T23:51:50.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c08b5a640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c04101d00 0x7f7c0419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:51:50.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c0935b640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c04100b00 0x7f7c0406b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:51:50.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7c09b5c640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c041026c0 0x7f7c0419f1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00b970 tx=0x7f7bfc00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:50.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.163+0000 7f7bfa7fc640 1 -- 172.21.15.134:0/3937327041 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc019070 con 0x7f7c041026c0 2024-09-11T23:51:50.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.164+0000 7f7bfa7fc640 1 -- 172.21.15.134:0/3937327041 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7bfc014440 con 0x7f7c041026c0 2024-09-11T23:51:50.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.164+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/3937327041 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0419fd90 con 0x7f7c041026c0 2024-09-11T23:51:50.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.164+0000 7f7bfa7fc640 1 -- 172.21.15.134:0/3937327041 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0075d0 con 0x7f7c041026c0 2024-09-11T23:51:50.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.164+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/3937327041 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c041a02a0 con 0x7f7c041026c0 2024-09-11T23:51:50.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.165+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/3937327041 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c04107f90 con 0x7f7c041026c0 2024-09-11T23:51:50.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.166+0000 7f7bfa7fc640 1 -- 172.21.15.134:0/3937327041 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f7bfc01c070 con 0x7f7c041026c0 2024-09-11T23:51:50.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.166+0000 7f7bfa7fc640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7bf00a2af0 0x7f7bf00a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:50.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.167+0000 7f7bfa7fc640 1 -- 172.21.15.134:0/3937327041 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f7bfc0cd110 con 0x7f7c041026c0 2024-09-11T23:51:50.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.167+0000 7f7c0935b640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7bf00a2af0 0x7f7bf00a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:50.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.168+0000 7f7c0935b640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7bf00a2af0 0x7f7bf00a4fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c00000c00 tx=0x7f7c000314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:50.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.170+0000 7f7bfa7fc640 1 -- 172.21.15.134:0/3937327041 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7bfc09ba60 con 0x7f7c041026c0 2024-09-11T23:51:50.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:51:50.351+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/3937327041 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7c04062630 con 0x7f7bf00a2af0 2024-09-11T23:51:50.353 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:50.353 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T23:51:50.353 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T23:51:50.353 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: from='osd.1 [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:51:50.353 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:50.354 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:51:50.354 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: Detected new or changed devices on smithi039 2024-09-11T23:51:50.354 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:50.354 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:50.354 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:51:50.354 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi039 to 17088M 2024-09-11T23:51:50.354 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:50.354 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:50.355 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:50.355 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:50.544 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1[39003]: 2024-09-11T23:51:50.240+0000 7f2261efd640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T23:51:50.544 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1[39003]: 2024-09-11T23:51:50.244+0000 7f225dd25640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:51:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T23:51:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T23:51:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: from='osd.1 [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:51:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:51:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: Detected new or changed devices on smithi039 2024-09-11T23:51:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:51:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi039 to 17088M 2024-09-11T23:51:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:50.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:50.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T23:51:50.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T23:51:50.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: from='osd.1 [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:51:50.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:50.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:51:50.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: Detected new or changed devices on smithi039 2024-09-11T23:51:50.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:50.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:50.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:51:50.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi039 to 17088M 2024-09-11T23:51:50.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:50.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:50.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:50.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:51:51.367 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:51 smithi134 ceph-mon[34893]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-11T23:51:51.367 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:51 smithi134 ceph-mon[34893]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T23:51:51.367 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:51 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:51.367 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:51 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:51.367 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:51 smithi134 ceph-mon[34893]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:51.368 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:51 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:51:51.368 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:51 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:51:51.368 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:51 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:51.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:51 smithi039 ceph-mon[34543]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-11T23:51:51.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:51 smithi039 ceph-mon[34543]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T23:51:51.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:51.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:51.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:51 smithi039 ceph-mon[34543]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:51.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:51:51.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:51:51.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:51.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:51 smithi006 ceph-mon[30947]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-11T23:51:51.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:51 smithi006 ceph-mon[30947]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T23:51:51.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:51 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:51.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:51 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:51.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:51 smithi006 ceph-mon[30947]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:51.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:51 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:51:51.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:51 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:51:51.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:51 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:52 smithi039 ceph-mon[34543]: purged_snaps scrub starts 2024-09-11T23:51:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:52 smithi039 ceph-mon[34543]: purged_snaps scrub ok 2024-09-11T23:51:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:52 smithi039 ceph-mon[34543]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:52 smithi039 ceph-mon[34543]: osd.1 [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609] boot 2024-09-11T23:51:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:52 smithi039 ceph-mon[34543]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T23:51:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:52.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:52 smithi006 ceph-mon[30947]: purged_snaps scrub starts 2024-09-11T23:51:52.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:52 smithi006 ceph-mon[30947]: purged_snaps scrub ok 2024-09-11T23:51:52.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:52 smithi006 ceph-mon[30947]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:52.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:52 smithi006 ceph-mon[30947]: osd.1 [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609] boot 2024-09-11T23:51:52.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:52 smithi006 ceph-mon[30947]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T23:51:52.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:52.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:52 smithi134 ceph-mon[34893]: purged_snaps scrub starts 2024-09-11T23:51:52.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:52 smithi134 ceph-mon[34893]: purged_snaps scrub ok 2024-09-11T23:51:52.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:52 smithi134 ceph-mon[34893]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:51:52.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:52 smithi134 ceph-mon[34893]: osd.1 [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609] boot 2024-09-11T23:51:52.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:52 smithi134 ceph-mon[34893]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T23:51:52.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:51:53.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:53 smithi134 ceph-mon[34893]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T23:51:53.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:53 smithi134 ceph-mon[34893]: from='client.? 172.21.15.134:0/933578470' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c143215f-b1f7-4095-9015-1d810941ece5"}]: dispatch 2024-09-11T23:51:53.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:53 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c143215f-b1f7-4095-9015-1d810941ece5"}]: dispatch 2024-09-11T23:51:53.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:53 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c143215f-b1f7-4095-9015-1d810941ece5"}]': finished 2024-09-11T23:51:53.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:53 smithi134 ceph-mon[34893]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T23:51:53.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:53 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:51:53.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:53 smithi134 ceph-mon[34893]: from='client.? 172.21.15.134:0/808844987' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:51:53.520 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:53 smithi006 ceph-mon[30947]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T23:51:53.520 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:53 smithi006 ceph-mon[30947]: from='client.? 172.21.15.134:0/933578470' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c143215f-b1f7-4095-9015-1d810941ece5"}]: dispatch 2024-09-11T23:51:53.520 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:53 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c143215f-b1f7-4095-9015-1d810941ece5"}]: dispatch 2024-09-11T23:51:53.520 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:53 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c143215f-b1f7-4095-9015-1d810941ece5"}]': finished 2024-09-11T23:51:53.520 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:53 smithi006 ceph-mon[30947]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T23:51:53.520 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:53 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:51:53.520 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:53 smithi006 ceph-mon[30947]: from='client.? 172.21.15.134:0/808844987' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:51:53.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:53 smithi039 ceph-mon[34543]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T23:51:53.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:53 smithi039 ceph-mon[34543]: from='client.? 172.21.15.134:0/933578470' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c143215f-b1f7-4095-9015-1d810941ece5"}]: dispatch 2024-09-11T23:51:53.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:53 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c143215f-b1f7-4095-9015-1d810941ece5"}]: dispatch 2024-09-11T23:51:53.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:53 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c143215f-b1f7-4095-9015-1d810941ece5"}]': finished 2024-09-11T23:51:53.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:53 smithi039 ceph-mon[34543]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T23:51:53.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:53 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:51:53.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:53 smithi039 ceph-mon[34543]: from='client.? 172.21.15.134:0/808844987' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:51:54.814 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:54 smithi006 ceph-mon[30947]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:51:54.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:54 smithi134 ceph-mon[34893]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:51:55.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:54 smithi039 ceph-mon[34543]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:51:56.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:56 smithi134 ceph-mon[34893]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:51:57.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:56 smithi039 ceph-mon[34543]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:51:57.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:56 smithi006 ceph-mon[30947]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:51:58.780 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:51:58 smithi134 ceph-mon[34893]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:51:59.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:51:58 smithi039 ceph-mon[34543]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:51:59.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:51:58 smithi006 ceph-mon[30947]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:00.829 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:00 smithi134 ceph-mon[34893]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:00.829 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T23:52:00.829 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:00 smithi039 ceph-mon[34543]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T23:52:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:01.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:00 smithi006 ceph-mon[30947]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:01.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T23:52:01.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:01.931 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:01 smithi134 ceph-mon[34893]: Deploying daemon osd.2 on smithi134 2024-09-11T23:52:02.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:01 smithi039 ceph-mon[34543]: Deploying daemon osd.2 on smithi134 2024-09-11T23:52:02.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:01 smithi006 ceph-mon[30947]: Deploying daemon osd.2 on smithi134 2024-09-11T23:52:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:02 smithi134 ceph-mon[34893]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:03.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:02 smithi039 ceph-mon[34543]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:03.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:02 smithi006 ceph-mon[30947]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:04 smithi134 ceph-mon[34893]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:05.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:04 smithi039 ceph-mon[34543]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:05.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:04 smithi006 ceph-mon[30947]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:06.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:06 smithi134 ceph-mon[34893]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:07.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:06 smithi039 ceph-mon[34543]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:07.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:06 smithi006 ceph-mon[30947]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:07.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:07 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:07.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:07 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:07.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:07 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:08.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:07 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:08.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:07 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:08.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:07 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:08.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:07 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:08.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:07 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:08.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:07 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:09.000 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:08 smithi134 ceph-mon[34893]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:09.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:08 smithi006 ceph-mon[30947]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:09.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:08 smithi039 ceph-mon[34543]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:10.407 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:10 smithi134 ceph-mon[34893]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:10.407 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:10.408 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:10.408 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:10.408 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:10.408 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:10.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.449+0000 7f7bfa7fc640 1 -- 172.21.15.134:0/3937327041 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7c04062630 con 0x7f7bf00a2af0 2024-09-11T23:52:10.450 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 2 on host 'smithi134' 2024-09-11T23:52:10.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.451+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/3937327041 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7bf00a2af0 msgr2=0x7f7bf00a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:10.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.451+0000 7f7c0b5bf640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7bf00a2af0 0x7f7bf00a4fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c00000c00 tx=0x7f7c000314a0 comp rx=0 tx=0).stop 2024-09-11T23:52:10.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.451+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/3937327041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c041026c0 msgr2=0x7f7c0419f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:10.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.451+0000 7f7c0b5bf640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c041026c0 0x7f7c0419f1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00b970 tx=0x7f7bfc00be30 comp rx=0 tx=0).stop 2024-09-11T23:52:10.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.451+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/3937327041 shutdown_connections 2024-09-11T23:52:10.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.451+0000 7f7c0b5bf640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7bf00a2af0 0x7f7bf00a4fb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:10.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.451+0000 7f7c0b5bf640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c041026c0 0x7f7c0419f1e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:10.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.451+0000 7f7c0b5bf640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c04101d00 0x7f7c0419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:10.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.451+0000 7f7c0b5bf640 1 --2- 172.21.15.134:0/3937327041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c04100b00 0x7f7c0406b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:10.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.451+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/3937327041 >> 172.21.15.134:0/3937327041 conn(0x7f7c040fc270 msgr2=0x7f7c04105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:52:10.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.452+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/3937327041 shutdown_connections 2024-09-11T23:52:10.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:52:10.452+0000 7f7c0b5bf640 1 -- 172.21.15.134:0/3937327041 wait complete. 2024-09-11T23:52:10.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:10 smithi006 ceph-mon[30947]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:10.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:10.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:10.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:10.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:10.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:10.801 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:10 smithi039 ceph-mon[34543]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:10.801 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:10.801 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:10.802 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:10.802 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:10.802 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:11.041 DEBUG:teuthology.orchestra.run.smithi134:osd.2> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.2.service 2024-09-11T23:52:12.026 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:11 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:12.026 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:11 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:12.026 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:11 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:12.026 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:11 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:12.026 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:11 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:12.027 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:11 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:12.027 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:11 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:12.027 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:11 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:12.027 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:11 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:12.029 INFO:tasks.cephadm:Deploying osd.3 on smithi006 with /dev/vg_nvme/lv_3... 2024-09-11T23:52:12.029 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T23:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:52:12.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:12 smithi134 ceph-mon[34893]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:12.704 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 11 23:52:12 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2[39886]: 2024-09-11T23:52:12.644+0000 7fee89a99640 -1 osd.2 0 log_to_monitors true 2024-09-11T23:52:12.750 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:12 smithi006 ceph-mon[30947]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:12.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:12 smithi039 ceph-mon[34543]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:13.575 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:13 smithi134 ceph-mon[34893]: from='osd.2 [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:52:13.575 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:13 smithi134 ceph-mon[34893]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:52:13.693 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:13 smithi006 ceph-mon[30947]: from='osd.2 [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:52:13.693 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:13 smithi006 ceph-mon[30947]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:52:13.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:13 smithi039 ceph-mon[34543]: from='osd.2 [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:52:13.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:13 smithi039 ceph-mon[34543]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:52:14.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:14.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T23:52:14.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T23:52:14.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:14.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: from='osd.2 [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:52:14.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:52:14.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:14.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:14.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:14.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:14.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:14.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:14.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:14.852 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:14.852 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T23:52:14.852 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T23:52:14.852 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:14.853 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: from='osd.2 [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:52:14.853 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:52:14.853 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:14.853 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:14.853 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:14.853 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:14.853 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:14.853 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:14.853 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:14.861 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:14.861 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T23:52:14.861 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T23:52:14.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:14.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: from='osd.2 [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:52:14.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:52:14.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:14.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:14.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:14.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:14.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:14.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:14.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:14.865 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:52:14.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi006:vg_nvme/lv_3 2024-09-11T23:52:15.149 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:52:15.203 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2[39886]: 2024-09-11T23:52:14.852+0000 7fee86230640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T23:52:15.203 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 11 23:52:14 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2[39886]: 2024-09-11T23:52:14.856+0000 7fee7d83c640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:52:15.565 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:15 smithi006 ceph-mon[30947]: Detected new or changed devices on smithi134 2024-09-11T23:52:15.565 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:15 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi134 to 17088M 2024-09-11T23:52:15.565 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:15 smithi006 ceph-mon[30947]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-11T23:52:15.565 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:15 smithi006 ceph-mon[30947]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T23:52:15.565 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:15.565 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:15.565 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:15 smithi006 ceph-mon[30947]: from='osd.2 ' entity='osd.2' 2024-09-11T23:52:15.565 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.652+0000 7f0312f35640 1 -- 172.21.15.6:0/466351193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f030c1026d0 msgr2=0x7f030c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.652+0000 7f0312f35640 1 --2- 172.21.15.6:0/466351193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f030c1026d0 0x7f030c108f60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0304009ca0 tx=0x7f030402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:52:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.652+0000 7f0312f35640 1 -- 172.21.15.6:0/466351193 shutdown_connections 2024-09-11T23:52:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.652+0000 7f0312f35640 1 --2- 172.21.15.6:0/466351193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f030c1026d0 0x7f030c108f60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.652+0000 7f0312f35640 1 --2- 172.21.15.6:0/466351193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f030c101d10 0x7f030c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.652+0000 7f0312f35640 1 --2- 172.21.15.6:0/466351193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c100b10 0x7f030c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.652+0000 7f0312f35640 1 -- 172.21.15.6:0/466351193 >> 172.21.15.6:0/466351193 conn(0x7f030c0fc2a0 msgr2=0x7f030c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:52:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.652+0000 7f0312f35640 1 -- 172.21.15.6:0/466351193 shutdown_connections 2024-09-11T23:52:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.652+0000 7f0312f35640 1 -- 172.21.15.6:0/466351193 wait complete. 2024-09-11T23:52:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f0312f35640 1 Processor -- start 2024-09-11T23:52:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f0312f35640 1 -- start start 2024-09-11T23:52:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f0312f35640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c100b10 0x7f030c197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f0312f35640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f030c101d10 0x7f030c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f0312f35640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f030c1026d0 0x7f030c19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f0312f35640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f030c10c740 con 0x7f030c1026d0 2024-09-11T23:52:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f0312f35640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f030c10c5c0 con 0x7f030c101d10 2024-09-11T23:52:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f0312f35640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f030c10c8c0 con 0x7f030c100b10 2024-09-11T23:52:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f03114d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f030c1026d0 0x7f030c19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f03114d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f030c1026d0 0x7f030c19f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54648/0 (socket says 172.21.15.6:54648) 2024-09-11T23:52:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f03114d2640 1 -- 172.21.15.6:0/1928525664 learned_addr learned my addr 172.21.15.6:0/1928525664 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:52:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f0310cd1640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c100b10 0x7f030c197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.653+0000 7f030bfff640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f030c101d10 0x7f030c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.654+0000 7f03114d2640 1 -- 172.21.15.6:0/1928525664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c100b10 msgr2=0x7f030c197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.654+0000 7f03114d2640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c100b10 0x7f030c197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.654+0000 7f03114d2640 1 -- 172.21.15.6:0/1928525664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f030c101d10 msgr2=0x7f030c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.654+0000 7f03114d2640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f030c101d10 0x7f030c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.654+0000 7f03114d2640 1 -- 172.21.15.6:0/1928525664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030c19fb40 con 0x7f030c1026d0 2024-09-11T23:52:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.654+0000 7f030bfff640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f030c101d10 0x7f030c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:52:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.654+0000 7f03114d2640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f030c1026d0 0x7f030c19f4d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0304009dc0 tx=0x7f0304003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:52:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.654+0000 7f0309ffb640 1 -- 172.21.15.6:0/1928525664 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304004040 con 0x7f030c1026d0 2024-09-11T23:52:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.654+0000 7f0312f35640 1 -- 172.21.15.6:0/1928525664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030c19fdd0 con 0x7f030c1026d0 2024-09-11T23:52:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.654+0000 7f0309ffb640 1 -- 172.21.15.6:0/1928525664 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0304004690 con 0x7f030c1026d0 2024-09-11T23:52:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.654+0000 7f0309ffb640 1 -- 172.21.15.6:0/1928525664 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030402f4c0 con 0x7f030c1026d0 2024-09-11T23:52:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.654+0000 7f0312f35640 1 -- 172.21.15.6:0/1928525664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f030c1a0300 con 0x7f030c1026d0 2024-09-11T23:52:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.655+0000 7f0312f35640 1 -- 172.21.15.6:0/1928525664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f030c1a0560 con 0x7f030c1026d0 2024-09-11T23:52:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.656+0000 7f0309ffb640 1 -- 172.21.15.6:0/1928525664 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f03040305c0 con 0x7f030c1026d0 2024-09-11T23:52:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.657+0000 7f0309ffb640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f02fc0a2b20 0x7f02fc0a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.657+0000 7f0309ffb640 1 -- 172.21.15.6:0/1928525664 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f03040ef040 con 0x7f030c1026d0 2024-09-11T23:52:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.657+0000 7f0310cd1640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f02fc0a2b20 0x7f02fc0a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:15.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.658+0000 7f0310cd1640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f02fc0a2b20 0x7f02fc0a4fe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f030c101b70 tx=0x7f0300009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:52:15.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.661+0000 7f0309ffb640 1 -- 172.21.15.6:0/1928525664 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03040bd6f0 con 0x7f030c1026d0 2024-09-11T23:52:15.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:15 smithi039 ceph-mon[34543]: Detected new or changed devices on smithi134 2024-09-11T23:52:15.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:15 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi134 to 17088M 2024-09-11T23:52:15.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:15 smithi039 ceph-mon[34543]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-11T23:52:15.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:15 smithi039 ceph-mon[34543]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T23:52:15.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:15.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:15.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:15 smithi039 ceph-mon[34543]: from='osd.2 ' entity='osd.2' 2024-09-11T23:52:15.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:15.830 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:15 smithi134 ceph-mon[34893]: Detected new or changed devices on smithi134 2024-09-11T23:52:15.830 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:15 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi134 to 17088M 2024-09-11T23:52:15.830 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:15 smithi134 ceph-mon[34893]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-11T23:52:15.830 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:15 smithi134 ceph-mon[34893]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T23:52:15.830 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:15.830 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:15.830 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:15 smithi134 ceph-mon[34893]: from='osd.2 ' entity='osd.2' 2024-09-11T23:52:15.830 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:15.845+0000 7f0312f35640 1 -- 172.21.15.6:0/1928525664 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f030c1a0730 con 0x7f02fc0a2b20 2024-09-11T23:52:16.526 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:16 smithi006 ceph-mon[30947]: purged_snaps scrub starts 2024-09-11T23:52:16.526 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:16 smithi006 ceph-mon[30947]: purged_snaps scrub ok 2024-09-11T23:52:16.526 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:16 smithi006 ceph-mon[30947]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:16.527 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:16 smithi006 ceph-mon[30947]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:16.527 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:16.527 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:16.527 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:16.527 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:16 smithi006 ceph-mon[30947]: osd.2 [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235] boot 2024-09-11T23:52:16.527 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:16 smithi006 ceph-mon[30947]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T23:52:16.527 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:16.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:16 smithi134 ceph-mon[34893]: purged_snaps scrub starts 2024-09-11T23:52:16.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:16 smithi134 ceph-mon[34893]: purged_snaps scrub ok 2024-09-11T23:52:16.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:16 smithi134 ceph-mon[34893]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:16.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:16 smithi134 ceph-mon[34893]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:16.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:16.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:16.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:16.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:16 smithi134 ceph-mon[34893]: osd.2 [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235] boot 2024-09-11T23:52:16.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:16 smithi134 ceph-mon[34893]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T23:52:16.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:16 smithi039 ceph-mon[34543]: purged_snaps scrub starts 2024-09-11T23:52:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:16 smithi039 ceph-mon[34543]: purged_snaps scrub ok 2024-09-11T23:52:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:16 smithi039 ceph-mon[34543]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:16 smithi039 ceph-mon[34543]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:16 smithi039 ceph-mon[34543]: osd.2 [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235] boot 2024-09-11T23:52:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:16 smithi039 ceph-mon[34543]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T23:52:16.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:17.609 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:17 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:52:17.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:17 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:52:17.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:17 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:52:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:18 smithi039 ceph-mon[34543]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:18 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T23:52:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:18 smithi039 ceph-mon[34543]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T23:52:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:18 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:52:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:18 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1377464158' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9278237a-27a1-40bc-9bac-9b234b7b82b0"}]: dispatch 2024-09-11T23:52:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:18 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:52:18.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:18 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1377464158' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9278237a-27a1-40bc-9bac-9b234b7b82b0"}]': finished 2024-09-11T23:52:18.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:18 smithi039 ceph-mon[34543]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T23:52:18.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:18 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:18.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:18 smithi006 ceph-mon[30947]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:18 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T23:52:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:18 smithi006 ceph-mon[30947]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T23:52:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:18 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:52:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:18 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1377464158' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9278237a-27a1-40bc-9bac-9b234b7b82b0"}]: dispatch 2024-09-11T23:52:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:18 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:52:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:18 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1377464158' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9278237a-27a1-40bc-9bac-9b234b7b82b0"}]': finished 2024-09-11T23:52:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:18 smithi006 ceph-mon[30947]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T23:52:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:18 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:18.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:18 smithi134 ceph-mon[34893]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:18.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:18 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T23:52:18.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:18 smithi134 ceph-mon[34893]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T23:52:18.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:18 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:52:18.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:18 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1377464158' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9278237a-27a1-40bc-9bac-9b234b7b82b0"}]: dispatch 2024-09-11T23:52:18.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:18 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:52:18.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:18 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1377464158' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9278237a-27a1-40bc-9bac-9b234b7b82b0"}]': finished 2024-09-11T23:52:18.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:18 smithi134 ceph-mon[34893]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T23:52:18.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:18 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:19.362 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 11 23:52:18 smithi006 sudo[50030]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:52:19.362 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 11 23:52:18 smithi006 sudo[50030]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:19.362 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 11 23:52:18 smithi006 sudo[50030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:19.362 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 11 23:52:18 smithi006 sudo[50030]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:19.496+0000 7f0309ffb640 1 -- 172.21.15.6:0/1928525664 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f03040041e0 con 0x7f030c1026d0 2024-09-11T23:52:19.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:19 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2010597740' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:19.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:19 smithi006 ceph-mon[30947]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T23:52:19.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:19.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:19.619 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 11 23:52:19 smithi006 sudo[50079]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:52:19.619 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 11 23:52:19 smithi006 sudo[50079]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:19.619 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 11 23:52:19 smithi006 sudo[50079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:19.619 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 11 23:52:19 smithi006 sudo[50079]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:19.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:19 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2010597740' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:19.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:19 smithi039 ceph-mon[34543]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T23:52:19.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:19.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:19.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:19 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2010597740' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:19.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:19 smithi134 ceph-mon[34893]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T23:52:19.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:19.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:20.287 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 11 23:52:19 smithi039 sudo[43120]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:52:20.287 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 11 23:52:19 smithi039 sudo[43120]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:20.287 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 11 23:52:19 smithi039 sudo[43120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:20.287 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 11 23:52:19 smithi039 sudo[43120]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:20.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:20 smithi039 ceph-mon[34543]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:20.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:20 smithi039 ceph-mon[34543]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T23:52:20.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:20 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:20.544 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 11 23:52:20 smithi039 sudo[43123]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:52:20.544 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 11 23:52:20 smithi039 sudo[43123]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:20.545 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 11 23:52:20 smithi039 sudo[43123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:20.545 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 11 23:52:20 smithi039 sudo[43123]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:20.816 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:20 smithi134 ceph-mon[34893]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:20.816 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:20 smithi134 ceph-mon[34893]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T23:52:20.817 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:20 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:20.817 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 11 23:52:20 smithi134 sudo[43926]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:52:20.817 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 11 23:52:20 smithi134 sudo[43926]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:20.817 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 11 23:52:20 smithi134 sudo[43926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:20.817 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 11 23:52:20 smithi134 sudo[43926]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:20.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:20 smithi006 ceph-mon[30947]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:20.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:20 smithi006 ceph-mon[30947]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T23:52:20.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:20 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:21.203 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 11 23:52:20 smithi134 sudo[43929]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:52:21.203 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 11 23:52:20 smithi134 sudo[43929]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:21.203 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 11 23:52:20 smithi134 sudo[43929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:21.204 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 11 23:52:20 smithi134 sudo[43929]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:21.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:21 smithi006 sudo[50828]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:52:21.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:21 smithi006 sudo[50828]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:21.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:21 smithi006 sudo[50828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:21.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:21 smithi006 sudo[50828]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:22.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:21 smithi006 sudo[51019]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:52:22.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:21 smithi006 sudo[51019]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:22.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:21 smithi006 sudo[51019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:22.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:21 smithi006 sudo[51019]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:22.240 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:21 smithi134 sudo[43932]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:52:22.240 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:21 smithi134 sudo[43932]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:22.240 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:21 smithi134 sudo[43932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:22.240 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:22 smithi134 sudo[43932]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:22.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:22 smithi134 sudo[43935]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:52:22.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:22 smithi134 sudo[43935]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:22.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:22 smithi134 sudo[43935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:22.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:22 smithi134 sudo[43935]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:22.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:22 smithi039 sudo[43126]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:52:22.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:22 smithi039 sudo[43126]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:22.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:22 smithi039 sudo[43126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:22.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:22 smithi039 sudo[43126]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:23.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:23.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:23 smithi134 ceph-mon[34893]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:23.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:23 smithi134 ceph-mon[34893]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:23.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:23.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:23.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:23.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:23.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:23.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:23.498 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:23.498 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:23 smithi006 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:23.498 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:23 smithi006 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:23.498 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:23.498 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:23.498 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:23.498 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:23.498 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:23.498 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 sudo[43129]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:52:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 sudo[43129]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 sudo[43129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 sudo[43129]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 ceph-mon[34543]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 ceph-mon[34543]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:24.213 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:24 smithi006 ceph-mon[30947]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:24.214 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:24 smithi006 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:24.214 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:24 smithi006 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:24.214 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:24 smithi006 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:24.214 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:24.214 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:24.214 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:24.214 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:24 smithi006 ceph-mon[30947]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:24.214 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:24 smithi006 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:24 smithi134 ceph-mon[34893]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:24 smithi134 ceph-mon[34893]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:24 smithi134 ceph-mon[34893]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:24 smithi134 ceph-mon[34893]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:24.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:24.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:24 smithi134 ceph-mon[34893]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:24.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:24 smithi134 ceph-mon[34893]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:24 smithi039 ceph-mon[34543]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:24 smithi039 ceph-mon[34543]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:24 smithi039 ceph-mon[34543]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:24 smithi039 ceph-mon[34543]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:24 smithi039 ceph-mon[34543]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:24.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:24 smithi039 ceph-mon[34543]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:26.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:26 smithi006 ceph-mon[30947]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:26.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:26 smithi134 ceph-mon[34893]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:26.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:26 smithi039 ceph-mon[34543]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:27.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:27 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T23:52:27.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:27 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:27.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:27 smithi134 ceph-mon[34893]: Deploying daemon osd.3 on smithi006 2024-09-11T23:52:27.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:27 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T23:52:27.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:27 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:27.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:27 smithi039 ceph-mon[34543]: Deploying daemon osd.3 on smithi006 2024-09-11T23:52:27.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:27 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T23:52:27.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:27 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:27.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:27 smithi006 ceph-mon[30947]: Deploying daemon osd.3 on smithi006 2024-09-11T23:52:28.294 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:28 smithi006 ceph-mon[30947]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:28.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:28 smithi134 ceph-mon[34893]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:28.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:28 smithi039 ceph-mon[34543]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:30.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:30 smithi006 ceph-mon[30947]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-11T23:52:30.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:30 smithi134 ceph-mon[34893]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-11T23:52:30.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:30 smithi039 ceph-mon[34543]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-11T23:52:32.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:32 smithi006 ceph-mon[30947]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-11T23:52:32.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:32 smithi134 ceph-mon[34893]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-11T23:52:32.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:32 smithi039 ceph-mon[34543]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-11T23:52:33.409 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:33 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:33.409 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:33 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:33.409 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:33 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:33.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:33 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:33.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:33 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:33.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:33 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:33.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:33 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:33.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:33 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:33.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:33 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:34.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:34 smithi134 ceph-mon[34893]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-11T23:52:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:34 smithi039 ceph-mon[34543]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-11T23:52:35.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:34 smithi006 ceph-mon[30947]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-11T23:52:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:36 smithi006 ceph-mon[30947]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:52:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:36.869 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:36 smithi134 ceph-mon[34893]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:52:36.869 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:36.869 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:36.869 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:36.869 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:36.870 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:36.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.951+0000 7f0309ffb640 1 -- 172.21.15.6:0/1928525664 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f030c1a0730 con 0x7f02fc0a2b20 2024-09-11T23:52:36.951 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 3 on host 'smithi006' 2024-09-11T23:52:36.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.954+0000 7f0312f35640 1 -- 172.21.15.6:0/1928525664 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f02fc0a2b20 msgr2=0x7f02fc0a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:36.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.954+0000 7f0312f35640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f02fc0a2b20 0x7f02fc0a4fe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f030c101b70 tx=0x7f0300009110 comp rx=0 tx=0).stop 2024-09-11T23:52:36.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.954+0000 7f0312f35640 1 -- 172.21.15.6:0/1928525664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f030c1026d0 msgr2=0x7f030c19f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:36.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.954+0000 7f0312f35640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f030c1026d0 0x7f030c19f4d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0304009dc0 tx=0x7f0304003ba0 comp rx=0 tx=0).stop 2024-09-11T23:52:36.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.954+0000 7f0312f35640 1 -- 172.21.15.6:0/1928525664 shutdown_connections 2024-09-11T23:52:36.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.954+0000 7f0312f35640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f02fc0a2b20 0x7f02fc0a4fe0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:36.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.954+0000 7f0312f35640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f030c1026d0 0x7f030c19f4d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:36.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.954+0000 7f0312f35640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f030c101d10 0x7f030c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:36.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.954+0000 7f0312f35640 1 --2- 172.21.15.6:0/1928525664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c100b10 0x7f030c197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:36.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.954+0000 7f0312f35640 1 -- 172.21.15.6:0/1928525664 >> 172.21.15.6:0/1928525664 conn(0x7f030c0fc2a0 msgr2=0x7f030c06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:52:36.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.954+0000 7f0312f35640 1 -- 172.21.15.6:0/1928525664 shutdown_connections 2024-09-11T23:52:36.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:52:36.954+0000 7f0312f35640 1 -- 172.21.15.6:0/1928525664 wait complete. 2024-09-11T23:52:37.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:36 smithi039 ceph-mon[34543]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:52:37.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:37.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:37.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:37.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:37.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:37.568 DEBUG:teuthology.orchestra.run.smithi006:osd.3> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.3.service 2024-09-11T23:52:37.571 INFO:tasks.cephadm:Deploying osd.4 on smithi039 with /dev/vg_nvme/lv_3... 2024-09-11T23:52:37.572 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T23:52:37.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:37 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:37.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:37 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:37.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:37 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:37.838 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:52:37.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:37 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:37.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:37 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:37.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:37 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:37.959 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:37 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:37.959 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:37 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:37.959 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:37 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:38.804 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:38 smithi006 ceph-mon[30947]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:52:38.804 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:38 smithi006 ceph-mon[30947]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T23:52:38.804 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 11 23:52:38 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3[52056]: 2024-09-11T23:52:38.482+0000 7ffa67bd1640 -1 osd.3 0 log_to_monitors true 2024-09-11T23:52:38.870 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:38 smithi039 ceph-mon[34543]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:52:38.870 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:38 smithi039 ceph-mon[34543]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T23:52:38.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:38 smithi134 ceph-mon[34893]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:52:38.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:38 smithi134 ceph-mon[34893]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T23:52:39.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:39 smithi006 ceph-mon[30947]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T23:52:39.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:39 smithi006 ceph-mon[30947]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T23:52:39.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:39 smithi006 ceph-mon[30947]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-09-11T23:52:39.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:39 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:39.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:39 smithi006 ceph-mon[30947]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-11T23:52:39.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:39 smithi006 ceph-mon[30947]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T23:52:39.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:39 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:39.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:39 smithi134 ceph-mon[34893]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T23:52:39.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:39 smithi134 ceph-mon[34893]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T23:52:39.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:39 smithi134 ceph-mon[34893]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-09-11T23:52:39.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:39 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:39.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:39 smithi134 ceph-mon[34893]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-11T23:52:39.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:39 smithi134 ceph-mon[34893]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T23:52:39.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:39 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:40.005 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:39 smithi039 ceph-mon[34543]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T23:52:40.005 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:39 smithi039 ceph-mon[34543]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T23:52:40.005 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:39 smithi039 ceph-mon[34543]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-09-11T23:52:40.005 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:39 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:40.005 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:39 smithi039 ceph-mon[34543]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-11T23:52:40.005 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:39 smithi039 ceph-mon[34543]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T23:52:40.005 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:39 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:40.294 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 11 23:52:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3[52056]: 2024-09-11T23:52:40.016+0000 7ffa63b54640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T23:52:40.294 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 11 23:52:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3[52056]: 2024-09-11T23:52:40.024+0000 7ffa5b974640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:52:40.452 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:52:40.485 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_3 2024-09-11T23:52:40.753 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:52:40.774 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:40 smithi039 ceph-mon[34543]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:40.774 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:40.774 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:40 smithi039 ceph-mon[34543]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' 2024-09-11T23:52:40.774 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:40 smithi039 ceph-mon[34543]: osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871] boot 2024-09-11T23:52:40.775 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:40 smithi039 ceph-mon[34543]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T23:52:40.775 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:40 smithi006 ceph-mon[30947]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:40 smithi006 ceph-mon[30947]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' 2024-09-11T23:52:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:40 smithi006 ceph-mon[30947]: osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871] boot 2024-09-11T23:52:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:40 smithi006 ceph-mon[30947]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T23:52:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:40.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:40 smithi134 ceph-mon[34893]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:40.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:40.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:40 smithi134 ceph-mon[34893]: from='osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871]' entity='osd.3' 2024-09-11T23:52:40.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:40 smithi134 ceph-mon[34893]: osd.3 [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871] boot 2024-09-11T23:52:40.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:40 smithi134 ceph-mon[34893]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T23:52:40.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:41.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.223+0000 7fd92a9be640 1 -- 172.21.15.39:0/786105895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd924101cd0 msgr2=0x7fd924102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:41.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.223+0000 7fd92a9be640 1 --2- 172.21.15.39:0/786105895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd924101cd0 0x7fd924102150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd918009900 tx=0x7fd91802a410 comp rx=0 tx=0).stop 2024-09-11T23:52:41.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.223+0000 7fd92a9be640 1 -- 172.21.15.39:0/786105895 shutdown_connections 2024-09-11T23:52:41.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.223+0000 7fd92a9be640 1 --2- 172.21.15.39:0/786105895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd924102690 0x7fd924108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.223+0000 7fd92a9be640 1 --2- 172.21.15.39:0/786105895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd924101cd0 0x7fd924102150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.223+0000 7fd92a9be640 1 --2- 172.21.15.39:0/786105895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd924100ad0 0x7fd924100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.223+0000 7fd92a9be640 1 -- 172.21.15.39:0/786105895 >> 172.21.15.39:0/786105895 conn(0x7fd9240fc280 msgr2=0x7fd9240fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.223+0000 7fd92a9be640 1 -- 172.21.15.39:0/786105895 shutdown_connections 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.223+0000 7fd92a9be640 1 -- 172.21.15.39:0/786105895 wait complete. 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.223+0000 7fd92a9be640 1 Processor -- start 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.223+0000 7fd92a9be640 1 -- start start 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd92a9be640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd924100ad0 0x7fd924197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd92a9be640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd924101cd0 0x7fd924198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd92a9be640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd924102690 0x7fd92419f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd92a9be640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd92410d730 con 0x7fd924102690 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd92a9be640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd92410d5b0 con 0x7fd924100ad0 2024-09-11T23:52:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd92a9be640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd92410d8b0 con 0x7fd924101cd0 2024-09-11T23:52:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd923fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd924100ad0 0x7fd924197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd9237fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd924101cd0 0x7fd924198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd923fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd924100ad0 0x7fd924197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45608/0 (socket says 172.21.15.39:45608) 2024-09-11T23:52:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd923fff640 1 -- 172.21.15.39:0/2728253554 learned_addr learned my addr 172.21.15.39:0/2728253554 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-11T23:52:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd928f5b640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd924102690 0x7fd92419f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd923fff640 1 -- 172.21.15.39:0/2728253554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd924101cd0 msgr2=0x7fd924198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd923fff640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd924101cd0 0x7fd924198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd923fff640 1 -- 172.21.15.39:0/2728253554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd924102690 msgr2=0x7fd92419f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd923fff640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd924102690 0x7fd92419f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.224+0000 7fd923fff640 1 -- 172.21.15.39:0/2728253554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92419fa10 con 0x7fd924100ad0 2024-09-11T23:52:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.225+0000 7fd923fff640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd924100ad0 0x7fd924197de0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd91400c970 tx=0x7fd91400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:52:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.225+0000 7fd9217fa640 1 -- 172.21.15.39:0/2728253554 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914004220 con 0x7fd924100ad0 2024-09-11T23:52:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.225+0000 7fd92a9be640 1 -- 172.21.15.39:0/2728253554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92419fd00 con 0x7fd924100ad0 2024-09-11T23:52:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.225+0000 7fd9217fa640 1 -- 172.21.15.39:0/2728253554 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9140043c0 con 0x7fd924100ad0 2024-09-11T23:52:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.225+0000 7fd9217fa640 1 -- 172.21.15.39:0/2728253554 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91400f450 con 0x7fd924100ad0 2024-09-11T23:52:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.225+0000 7fd92a9be640 1 -- 172.21.15.39:0/2728253554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9241a01b0 con 0x7fd924100ad0 2024-09-11T23:52:41.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.226+0000 7fd92a9be640 1 -- 172.21.15.39:0/2728253554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd924107f70 con 0x7fd924100ad0 2024-09-11T23:52:41.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.228+0000 7fd9217fa640 1 -- 172.21.15.39:0/2728253554 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fd9140079b0 con 0x7fd924100ad0 2024-09-11T23:52:41.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.229+0000 7fd9217fa640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd90c0a2bb0 0x7fd90c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:41.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.229+0000 7fd9217fa640 1 -- 172.21.15.39:0/2728253554 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3702+0+0 (secure 0 0 0) 0x7fd9140cdec0 con 0x7fd924100ad0 2024-09-11T23:52:41.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.229+0000 7fd9237fe640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd90c0a2bb0 0x7fd90c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:41.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.230+0000 7fd9237fe640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd90c0a2bb0 0x7fd90c0a5070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd918006010 tx=0x7fd918000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:52:41.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.232+0000 7fd9217fa640 1 -- 172.21.15.39:0/2728253554 <== mon.2 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd914014030 con 0x7fd924100ad0 2024-09-11T23:52:41.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:52:41.420+0000 7fd92a9be640 1 -- 172.21.15.39:0/2728253554 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd924062630 con 0x7fd90c0a2bb0 2024-09-11T23:52:41.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: purged_snaps scrub starts 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: purged_snaps scrub ok 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: Detected new or changed devices on smithi006 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi006 to 8546M 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:41.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:41.955 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:41.955 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:41 smithi134 ceph-mon[34893]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T23:52:41.985 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: purged_snaps scrub starts 2024-09-11T23:52:41.985 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: purged_snaps scrub ok 2024-09-11T23:52:41.985 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: Detected new or changed devices on smithi006 2024-09-11T23:52:41.985 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:41.985 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:41.986 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:41.986 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:41.986 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi006 to 8546M 2024-09-11T23:52:41.986 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:41.986 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:41.986 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:41.986 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:41.986 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:41.986 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:41.986 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:41.986 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:41 smithi039 ceph-mon[34543]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T23:52:42.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: purged_snaps scrub starts 2024-09-11T23:52:42.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: purged_snaps scrub ok 2024-09-11T23:52:42.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: Detected new or changed devices on smithi006 2024-09-11T23:52:42.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:42.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:42.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:42.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:42.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi006 to 8546M 2024-09-11T23:52:42.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:42.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:42.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:42.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:42.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:42.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:42.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:42.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:41 smithi006 ceph-mon[30947]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T23:52:42.966 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:42 smithi039 ceph-mon[34543]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:52:42.966 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:42 smithi039 ceph-mon[34543]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:42.966 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:42 smithi039 ceph-mon[34543]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T23:52:43.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:42 smithi006 ceph-mon[30947]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:52:43.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:42 smithi006 ceph-mon[30947]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:43.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:42 smithi006 ceph-mon[30947]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T23:52:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:42 smithi134 ceph-mon[34893]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:52:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:42 smithi134 ceph-mon[34893]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:42 smithi134 ceph-mon[34893]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T23:52:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:44 smithi006 ceph-mon[30947]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:52:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:44 smithi006 ceph-mon[30947]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T23:52:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:44 smithi006 ceph-mon[30947]: from='client.? 172.21.15.39:0/1559236959' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1945486a-37b3-40c9-8854-0c9d0b63f3aa"}]: dispatch 2024-09-11T23:52:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:44 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1945486a-37b3-40c9-8854-0c9d0b63f3aa"}]: dispatch 2024-09-11T23:52:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:44 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1945486a-37b3-40c9-8854-0c9d0b63f3aa"}]': finished 2024-09-11T23:52:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:44 smithi006 ceph-mon[30947]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T23:52:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:44 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:52:44.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:44 smithi134 ceph-mon[34893]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:52:44.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:44 smithi134 ceph-mon[34893]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T23:52:44.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:44 smithi134 ceph-mon[34893]: from='client.? 172.21.15.39:0/1559236959' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1945486a-37b3-40c9-8854-0c9d0b63f3aa"}]: dispatch 2024-09-11T23:52:44.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:44 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1945486a-37b3-40c9-8854-0c9d0b63f3aa"}]: dispatch 2024-09-11T23:52:44.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:44 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1945486a-37b3-40c9-8854-0c9d0b63f3aa"}]': finished 2024-09-11T23:52:44.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:44 smithi134 ceph-mon[34893]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T23:52:44.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:44 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:52:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:44 smithi039 ceph-mon[34543]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:52:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:44 smithi039 ceph-mon[34543]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T23:52:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:44 smithi039 ceph-mon[34543]: from='client.? 172.21.15.39:0/1559236959' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1945486a-37b3-40c9-8854-0c9d0b63f3aa"}]: dispatch 2024-09-11T23:52:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:44 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1945486a-37b3-40c9-8854-0c9d0b63f3aa"}]: dispatch 2024-09-11T23:52:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:44 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1945486a-37b3-40c9-8854-0c9d0b63f3aa"}]': finished 2024-09-11T23:52:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:44 smithi039 ceph-mon[34543]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T23:52:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:44 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:52:45.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:45 smithi006 ceph-mon[30947]: from='client.? 172.21.15.39:0/2043013792' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:45.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:45 smithi134 ceph-mon[34893]: from='client.? 172.21.15.39:0/2043013792' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:46.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:45 smithi039 ceph-mon[34543]: from='client.? 172.21.15.39:0/2043013792' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:46.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:46 smithi134 ceph-mon[34893]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:52:46.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:46 smithi006 ceph-mon[30947]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:52:47.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:46 smithi039 ceph-mon[34543]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:52:48.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:48 smithi006 ceph-mon[30947]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:52:48.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:48 smithi134 ceph-mon[34893]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:52:48.964 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:48 smithi039 ceph-mon[34543]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:52:50.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:50 smithi039 ceph-mon[34543]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-11T23:52:50.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:50 smithi006 ceph-mon[30947]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-11T23:52:50.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:50 smithi134 ceph-mon[34893]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-11T23:52:52.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:52 smithi039 ceph-mon[34543]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:52:52.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T23:52:52.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:52.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:52 smithi006 ceph-mon[30947]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:52:52.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T23:52:52.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:52.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:52 smithi134 ceph-mon[34893]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:52:52.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T23:52:52.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:53.821 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:53 smithi039 ceph-mon[34543]: Deploying daemon osd.4 on smithi039 2024-09-11T23:52:53.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:53 smithi006 ceph-mon[30947]: Deploying daemon osd.4 on smithi039 2024-09-11T23:52:53.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:53 smithi134 ceph-mon[34893]: Deploying daemon osd.4 on smithi039 2024-09-11T23:52:54.761 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:54 smithi039 ceph-mon[34543]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-11T23:52:54.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:54 smithi006 ceph-mon[30947]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-11T23:52:54.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:54 smithi134 ceph-mon[34893]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-11T23:52:56.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:56 smithi006 ceph-mon[30947]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-11T23:52:56.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:56 smithi134 ceph-mon[34893]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-11T23:52:57.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:56 smithi039 ceph-mon[34543]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-11T23:52:58.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:58 smithi039 ceph-mon[34543]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:52:58.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:58 smithi006 ceph-mon[30947]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:52:58.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:58 smithi134 ceph-mon[34893]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:52:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:59 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:59 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:52:59 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:59.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:59 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:59.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:59 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:59.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:52:59 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:59.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:59 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:59.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:59 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:52:59.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:52:59 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:00.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:00 smithi039 ceph-mon[34543]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:53:00.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:00 smithi134 ceph-mon[34893]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:53:01.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:00 smithi006 ceph-mon[30947]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:53:02.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.386+0000 7fd9217fa640 1 -- 172.21.15.39:0/2728253554 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd924062630 con 0x7fd90c0a2bb0 2024-09-11T23:53:02.385 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 4 on host 'smithi039' 2024-09-11T23:53:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.388+0000 7fd92a9be640 1 -- 172.21.15.39:0/2728253554 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd90c0a2bb0 msgr2=0x7fd90c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.388+0000 7fd92a9be640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd90c0a2bb0 0x7fd90c0a5070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd918006010 tx=0x7fd918000bc0 comp rx=0 tx=0).stop 2024-09-11T23:53:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.388+0000 7fd92a9be640 1 -- 172.21.15.39:0/2728253554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd924100ad0 msgr2=0x7fd924197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.388+0000 7fd92a9be640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd924100ad0 0x7fd924197de0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd91400c970 tx=0x7fd91400ce30 comp rx=0 tx=0).stop 2024-09-11T23:53:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.389+0000 7fd92a9be640 1 -- 172.21.15.39:0/2728253554 shutdown_connections 2024-09-11T23:53:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.389+0000 7fd92a9be640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd90c0a2bb0 0x7fd90c0a5070 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.389+0000 7fd92a9be640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd924102690 0x7fd92419f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.389+0000 7fd92a9be640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd924101cd0 0x7fd924198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.389+0000 7fd92a9be640 1 --2- 172.21.15.39:0/2728253554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd924100ad0 0x7fd924197de0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.389+0000 7fd92a9be640 1 -- 172.21.15.39:0/2728253554 >> 172.21.15.39:0/2728253554 conn(0x7fd9240fc280 msgr2=0x7fd924105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:53:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.389+0000 7fd92a9be640 1 -- 172.21.15.39:0/2728253554 shutdown_connections 2024-09-11T23:53:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:02.389+0000 7fd92a9be640 1 -- 172.21.15.39:0/2728253554 wait complete. 2024-09-11T23:53:02.768 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:02 smithi039 ceph-mon[34543]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:02.769 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.769 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.769 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:02.769 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:02.769 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.769 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:02.770 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.770 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:02 smithi006 ceph-mon[30947]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:02.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:02.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:02.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:02.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:02 smithi134 ceph-mon[34893]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:02.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:02.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:02.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:03.054 DEBUG:teuthology.orchestra.run.smithi039:osd.4> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.4.service 2024-09-11T23:53:03.056 INFO:tasks.cephadm:Deploying osd.5 on smithi134 with /dev/vg_nvme/lv_3... 2024-09-11T23:53:03.056 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T23:53:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:53:04.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:04 smithi039 ceph-mon[34543]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:04.794 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 11 23:53:04 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4[45873]: 2024-09-11T23:53:04.509+0000 7fa521a32640 -1 osd.4 0 log_to_monitors true 2024-09-11T23:53:04.832 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:04 smithi134 ceph-mon[34893]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:04 smithi006 ceph-mon[30947]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:05.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:05 smithi039 ceph-mon[34543]: from='osd.4 [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:53:05.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:05 smithi039 ceph-mon[34543]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:53:05.777 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:05 smithi134 ceph-mon[34893]: from='osd.4 [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:53:05.777 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:05 smithi134 ceph-mon[34893]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:53:05.781 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:53:05.816 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2024-09-11T23:53:05.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:05 smithi006 ceph-mon[30947]: from='osd.4 [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:53:05.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:05 smithi006 ceph-mon[30947]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:53:06.068 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:53:06.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.566+0000 7fddbcccd640 1 -- 172.21.15.134:0/3752769229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb81037c0 msgr2=0x7fddb810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:06.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.566+0000 7fddbcccd640 1 --2- 172.21.15.134:0/3752769229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb81037c0 0x7fddb810a050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009ca0 tx=0x7fddb002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:53:06.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.566+0000 7fddbcccd640 1 -- 172.21.15.134:0/3752769229 shutdown_connections 2024-09-11T23:53:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.566+0000 7fddbcccd640 1 --2- 172.21.15.134:0/3752769229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb81037c0 0x7fddb810a050 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.566+0000 7fddbcccd640 1 --2- 172.21.15.134:0/3752769229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb8102e00 0x7fddb8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.566+0000 7fddbcccd640 1 --2- 172.21.15.134:0/3752769229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddb8101c00 0x7fddb8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.566+0000 7fddbcccd640 1 -- 172.21.15.134:0/3752769229 >> 172.21.15.134:0/3752769229 conn(0x7fddb80fd390 msgr2=0x7fddb80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:53:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.566+0000 7fddbcccd640 1 -- 172.21.15.134:0/3752769229 shutdown_connections 2024-09-11T23:53:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.566+0000 7fddbcccd640 1 -- 172.21.15.134:0/3752769229 wait complete. 2024-09-11T23:53:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddbcccd640 1 Processor -- start 2024-09-11T23:53:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddbcccd640 1 -- start start 2024-09-11T23:53:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddbcccd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb8101c00 0x7fddb8197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddbcccd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb8102e00 0x7fddb8198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddbcccd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddb81037c0 0x7fddb819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddbcccd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fddb810d730 con 0x7fddb8101c00 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddbcccd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fddb810d5b0 con 0x7fddb81037c0 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddbcccd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fddb810d8b0 con 0x7fddb8102e00 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddaffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb8102e00 0x7fddb8198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddaffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb8102e00 0x7fddb8198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56124/0 (socket says 172.21.15.134:56124) 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddaffff640 1 -- 172.21.15.134:0/2389965004 learned_addr learned my addr 172.21.15.134:0/2389965004 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddb6d9d640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddb81037c0 0x7fddb819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.567+0000 7fddb659c640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb8101c00 0x7fddb8197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.568+0000 7fddaffff640 1 -- 172.21.15.134:0/2389965004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddb81037c0 msgr2=0x7fddb819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.568+0000 7fddaffff640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddb81037c0 0x7fddb819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.568+0000 7fddaffff640 1 -- 172.21.15.134:0/2389965004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb8101c00 msgr2=0x7fddb8197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.568+0000 7fddaffff640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb8101c00 0x7fddb8197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.568+0000 7fddaffff640 1 -- 172.21.15.134:0/2389965004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb819f9f0 con 0x7fddb8102e00 2024-09-11T23:53:06.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.568+0000 7fddb659c640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb8101c00 0x7fddb8197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:53:06.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.568+0000 7fddaffff640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb8102e00 0x7fddb8198300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdda000d950 tx=0x7fdda000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:53:06.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.568+0000 7fddaf7fe640 1 -- 172.21.15.134:0/2389965004 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0017030 con 0x7fddb8102e00 2024-09-11T23:53:06.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.568+0000 7fddaf7fe640 1 -- 172.21.15.134:0/2389965004 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdda0004020 con 0x7fddb8102e00 2024-09-11T23:53:06.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.568+0000 7fddbcccd640 1 -- 172.21.15.134:0/2389965004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb819fce0 con 0x7fddb8102e00 2024-09-11T23:53:06.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.568+0000 7fddaf7fe640 1 -- 172.21.15.134:0/2389965004 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda00047a0 con 0x7fddb8102e00 2024-09-11T23:53:06.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.568+0000 7fddbcccd640 1 -- 172.21.15.134:0/2389965004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb81a0210 con 0x7fddb8102e00 2024-09-11T23:53:06.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.569+0000 7fddbcccd640 1 -- 172.21.15.134:0/2389965004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb8109070 con 0x7fddb8102e00 2024-09-11T23:53:06.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.570+0000 7fddaf7fe640 1 -- 172.21.15.134:0/2389965004 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fdda00041d0 con 0x7fddb8102e00 2024-09-11T23:53:06.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.571+0000 7fddaf7fe640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdda40a2c30 0x7fdda40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:06.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.571+0000 7fddaf7fe640 1 -- 172.21.15.134:0/2389965004 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7fdda00cd930 con 0x7fddb8102e00 2024-09-11T23:53:06.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.571+0000 7fddb659c640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdda40a2c30 0x7fdda40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:06.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.571+0000 7fddb659c640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdda40a2c30 0x7fdda40a50f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdda80058c0 tx=0x7fdda8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:53:06.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.575+0000 7fddaf7fe640 1 -- 172.21.15.134:0/2389965004 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdda009b980 con 0x7fddb8102e00 2024-09-11T23:53:06.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:06.751+0000 7fddbcccd640 1 -- 172.21.15.134:0/2389965004 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fddb8062630 con 0x7fdda40a2c30 2024-09-11T23:53:06.751 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:06.751 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T23:53:06.751 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: from='osd.4 [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:53:06.751 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T23:53:06.751 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:06.751 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:53:06.751 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:06.752 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:06.752 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:06.752 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:06.752 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:06.752 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:06.752 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:06.752 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:06.794 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4[45873]: 2024-09-11T23:53:06.530+0000 7fa51d9b5640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T23:53:06.794 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4[45873]: 2024-09-11T23:53:06.539+0000 7fa5197dd640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:53:06.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:06.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T23:53:06.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: from='osd.4 [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:53:06.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T23:53:06.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:06.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:53:06.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:06.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:06.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:06.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:06.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:06.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:06.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:06.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:06.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:06.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T23:53:06.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: from='osd.4 [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:53:06.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T23:53:06.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:06.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:53:06.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:06.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:06.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:06.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:06.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:06.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:06.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:06.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:07.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:07 smithi039 ceph-mon[34543]: purged_snaps scrub starts 2024-09-11T23:53:07.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:07 smithi039 ceph-mon[34543]: purged_snaps scrub ok 2024-09-11T23:53:07.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:07 smithi039 ceph-mon[34543]: Detected new or changed devices on smithi039 2024-09-11T23:53:07.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:07 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi039 to 8544M 2024-09-11T23:53:07.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:07 smithi039 ceph-mon[34543]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-11T23:53:07.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:07 smithi039 ceph-mon[34543]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T23:53:07.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:07 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:07.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:07 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:07.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:07 smithi039 ceph-mon[34543]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:07.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:07 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:07.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:07 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:07.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:07 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:07.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:07 smithi134 ceph-mon[34893]: purged_snaps scrub starts 2024-09-11T23:53:07.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:07 smithi134 ceph-mon[34893]: purged_snaps scrub ok 2024-09-11T23:53:07.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:07 smithi134 ceph-mon[34893]: Detected new or changed devices on smithi039 2024-09-11T23:53:07.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:07 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi039 to 8544M 2024-09-11T23:53:07.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:07 smithi134 ceph-mon[34893]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-11T23:53:07.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:07 smithi134 ceph-mon[34893]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T23:53:07.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:07 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:07.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:07 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:07.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:07 smithi134 ceph-mon[34893]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:07.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:07 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:07.813 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:07 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:07.813 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:07 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:07.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:07 smithi006 ceph-mon[30947]: purged_snaps scrub starts 2024-09-11T23:53:07.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:07 smithi006 ceph-mon[30947]: purged_snaps scrub ok 2024-09-11T23:53:07.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:07 smithi006 ceph-mon[30947]: Detected new or changed devices on smithi039 2024-09-11T23:53:07.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:07 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi039 to 8544M 2024-09-11T23:53:07.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:07 smithi006 ceph-mon[30947]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-11T23:53:07.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:07 smithi006 ceph-mon[30947]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T23:53:07.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:07 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:07.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:07 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:07.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:07 smithi006 ceph-mon[30947]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:07.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:07 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:07.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:07 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:07.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:07 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:08.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:08 smithi134 ceph-mon[34893]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:08.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:08 smithi134 ceph-mon[34893]: osd.4 [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335] boot 2024-09-11T23:53:08.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:08 smithi134 ceph-mon[34893]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T23:53:08.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:08 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:08.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:08 smithi039 ceph-mon[34543]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:08.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:08 smithi039 ceph-mon[34543]: osd.4 [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335] boot 2024-09-11T23:53:08.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:08 smithi039 ceph-mon[34543]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T23:53:08.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:08 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:08.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:08 smithi006 ceph-mon[30947]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:08.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:08 smithi006 ceph-mon[30947]: osd.4 [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335] boot 2024-09-11T23:53:08.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:08 smithi006 ceph-mon[30947]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T23:53:08.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:08 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:09.622 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:09 smithi134 ceph-mon[34893]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T23:53:09.622 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:09 smithi134 ceph-mon[34893]: from='client.? 172.21.15.134:0/879835076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d57840a8-4d24-432a-9368-863496d55a95"}]: dispatch 2024-09-11T23:53:09.622 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:09 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d57840a8-4d24-432a-9368-863496d55a95"}]: dispatch 2024-09-11T23:53:09.622 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:09 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d57840a8-4d24-432a-9368-863496d55a95"}]': finished 2024-09-11T23:53:09.622 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:09 smithi134 ceph-mon[34893]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T23:53:09.622 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:09 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:09.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:09 smithi006 ceph-mon[30947]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T23:53:09.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:09 smithi006 ceph-mon[30947]: from='client.? 172.21.15.134:0/879835076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d57840a8-4d24-432a-9368-863496d55a95"}]: dispatch 2024-09-11T23:53:09.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:09 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d57840a8-4d24-432a-9368-863496d55a95"}]: dispatch 2024-09-11T23:53:09.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:09 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d57840a8-4d24-432a-9368-863496d55a95"}]': finished 2024-09-11T23:53:09.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:09 smithi006 ceph-mon[30947]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T23:53:09.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:09 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:10.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:09 smithi039 ceph-mon[34543]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T23:53:10.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:09 smithi039 ceph-mon[34543]: from='client.? 172.21.15.134:0/879835076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d57840a8-4d24-432a-9368-863496d55a95"}]: dispatch 2024-09-11T23:53:10.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:09 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d57840a8-4d24-432a-9368-863496d55a95"}]: dispatch 2024-09-11T23:53:10.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:09 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d57840a8-4d24-432a-9368-863496d55a95"}]': finished 2024-09-11T23:53:10.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:09 smithi039 ceph-mon[34543]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T23:53:10.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:09 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:10.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:10 smithi006 ceph-mon[30947]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:10.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:10 smithi006 ceph-mon[30947]: from='client.? 172.21.15.134:0/2458955218' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:53:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:10 smithi134 ceph-mon[34893]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:10 smithi134 ceph-mon[34893]: from='client.? 172.21.15.134:0/2458955218' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:53:11.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:10 smithi039 ceph-mon[34543]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:11.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:10 smithi039 ceph-mon[34543]: from='client.? 172.21.15.134:0/2458955218' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:53:12.846 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:12 smithi039 ceph-mon[34543]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:12.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:12 smithi006 ceph-mon[30947]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:12.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:12 smithi134 ceph-mon[34893]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:14.846 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:14 smithi134 ceph-mon[34893]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:14.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:14 smithi006 ceph-mon[30947]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:15.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:14 smithi039 ceph-mon[34543]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:16.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:16 smithi006 ceph-mon[30947]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:16.921 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:16 smithi134 ceph-mon[34893]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:17.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:16 smithi039 ceph-mon[34543]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:17.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:17 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T23:53:17.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:17 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:17.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:17 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T23:53:17.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:17 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:18.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:17 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T23:53:18.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:17 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:18.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:18 smithi006 ceph-mon[30947]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:18 smithi006 ceph-mon[30947]: Deploying daemon osd.5 on smithi134 2024-09-11T23:53:18.908 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:18 smithi134 ceph-mon[34893]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:18.909 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:18 smithi134 ceph-mon[34893]: Deploying daemon osd.5 on smithi134 2024-09-11T23:53:19.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:18 smithi039 ceph-mon[34543]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:19.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:18 smithi039 ceph-mon[34543]: Deploying daemon osd.5 on smithi134 2024-09-11T23:53:20.861 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:20 smithi134 ceph-mon[34893]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:20.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:20 smithi006 ceph-mon[30947]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:21.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:20 smithi039 ceph-mon[34543]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:22.857 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:22 smithi134 ceph-mon[34893]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:22.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:22 smithi006 ceph-mon[30947]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:23.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:22 smithi039 ceph-mon[34543]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:24.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:24 smithi006 ceph-mon[30947]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:24.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:24.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:24.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:24.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:24 smithi134 ceph-mon[34893]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:24.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:24.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:24.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:25.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:24 smithi039 ceph-mon[34543]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:25.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:25.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:25.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:26.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:26 smithi006 ceph-mon[30947]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:26.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:26.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:26.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:26.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:26.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:26 smithi134 ceph-mon[34893]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:26.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:27.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:26 smithi039 ceph-mon[34543]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:27.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:27.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:27.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:27.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:27.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.760+0000 7fddaf7fe640 1 -- 172.21.15.134:0/2389965004 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fddb8062630 con 0x7fdda40a2c30 2024-09-11T23:53:27.760 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 5 on host 'smithi134' 2024-09-11T23:53:27.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.762+0000 7fddbcccd640 1 -- 172.21.15.134:0/2389965004 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdda40a2c30 msgr2=0x7fdda40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:27.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.762+0000 7fddbcccd640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdda40a2c30 0x7fdda40a50f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdda80058c0 tx=0x7fdda8005850 comp rx=0 tx=0).stop 2024-09-11T23:53:27.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.762+0000 7fddbcccd640 1 -- 172.21.15.134:0/2389965004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb8102e00 msgr2=0x7fddb8198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:27.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.762+0000 7fddbcccd640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb8102e00 0x7fddb8198300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdda000d950 tx=0x7fdda000de10 comp rx=0 tx=0).stop 2024-09-11T23:53:27.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.762+0000 7fddbcccd640 1 -- 172.21.15.134:0/2389965004 shutdown_connections 2024-09-11T23:53:27.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.762+0000 7fddbcccd640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdda40a2c30 0x7fdda40a50f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:27.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.762+0000 7fddbcccd640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddb81037c0 0x7fddb819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:27.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.762+0000 7fddbcccd640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb8102e00 0x7fddb8198300 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:27.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.762+0000 7fddbcccd640 1 --2- 172.21.15.134:0/2389965004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb8101c00 0x7fddb8197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:27.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.762+0000 7fddbcccd640 1 -- 172.21.15.134:0/2389965004 >> 172.21.15.134:0/2389965004 conn(0x7fddb80fd390 msgr2=0x7fddb8106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:53:27.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.763+0000 7fddbcccd640 1 -- 172.21.15.134:0/2389965004 shutdown_connections 2024-09-11T23:53:27.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:53:27.763+0000 7fddbcccd640 1 -- 172.21.15.134:0/2389965004 wait complete. 2024-09-11T23:53:28.375 DEBUG:teuthology.orchestra.run.smithi134:osd.5> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.5.service 2024-09-11T23:53:28.378 INFO:tasks.cephadm:Deploying osd.6 on smithi006 with /dev/vg_nvme/lv_2... 2024-09-11T23:53:28.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T23:53:28.608 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:28 smithi134 ceph-mon[34893]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:28.608 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:28 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:28.608 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:28 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:28.609 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:28 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:28.645 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:53:28.766 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:28 smithi006 ceph-mon[30947]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:28.766 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:28 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:28.767 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:28 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:28.767 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:28 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:29.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:28 smithi039 ceph-mon[34543]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:29.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:28 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:29.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:28 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:29.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:28 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:30.203 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 11 23:53:30 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5[46759]: 2024-09-11T23:53:30.059+0000 7fc6323a7640 -1 osd.5 0 log_to_monitors true 2024-09-11T23:53:30.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:30 smithi006 ceph-mon[30947]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:30 smithi006 ceph-mon[30947]: from='osd.5 [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:53:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:30 smithi006 ceph-mon[30947]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:53:30.929 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:30 smithi134 ceph-mon[34893]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:30.930 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:30 smithi134 ceph-mon[34893]: from='osd.5 [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:53:30.930 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:30 smithi134 ceph-mon[34893]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:53:31.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:30 smithi039 ceph-mon[34543]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:31.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:30 smithi039 ceph-mon[34543]: from='osd.5 [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:53:31.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:30 smithi039 ceph-mon[34543]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:53:31.364 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:53:31.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi006:vg_nvme/lv_2 2024-09-11T23:53:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:53:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T23:53:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='osd.5 [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:53:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T23:53:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:53:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:31.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:31.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:31.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:31.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:31.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:31.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-11T23:53:31.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T23:53:31.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:31.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:31.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T23:53:31.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='osd.5 [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:53:31.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T23:53:31.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:31.955 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:32.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T23:53:32.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='osd.5 [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:53:32.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T23:53:32.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:32.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:53:32.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:32.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:32.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:32.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:32.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:32.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:32.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:32.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:32.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-11T23:53:32.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T23:53:32.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:32.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:32.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.151+0000 7f434f424640 1 -- 172.21.15.6:0/578739457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4348101cd0 msgr2=0x7f4348102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:32.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.151+0000 7f434f424640 1 --2- 172.21.15.6:0/578739457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4348101cd0 0x7f4348102150 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f433c009900 tx=0x7f433c02a410 comp rx=0 tx=0).stop 2024-09-11T23:53:32.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.151+0000 7f434f424640 1 -- 172.21.15.6:0/578739457 shutdown_connections 2024-09-11T23:53:32.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.151+0000 7f434f424640 1 --2- 172.21.15.6:0/578739457 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4348102690 0x7f4348108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:32.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.151+0000 7f434f424640 1 --2- 172.21.15.6:0/578739457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4348101cd0 0x7f4348102150 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.151+0000 7f434f424640 1 --2- 172.21.15.6:0/578739457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4348100ad0 0x7f4348100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.151+0000 7f434f424640 1 -- 172.21.15.6:0/578739457 >> 172.21.15.6:0/578739457 conn(0x7f43480fc280 msgr2=0x7f43480fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.151+0000 7f434f424640 1 -- 172.21.15.6:0/578739457 shutdown_connections 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.151+0000 7f434f424640 1 -- 172.21.15.6:0/578739457 wait complete. 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.152+0000 7f434f424640 1 Processor -- start 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.152+0000 7f434f424640 1 -- start start 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.152+0000 7f434f424640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4348100ad0 0x7f4348196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.152+0000 7f434f424640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4348101cd0 0x7f4348197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.152+0000 7f434f424640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4348102690 0x7f434819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.152+0000 7f434f424640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f434810c5e0 con 0x7f4348100ad0 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.152+0000 7f434f424640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f434810c460 con 0x7f4348101cd0 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.152+0000 7f434f424640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f434810c760 con 0x7f4348102690 2024-09-11T23:53:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.152+0000 7f434d1c0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4348100ad0 0x7f4348196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.152+0000 7f434d1c0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4348100ad0 0x7f4348196ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41404/0 (socket says 172.21.15.6:41404) 2024-09-11T23:53:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.152+0000 7f434d1c0640 1 -- 172.21.15.6:0/1206467134 learned_addr learned my addr 172.21.15.6:0/1206467134 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:53:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.152+0000 7f434c9bf640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4348101cd0 0x7f4348197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f434d9c1640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4348102690 0x7f434819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f434d1c0640 1 -- 172.21.15.6:0/1206467134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4348102690 msgr2=0x7f434819e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f434d1c0640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4348102690 0x7f434819e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f434d1c0640 1 -- 172.21.15.6:0/1206467134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4348101cd0 msgr2=0x7f4348197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f434d1c0640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4348101cd0 0x7f4348197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f434d1c0640 1 -- 172.21.15.6:0/1206467134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434819e900 con 0x7f4348100ad0 2024-09-11T23:53:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f434c9bf640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4348101cd0 0x7f4348197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:53:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f434d1c0640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4348100ad0 0x7f4348196ce0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4344009970 tx=0x7f4344009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:53:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f433a7fc640 1 -- 172.21.15.6:0/1206467134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434400d030 con 0x7f4348100ad0 2024-09-11T23:53:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f434f424640 1 -- 172.21.15.6:0/1206467134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4348069fd0 con 0x7f4348100ad0 2024-09-11T23:53:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f433a7fc640 1 -- 172.21.15.6:0/1206467134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4344007d10 con 0x7f4348100ad0 2024-09-11T23:53:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f433a7fc640 1 -- 172.21.15.6:0/1206467134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434400cbe0 con 0x7f4348100ad0 2024-09-11T23:53:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.153+0000 7f434f424640 1 -- 172.21.15.6:0/1206467134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f434806a510 con 0x7f4348100ad0 2024-09-11T23:53:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.154+0000 7f434f424640 1 -- 172.21.15.6:0/1206467134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4348100ed0 con 0x7f4348100ad0 2024-09-11T23:53:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.155+0000 7f433a7fc640 1 -- 172.21.15.6:0/1206467134 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4344007860 con 0x7f4348100ad0 2024-09-11T23:53:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.156+0000 7f433a7fc640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f43340a2b80 0x7f43340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.156+0000 7f433a7fc640 1 -- 172.21.15.6:0/1206467134 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4253+0+0 (secure 0 0 0) 0x7f43440cfb50 con 0x7f4348100ad0 2024-09-11T23:53:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.156+0000 7f434c9bf640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f43340a2b80 0x7f43340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.157+0000 7f434c9bf640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f43340a2b80 0x7f43340a5040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f433c0314e0 tx=0x7f433c032d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:53:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.160+0000 7f433a7fc640 1 -- 172.21.15.6:0/1206467134 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f434409da90 con 0x7f4348100ad0 2024-09-11T23:53:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:32.347+0000 7f434f424640 1 -- 172.21.15.6:0/1206467134 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f434806a7d0 con 0x7f43340a2b80 2024-09-11T23:53:32.453 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5[46759]: 2024-09-11T23:53:31.972+0000 7fc62e32a640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T23:53:32.453 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 11 23:53:31 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5[46759]: 2024-09-11T23:53:31.979+0000 7fc62614a640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:53:32.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:32 smithi006 ceph-mon[30947]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:32.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:32 smithi006 ceph-mon[30947]: Detected new or changed devices on smithi134 2024-09-11T23:53:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:32 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi134 to 8544M 2024-09-11T23:53:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:32 smithi006 ceph-mon[30947]: from='osd.5 ' entity='osd.5' 2024-09-11T23:53:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:32 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:32 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:32 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:32 smithi006 ceph-mon[30947]: osd.5 [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565] boot 2024-09-11T23:53:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:32 smithi006 ceph-mon[30947]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T23:53:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:32 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:32 smithi134 ceph-mon[34893]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:32 smithi134 ceph-mon[34893]: Detected new or changed devices on smithi134 2024-09-11T23:53:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:32 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi134 to 8544M 2024-09-11T23:53:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:32 smithi134 ceph-mon[34893]: from='osd.5 ' entity='osd.5' 2024-09-11T23:53:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:32 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:32.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:32 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:32.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:32 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:32.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:32 smithi134 ceph-mon[34893]: osd.5 [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565] boot 2024-09-11T23:53:32.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:32 smithi134 ceph-mon[34893]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T23:53:32.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:32 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:33.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:32 smithi039 ceph-mon[34543]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:33.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:32 smithi039 ceph-mon[34543]: Detected new or changed devices on smithi134 2024-09-11T23:53:33.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:32 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi134 to 8544M 2024-09-11T23:53:33.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:32 smithi039 ceph-mon[34543]: from='osd.5 ' entity='osd.5' 2024-09-11T23:53:33.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:32 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:33.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:32 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:33.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:32 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:33.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:32 smithi039 ceph-mon[34543]: osd.5 [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565] boot 2024-09-11T23:53:33.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:32 smithi039 ceph-mon[34543]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T23:53:33.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:32 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:33.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:33 smithi006 ceph-mon[30947]: purged_snaps scrub starts 2024-09-11T23:53:33.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:33 smithi006 ceph-mon[30947]: purged_snaps scrub ok 2024-09-11T23:53:33.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:33 smithi006 ceph-mon[30947]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:33.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:33 smithi006 ceph-mon[30947]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T23:53:33.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:33 smithi134 ceph-mon[34893]: purged_snaps scrub starts 2024-09-11T23:53:33.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:33 smithi134 ceph-mon[34893]: purged_snaps scrub ok 2024-09-11T23:53:33.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:33 smithi134 ceph-mon[34893]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:33.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:33 smithi134 ceph-mon[34893]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T23:53:34.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:33 smithi039 ceph-mon[34543]: purged_snaps scrub starts 2024-09-11T23:53:34.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:33 smithi039 ceph-mon[34543]: purged_snaps scrub ok 2024-09-11T23:53:34.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:33 smithi039 ceph-mon[34543]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:34.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:33 smithi039 ceph-mon[34543]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T23:53:34.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:34 smithi006 ceph-mon[30947]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:34 smithi006 ceph-mon[30947]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T23:53:34.869 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:34 smithi134 ceph-mon[34893]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:34.869 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:34 smithi134 ceph-mon[34893]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T23:53:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:34 smithi039 ceph-mon[34543]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:34 smithi039 ceph-mon[34543]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T23:53:35.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:35 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2731343718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de6a7236-3d15-4b09-b2be-4b23a03e512f"}]: dispatch 2024-09-11T23:53:35.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:35 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2731343718' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de6a7236-3d15-4b09-b2be-4b23a03e512f"}]': finished 2024-09-11T23:53:35.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:35 smithi006 ceph-mon[30947]: osdmap e39: 7 total, 6 up, 7 in 2024-09-11T23:53:35.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:35 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:35.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:35 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2446161434' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:53:35.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:35 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2731343718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de6a7236-3d15-4b09-b2be-4b23a03e512f"}]: dispatch 2024-09-11T23:53:35.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:35 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2731343718' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de6a7236-3d15-4b09-b2be-4b23a03e512f"}]': finished 2024-09-11T23:53:35.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:35 smithi134 ceph-mon[34893]: osdmap e39: 7 total, 6 up, 7 in 2024-09-11T23:53:35.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:35 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:35.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:35 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2446161434' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:53:36.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:35 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2731343718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de6a7236-3d15-4b09-b2be-4b23a03e512f"}]: dispatch 2024-09-11T23:53:36.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:35 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2731343718' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de6a7236-3d15-4b09-b2be-4b23a03e512f"}]': finished 2024-09-11T23:53:36.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:35 smithi039 ceph-mon[34543]: osdmap e39: 7 total, 6 up, 7 in 2024-09-11T23:53:36.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:35 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:36.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:35 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2446161434' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:53:36.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:36 smithi134 ceph-mon[34893]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:36.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:36 smithi134 ceph-mon[34893]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T23:53:36.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:37.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:36 smithi039 ceph-mon[34543]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:37.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:36 smithi039 ceph-mon[34543]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T23:53:37.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:37.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:36 smithi006 ceph-mon[30947]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:37.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:36 smithi006 ceph-mon[30947]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T23:53:37.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:38.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:38 smithi134 ceph-mon[34893]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:39.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:38 smithi039 ceph-mon[34543]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:39.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:38 smithi006 ceph-mon[30947]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:40.822 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:40 smithi006 ceph-mon[30947]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-11T23:53:40.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:40 smithi134 ceph-mon[34893]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-11T23:53:41.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:40 smithi039 ceph-mon[34543]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-11T23:53:42.918 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:42 smithi006 ceph-mon[30947]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-11T23:53:42.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:42 smithi134 ceph-mon[34893]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-11T23:53:43.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:42 smithi039 ceph-mon[34543]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-11T23:53:44.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:44 smithi006 ceph-mon[30947]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:53:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:44 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T23:53:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:44 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:44 smithi006 ceph-mon[30947]: Deploying daemon osd.6 on smithi006 2024-09-11T23:53:44.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:44 smithi134 ceph-mon[34893]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:53:44.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:44 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T23:53:44.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:44 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:44.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:44 smithi134 ceph-mon[34893]: Deploying daemon osd.6 on smithi006 2024-09-11T23:53:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:44 smithi039 ceph-mon[34543]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:53:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:44 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T23:53:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:44 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:44 smithi039 ceph-mon[34543]: Deploying daemon osd.6 on smithi006 2024-09-11T23:53:46.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:46 smithi006 ceph-mon[30947]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:53:46.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:46 smithi134 ceph-mon[34893]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:53:47.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:46 smithi039 ceph-mon[34543]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:53:48.724 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:48 smithi006 ceph-mon[30947]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-11T23:53:48.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:48 smithi134 ceph-mon[34893]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-11T23:53:49.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:48 smithi039 ceph-mon[34543]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-11T23:53:50.770 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:50 smithi006 ceph-mon[30947]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:53:50.770 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:50.771 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:50.771 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:50.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:50 smithi134 ceph-mon[34893]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:53:50.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:50.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:50.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:51.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:50 smithi039 ceph-mon[34543]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:53:51.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:51.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:51.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:52.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:52 smithi134 ceph-mon[34893]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:53.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:52 smithi039 ceph-mon[34543]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:53.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:52 smithi006 ceph-mon[30947]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.862+0000 7f433a7fc640 1 -- 172.21.15.6:0/1206467134 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f434806a7d0 con 0x7f43340a2b80 2024-09-11T23:53:53.863 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 6 on host 'smithi006' 2024-09-11T23:53:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.865+0000 7f434f424640 1 -- 172.21.15.6:0/1206467134 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f43340a2b80 msgr2=0x7f43340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.865+0000 7f434f424640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f43340a2b80 0x7f43340a5040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f433c0314e0 tx=0x7f433c032d40 comp rx=0 tx=0).stop 2024-09-11T23:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.865+0000 7f434f424640 1 -- 172.21.15.6:0/1206467134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4348100ad0 msgr2=0x7f4348196ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.865+0000 7f434f424640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4348100ad0 0x7f4348196ce0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4344009970 tx=0x7f4344009e30 comp rx=0 tx=0).stop 2024-09-11T23:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.865+0000 7f434f424640 1 -- 172.21.15.6:0/1206467134 shutdown_connections 2024-09-11T23:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.865+0000 7f434f424640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f43340a2b80 0x7f43340a5040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.865+0000 7f434f424640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4348102690 0x7f434819e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.865+0000 7f434f424640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4348101cd0 0x7f4348197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.865+0000 7f434f424640 1 --2- 172.21.15.6:0/1206467134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4348100ad0 0x7f4348196ce0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.866+0000 7f434f424640 1 -- 172.21.15.6:0/1206467134 >> 172.21.15.6:0/1206467134 conn(0x7f43480fc280 msgr2=0x7f4348105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.866+0000 7f434f424640 1 -- 172.21.15.6:0/1206467134 shutdown_connections 2024-09-11T23:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:53:53.866+0000 7f434f424640 1 -- 172.21.15.6:0/1206467134 wait complete. 2024-09-11T23:53:54.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:53 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:53 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:53 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:54.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:53 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:54.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:53 smithi006 ceph-mon[30947]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:54.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:53 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:53 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:54.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:53 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:53 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:53 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:53 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:53 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:54.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:53 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:54.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:53 smithi134 ceph-mon[34893]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:54.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:53 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:53 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:54.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:53 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:53 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:53 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:53 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:53 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:54.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:53 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:54.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:53 smithi039 ceph-mon[34543]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:54.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:53 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:53 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:54.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:53 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:53 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:54.694 DEBUG:teuthology.orchestra.run.smithi006:osd.6> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.6.service 2024-09-11T23:53:54.696 INFO:tasks.cephadm:Deploying osd.7 on smithi039 with /dev/vg_nvme/lv_2... 2024-09-11T23:53:54.696 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T23:53:54.973 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:53:56.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:55 smithi006 ceph-mon[30947]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:56.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:55 smithi006 ceph-mon[30947]: from='osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T23:53:56.119 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 11 23:53:55 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6[58820]: 2024-09-11T23:53:55.834+0000 7f45b9490640 -1 osd.6 0 log_to_monitors true 2024-09-11T23:53:56.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:55 smithi134 ceph-mon[34893]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:56.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:55 smithi134 ceph-mon[34893]: from='osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T23:53:56.231 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:55 smithi039 ceph-mon[34543]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:56.231 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:55 smithi039 ceph-mon[34543]: from='osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T23:53:57.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:56 smithi039 ceph-mon[34543]: from='osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T23:53:57.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:56 smithi039 ceph-mon[34543]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T23:53:57.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:56 smithi039 ceph-mon[34543]: from='osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-09-11T23:53:57.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:56 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:57.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:56 smithi006 ceph-mon[30947]: from='osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T23:53:57.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:56 smithi006 ceph-mon[30947]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T23:53:57.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:56 smithi006 ceph-mon[30947]: from='osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-09-11T23:53:57.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:56 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:57.371 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 11 23:53:56 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6[58820]: 2024-09-11T23:53:56.959+0000 7f45b5413640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T23:53:57.371 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 11 23:53:56 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6[58820]: 2024-09-11T23:53:56.967+0000 7f45b123b640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:53:57.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:56 smithi134 ceph-mon[34893]: from='osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T23:53:57.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:56 smithi134 ceph-mon[34893]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T23:53:57.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:56 smithi134 ceph-mon[34893]: from='osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-09-11T23:53:57.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:56 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:57.742 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:53:57.769 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_2 2024-09-11T23:53:58.029 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:53:58.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:58.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-11T23:53:58.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T23:53:58.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:58.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:58.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: Detected new or changed devices on smithi006 2024-09-11T23:53:58.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:58.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:58.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:58.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:58.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:58.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi006 to 5697M 2024-09-11T23:53:58.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:58.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:58.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:58.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:58.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:58.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:58.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-11T23:53:58.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T23:53:58.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:58.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:58.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: Detected new or changed devices on smithi006 2024-09-11T23:53:58.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:58.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:58.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:58.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:58.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:58.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi006 to 5697M 2024-09-11T23:53:58.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:58.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:58.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:58.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:58.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:58.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:53:58.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-11T23:53:58.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T23:53:58.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:58.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:58.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: Detected new or changed devices on smithi006 2024-09-11T23:53:58.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:58.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:58.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:58.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:58.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:58.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi006 to 5697M 2024-09-11T23:53:58.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:58.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:58.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:58.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:53:58.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:58.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.504+0000 7f47d41b7640 1 -- 172.21.15.39:0/1121637506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47cc1037c0 msgr2=0x7f47cc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:58.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.504+0000 7f47d41b7640 1 --2- 172.21.15.39:0/1121637506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47cc1037c0 0x7f47cc10a050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009ca0 tx=0x7f47c402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:53:58.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.504+0000 7f47d41b7640 1 -- 172.21.15.39:0/1121637506 shutdown_connections 2024-09-11T23:53:58.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.504+0000 7f47d41b7640 1 --2- 172.21.15.39:0/1121637506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47cc1037c0 0x7f47cc10a050 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:58.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.504+0000 7f47d41b7640 1 --2- 172.21.15.39:0/1121637506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc102e00 0x7f47cc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:58.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.504+0000 7f47d41b7640 1 --2- 172.21.15.39:0/1121637506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47cc101c00 0x7f47cc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:58.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.504+0000 7f47d41b7640 1 -- 172.21.15.39:0/1121637506 >> 172.21.15.39:0/1121637506 conn(0x7f47cc0fd390 msgr2=0x7f47cc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:53:58.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.504+0000 7f47d41b7640 1 -- 172.21.15.39:0/1121637506 shutdown_connections 2024-09-11T23:53:58.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.504+0000 7f47d41b7640 1 -- 172.21.15.39:0/1121637506 wait complete. 2024-09-11T23:53:58.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.505+0000 7f47d41b7640 1 Processor -- start 2024-09-11T23:53:58.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.505+0000 7f47d41b7640 1 -- start start 2024-09-11T23:53:58.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.505+0000 7f47d41b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc101c00 0x7f47cc075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:58.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.505+0000 7f47d41b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47cc102e00 0x7f47cc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:58.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.505+0000 7f47d41b7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47cc1037c0 0x7f47cc074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:58.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.505+0000 7f47d41b7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc10d7e0 con 0x7f47cc102e00 2024-09-11T23:53:58.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.505+0000 7f47d41b7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc10d660 con 0x7f47cc1037c0 2024-09-11T23:53:58.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.505+0000 7f47d41b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc10d960 con 0x7f47cc101c00 2024-09-11T23:53:58.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.505+0000 7f47d2754640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47cc1037c0 0x7f47cc074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:58.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.505+0000 7f47d2754640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47cc1037c0 0x7f47cc074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37102/0 (socket says 172.21.15.39:37102) 2024-09-11T23:53:58.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.505+0000 7f47d2754640 1 -- 172.21.15.39:0/3282834644 learned_addr learned my addr 172.21.15.39:0/3282834644 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-11T23:53:58.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.505+0000 7f47d1752640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47cc102e00 0x7f47cc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:58.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.506+0000 7f47d1f53640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc101c00 0x7f47cc075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:58.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.506+0000 7f47d2754640 1 -- 172.21.15.39:0/3282834644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc101c00 msgr2=0x7f47cc075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.506+0000 7f47d2754640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc101c00 0x7f47cc075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.506+0000 7f47d2754640 1 -- 172.21.15.39:0/3282834644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47cc102e00 msgr2=0x7f47cc0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.506+0000 7f47d2754640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47cc102e00 0x7f47cc0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.506+0000 7f47d2754640 1 -- 172.21.15.39:0/3282834644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc0753e0 con 0x7f47cc1037c0 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.506+0000 7f47d2754640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47cc1037c0 0x7f47cc074b20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f47c4031040 tx=0x7f47c4003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.506+0000 7f47c2ffd640 1 -- 172.21.15.39:0/3282834644 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4032ec0 con 0x7f47cc1037c0 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.506+0000 7f47c2ffd640 1 -- 172.21.15.39:0/3282834644 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47c40044f0 con 0x7f47cc1037c0 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.506+0000 7f47d41b7640 1 -- 172.21.15.39:0/3282834644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47cc1a1f80 con 0x7f47cc1037c0 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.506+0000 7f47c2ffd640 1 -- 172.21.15.39:0/3282834644 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4030c30 con 0x7f47cc1037c0 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.506+0000 7f47d41b7640 1 -- 172.21.15.39:0/3282834644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47cc1a2480 con 0x7f47cc1037c0 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.507+0000 7f47d41b7640 1 -- 172.21.15.39:0/3282834644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47cc109000 con 0x7f47cc1037c0 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.508+0000 7f47c2ffd640 1 -- 172.21.15.39:0/3282834644 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f47c4004040 con 0x7f47cc1037c0 2024-09-11T23:53:58.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.509+0000 7f47c2ffd640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f47b80a2da0 0x7f47b80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:58.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.509+0000 7f47c2ffd640 1 -- 172.21.15.39:0/3282834644 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7f47c40efaf0 con 0x7f47cc1037c0 2024-09-11T23:53:58.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.509+0000 7f47d1f53640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f47b80a2da0 0x7f47b80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:58.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.510+0000 7f47d1f53640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f47b80a2da0 0x7f47b80a5260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f47c8005fd0 tx=0x7f47c8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:53:58.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.513+0000 7f47c2ffd640 1 -- 172.21.15.39:0/3282834644 <== mon.2 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47c40bd760 con 0x7f47cc1037c0 2024-09-11T23:53:58.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:53:58.696+0000 7f47d41b7640 1 -- 172.21.15.39:0/3282834644 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f47cc062630 con 0x7f47b80a2da0 2024-09-11T23:53:59.250 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:58 smithi039 ceph-mon[34543]: purged_snaps scrub starts 2024-09-11T23:53:59.250 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:58 smithi039 ceph-mon[34543]: purged_snaps scrub ok 2024-09-11T23:53:59.250 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:58 smithi039 ceph-mon[34543]: osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243] boot 2024-09-11T23:53:59.250 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:58 smithi039 ceph-mon[34543]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T23:53:59.250 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:59.250 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:58 smithi039 ceph-mon[34543]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:59.250 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:59.251 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:59.251 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:59.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:58 smithi006 ceph-mon[30947]: purged_snaps scrub starts 2024-09-11T23:53:59.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:58 smithi006 ceph-mon[30947]: purged_snaps scrub ok 2024-09-11T23:53:59.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:58 smithi006 ceph-mon[30947]: osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243] boot 2024-09-11T23:53:59.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:58 smithi006 ceph-mon[30947]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T23:53:59.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:59.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:58 smithi006 ceph-mon[30947]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:59.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:59.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:59.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:59.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:58 smithi134 ceph-mon[34893]: purged_snaps scrub starts 2024-09-11T23:53:59.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:58 smithi134 ceph-mon[34893]: purged_snaps scrub ok 2024-09-11T23:53:59.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:58 smithi134 ceph-mon[34893]: osd.6 [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243] boot 2024-09-11T23:53:59.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:58 smithi134 ceph-mon[34893]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T23:53:59.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:53:59.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:58 smithi134 ceph-mon[34893]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:59.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:59.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:59.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:00.133 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:59 smithi039 ceph-mon[34543]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:00.133 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:53:59 smithi039 ceph-mon[34543]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T23:54:00.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:59 smithi006 ceph-mon[30947]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:00.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:53:59 smithi006 ceph-mon[30947]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T23:54:00.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:59 smithi134 ceph-mon[34893]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:00.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:53:59 smithi134 ceph-mon[34893]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T23:54:02.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:01 smithi039 ceph-mon[34543]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:02.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:01 smithi039 ceph-mon[34543]: from='client.? 172.21.15.39:0/2034938046' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1534560b-9f95-476e-8c70-a6e62eb0621c"}]: dispatch 2024-09-11T23:54:02.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:01 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1534560b-9f95-476e-8c70-a6e62eb0621c"}]: dispatch 2024-09-11T23:54:02.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:01 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1534560b-9f95-476e-8c70-a6e62eb0621c"}]': finished 2024-09-11T23:54:02.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:01 smithi039 ceph-mon[34543]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T23:54:02.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:02.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:01 smithi039 ceph-mon[34543]: from='client.? 172.21.15.39:0/1346064542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:02.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:01 smithi006 ceph-mon[30947]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:02.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:01 smithi006 ceph-mon[30947]: from='client.? 172.21.15.39:0/2034938046' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1534560b-9f95-476e-8c70-a6e62eb0621c"}]: dispatch 2024-09-11T23:54:02.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:01 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1534560b-9f95-476e-8c70-a6e62eb0621c"}]: dispatch 2024-09-11T23:54:02.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:01 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1534560b-9f95-476e-8c70-a6e62eb0621c"}]': finished 2024-09-11T23:54:02.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:01 smithi006 ceph-mon[30947]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T23:54:02.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:02.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:01 smithi006 ceph-mon[30947]: from='client.? 172.21.15.39:0/1346064542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:02.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:01 smithi134 ceph-mon[34893]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:02.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:01 smithi134 ceph-mon[34893]: from='client.? 172.21.15.39:0/2034938046' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1534560b-9f95-476e-8c70-a6e62eb0621c"}]: dispatch 2024-09-11T23:54:02.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:01 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1534560b-9f95-476e-8c70-a6e62eb0621c"}]: dispatch 2024-09-11T23:54:02.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:01 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1534560b-9f95-476e-8c70-a6e62eb0621c"}]': finished 2024-09-11T23:54:02.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:01 smithi134 ceph-mon[34893]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T23:54:02.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:02.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:01 smithi134 ceph-mon[34893]: from='client.? 172.21.15.39:0/1346064542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:04.255 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:03 smithi134 ceph-mon[34893]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:04.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:03 smithi039 ceph-mon[34543]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:04.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:03 smithi006 ceph-mon[30947]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:06.258 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:05 smithi039 ceph-mon[34543]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:06.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:05 smithi006 ceph-mon[30947]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:06.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:05 smithi134 ceph-mon[34893]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:08.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:07 smithi039 ceph-mon[34543]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:08.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:07 smithi006 ceph-mon[30947]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:08.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:07 smithi134 ceph-mon[34893]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:10.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:09 smithi039 ceph-mon[34543]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:10.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:09 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T23:54:10.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:09 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:10.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:09 smithi039 ceph-mon[34543]: Deploying daemon osd.7 on smithi039 2024-09-11T23:54:10.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:09 smithi006 ceph-mon[30947]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:10.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:09 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T23:54:10.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:09 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:10.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:09 smithi006 ceph-mon[30947]: Deploying daemon osd.7 on smithi039 2024-09-11T23:54:10.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:09 smithi134 ceph-mon[34893]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:10.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:09 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T23:54:10.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:09 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:10.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:09 smithi134 ceph-mon[34893]: Deploying daemon osd.7 on smithi039 2024-09-11T23:54:12.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:11 smithi039 ceph-mon[34543]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:12.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:11 smithi006 ceph-mon[30947]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:12.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:11 smithi134 ceph-mon[34893]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:14.164 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:13 smithi039 ceph-mon[34543]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:14.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:13 smithi006 ceph-mon[30947]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:14.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:13 smithi134 ceph-mon[34893]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:16.188 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:16 smithi039 ceph-mon[34543]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:16.188 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:16.188 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:16.189 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:16.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:16 smithi006 ceph-mon[30947]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:16.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:16.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:16.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:16.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:16 smithi134 ceph-mon[34893]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:16.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:16.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:16.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:18.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:18 smithi039 ceph-mon[34543]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:18.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:18 smithi006 ceph-mon[30947]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:18.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:18 smithi134 ceph-mon[34893]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:19.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.029+0000 7f47c2ffd640 1 -- 172.21.15.39:0/3282834644 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f47cc062630 con 0x7f47b80a2da0 2024-09-11T23:54:19.029 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 7 on host 'smithi039' 2024-09-11T23:54:19.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.031+0000 7f47d41b7640 1 -- 172.21.15.39:0/3282834644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f47b80a2da0 msgr2=0x7f47b80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:19.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.031+0000 7f47d41b7640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f47b80a2da0 0x7f47b80a5260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f47c8005fd0 tx=0x7f47c8005850 comp rx=0 tx=0).stop 2024-09-11T23:54:19.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.031+0000 7f47d41b7640 1 -- 172.21.15.39:0/3282834644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47cc1037c0 msgr2=0x7f47cc074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:19.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.031+0000 7f47d41b7640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47cc1037c0 0x7f47cc074b20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f47c4031040 tx=0x7f47c4003ba0 comp rx=0 tx=0).stop 2024-09-11T23:54:19.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.031+0000 7f47d41b7640 1 -- 172.21.15.39:0/3282834644 shutdown_connections 2024-09-11T23:54:19.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.031+0000 7f47d41b7640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f47b80a2da0 0x7f47b80a5260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:19.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.031+0000 7f47d41b7640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47cc1037c0 0x7f47cc074b20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:19.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.031+0000 7f47d41b7640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47cc102e00 0x7f47cc0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:19.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.031+0000 7f47d41b7640 1 --2- 172.21.15.39:0/3282834644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc101c00 0x7f47cc075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:19.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.031+0000 7f47d41b7640 1 -- 172.21.15.39:0/3282834644 >> 172.21.15.39:0/3282834644 conn(0x7f47cc0fd390 msgr2=0x7f47cc1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:54:19.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.031+0000 7f47d41b7640 1 -- 172.21.15.39:0/3282834644 shutdown_connections 2024-09-11T23:54:19.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:54:19.031+0000 7f47d41b7640 1 -- 172.21.15.39:0/3282834644 wait complete. 2024-09-11T23:54:19.290 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.290 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.290 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:19.290 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:19.291 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.291 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:19.291 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.291 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:19.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:19.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:19.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:19.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:19.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:19.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:19.613 DEBUG:teuthology.orchestra.run.smithi039:osd.7> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.7.service 2024-09-11T23:54:19.615 INFO:tasks.cephadm:Deploying osd.8 on smithi134 with /dev/vg_nvme/lv_2... 2024-09-11T23:54:19.615 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T23:54:19.873 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:54:20.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:20 smithi134 ceph-mon[34893]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:20.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:20 smithi039 ceph-mon[34543]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:20.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:20 smithi006 ceph-mon[30947]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:21.044 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 11 23:54:21 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7[52771]: 2024-09-11T23:54:21.029+0000 7fb6fcf50640 -1 osd.7 0 log_to_monitors true 2024-09-11T23:54:21.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:21 smithi134 ceph-mon[34893]: from='osd.7 [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:54:21.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:21 smithi134 ceph-mon[34893]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:54:21.335 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:21 smithi039 ceph-mon[34543]: from='osd.7 [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:54:21.336 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:21 smithi039 ceph-mon[34543]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:54:21.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:21 smithi006 ceph-mon[30947]: from='osd.7 [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:54:21.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:21 smithi006 ceph-mon[30947]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:54:22.108 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:22 smithi039 ceph-mon[34543]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:22.108 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:22 smithi039 ceph-mon[34543]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T23:54:22.108 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:22 smithi039 ceph-mon[34543]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T23:54:22.108 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:22 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:22.108 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:22 smithi039 ceph-mon[34543]: from='osd.7 [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:54:22.108 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:22 smithi039 ceph-mon[34543]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:54:22.201 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:22 smithi134 ceph-mon[34893]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:22.201 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:22 smithi134 ceph-mon[34893]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T23:54:22.201 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:22 smithi134 ceph-mon[34893]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T23:54:22.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:22 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:22.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:22 smithi134 ceph-mon[34893]: from='osd.7 [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:54:22.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:22 smithi134 ceph-mon[34893]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:54:22.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:22 smithi006 ceph-mon[30947]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:22.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:22 smithi006 ceph-mon[30947]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T23:54:22.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:22 smithi006 ceph-mon[30947]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T23:54:22.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:22 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:22.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:22 smithi006 ceph-mon[30947]: from='osd.7 [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:54:22.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:22 smithi006 ceph-mon[30947]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:54:22.479 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:54:22.505 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2024-09-11T23:54:22.523 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 11 23:54:22 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7[52771]: 2024-09-11T23:54:22.108+0000 7fb6f8ed3640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T23:54:22.523 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 11 23:54:22 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7[52771]: 2024-09-11T23:54:22.120+0000 7fb6f4cfb640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:54:22.765 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:54:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.242+0000 7fe1aee91640 1 -- 172.21.15.134:0/431870948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1a8101bf0 msgr2=0x7fe1a8101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.242+0000 7fe1aee91640 1 --2- 172.21.15.134:0/431870948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1a8101bf0 0x7fe1a8101ff0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009900 tx=0x7fe19c02a410 comp rx=0 tx=0).stop 2024-09-11T23:54:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.242+0000 7fe1aee91640 1 -- 172.21.15.134:0/431870948 shutdown_connections 2024-09-11T23:54:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.242+0000 7fe1aee91640 1 --2- 172.21.15.134:0/431870948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1a81037b0 0x7fe1a810a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.242+0000 7fe1aee91640 1 --2- 172.21.15.134:0/431870948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a8102df0 0x7fe1a8103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.242+0000 7fe1aee91640 1 --2- 172.21.15.134:0/431870948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1a8101bf0 0x7fe1a8101ff0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.242+0000 7fe1aee91640 1 -- 172.21.15.134:0/431870948 >> 172.21.15.134:0/431870948 conn(0x7fe1a80fd3c0 msgr2=0x7fe1a80ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:54:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1aee91640 1 -- 172.21.15.134:0/431870948 shutdown_connections 2024-09-11T23:54:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1aee91640 1 -- 172.21.15.134:0/431870948 wait complete. 2024-09-11T23:54:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1aee91640 1 Processor -- start 2024-09-11T23:54:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1aee91640 1 -- start start 2024-09-11T23:54:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1aee91640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1a8101bf0 0x7fe1a8199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1aee91640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1a8102df0 0x7fe1a819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1aee91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a81037b0 0x7fe1a81a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1aee91640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a810d730 con 0x7fe1a81037b0 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1aee91640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a810d5b0 con 0x7fe1a8101bf0 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1aee91640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a810d8b0 con 0x7fe1a8102df0 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1a7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1a8102df0 0x7fe1a819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1a7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1a8102df0 0x7fe1a819a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35650/0 (socket says 172.21.15.134:35650) 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1a7fff640 1 -- 172.21.15.134:0/755414638 learned_addr learned my addr 172.21.15.134:0/755414638 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.243+0000 7fe1acc2d640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1a8101bf0 0x7fe1a8199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.244+0000 7fe1a7fff640 1 -- 172.21.15.134:0/755414638 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1a8101bf0 msgr2=0x7fe1a8199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.244+0000 7fe1a7fff640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1a8101bf0 0x7fe1a8199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.244+0000 7fe1ad42e640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a81037b0 0x7fe1a81a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.244+0000 7fe1a7fff640 1 -- 172.21.15.134:0/755414638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a81037b0 msgr2=0x7fe1a81a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.244+0000 7fe1a7fff640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a81037b0 0x7fe1a81a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.244+0000 7fe1a7fff640 1 -- 172.21.15.134:0/755414638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a81a1c00 con 0x7fe1a8102df0 2024-09-11T23:54:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.244+0000 7fe1a7fff640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1a8102df0 0x7fe1a819a510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe19400d950 tx=0x7fe19400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:54:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.244+0000 7fe1a5ffb640 1 -- 172.21.15.134:0/755414638 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194017070 con 0x7fe1a8102df0 2024-09-11T23:54:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.244+0000 7fe1aee91640 1 -- 172.21.15.134:0/755414638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a81a1ef0 con 0x7fe1a8102df0 2024-09-11T23:54:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.244+0000 7fe1a5ffb640 1 -- 172.21.15.134:0/755414638 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe194009c30 con 0x7fe1a8102df0 2024-09-11T23:54:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.244+0000 7fe1a5ffb640 1 -- 172.21.15.134:0/755414638 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19400f620 con 0x7fe1a8102df0 2024-09-11T23:54:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.244+0000 7fe1aee91640 1 -- 172.21.15.134:0/755414638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a81a23a0 con 0x7fe1a8102df0 2024-09-11T23:54:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.245+0000 7fe1aee91640 1 -- 172.21.15.134:0/755414638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a81a25d0 con 0x7fe1a8102df0 2024-09-11T23:54:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.247+0000 7fe1a5ffb640 1 -- 172.21.15.134:0/755414638 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe1940109a0 con 0x7fe1a8102df0 2024-09-11T23:54:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.248+0000 7fe1a5ffb640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe1980a2bb0 0x7fe1980a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.248+0000 7fe1a5ffb640 1 -- 172.21.15.134:0/755414638 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5430+0+0 (secure 0 0 0) 0x7fe1940ce070 con 0x7fe1a8102df0 2024-09-11T23:54:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.248+0000 7fe1acc2d640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe1980a2bb0 0x7fe1980a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.249+0000 7fe1acc2d640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe1980a2bb0 0x7fe1980a5070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe19c004770 tx=0x7fe19c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:54:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.251+0000 7fe1a5ffb640 1 -- 172.21.15.134:0/755414638 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe19409bb10 con 0x7fe1a8102df0 2024-09-11T23:54:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-11T23:54:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T23:54:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: Detected new or changed devices on smithi039 2024-09-11T23:54:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi039 to 5696M 2024-09-11T23:54:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:23.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:23.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:23.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:23.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: osd.7 [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620] boot 2024-09-11T23:54:23.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T23:54:23.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:23.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:23.429+0000 7fe1aee91640 1 -- 172.21.15.134:0/755414638 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe1a8109d30 con 0x7fe1980a2bb0 2024-09-11T23:54:23.429 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-11T23:54:23.429 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T23:54:23.429 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:23.429 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:23.429 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: Detected new or changed devices on smithi039 2024-09-11T23:54:23.429 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:23.429 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:23.430 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:23.430 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:23.430 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:23.430 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi039 to 5696M 2024-09-11T23:54:23.430 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:23.430 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:23.430 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:23.430 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:23.430 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: osd.7 [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620] boot 2024-09-11T23:54:23.430 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T23:54:23.430 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-11T23:54:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T23:54:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: Detected new or changed devices on smithi039 2024-09-11T23:54:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:23.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi039 to 5696M 2024-09-11T23:54:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: osd.7 [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620] boot 2024-09-11T23:54:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T23:54:23.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:24.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:24 smithi006 ceph-mon[30947]: purged_snaps scrub starts 2024-09-11T23:54:24.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:24 smithi006 ceph-mon[30947]: purged_snaps scrub ok 2024-09-11T23:54:24.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:24 smithi006 ceph-mon[30947]: pgmap v168: 1 pgs: 1 unknown; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:24.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:24 smithi006 ceph-mon[30947]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:24.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:24.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:24.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:24.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:24 smithi006 ceph-mon[30947]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T23:54:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:24 smithi134 ceph-mon[34893]: purged_snaps scrub starts 2024-09-11T23:54:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:24 smithi134 ceph-mon[34893]: purged_snaps scrub ok 2024-09-11T23:54:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:24 smithi134 ceph-mon[34893]: pgmap v168: 1 pgs: 1 unknown; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:24 smithi134 ceph-mon[34893]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:24.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:24.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:24.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:24 smithi134 ceph-mon[34893]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T23:54:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:24 smithi039 ceph-mon[34543]: purged_snaps scrub starts 2024-09-11T23:54:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:24 smithi039 ceph-mon[34543]: purged_snaps scrub ok 2024-09-11T23:54:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:24 smithi039 ceph-mon[34543]: pgmap v168: 1 pgs: 1 unknown; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:24 smithi039 ceph-mon[34543]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:24.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:24 smithi039 ceph-mon[34543]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T23:54:26.364 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:26 smithi134 ceph-mon[34893]: pgmap v171: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:26.365 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:26 smithi134 ceph-mon[34893]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T23:54:26.365 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:26 smithi134 ceph-mon[34893]: from='client.? 172.21.15.134:0/3219010934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe976d0-c581-4c77-a075-77eeb02e9153"}]: dispatch 2024-09-11T23:54:26.365 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:26 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe976d0-c581-4c77-a075-77eeb02e9153"}]: dispatch 2024-09-11T23:54:26.365 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:26 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfe976d0-c581-4c77-a075-77eeb02e9153"}]': finished 2024-09-11T23:54:26.365 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:26 smithi134 ceph-mon[34893]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T23:54:26.365 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:26 smithi006 ceph-mon[30947]: pgmap v171: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:26 smithi006 ceph-mon[30947]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T23:54:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:26 smithi006 ceph-mon[30947]: from='client.? 172.21.15.134:0/3219010934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe976d0-c581-4c77-a075-77eeb02e9153"}]: dispatch 2024-09-11T23:54:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:26 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe976d0-c581-4c77-a075-77eeb02e9153"}]: dispatch 2024-09-11T23:54:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:26 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfe976d0-c581-4c77-a075-77eeb02e9153"}]': finished 2024-09-11T23:54:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:26 smithi006 ceph-mon[30947]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T23:54:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:26.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:26 smithi039 ceph-mon[34543]: pgmap v171: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:26.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:26 smithi039 ceph-mon[34543]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T23:54:26.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:26 smithi039 ceph-mon[34543]: from='client.? 172.21.15.134:0/3219010934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe976d0-c581-4c77-a075-77eeb02e9153"}]: dispatch 2024-09-11T23:54:26.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:26 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe976d0-c581-4c77-a075-77eeb02e9153"}]: dispatch 2024-09-11T23:54:26.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:26 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfe976d0-c581-4c77-a075-77eeb02e9153"}]': finished 2024-09-11T23:54:26.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:26 smithi039 ceph-mon[34543]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T23:54:26.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:27.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:27 smithi006 ceph-mon[30947]: from='client.? 172.21.15.134:0/611119374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:27.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:27 smithi006 ceph-mon[30947]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T23:54:27.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:27 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:27.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:27 smithi134 ceph-mon[34893]: from='client.? 172.21.15.134:0/611119374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:27.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:27 smithi134 ceph-mon[34893]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T23:54:27.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:27 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:27.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:27 smithi039 ceph-mon[34543]: from='client.? 172.21.15.134:0/611119374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:27.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:27 smithi039 ceph-mon[34543]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T23:54:27.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:27 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:29.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:28 smithi006 ceph-mon[30947]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:29.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:28 smithi134 ceph-mon[34893]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:29.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:28 smithi039 ceph-mon[34543]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:30.922 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:30 smithi134 ceph-mon[34893]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:31.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:30 smithi006 ceph-mon[30947]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:31.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:30 smithi039 ceph-mon[34543]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:32 smithi134 ceph-mon[34893]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:33.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:32 smithi006 ceph-mon[30947]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:33.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:32 smithi039 ceph-mon[34543]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:34.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:34 smithi134 ceph-mon[34893]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:34.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T23:54:34.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:35.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:34 smithi006 ceph-mon[30947]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:35.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T23:54:35.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:35.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:34 smithi039 ceph-mon[34543]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:35.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T23:54:35.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:35.938 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:35 smithi134 ceph-mon[34893]: Deploying daemon osd.8 on smithi134 2024-09-11T23:54:36.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:35 smithi006 ceph-mon[30947]: Deploying daemon osd.8 on smithi134 2024-09-11T23:54:36.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:35 smithi039 ceph-mon[34543]: Deploying daemon osd.8 on smithi134 2024-09-11T23:54:37.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:36 smithi006 ceph-mon[30947]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:37.155 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:36 smithi134 ceph-mon[34893]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:37.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:36 smithi039 ceph-mon[34543]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:38.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:38 smithi134 ceph-mon[34893]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:39.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:38 smithi006 ceph-mon[30947]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:39.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:38 smithi039 ceph-mon[34543]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:40.873 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:40 smithi134 ceph-mon[34893]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:40.873 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:40.873 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:40.873 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:41.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:40 smithi006 ceph-mon[30947]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:41.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:41.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:41.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:41.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:40 smithi039 ceph-mon[34543]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:41.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:41.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:41.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:43.096 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:42 smithi039 ceph-mon[34543]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:43.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:42 smithi006 ceph-mon[30947]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:42 smithi134 ceph-mon[34893]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:44.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.100+0000 7fe1a5ffb640 1 -- 172.21.15.134:0/755414638 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe1a8109d30 con 0x7fe1980a2bb0 2024-09-11T23:54:44.102 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 8 on host 'smithi134' 2024-09-11T23:54:44.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.103+0000 7fe1aee91640 1 -- 172.21.15.134:0/755414638 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe1980a2bb0 msgr2=0x7fe1980a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:44.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.103+0000 7fe1aee91640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe1980a2bb0 0x7fe1980a5070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe19c004770 tx=0x7fe19c000bc0 comp rx=0 tx=0).stop 2024-09-11T23:54:44.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.103+0000 7fe1aee91640 1 -- 172.21.15.134:0/755414638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1a8102df0 msgr2=0x7fe1a819a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:44.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.103+0000 7fe1aee91640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1a8102df0 0x7fe1a819a510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe19400d950 tx=0x7fe19400de10 comp rx=0 tx=0).stop 2024-09-11T23:54:44.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.103+0000 7fe1aee91640 1 -- 172.21.15.134:0/755414638 shutdown_connections 2024-09-11T23:54:44.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.103+0000 7fe1aee91640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe1980a2bb0 0x7fe1980a5070 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:44.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.103+0000 7fe1aee91640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a81037b0 0x7fe1a81a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:44.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.103+0000 7fe1aee91640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1a8102df0 0x7fe1a819a510 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:44.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.103+0000 7fe1aee91640 1 --2- 172.21.15.134:0/755414638 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1a8101bf0 0x7fe1a8199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:44.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.103+0000 7fe1aee91640 1 -- 172.21.15.134:0/755414638 >> 172.21.15.134:0/755414638 conn(0x7fe1a80fd3c0 msgr2=0x7fe1a8108610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:54:44.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.103+0000 7fe1aee91640 1 -- 172.21.15.134:0/755414638 shutdown_connections 2024-09-11T23:54:44.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:54:44.103+0000 7fe1aee91640 1 -- 172.21.15.134:0/755414638 wait complete. 2024-09-11T23:54:44.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:44 smithi006 ceph-mon[30947]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:44.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:44 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:44.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:44 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:44.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:44 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:44.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:44 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:44.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:44 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:44.395 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:44 smithi039 ceph-mon[34543]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:44.395 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:44 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:44.395 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:44 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:44.395 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:44 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:44.396 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:44 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:44.396 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:44 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:44.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:44 smithi134 ceph-mon[34893]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:44.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:44 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:44.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:44 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:44.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:44 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:44.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:44 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:44.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:44 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:44.819 DEBUG:teuthology.orchestra.run.smithi134:osd.8> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.8.service 2024-09-11T23:54:44.822 INFO:tasks.cephadm:Deploying osd.9 on smithi006 with /dev/vg_nvme/lv_1... 2024-09-11T23:54:44.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T23:54:45.091 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:54:45.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:45 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:45.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:45 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:45.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:45 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:45.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:45 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:45.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:45 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:45.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:45 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:45.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:45 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:45.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:45 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:45.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:45 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:46.233 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:46 smithi134 ceph-mon[34893]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:46.233 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:46 smithi134 ceph-mon[34893]: from='osd.8 [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:54:46.233 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:46 smithi134 ceph-mon[34893]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:54:46.234 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 11 23:54:45 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8[53256]: 2024-09-11T23:54:45.969+0000 7f9188f8e640 -1 osd.8 0 log_to_monitors true 2024-09-11T23:54:46.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:46 smithi006 ceph-mon[30947]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:46.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:46 smithi006 ceph-mon[30947]: from='osd.8 [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:54:46.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:46 smithi006 ceph-mon[30947]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:54:46.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:46 smithi039 ceph-mon[34543]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:46.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:46 smithi039 ceph-mon[34543]: from='osd.8 [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:54:46.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:46 smithi039 ceph-mon[34543]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:54:47.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:47 smithi134 ceph-mon[34893]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T23:54:47.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:47 smithi134 ceph-mon[34893]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T23:54:47.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:47 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:47.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:47 smithi134 ceph-mon[34893]: from='osd.8 [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:54:47.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:47 smithi134 ceph-mon[34893]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:54:47.337 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:47 smithi006 ceph-mon[30947]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T23:54:47.337 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:47 smithi006 ceph-mon[30947]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T23:54:47.337 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:47 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:47.337 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:47 smithi006 ceph-mon[30947]: from='osd.8 [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:54:47.337 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:47 smithi006 ceph-mon[30947]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:54:47.537 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 11 23:54:47 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8[53256]: 2024-09-11T23:54:47.527+0000 7f9184f11640 -1 osd.8 0 waiting for initial osdmap 2024-09-11T23:54:47.537 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 11 23:54:47 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8[53256]: 2024-09-11T23:54:47.537+0000 7f917cd31640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:54:47.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:47 smithi039 ceph-mon[34543]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T23:54:47.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:47 smithi039 ceph-mon[34543]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T23:54:47.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:47 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:47.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:47 smithi039 ceph-mon[34543]: from='osd.8 [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:54:47.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:47 smithi039 ceph-mon[34543]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:54:48.159 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:54:48.184 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi006:vg_nvme/lv_1 2024-09-11T23:54:48.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:48.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-11T23:54:48.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T23:54:48.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:48.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:48.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='osd.8 ' entity='osd.8' 2024-09-11T23:54:48.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: Detected new or changed devices on smithi134 2024-09-11T23:54:48.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:48.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:48.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:48.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:48.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:48.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi134 to 5696M 2024-09-11T23:54:48.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:48.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:48.372 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:48.372 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:54:48.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:48.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-11T23:54:48.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T23:54:48.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:48.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:48.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='osd.8 ' entity='osd.8' 2024-09-11T23:54:48.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: Detected new or changed devices on smithi134 2024-09-11T23:54:48.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:48.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:48.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:48.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:48.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:48.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi134 to 5696M 2024-09-11T23:54:48.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:48.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:48.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:48.455 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:48.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:48.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-11T23:54:48.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T23:54:48.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:48.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:48.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='osd.8 ' entity='osd.8' 2024-09-11T23:54:48.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: Detected new or changed devices on smithi134 2024-09-11T23:54:48.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:48.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:48.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:48.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:48.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:48.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi134 to 5696M 2024-09-11T23:54:48.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:48.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:48.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:48.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:54:48.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.920+0000 7f740de79640 1 -- 172.21.15.6:0/1962471806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7408101c00 msgr2=0x7f7408102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:48.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.920+0000 7f740de79640 1 --2- 172.21.15.6:0/1962471806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7408101c00 0x7f7408102000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009900 tx=0x7f73f802a410 comp rx=0 tx=0).stop 2024-09-11T23:54:48.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.921+0000 7f740de79640 1 -- 172.21.15.6:0/1962471806 shutdown_connections 2024-09-11T23:54:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.921+0000 7f740de79640 1 --2- 172.21.15.6:0/1962471806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74081037c0 0x7f740810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.921+0000 7f740de79640 1 --2- 172.21.15.6:0/1962471806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7408102e00 0x7f7408103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.921+0000 7f740de79640 1 --2- 172.21.15.6:0/1962471806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7408101c00 0x7f7408102000 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.921+0000 7f740de79640 1 -- 172.21.15.6:0/1962471806 >> 172.21.15.6:0/1962471806 conn(0x7f74080fd390 msgr2=0x7f74080ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:54:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.921+0000 7f740de79640 1 -- 172.21.15.6:0/1962471806 shutdown_connections 2024-09-11T23:54:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.921+0000 7f740de79640 1 -- 172.21.15.6:0/1962471806 wait complete. 2024-09-11T23:54:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.921+0000 7f740de79640 1 Processor -- start 2024-09-11T23:54:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.921+0000 7f740de79640 1 -- start start 2024-09-11T23:54:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f740de79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7408101c00 0x7f7408197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f740de79640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7408102e00 0x7f7408198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f740de79640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74081037c0 0x7f740819f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f740de79640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f740810d730 con 0x7f7408101c00 2024-09-11T23:54:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f740de79640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f740810d5b0 con 0x7f7408102e00 2024-09-11T23:54:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f740de79640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f740810d8b0 con 0x7f74081037c0 2024-09-11T23:54:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f74077fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7408101c00 0x7f7408197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f73feffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7408102e00 0x7f7408198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f74077fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7408101c00 0x7f7408197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51628/0 (socket says 172.21.15.6:51628) 2024-09-11T23:54:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f74077fe640 1 -- 172.21.15.6:0/3731611070 learned_addr learned my addr 172.21.15.6:0/3731611070 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:54:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f7407fff640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74081037c0 0x7f740819f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f74077fe640 1 -- 172.21.15.6:0/3731611070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74081037c0 msgr2=0x7f740819f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f74077fe640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74081037c0 0x7f740819f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f74077fe640 1 -- 172.21.15.6:0/3731611070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7408102e00 msgr2=0x7f7408198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f74077fe640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7408102e00 0x7f7408198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f74077fe640 1 -- 172.21.15.6:0/3731611070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740819fa40 con 0x7f7408101c00 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.922+0000 7f74077fe640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7408101c00 0x7f7408197e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f73f80314e0 tx=0x7f73f80042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.923+0000 7f74057fa640 1 -- 172.21.15.6:0/3731611070 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f803f030 con 0x7f7408101c00 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.923+0000 7f74057fa640 1 -- 172.21.15.6:0/3731611070 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73f8003cb0 con 0x7f7408101c00 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.923+0000 7f740de79640 1 -- 172.21.15.6:0/3731611070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740819fcd0 con 0x7f7408101c00 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.923+0000 7f74057fa640 1 -- 172.21.15.6:0/3731611070 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8035070 con 0x7f7408101c00 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.923+0000 7f740de79640 1 -- 172.21.15.6:0/3731611070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74081a01b0 con 0x7f7408101c00 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.924+0000 7f740de79640 1 -- 172.21.15.6:0/3731611070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74081090a0 con 0x7f7408101c00 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.925+0000 7f74057fa640 1 -- 172.21.15.6:0/3731611070 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f73f8042030 con 0x7f7408101c00 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.926+0000 7f74057fa640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73f40a2c30 0x7f73f40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.926+0000 7f73feffd640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73f40a2c30 0x7f73f40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.926+0000 7f74057fa640 1 -- 172.21.15.6:0/3731611070 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5862+0+0 (secure 0 0 0) 0x7f73f80eeb40 con 0x7f7408101c00 2024-09-11T23:54:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.926+0000 7f73feffd640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73f40a2c30 0x7f73f40a50f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7408199330 tx=0x7f73f000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:54:48.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:48.930+0000 7f74057fa640 1 -- 172.21.15.6:0/3731611070 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73f80bbde0 con 0x7f7408101c00 2024-09-11T23:54:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:54:49.117+0000 7f740de79640 1 -- 172.21.15.6:0/3731611070 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7408062630 con 0x7f73f40a2c30 2024-09-11T23:54:49.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:49 smithi006 ceph-mon[30947]: purged_snaps scrub starts 2024-09-11T23:54:49.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:49 smithi006 ceph-mon[30947]: purged_snaps scrub ok 2024-09-11T23:54:49.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:49.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:49 smithi006 ceph-mon[30947]: osd.8 [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543] boot 2024-09-11T23:54:49.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:49 smithi006 ceph-mon[30947]: osdmap e55: 9 total, 9 up, 9 in 2024-09-11T23:54:49.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:49 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:49.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:49 smithi006 ceph-mon[30947]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T23:54:49.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:49 smithi134 ceph-mon[34893]: purged_snaps scrub starts 2024-09-11T23:54:49.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:49 smithi134 ceph-mon[34893]: purged_snaps scrub ok 2024-09-11T23:54:49.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:49.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:49 smithi134 ceph-mon[34893]: osd.8 [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543] boot 2024-09-11T23:54:49.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:49 smithi134 ceph-mon[34893]: osdmap e55: 9 total, 9 up, 9 in 2024-09-11T23:54:49.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:49 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:49.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:49 smithi134 ceph-mon[34893]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T23:54:49.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:49 smithi039 ceph-mon[34543]: purged_snaps scrub starts 2024-09-11T23:54:49.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:49 smithi039 ceph-mon[34543]: purged_snaps scrub ok 2024-09-11T23:54:49.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:49 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:49.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:49 smithi039 ceph-mon[34543]: osd.8 [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543] boot 2024-09-11T23:54:49.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:49 smithi039 ceph-mon[34543]: osdmap e55: 9 total, 9 up, 9 in 2024-09-11T23:54:49.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:49 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:54:49.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:49 smithi039 ceph-mon[34543]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T23:54:50.242 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:50 smithi006 ceph-mon[30947]: pgmap v189: 1 pgs: 1 peering; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:50.242 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:50 smithi006 ceph-mon[30947]: from='client.14451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:50.242 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:50.242 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:50.242 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:50.242 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:50 smithi006 ceph-mon[30947]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T23:54:50.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:50 smithi134 ceph-mon[34893]: pgmap v189: 1 pgs: 1 peering; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:50.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:50 smithi134 ceph-mon[34893]: from='client.14451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:50.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:50.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:50.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:50.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:50 smithi134 ceph-mon[34893]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T23:54:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:50 smithi039 ceph-mon[34543]: pgmap v189: 1 pgs: 1 peering; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:54:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:50 smithi039 ceph-mon[34543]: from='client.14451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:50 smithi039 ceph-mon[34543]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T23:54:52.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:52 smithi006 ceph-mon[30947]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:54:52.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:52 smithi006 ceph-mon[30947]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T23:54:52.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:52 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1541206690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65dd99b2-6515-4d89-b660-26fe171e8323"}]: dispatch 2024-09-11T23:54:52.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:52 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1541206690' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65dd99b2-6515-4d89-b660-26fe171e8323"}]': finished 2024-09-11T23:54:52.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:52 smithi006 ceph-mon[30947]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T23:54:52.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:54:52.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:52 smithi134 ceph-mon[34893]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:54:52.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:52 smithi134 ceph-mon[34893]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T23:54:52.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:52 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1541206690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65dd99b2-6515-4d89-b660-26fe171e8323"}]: dispatch 2024-09-11T23:54:52.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:52 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1541206690' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65dd99b2-6515-4d89-b660-26fe171e8323"}]': finished 2024-09-11T23:54:52.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:52 smithi134 ceph-mon[34893]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T23:54:52.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:54:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:52 smithi039 ceph-mon[34543]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:54:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:52 smithi039 ceph-mon[34543]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T23:54:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:52 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1541206690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65dd99b2-6515-4d89-b660-26fe171e8323"}]: dispatch 2024-09-11T23:54:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:52 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1541206690' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65dd99b2-6515-4d89-b660-26fe171e8323"}]': finished 2024-09-11T23:54:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:52 smithi039 ceph-mon[34543]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T23:54:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:54:53.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:53 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/863157634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:53.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:53 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/863157634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:53.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:53 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/863157634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:54.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:54 smithi134 ceph-mon[34893]: pgmap v195: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:54:54.480 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:54 smithi039 ceph-mon[34543]: pgmap v195: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:54:54.519 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:54 smithi006 ceph-mon[30947]: pgmap v195: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:54:56.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:56 smithi134 ceph-mon[34893]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-11T23:54:56.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:56 smithi039 ceph-mon[34543]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-11T23:54:56.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:56 smithi006 ceph-mon[30947]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-11T23:54:58.309 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:54:58 smithi006 ceph-mon[30947]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-11T23:54:58.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:54:58 smithi134 ceph-mon[34893]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-11T23:54:58.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:54:58 smithi039 ceph-mon[34543]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-11T23:55:00.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:00 smithi134 ceph-mon[34893]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:55:00.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:00 smithi039 ceph-mon[34543]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:55:00.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:00 smithi006 ceph-mon[30947]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:55:01.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T23:55:01.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:01.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:01 smithi006 ceph-mon[30947]: Deploying daemon osd.9 on smithi006 2024-09-11T23:55:01.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T23:55:01.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:01.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:01 smithi134 ceph-mon[34893]: Deploying daemon osd.9 on smithi006 2024-09-11T23:55:01.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T23:55:01.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:01.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:01 smithi039 ceph-mon[34543]: Deploying daemon osd.9 on smithi006 2024-09-11T23:55:02.405 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:02 smithi006 ceph-mon[30947]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-11T23:55:02.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:02 smithi134 ceph-mon[34893]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-11T23:55:02.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:02 smithi039 ceph-mon[34543]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-11T23:55:04.278 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:04 smithi006 ceph-mon[30947]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-11T23:55:04.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:04 smithi134 ceph-mon[34893]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-11T23:55:04.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:04 smithi039 ceph-mon[34543]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-11T23:55:06.285 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:06 smithi006 ceph-mon[30947]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:55:06.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:06 smithi134 ceph-mon[34893]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:55:06.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:06 smithi039 ceph-mon[34543]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:55:07.282 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:07 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:07.282 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:07 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:07.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:07 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:07.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:07 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:07.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:07 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:07.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:07 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:07.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:07 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:07.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:07 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:07.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:07 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:08.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:08 smithi006 ceph-mon[30947]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:08.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:08 smithi134 ceph-mon[34893]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:09.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:08 smithi039 ceph-mon[34543]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:10.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.450+0000 7f74057fa640 1 -- 172.21.15.6:0/3731611070 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7408062630 con 0x7f73f40a2c30 2024-09-11T23:55:10.450 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 9 on host 'smithi006' 2024-09-11T23:55:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.452+0000 7f740de79640 1 -- 172.21.15.6:0/3731611070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73f40a2c30 msgr2=0x7f73f40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.452+0000 7f740de79640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73f40a2c30 0x7f73f40a50f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7408199330 tx=0x7f73f000a250 comp rx=0 tx=0).stop 2024-09-11T23:55:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.452+0000 7f740de79640 1 -- 172.21.15.6:0/3731611070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7408101c00 msgr2=0x7f7408197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.452+0000 7f740de79640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7408101c00 0x7f7408197e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f73f80314e0 tx=0x7f73f80042e0 comp rx=0 tx=0).stop 2024-09-11T23:55:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.453+0000 7f740de79640 1 -- 172.21.15.6:0/3731611070 shutdown_connections 2024-09-11T23:55:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.453+0000 7f740de79640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73f40a2c30 0x7f73f40a50f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.453+0000 7f740de79640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74081037c0 0x7f740819f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.453+0000 7f740de79640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7408102e00 0x7f7408198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.453+0000 7f740de79640 1 --2- 172.21.15.6:0/3731611070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7408101c00 0x7f7408197e10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.453+0000 7f740de79640 1 -- 172.21.15.6:0/3731611070 >> 172.21.15.6:0/3731611070 conn(0x7f74080fd390 msgr2=0x7f7408106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:55:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.453+0000 7f740de79640 1 -- 172.21.15.6:0/3731611070 shutdown_connections 2024-09-11T23:55:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:55:10.453+0000 7f740de79640 1 -- 172.21.15.6:0/3731611070 wait complete. 2024-09-11T23:55:10.855 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:10 smithi006 ceph-mon[30947]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:10.855 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:10.855 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:10.855 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:10.855 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:10.855 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:10.855 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:10.856 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:10.856 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:10 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:10 smithi134 ceph-mon[34893]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:10.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:10.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:10 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:11.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:10 smithi039 ceph-mon[34543]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:11.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:11.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:11.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:11.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:11.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:11.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:11.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:11.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:10 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:11.234 DEBUG:teuthology.orchestra.run.smithi006:osd.9> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.9.service 2024-09-11T23:55:11.237 INFO:tasks.cephadm:Deploying osd.10 on smithi039 with /dev/vg_nvme/lv_1... 2024-09-11T23:55:11.237 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T23:55:11.504 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:55:12.704 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:12 smithi039 ceph-mon[34543]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:12.704 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:12 smithi039 ceph-mon[34543]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:55:12.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:12 smithi006 ceph-mon[30947]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:12.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:12 smithi006 ceph-mon[30947]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:55:12.734 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 11 23:55:12 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-11T23:55:12.395+0000 7fb73b0f4640 -1 osd.9 0 log_to_monitors true 2024-09-11T23:55:12.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:12 smithi134 ceph-mon[34893]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:12.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:12 smithi134 ceph-mon[34893]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:55:13.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:13 smithi006 ceph-mon[30947]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T23:55:13.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:13 smithi006 ceph-mon[30947]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T23:55:13.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:13 smithi006 ceph-mon[30947]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-09-11T23:55:13.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:13 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:13.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:13 smithi134 ceph-mon[34893]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T23:55:13.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:13 smithi134 ceph-mon[34893]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T23:55:13.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:13 smithi134 ceph-mon[34893]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-09-11T23:55:13.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:13 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:13.978 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:13 smithi039 ceph-mon[34543]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T23:55:13.978 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:13 smithi039 ceph-mon[34543]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T23:55:13.978 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:13 smithi039 ceph-mon[34543]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-09-11T23:55:13.979 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:13 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-11T23:55:14.326 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_1 2024-09-11T23:55:14.368 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-11T23:55:14.039+0000 7fb737077640 -1 osd.9 0 waiting for initial osdmap 2024-09-11T23:55:14.368 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-11T23:55:14.050+0000 7fb72ee97640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:55:14.583 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:55:14.856 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:14.856 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-11T23:55:14.856 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T23:55:14.856 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:14.856 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:14.856 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' 2024-09-11T23:55:14.856 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:14.857 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:14.857 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:14.857 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:14.857 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:14.857 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:14.857 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:14.857 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:14.857 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:14.857 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:14 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:14.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:14.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-11T23:55:14.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T23:55:14.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:14.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:14.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' 2024-09-11T23:55:14.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:14.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:14.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:14.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:14.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:14.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:14.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:14.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:14.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:14.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:14 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:14.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:14.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536]' entity='osd.9' 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:14.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:14.955 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:14 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:15.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.069+0000 7fc01fcaa640 1 -- 172.21.15.39:0/2129528309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018100b10 msgr2=0x7fc018100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.069+0000 7fc01fcaa640 1 --2- 172.21.15.39:0/2129528309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018100b10 0x7fc018100f10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc014009900 tx=0x7fc01402a410 comp rx=0 tx=0).stop 2024-09-11T23:55:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.069+0000 7fc01fcaa640 1 -- 172.21.15.39:0/2129528309 shutdown_connections 2024-09-11T23:55:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.069+0000 7fc01fcaa640 1 --2- 172.21.15.39:0/2129528309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0181026d0 0x7fc018108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.069+0000 7fc01fcaa640 1 --2- 172.21.15.39:0/2129528309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc018101d10 0x7fc018102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.069+0000 7fc01fcaa640 1 --2- 172.21.15.39:0/2129528309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018100b10 0x7fc018100f10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.069+0000 7fc01fcaa640 1 -- 172.21.15.39:0/2129528309 >> 172.21.15.39:0/2129528309 conn(0x7fc0180fc2a0 msgr2=0x7fc0180fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:55:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.069+0000 7fc01fcaa640 1 -- 172.21.15.39:0/2129528309 shutdown_connections 2024-09-11T23:55:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.069+0000 7fc01fcaa640 1 -- 172.21.15.39:0/2129528309 wait complete. 2024-09-11T23:55:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01fcaa640 1 Processor -- start 2024-09-11T23:55:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01fcaa640 1 -- start start 2024-09-11T23:55:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01fcaa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc018100b10 0x7fc01806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01fcaa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018101d10 0x7fc01819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01fcaa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0181026d0 0x7fc01819f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01fcaa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc01810c620 con 0x7fc0181026d0 2024-09-11T23:55:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01fcaa640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc01810c4a0 con 0x7fc018101d10 2024-09-11T23:55:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01fcaa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc01810c7a0 con 0x7fc018100b10 2024-09-11T23:55:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01d245640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018101d10 0x7fc01819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01d245640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018101d10 0x7fc01819cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42096/0 (socket says 172.21.15.39:42096) 2024-09-11T23:55:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01d245640 1 -- 172.21.15.39:0/3198324829 learned_addr learned my addr 172.21.15.39:0/3198324829 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-11T23:55:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01e247640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0181026d0 0x7fc01819f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.070+0000 7fc01da46640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc018100b10 0x7fc01806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.071+0000 7fc01d245640 1 -- 172.21.15.39:0/3198324829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc018100b10 msgr2=0x7fc01806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.071+0000 7fc01d245640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc018100b10 0x7fc01806b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.071+0000 7fc01d245640 1 -- 172.21.15.39:0/3198324829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0181026d0 msgr2=0x7fc01819f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.071+0000 7fc01d245640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0181026d0 0x7fc01819f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.071+0000 7fc01d245640 1 -- 172.21.15.39:0/3198324829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01819faf0 con 0x7fc018101d10 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.071+0000 7fc01d245640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018101d10 0x7fc01819cbc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc00800d950 tx=0x7fc00800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.071+0000 7fc00effd640 1 -- 172.21.15.39:0/3198324829 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc008017070 con 0x7fc018101d10 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.071+0000 7fc00effd640 1 -- 172.21.15.39:0/3198324829 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc008009c30 con 0x7fc018101d10 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.071+0000 7fc01fcaa640 1 -- 172.21.15.39:0/3198324829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc01819fd80 con 0x7fc018101d10 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.071+0000 7fc00effd640 1 -- 172.21.15.39:0/3198324829 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00800f620 con 0x7fc018101d10 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.071+0000 7fc01fcaa640 1 -- 172.21.15.39:0/3198324829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0181a0260 con 0x7fc018101d10 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.072+0000 7fc01fcaa640 1 -- 172.21.15.39:0/3198324829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc018108000 con 0x7fc018101d10 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.073+0000 7fc00effd640 1 -- 172.21.15.39:0/3198324829 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc0080109a0 con 0x7fc018101d10 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.074+0000 7fc00effd640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc0040a2b80 0x7fc0040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.074+0000 7fc00effd640 1 -- 172.21.15.39:0/3198324829 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6261+0+0 (secure 0 0 0) 0x7fc0080ce3b0 con 0x7fc018101d10 2024-09-11T23:55:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.074+0000 7fc01da46640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc0040a2b80 0x7fc0040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.075+0000 7fc01da46640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc0040a2b80 0x7fc0040a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc014004770 tx=0x7fc014000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:55:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.078+0000 7fc00effd640 1 -- 172.21.15.39:0/3198324829 <== mon.2 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc008009de0 con 0x7fc018101d10 2024-09-11T23:55:15.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:15.263+0000 7fc01fcaa640 1 -- 172.21.15.39:0/3198324829 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc018062630 con 0x7fc0040a2b80 2024-09-11T23:55:15.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:15 smithi006 ceph-mon[30947]: purged_snaps scrub starts 2024-09-11T23:55:15.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:15 smithi006 ceph-mon[30947]: purged_snaps scrub ok 2024-09-11T23:55:15.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:15 smithi006 ceph-mon[30947]: Detected new or changed devices on smithi006 2024-09-11T23:55:15.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:15 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi006 to 4273M 2024-09-11T23:55:15.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:15.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:15 smithi006 ceph-mon[30947]: osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536] boot 2024-09-11T23:55:15.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:15 smithi006 ceph-mon[30947]: osdmap e62: 10 total, 10 up, 10 in 2024-09-11T23:55:15.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:15.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:55:15.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:55:15.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:15.928 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:15 smithi039 ceph-mon[34543]: purged_snaps scrub starts 2024-09-11T23:55:15.928 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:15 smithi039 ceph-mon[34543]: purged_snaps scrub ok 2024-09-11T23:55:15.928 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:15 smithi039 ceph-mon[34543]: Detected new or changed devices on smithi006 2024-09-11T23:55:15.929 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:15 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi006 to 4273M 2024-09-11T23:55:15.929 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:15.929 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:15 smithi039 ceph-mon[34543]: osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536] boot 2024-09-11T23:55:15.929 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:15 smithi039 ceph-mon[34543]: osdmap e62: 10 total, 10 up, 10 in 2024-09-11T23:55:15.929 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:15.929 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:55:15.929 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:55:15.929 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:15.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:15 smithi134 ceph-mon[34893]: purged_snaps scrub starts 2024-09-11T23:55:15.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:15 smithi134 ceph-mon[34893]: purged_snaps scrub ok 2024-09-11T23:55:15.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:15 smithi134 ceph-mon[34893]: Detected new or changed devices on smithi006 2024-09-11T23:55:15.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:15 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi006 to 4273M 2024-09-11T23:55:15.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:15.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:15 smithi134 ceph-mon[34893]: osd.9 [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536] boot 2024-09-11T23:55:15.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:15 smithi134 ceph-mon[34893]: osdmap e62: 10 total, 10 up, 10 in 2024-09-11T23:55:15.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:15.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:55:15.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:55:15.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:16 smithi039 ceph-mon[34543]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:16 smithi039 ceph-mon[34543]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:55:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:16 smithi039 ceph-mon[34543]: osdmap e63: 10 total, 10 up, 10 in 2024-09-11T23:55:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:16 smithi006 ceph-mon[30947]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:16 smithi006 ceph-mon[30947]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:55:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:16 smithi006 ceph-mon[30947]: osdmap e63: 10 total, 10 up, 10 in 2024-09-11T23:55:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:16 smithi134 ceph-mon[34893]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:16 smithi134 ceph-mon[34893]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:55:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:16 smithi134 ceph-mon[34893]: osdmap e63: 10 total, 10 up, 10 in 2024-09-11T23:55:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:18 smithi039 ceph-mon[34543]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:18 smithi039 ceph-mon[34543]: from='client.? 172.21.15.39:0/3121990587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59380dc6-81fd-4f46-84a1-a5c18746b61c"}]: dispatch 2024-09-11T23:55:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:18 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59380dc6-81fd-4f46-84a1-a5c18746b61c"}]: dispatch 2024-09-11T23:55:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:18 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59380dc6-81fd-4f46-84a1-a5c18746b61c"}]': finished 2024-09-11T23:55:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:18 smithi039 ceph-mon[34543]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T23:55:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:18 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:18 smithi039 ceph-mon[34543]: from='client.? 172.21.15.39:0/3268412307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:18 smithi006 ceph-mon[30947]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:18 smithi006 ceph-mon[30947]: from='client.? 172.21.15.39:0/3121990587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59380dc6-81fd-4f46-84a1-a5c18746b61c"}]: dispatch 2024-09-11T23:55:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:18 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59380dc6-81fd-4f46-84a1-a5c18746b61c"}]: dispatch 2024-09-11T23:55:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:18 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59380dc6-81fd-4f46-84a1-a5c18746b61c"}]': finished 2024-09-11T23:55:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:18 smithi006 ceph-mon[30947]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T23:55:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:18 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:18.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:18 smithi006 ceph-mon[30947]: from='client.? 172.21.15.39:0/3268412307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:18.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:18 smithi134 ceph-mon[34893]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:18.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:18 smithi134 ceph-mon[34893]: from='client.? 172.21.15.39:0/3121990587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59380dc6-81fd-4f46-84a1-a5c18746b61c"}]: dispatch 2024-09-11T23:55:18.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:18 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59380dc6-81fd-4f46-84a1-a5c18746b61c"}]: dispatch 2024-09-11T23:55:18.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:18 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59380dc6-81fd-4f46-84a1-a5c18746b61c"}]': finished 2024-09-11T23:55:18.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:18 smithi134 ceph-mon[34893]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T23:55:18.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:18 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:18.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:18 smithi134 ceph-mon[34893]: from='client.? 172.21.15.39:0/3268412307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:20.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:20 smithi006 ceph-mon[30947]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:20.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:20 smithi134 ceph-mon[34893]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:21.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:20 smithi039 ceph-mon[34543]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:22.788 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:22 smithi039 ceph-mon[34543]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:22.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:22 smithi006 ceph-mon[30947]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:22 smithi134 ceph-mon[34893]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:24.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:24 smithi134 ceph-mon[34893]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:24.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:24 smithi006 ceph-mon[30947]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:25.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:24 smithi039 ceph-mon[34543]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:26.878 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:26 smithi039 ceph-mon[34543]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:26.878 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T23:55:26.878 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:26 smithi134 ceph-mon[34893]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T23:55:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:27.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:26 smithi006 ceph-mon[30947]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:27.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T23:55:27.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:27.894 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:27 smithi039 ceph-mon[34543]: Deploying daemon osd.10 on smithi039 2024-09-11T23:55:27.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:27 smithi134 ceph-mon[34893]: Deploying daemon osd.10 on smithi039 2024-09-11T23:55:28.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:27 smithi006 ceph-mon[30947]: Deploying daemon osd.10 on smithi039 2024-09-11T23:55:28.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:28 smithi039 ceph-mon[34543]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:28 smithi134 ceph-mon[34893]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:29.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:28 smithi006 ceph-mon[30947]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:30.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:30 smithi134 ceph-mon[34893]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:31.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:30 smithi039 ceph-mon[34543]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:31.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:30 smithi006 ceph-mon[30947]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:32.887 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:32 smithi039 ceph-mon[34543]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:32.887 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:32 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:32.888 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:32 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:32.888 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:32 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:32 smithi134 ceph-mon[34893]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:32 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:32 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:32 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:33.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:32 smithi006 ceph-mon[30947]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:33.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:32 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:33.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:32 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:33.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:32 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:34.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:34 smithi134 ceph-mon[34893]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:34.955 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:34 smithi039 ceph-mon[34543]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:35.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:34 smithi006 ceph-mon[30947]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.140+0000 7fc00effd640 1 -- 172.21.15.39:0/3198324829 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc018062630 con 0x7fc0040a2b80 2024-09-11T23:55:36.139 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 10 on host 'smithi039' 2024-09-11T23:55:36.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.142+0000 7fc01fcaa640 1 -- 172.21.15.39:0/3198324829 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc0040a2b80 msgr2=0x7fc0040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:36.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.142+0000 7fc01fcaa640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc0040a2b80 0x7fc0040a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc014004770 tx=0x7fc014000bc0 comp rx=0 tx=0).stop 2024-09-11T23:55:36.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.142+0000 7fc01fcaa640 1 -- 172.21.15.39:0/3198324829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018101d10 msgr2=0x7fc01819cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:36.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.142+0000 7fc01fcaa640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018101d10 0x7fc01819cbc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc00800d950 tx=0x7fc00800de10 comp rx=0 tx=0).stop 2024-09-11T23:55:36.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.142+0000 7fc01fcaa640 1 -- 172.21.15.39:0/3198324829 shutdown_connections 2024-09-11T23:55:36.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.142+0000 7fc01fcaa640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc0040a2b80 0x7fc0040a5040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:36.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.142+0000 7fc01fcaa640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0181026d0 0x7fc01819f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:36.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.142+0000 7fc01fcaa640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018101d10 0x7fc01819cbc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:36.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.142+0000 7fc01fcaa640 1 --2- 172.21.15.39:0/3198324829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc018100b10 0x7fc01806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:36.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.142+0000 7fc01fcaa640 1 -- 172.21.15.39:0/3198324829 >> 172.21.15.39:0/3198324829 conn(0x7fc0180fc2a0 msgr2=0x7fc0181051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:55:36.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.143+0000 7fc01fcaa640 1 -- 172.21.15.39:0/3198324829 shutdown_connections 2024-09-11T23:55:36.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-11T23:55:36.143+0000 7fc01fcaa640 1 -- 172.21.15.39:0/3198324829 wait complete. 2024-09-11T23:55:36.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:36 smithi134 ceph-mon[34893]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:36.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:36.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:36.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:36.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.766 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:36 smithi039 ceph-mon[34543]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:36.766 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.766 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.766 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:36.766 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:36.766 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.766 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:36.766 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.766 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.794 DEBUG:teuthology.orchestra.run.smithi039:osd.10> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.10.service 2024-09-11T23:55:36.797 INFO:tasks.cephadm:Deploying osd.11 on smithi134 with /dev/vg_nvme/lv_1... 2024-09-11T23:55:36.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T23:55:36.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:36 smithi006 ceph-mon[30947]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:37.055 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:55:38.294 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 11 23:55:38 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-11T23:55:38.253+0000 7f7c3b6cc640 -1 osd.10 0 log_to_monitors true 2024-09-11T23:55:38.602 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:38 smithi134 ceph-mon[34893]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:38.602 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:38 smithi134 ceph-mon[34893]: from='osd.10 [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:55:38.602 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:38 smithi134 ceph-mon[34893]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:55:38.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:38 smithi039 ceph-mon[34543]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:38.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:38 smithi039 ceph-mon[34543]: from='osd.10 [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:55:38.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:38 smithi039 ceph-mon[34543]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:55:38.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:38 smithi006 ceph-mon[30947]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:38.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:38 smithi006 ceph-mon[30947]: from='osd.10 [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:55:38.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:38 smithi006 ceph-mon[30947]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:55:39.688 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:39 smithi134 ceph-mon[34893]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T23:55:39.688 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:39 smithi134 ceph-mon[34893]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T23:55:39.688 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:39 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:39.688 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:39 smithi134 ceph-mon[34893]: from='osd.10 [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:55:39.688 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:39 smithi134 ceph-mon[34893]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:55:39.691 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-11T23:55:39.716 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_1 2024-09-11T23:55:39.725 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 11 23:55:39 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-11T23:55:39.396+0000 7f7c3764f640 -1 osd.10 0 waiting for initial osdmap 2024-09-11T23:55:39.725 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 11 23:55:39 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-11T23:55:39.410+0000 7f7c33477640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:55:39.725 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:39 smithi039 ceph-mon[34543]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T23:55:39.725 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:39 smithi039 ceph-mon[34543]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T23:55:39.725 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:39 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:39.725 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:39 smithi039 ceph-mon[34543]: from='osd.10 [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:55:39.725 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:39 smithi039 ceph-mon[34543]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:55:39.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:39 smithi006 ceph-mon[30947]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T23:55:39.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:39 smithi006 ceph-mon[30947]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T23:55:39.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:39 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:39.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:39 smithi006 ceph-mon[30947]: from='osd.10 [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:55:39.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:39 smithi006 ceph-mon[30947]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-11T23:55:39.964 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:55:40.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.436+0000 7f9185e21640 1 -- 172.21.15.134:0/3751300465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101c00 msgr2=0x7f9180102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:40.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.436+0000 7f9185e21640 1 --2- 172.21.15.134:0/3751300465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101c00 0x7f9180102000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9170009900 tx=0x7f917002a410 comp rx=0 tx=0).stop 2024-09-11T23:55:40.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.436+0000 7f9185e21640 1 -- 172.21.15.134:0/3751300465 shutdown_connections 2024-09-11T23:55:40.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.436+0000 7f9185e21640 1 --2- 172.21.15.134:0/3751300465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91801037c0 0x7f918010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:40.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.436+0000 7f9185e21640 1 --2- 172.21.15.134:0/3751300465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9180102e00 0x7f9180103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.436+0000 7f9185e21640 1 --2- 172.21.15.134:0/3751300465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101c00 0x7f9180102000 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.436+0000 7f9185e21640 1 -- 172.21.15.134:0/3751300465 >> 172.21.15.134:0/3751300465 conn(0x7f91800fd390 msgr2=0x7f91800ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.436+0000 7f9185e21640 1 -- 172.21.15.134:0/3751300465 shutdown_connections 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.436+0000 7f9185e21640 1 -- 172.21.15.134:0/3751300465 wait complete. 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f9185e21640 1 Processor -- start 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f9185e21640 1 -- start start 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f9185e21640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101c00 0x7f9180197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f9185e21640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9180102e00 0x7f9180198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f9185e21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91801037c0 0x7f918019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f9185e21640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f918010d740 con 0x7f91801037c0 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f9185e21640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f918010d5c0 con 0x7f9180102e00 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f9185e21640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f918010d8c0 con 0x7f9180101c00 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f917f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101c00 0x7f9180197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f917f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101c00 0x7f9180197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38774/0 (socket says 172.21.15.134:38774) 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f917f7fe640 1 -- 172.21.15.134:0/418854712 learned_addr learned my addr 172.21.15.134:0/418854712 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f917effd640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9180102e00 0x7f9180198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.437+0000 7f917ffff640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91801037c0 0x7f918019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.438+0000 7f917f7fe640 1 -- 172.21.15.134:0/418854712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9180102e00 msgr2=0x7f9180198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.438+0000 7f917f7fe640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9180102e00 0x7f9180198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.438+0000 7f917f7fe640 1 -- 172.21.15.134:0/418854712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91801037c0 msgr2=0x7f918019f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.438+0000 7f917f7fe640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91801037c0 0x7f918019f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.438+0000 7f917f7fe640 1 -- 172.21.15.134:0/418854712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918019fa60 con 0x7f9180101c00 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.438+0000 7f917ffff640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91801037c0 0x7f918019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.438+0000 7f917f7fe640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101c00 0x7f9180197e30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f91700314e0 tx=0x7f91700042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.438+0000 7f917cff9640 1 -- 172.21.15.134:0/418854712 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917003f030 con 0x7f9180101c00 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.438+0000 7f9185e21640 1 -- 172.21.15.134:0/418854712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f918019fcf0 con 0x7f9180101c00 2024-09-11T23:55:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.438+0000 7f917cff9640 1 -- 172.21.15.134:0/418854712 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9170003cb0 con 0x7f9180101c00 2024-09-11T23:55:40.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.438+0000 7f917cff9640 1 -- 172.21.15.134:0/418854712 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170035070 con 0x7f9180101c00 2024-09-11T23:55:40.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.438+0000 7f9185e21640 1 -- 172.21.15.134:0/418854712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91801a0170 con 0x7f9180101c00 2024-09-11T23:55:40.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.439+0000 7f9185e21640 1 -- 172.21.15.134:0/418854712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9180109050 con 0x7f9180101c00 2024-09-11T23:55:40.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.440+0000 7f917cff9640 1 -- 172.21.15.134:0/418854712 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f9170042030 con 0x7f9180101c00 2024-09-11T23:55:40.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.441+0000 7f917cff9640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f91680a2bb0 0x7f91680a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:40.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.441+0000 7f917cff9640 1 -- 172.21.15.134:0/418854712 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6727+0+0 (secure 0 0 0) 0x7f91700ef020 con 0x7f9180101c00 2024-09-11T23:55:40.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.441+0000 7f917effd640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f91680a2bb0 0x7f91680a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:40.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.441+0000 7f917effd640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f91680a2bb0 0x7f91680a5070 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9180199350 tx=0x7f917400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:55:40.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.445+0000 7f917cff9640 1 -- 172.21.15.134:0/418854712 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f91700bc5b0 con 0x7f9180101c00 2024-09-11T23:55:40.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:55:40.618+0000 7f9185e21640 1 -- 172.21.15.134:0/418854712 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9180062630 con 0x7f91680a2bb0 2024-09-11T23:55:40.618 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:40.618 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-11T23:55:40.618 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T23:55:40.618 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:40.618 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:40.618 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: Detected new or changed devices on smithi039 2024-09-11T23:55:40.619 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:40.619 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:40.619 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:40.619 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:40.619 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:40.619 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:40.619 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi039 to 4272M 2024-09-11T23:55:40.619 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:40.620 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:40.620 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:40.620 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:40 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:40.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:40.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-11T23:55:40.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T23:55:40.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:40.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:40.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: Detected new or changed devices on smithi039 2024-09-11T23:55:40.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:40.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:40.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:40.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:40.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:40.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:40.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi039 to 4272M 2024-09-11T23:55:40.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:40.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:40.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:40.798 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:40 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-11T23:55:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T23:55:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: Detected new or changed devices on smithi039 2024-09-11T23:55:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi039 to 4272M 2024-09-11T23:55:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:40 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:41.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:41 smithi134 ceph-mon[34893]: purged_snaps scrub starts 2024-09-11T23:55:41.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:41 smithi134 ceph-mon[34893]: purged_snaps scrub ok 2024-09-11T23:55:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:41 smithi134 ceph-mon[34893]: osd.10 [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012] boot 2024-09-11T23:55:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:41 smithi134 ceph-mon[34893]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T23:55:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:41 smithi134 ceph-mon[34893]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:55:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:55:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:55:41.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:41 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:41.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:41 smithi039 ceph-mon[34543]: purged_snaps scrub starts 2024-09-11T23:55:41.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:41 smithi039 ceph-mon[34543]: purged_snaps scrub ok 2024-09-11T23:55:41.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:41 smithi039 ceph-mon[34543]: osd.10 [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012] boot 2024-09-11T23:55:41.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:41 smithi039 ceph-mon[34543]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T23:55:41.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:41.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:41 smithi039 ceph-mon[34543]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:55:41.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:55:41.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:55:41.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:41 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:41.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:41 smithi006 ceph-mon[30947]: purged_snaps scrub starts 2024-09-11T23:55:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:41 smithi006 ceph-mon[30947]: purged_snaps scrub ok 2024-09-11T23:55:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:41 smithi006 ceph-mon[30947]: osd.10 [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012] boot 2024-09-11T23:55:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:41 smithi006 ceph-mon[30947]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T23:55:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:41 smithi006 ceph-mon[30947]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:55:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:55:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:55:41.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:41 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:42.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:42 smithi134 ceph-mon[34893]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:42.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:42 smithi134 ceph-mon[34893]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T23:55:42.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:42 smithi039 ceph-mon[34543]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:42.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:42 smithi039 ceph-mon[34543]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T23:55:42.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:42 smithi006 ceph-mon[30947]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:42.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:42 smithi006 ceph-mon[30947]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T23:55:43.644 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:43 smithi134 ceph-mon[34893]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T23:55:43.644 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:43 smithi134 ceph-mon[34893]: from='client.? 172.21.15.134:0/4032909559' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd4acadd-641f-4a0f-abda-589d1a0482e6"}]: dispatch 2024-09-11T23:55:43.645 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:43 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd4acadd-641f-4a0f-abda-589d1a0482e6"}]: dispatch 2024-09-11T23:55:43.645 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:43 smithi134 ceph-mon[34893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd4acadd-641f-4a0f-abda-589d1a0482e6"}]': finished 2024-09-11T23:55:43.645 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:43 smithi134 ceph-mon[34893]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T23:55:43.645 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:43 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:55:43.695 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:43 smithi039 ceph-mon[34543]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T23:55:43.695 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:43 smithi039 ceph-mon[34543]: from='client.? 172.21.15.134:0/4032909559' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd4acadd-641f-4a0f-abda-589d1a0482e6"}]: dispatch 2024-09-11T23:55:43.695 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:43 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd4acadd-641f-4a0f-abda-589d1a0482e6"}]: dispatch 2024-09-11T23:55:43.695 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:43 smithi039 ceph-mon[34543]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd4acadd-641f-4a0f-abda-589d1a0482e6"}]': finished 2024-09-11T23:55:43.695 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:43 smithi039 ceph-mon[34543]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T23:55:43.695 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:43 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:55:43.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:43 smithi006 ceph-mon[30947]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T23:55:43.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:43 smithi006 ceph-mon[30947]: from='client.? 172.21.15.134:0/4032909559' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd4acadd-641f-4a0f-abda-589d1a0482e6"}]: dispatch 2024-09-11T23:55:43.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:43 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd4acadd-641f-4a0f-abda-589d1a0482e6"}]: dispatch 2024-09-11T23:55:43.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:43 smithi006 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd4acadd-641f-4a0f-abda-589d1a0482e6"}]': finished 2024-09-11T23:55:43.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:43 smithi006 ceph-mon[30947]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T23:55:43.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:43 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:55:44.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:44 smithi134 ceph-mon[34893]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:44.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:44 smithi134 ceph-mon[34893]: from='client.? 172.21.15.134:0/2102417207' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:44.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:44 smithi134 ceph-mon[34893]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T23:55:44.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:44 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:55:44.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:44 smithi039 ceph-mon[34543]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:44.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:44 smithi039 ceph-mon[34543]: from='client.? 172.21.15.134:0/2102417207' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:44.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:44 smithi039 ceph-mon[34543]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T23:55:44.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:44 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:55:44.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:44 smithi006 ceph-mon[30947]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:44 smithi006 ceph-mon[30947]: from='client.? 172.21.15.134:0/2102417207' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:44 smithi006 ceph-mon[30947]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T23:55:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:44 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:55:46.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:46 smithi134 ceph-mon[34893]: pgmap v233: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T23:55:46.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:46 smithi039 ceph-mon[34543]: pgmap v233: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T23:55:46.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:46 smithi006 ceph-mon[30947]: pgmap v233: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T23:55:48.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:48 smithi134 ceph-mon[34893]: pgmap v234: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-11T23:55:48.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:48 smithi039 ceph-mon[34543]: pgmap v234: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-11T23:55:48.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:48 smithi006 ceph-mon[30947]: pgmap v234: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-11T23:55:50.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:50 smithi134 ceph-mon[34893]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-11T23:55:50.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:50 smithi039 ceph-mon[34543]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-11T23:55:50.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:50 smithi006 ceph-mon[30947]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-11T23:55:52.662 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:52 smithi134 ceph-mon[34893]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:55:52.663 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T23:55:52.663 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:52.663 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:52 smithi134 ceph-mon[34893]: Deploying daemon osd.11 on smithi134 2024-09-11T23:55:52.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:52 smithi039 ceph-mon[34543]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:55:52.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T23:55:52.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:52.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:52 smithi039 ceph-mon[34543]: Deploying daemon osd.11 on smithi134 2024-09-11T23:55:52.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:52 smithi006 ceph-mon[30947]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:55:52.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T23:55:52.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:52.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:52 smithi006 ceph-mon[30947]: Deploying daemon osd.11 on smithi134 2024-09-11T23:55:54.672 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:54 smithi134 ceph-mon[34893]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:54.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:54 smithi039 ceph-mon[34543]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:54.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:54 smithi006 ceph-mon[30947]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:56.577 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:56 smithi134 ceph-mon[34893]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:56.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:56 smithi039 ceph-mon[34543]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:56.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:56 smithi006 ceph-mon[30947]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:58.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:58 smithi134 ceph-mon[34893]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:58.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:58.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:58.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:55:58 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:58.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:58 smithi039 ceph-mon[34543]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:58.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:58.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:58.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:55:58 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:58.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:58 smithi006 ceph-mon[30947]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:55:58.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:58.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:55:58.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:55:58 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:00.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.415+0000 7f917cff9640 1 -- 172.21.15.134:0/418854712 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9180062630 con 0x7f91680a2bb0 2024-09-11T23:56:00.415 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 11 on host 'smithi134' 2024-09-11T23:56:00.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.418+0000 7f9185e21640 1 -- 172.21.15.134:0/418854712 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f91680a2bb0 msgr2=0x7f91680a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:00.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.418+0000 7f9185e21640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f91680a2bb0 0x7f91680a5070 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9180199350 tx=0x7f917400b390 comp rx=0 tx=0).stop 2024-09-11T23:56:00.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.418+0000 7f9185e21640 1 -- 172.21.15.134:0/418854712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101c00 msgr2=0x7f9180197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:00.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.418+0000 7f9185e21640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101c00 0x7f9180197e30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f91700314e0 tx=0x7f91700042e0 comp rx=0 tx=0).stop 2024-09-11T23:56:00.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.418+0000 7f9185e21640 1 -- 172.21.15.134:0/418854712 shutdown_connections 2024-09-11T23:56:00.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.418+0000 7f9185e21640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f91680a2bb0 0x7f91680a5070 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:00.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.418+0000 7f9185e21640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91801037c0 0x7f918019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:00.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.418+0000 7f9185e21640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9180102e00 0x7f9180198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:00.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.418+0000 7f9185e21640 1 --2- 172.21.15.134:0/418854712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101c00 0x7f9180197e30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:00.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.418+0000 7f9185e21640 1 -- 172.21.15.134:0/418854712 >> 172.21.15.134:0/418854712 conn(0x7f91800fd390 msgr2=0x7f9180106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:00.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.418+0000 7f9185e21640 1 -- 172.21.15.134:0/418854712 shutdown_connections 2024-09-11T23:56:00.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:00.418+0000 7f9185e21640 1 -- 172.21.15.134:0/418854712 wait complete. 2024-09-11T23:56:00.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:00 smithi134 ceph-mon[34893]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:00.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:00.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:00.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:00 smithi039 ceph-mon[34543]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:00.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:00.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:00.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:00 smithi006 ceph-mon[30947]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:00.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:00.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:01.150 DEBUG:teuthology.orchestra.run.smithi134:osd.11> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.11.service 2024-09-11T23:56:01.153 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-11T23:56:01.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T23:56:01.422 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.940+0000 7f8bd90a2640 1 -- 172.21.15.6:0/3337983121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bd41078c0 msgr2=0x7f8bd4109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.940+0000 7f8bd90a2640 1 --2- 172.21.15.6:0/3337983121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bd41078c0 0x7f8bd4109d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009ca0 tx=0x7f8bcc02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:56:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.940+0000 7f8bd90a2640 1 -- 172.21.15.6:0/3337983121 shutdown_connections 2024-09-11T23:56:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.940+0000 7f8bd90a2640 1 --2- 172.21.15.6:0/3337983121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bd41078c0 0x7f8bd4109d10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.940+0000 7f8bd90a2640 1 --2- 172.21.15.6:0/3337983121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4104f90 0x7f8bd4107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.940+0000 7f8bd90a2640 1 --2- 172.21.15.6:0/3337983121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd4102660 0x7f8bd4104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.940+0000 7f8bd90a2640 1 -- 172.21.15.6:0/3337983121 >> 172.21.15.6:0/3337983121 conn(0x7f8bd40fc280 msgr2=0x7f8bd40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.940+0000 7f8bd90a2640 1 -- 172.21.15.6:0/3337983121 shutdown_connections 2024-09-11T23:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.940+0000 7f8bd90a2640 1 -- 172.21.15.6:0/3337983121 wait complete. 2024-09-11T23:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd90a2640 1 Processor -- start 2024-09-11T23:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd90a2640 1 -- start start 2024-09-11T23:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd90a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bd4102660 0x7f8bd4197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd90a2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4104f90 0x7f8bd4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd90a2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd41078c0 0x7f8bd419f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd90a2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd410d710 con 0x7f8bd4102660 2024-09-11T23:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd90a2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd410d590 con 0x7f8bd41078c0 2024-09-11T23:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd90a2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd410d890 con 0x7f8bd4104f90 2024-09-11T23:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bd4102660 0x7f8bd4197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bd4102660 0x7f8bd4197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40062/0 (socket says 172.21.15.6:40062) 2024-09-11T23:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd2d9d640 1 -- 172.21.15.6:0/1197273072 learned_addr learned my addr 172.21.15.6:0/1197273072 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd259c640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4104f90 0x7f8bd4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd359e640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd41078c0 0x7f8bd419f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd2d9d640 1 -- 172.21.15.6:0/1197273072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4104f90 msgr2=0x7f8bd4198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd2d9d640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4104f90 0x7f8bd4198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd2d9d640 1 -- 172.21.15.6:0/1197273072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd41078c0 msgr2=0x7f8bd419f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd2d9d640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd41078c0 0x7f8bd419f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.941+0000 7f8bd2d9d640 1 -- 172.21.15.6:0/1197273072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd419f9f0 con 0x7f8bd4102660 2024-09-11T23:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.942+0000 7f8bd2d9d640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bd4102660 0x7f8bd4197dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400d950 tx=0x7f8bc400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.942+0000 7f8bbbfff640 1 -- 172.21.15.6:0/1197273072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4017070 con 0x7f8bd4102660 2024-09-11T23:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.942+0000 7f8bd90a2640 1 -- 172.21.15.6:0/1197273072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd419fce0 con 0x7f8bd4102660 2024-09-11T23:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.942+0000 7f8bbbfff640 1 -- 172.21.15.6:0/1197273072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8bc4009c30 con 0x7f8bd4102660 2024-09-11T23:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.942+0000 7f8bbbfff640 1 -- 172.21.15.6:0/1197273072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400f620 con 0x7f8bd4102660 2024-09-11T23:56:01.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.942+0000 7f8bd90a2640 1 -- 172.21.15.6:0/1197273072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd41a0170 con 0x7f8bd4102660 2024-09-11T23:56:01.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.943+0000 7f8bd90a2640 1 -- 172.21.15.6:0/1197273072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd40fdd70 con 0x7f8bd4102660 2024-09-11T23:56:01.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.944+0000 7f8bbbfff640 1 -- 172.21.15.6:0/1197273072 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8bc40109a0 con 0x7f8bd4102660 2024-09-11T23:56:01.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.945+0000 7f8bbbfff640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8bbc0a2bb0 0x7f8bbc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:01.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.945+0000 7f8bd259c640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8bbc0a2bb0 0x7f8bbc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:01.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.945+0000 7f8bbbfff640 1 -- 172.21.15.6:0/1197273072 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7f8bc40ce630 con 0x7f8bd4102660 2024-09-11T23:56:01.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.946+0000 7f8bd259c640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8bbc0a2bb0 0x7f8bbc0a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8bd41992e0 tx=0x7f8bc800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:01.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:01.949+0000 7f8bbbfff640 1 -- 172.21.15.6:0/1197273072 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8bc409b4c0 con 0x7f8bd4102660 2024-09-11T23:56:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.126+0000 7f8bd90a2640 1 -- 172.21.15.6:0/1197273072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8bd4062ef0 con 0x7f8bd4102660 2024-09-11T23:56:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.126+0000 7f8bbbfff640 1 -- 172.21.15.6:0/1197273072 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f8bc409f7c0 con 0x7f8bd4102660 2024-09-11T23:56:02.125 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:02.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.128+0000 7f8bd90a2640 1 -- 172.21.15.6:0/1197273072 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8bbc0a2bb0 msgr2=0x7f8bbc0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:02.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.128+0000 7f8bd90a2640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8bbc0a2bb0 0x7f8bbc0a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8bd41992e0 tx=0x7f8bc800b410 comp rx=0 tx=0).stop 2024-09-11T23:56:02.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.128+0000 7f8bd90a2640 1 -- 172.21.15.6:0/1197273072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bd4102660 msgr2=0x7f8bd4197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:02.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.128+0000 7f8bd90a2640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bd4102660 0x7f8bd4197dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400d950 tx=0x7f8bc400de10 comp rx=0 tx=0).stop 2024-09-11T23:56:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.128+0000 7f8bd90a2640 1 -- 172.21.15.6:0/1197273072 shutdown_connections 2024-09-11T23:56:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.128+0000 7f8bd90a2640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8bbc0a2bb0 0x7f8bbc0a5070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.128+0000 7f8bd90a2640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd41078c0 0x7f8bd419f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.128+0000 7f8bd90a2640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4104f90 0x7f8bd4198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.128+0000 7f8bd90a2640 1 --2- 172.21.15.6:0/1197273072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bd4102660 0x7f8bd4197dc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.128+0000 7f8bd90a2640 1 -- 172.21.15.6:0/1197273072 >> 172.21.15.6:0/1197273072 conn(0x7f8bd40fc280 msgr2=0x7f8bd4102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.128+0000 7f8bd90a2640 1 -- 172.21.15.6:0/1197273072 shutdown_connections 2024-09-11T23:56:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:02.128+0000 7f8bd90a2640 1 -- 172.21.15.6:0/1197273072 wait complete. 2024-09-11T23:56:02.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:02 smithi006 ceph-mon[30947]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:02.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:02.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:02.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:02 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1197273072' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:02.968 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726098940,"num_in_osds":12,"osd_in_since":1726098943,"num_remapped_pgs":0} 2024-09-11T23:56:03.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:02 smithi039 ceph-mon[34543]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:03.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:03.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:03.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:02 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1197273072' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:03.132 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:02 smithi134 ceph-mon[34893]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:03.132 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:03.132 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:03.132 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:02 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1197273072' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:03.439 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 11 23:56:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-11T23:56:03.311+0000 7f6be4f4c640 -1 osd.11 0 log_to_monitors true 2024-09-11T23:56:03.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T23:56:03.999 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:03 smithi006 ceph-mon[30947]: from='osd.11 [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:56:03.999 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:03 smithi006 ceph-mon[30947]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:56:04.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:03 smithi039 ceph-mon[34543]: from='osd.11 [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:56:04.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:03 smithi039 ceph-mon[34543]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:56:04.151 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:03 smithi134 ceph-mon[34893]: from='osd.11 [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:56:04.151 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:03 smithi134 ceph-mon[34893]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:56:04.238 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:04.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.750+0000 7fc333574640 1 -- 172.21.15.6:0/3372337337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc32c102690 msgr2=0x7fc32c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.750+0000 7fc333574640 1 --2- 172.21.15.6:0/3372337337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc32c102690 0x7fc32c108f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc324009ca0 tx=0x7fc32402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:56:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.750+0000 7fc333574640 1 -- 172.21.15.6:0/3372337337 shutdown_connections 2024-09-11T23:56:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.750+0000 7fc333574640 1 --2- 172.21.15.6:0/3372337337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc32c102690 0x7fc32c108f20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.750+0000 7fc333574640 1 --2- 172.21.15.6:0/3372337337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c101cd0 0x7fc32c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.750+0000 7fc333574640 1 --2- 172.21.15.6:0/3372337337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc32c100ad0 0x7fc32c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.750+0000 7fc333574640 1 -- 172.21.15.6:0/3372337337 >> 172.21.15.6:0/3372337337 conn(0x7fc32c0fc280 msgr2=0x7fc32c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.750+0000 7fc333574640 1 -- 172.21.15.6:0/3372337337 shutdown_connections 2024-09-11T23:56:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.750+0000 7fc333574640 1 -- 172.21.15.6:0/3372337337 wait complete. 2024-09-11T23:56:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc333574640 1 Processor -- start 2024-09-11T23:56:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc333574640 1 -- start start 2024-09-11T23:56:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc333574640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc32c100ad0 0x7fc32c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc333574640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c101cd0 0x7fc32c19caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc333574640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc32c102690 0x7fc32c19f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc333574640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c10c5e0 con 0x7fc32c102690 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc333574640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c10c460 con 0x7fc32c100ad0 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc333574640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c10c760 con 0x7fc32c101cd0 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc331b11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc32c102690 0x7fc32c19f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc330b0f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c101cd0 0x7fc32c19caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc331b11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc32c102690 0x7fc32c19f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40066/0 (socket says 172.21.15.6:40066) 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc330b0f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c101cd0 0x7fc32c19caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:33230/0 (socket says 172.21.15.6:33230) 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc331b11640 1 -- 172.21.15.6:0/281590345 learned_addr learned my addr 172.21.15.6:0/281590345 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc331310640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc32c100ad0 0x7fc32c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc331b11640 1 -- 172.21.15.6:0/281590345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c101cd0 msgr2=0x7fc32c19caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc331b11640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c101cd0 0x7fc32c19caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc331b11640 1 -- 172.21.15.6:0/281590345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc32c100ad0 msgr2=0x7fc32c06aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc331b11640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc32c100ad0 0x7fc32c06aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.751+0000 7fc331b11640 1 -- 172.21.15.6:0/281590345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32c19fa20 con 0x7fc32c102690 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.752+0000 7fc331b11640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc32c102690 0x7fc32c19f110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc324009dc0 tx=0x7fc324003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.752+0000 7fc3227fc640 1 -- 172.21.15.6:0/281590345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324032ec0 con 0x7fc32c102690 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.752+0000 7fc333574640 1 -- 172.21.15.6:0/281590345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32c19fc50 con 0x7fc32c102690 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.752+0000 7fc3227fc640 1 -- 172.21.15.6:0/281590345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3240044f0 con 0x7fc32c102690 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.752+0000 7fc3227fc640 1 -- 172.21.15.6:0/281590345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324030d40 con 0x7fc32c102690 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.752+0000 7fc333574640 1 -- 172.21.15.6:0/281590345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc32c1a0190 con 0x7fc32c102690 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.753+0000 7fc333574640 1 -- 172.21.15.6:0/281590345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc32c107f20 con 0x7fc32c102690 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.754+0000 7fc3227fc640 1 -- 172.21.15.6:0/281590345 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc324004040 con 0x7fc32c102690 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.755+0000 7fc3227fc640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3180a2d20 0x7fc3180a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.755+0000 7fc331310640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3180a2d20 0x7fc3180a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.755+0000 7fc3227fc640 1 -- 172.21.15.6:0/281590345 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6847+0+0 (secure 0 0 0) 0x7fc3240f0280 con 0x7fc32c102690 2024-09-11T23:56:04.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.755+0000 7fc331310640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3180a2d20 0x7fc3180a51e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc328005d00 tx=0x7fc328005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:04.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.758+0000 7fc3227fc640 1 -- 172.21.15.6:0/281590345 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3240bd700 con 0x7fc32c102690 2024-09-11T23:56:04.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.939+0000 7fc333574640 1 -- 172.21.15.6:0/281590345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc32c02da10 con 0x7fc32c102690 2024-09-11T23:56:04.940 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:04 smithi006 ceph-mon[30947]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:04.940 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:04 smithi006 ceph-mon[30947]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T23:56:04.940 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:04 smithi006 ceph-mon[30947]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T23:56:04.940 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:04.940 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:04 smithi006 ceph-mon[30947]: from='osd.11 [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:56:04.940 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:04 smithi006 ceph-mon[30947]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:56:04.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.940+0000 7fc3227fc640 1 -- 172.21.15.6:0/281590345 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7fc3240dd0c0 con 0x7fc32c102690 2024-09-11T23:56:04.941 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.942+0000 7fc333574640 1 -- 172.21.15.6:0/281590345 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3180a2d20 msgr2=0x7fc3180a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.942+0000 7fc333574640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3180a2d20 0x7fc3180a51e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc328005d00 tx=0x7fc328005c50 comp rx=0 tx=0).stop 2024-09-11T23:56:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.942+0000 7fc333574640 1 -- 172.21.15.6:0/281590345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc32c102690 msgr2=0x7fc32c19f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.942+0000 7fc333574640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc32c102690 0x7fc32c19f110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc324009dc0 tx=0x7fc324003ba0 comp rx=0 tx=0).stop 2024-09-11T23:56:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.942+0000 7fc333574640 1 -- 172.21.15.6:0/281590345 shutdown_connections 2024-09-11T23:56:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.942+0000 7fc333574640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3180a2d20 0x7fc3180a51e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.942+0000 7fc333574640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc32c102690 0x7fc32c19f110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.942+0000 7fc333574640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c101cd0 0x7fc32c19caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.942+0000 7fc333574640 1 --2- 172.21.15.6:0/281590345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc32c100ad0 0x7fc32c06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.942+0000 7fc333574640 1 -- 172.21.15.6:0/281590345 >> 172.21.15.6:0/281590345 conn(0x7fc32c0fc280 msgr2=0x7fc32c1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.942+0000 7fc333574640 1 -- 172.21.15.6:0/281590345 shutdown_connections 2024-09-11T23:56:04.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:04.942+0000 7fc333574640 1 -- 172.21.15.6:0/281590345 wait complete. 2024-09-11T23:56:05.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:04 smithi039 ceph-mon[34543]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:05.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:04 smithi039 ceph-mon[34543]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T23:56:05.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:04 smithi039 ceph-mon[34543]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T23:56:05.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:04 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:05.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:04 smithi039 ceph-mon[34543]: from='osd.11 [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:56:05.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:04 smithi039 ceph-mon[34543]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:56:05.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:04 smithi134 ceph-mon[34893]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:05.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:04 smithi134 ceph-mon[34893]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T23:56:05.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:04 smithi134 ceph-mon[34893]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T23:56:05.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:04 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:05.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:04 smithi134 ceph-mon[34893]: from='osd.11 [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:56:05.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:04 smithi134 ceph-mon[34893]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-11T23:56:05.204 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 11 23:56:04 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-11T23:56:04.746+0000 7f6be0ecf640 -1 osd.11 0 waiting for initial osdmap 2024-09-11T23:56:05.204 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 11 23:56:04 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-11T23:56:04.757+0000 7f6bdccf7640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:56:05.683 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726098940,"num_in_osds":12,"osd_in_since":1726098943,"num_remapped_pgs":0} 2024-09-11T23:56:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-11T23:56:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T23:56:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: Detected new or changed devices on smithi134 2024-09-11T23:56:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi134 to 4272M 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/281590345' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:06.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: Detected new or changed devices on smithi134 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi134 to 4272M 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:06.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:06.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/281590345' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:06.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:06.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:06.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:06.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: Detected new or changed devices on smithi134 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi134 to 4272M 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:06.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:06.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/281590345' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:06.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:06.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:06.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:06.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:06.684 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T23:56:07.030 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:07.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:06 smithi039 ceph-mon[34543]: purged_snaps scrub starts 2024-09-11T23:56:07.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:06 smithi039 ceph-mon[34543]: purged_snaps scrub ok 2024-09-11T23:56:07.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:06 smithi039 ceph-mon[34543]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:07.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:07.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:06 smithi039 ceph-mon[34543]: osd.11 [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401] boot 2024-09-11T23:56:07.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:06 smithi039 ceph-mon[34543]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T23:56:07.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:07.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:06 smithi006 ceph-mon[30947]: purged_snaps scrub starts 2024-09-11T23:56:07.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:06 smithi006 ceph-mon[30947]: purged_snaps scrub ok 2024-09-11T23:56:07.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:06 smithi006 ceph-mon[30947]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:07.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:07.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:06 smithi006 ceph-mon[30947]: osd.11 [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401] boot 2024-09-11T23:56:07.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:06 smithi006 ceph-mon[30947]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T23:56:07.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:06 smithi134 ceph-mon[34893]: purged_snaps scrub starts 2024-09-11T23:56:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:06 smithi134 ceph-mon[34893]: purged_snaps scrub ok 2024-09-11T23:56:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:06 smithi134 ceph-mon[34893]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:06 smithi134 ceph-mon[34893]: osd.11 [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401] boot 2024-09-11T23:56:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:06 smithi134 ceph-mon[34893]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T23:56:07.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 -- 172.21.15.6:0/1585965548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9381026d0 msgr2=0x7fb938108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 --2- 172.21.15.6:0/1585965548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9381026d0 0x7fb938108f60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb930009ca0 tx=0x7fb93002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:56:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 -- 172.21.15.6:0/1585965548 shutdown_connections 2024-09-11T23:56:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 --2- 172.21.15.6:0/1585965548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9381026d0 0x7fb938108f60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 --2- 172.21.15.6:0/1585965548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb938101d10 0x7fb938102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 --2- 172.21.15.6:0/1585965548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb938100b10 0x7fb938100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 -- 172.21.15.6:0/1585965548 >> 172.21.15.6:0/1585965548 conn(0x7fb9380fc2a0 msgr2=0x7fb9380fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 -- 172.21.15.6:0/1585965548 shutdown_connections 2024-09-11T23:56:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 -- 172.21.15.6:0/1585965548 wait complete. 2024-09-11T23:56:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 Processor -- start 2024-09-11T23:56:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 -- start start 2024-09-11T23:56:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb938100b10 0x7fb93810b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb938101d10 0x7fb938109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9381026d0 0x7fb93810a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb93810d770 con 0x7fb938101d10 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb93810d5f0 con 0x7fb9381026d0 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.530+0000 7fb93f215640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb93810d8f0 con 0x7fb938100b10 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb937fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb938101d10 0x7fb938109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb937fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb938101d10 0x7fb938109ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40082/0 (socket says 172.21.15.6:40082) 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb937fff640 1 -- 172.21.15.6:0/3430659207 learned_addr learned my addr 172.21.15.6:0/3430659207 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb93d7b2640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9381026d0 0x7fb93810a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb93cfb1640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb938100b10 0x7fb93810b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb937fff640 1 -- 172.21.15.6:0/3430659207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb938100b10 msgr2=0x7fb93810b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb937fff640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb938100b10 0x7fb93810b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb937fff640 1 -- 172.21.15.6:0/3430659207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9381026d0 msgr2=0x7fb93810a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb937fff640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9381026d0 0x7fb93810a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb937fff640 1 -- 172.21.15.6:0/3430659207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93810a8e0 con 0x7fb938101d10 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb93d7b2640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9381026d0 0x7fb93810a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb937fff640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb938101d10 0x7fb938109ae0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00d770 tx=0x7fb92c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb935ffb640 1 -- 172.21.15.6:0/3430659207 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c017070 con 0x7fb938101d10 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb93f215640 1 -- 172.21.15.6:0/3430659207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9381a1fa0 con 0x7fb938101d10 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb935ffb640 1 -- 172.21.15.6:0/3430659207 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb92c0054d0 con 0x7fb938101d10 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb935ffb640 1 -- 172.21.15.6:0/3430659207 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c004cf0 con 0x7fb938101d10 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.531+0000 7fb93f215640 1 -- 172.21.15.6:0/3430659207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9381a2400 con 0x7fb938101d10 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.533+0000 7fb93f215640 1 -- 172.21.15.6:0/3430659207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb938107fb0 con 0x7fb938101d10 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.534+0000 7fb935ffb640 1 -- 172.21.15.6:0/3430659207 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fb92c004e90 con 0x7fb938101d10 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.534+0000 7fb935ffb640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb9200a2b80 0x7fb9200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.534+0000 7fb93cfb1640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb9200a2b80 0x7fb9200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.534+0000 7fb935ffb640 1 -- 172.21.15.6:0/3430659207 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb92c0ce570 con 0x7fb938101d10 2024-09-11T23:56:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.535+0000 7fb93cfb1640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb9200a2b80 0x7fb9200a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb928005fd0 tx=0x7fb92800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.539+0000 7fb935ffb640 1 -- 172.21.15.6:0/3430659207 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb92c09b970 con 0x7fb938101d10 2024-09-11T23:56:07.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.716+0000 7fb93f215640 1 -- 172.21.15.6:0/3430659207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb93802d990 con 0x7fb938101d10 2024-09-11T23:56:07.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.717+0000 7fb935ffb640 1 -- 172.21.15.6:0/3430659207 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7fb92c09b270 con 0x7fb938101d10 2024-09-11T23:56:07.717 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.719+0000 7fb93f215640 1 -- 172.21.15.6:0/3430659207 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb9200a2b80 msgr2=0x7fb9200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.719+0000 7fb93f215640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb9200a2b80 0x7fb9200a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb928005fd0 tx=0x7fb92800b410 comp rx=0 tx=0).stop 2024-09-11T23:56:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.719+0000 7fb93f215640 1 -- 172.21.15.6:0/3430659207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb938101d10 msgr2=0x7fb938109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.719+0000 7fb93f215640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb938101d10 0x7fb938109ae0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00d770 tx=0x7fb92c00dc30 comp rx=0 tx=0).stop 2024-09-11T23:56:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.719+0000 7fb93f215640 1 -- 172.21.15.6:0/3430659207 shutdown_connections 2024-09-11T23:56:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.719+0000 7fb93f215640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb9200a2b80 0x7fb9200a5040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.719+0000 7fb93f215640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9381026d0 0x7fb93810a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.719+0000 7fb93f215640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb938101d10 0x7fb938109ae0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.719+0000 7fb93f215640 1 --2- 172.21.15.6:0/3430659207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb938100b10 0x7fb93810b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.719+0000 7fb93f215640 1 -- 172.21.15.6:0/3430659207 >> 172.21.15.6:0/3430659207 conn(0x7fb9380fc2a0 msgr2=0x7fb938105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.719+0000 7fb93f215640 1 -- 172.21.15.6:0/3430659207 shutdown_connections 2024-09-11T23:56:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:07.719+0000 7fb93f215640 1 -- 172.21.15.6:0/3430659207 wait complete. 2024-09-11T23:56:08.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:07 smithi006 ceph-mon[30947]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T23:56:08.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:07 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3430659207' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:08.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:07 smithi134 ceph-mon[34893]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T23:56:08.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:07 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3430659207' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:08.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:07 smithi039 ceph-mon[34543]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T23:56:08.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:07 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3430659207' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726098965,"num_in_osds":12,"osd_in_since":1726098943,"num_remapped_pgs":0} 2024-09-11T23:56:08.486 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:56:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:09.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:08 smithi006 ceph-mon[30947]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:08 smithi134 ceph-mon[34893]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.274+0000 7f28708e9640 1 -- 172.21.15.6:0/106072682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f286c100e20 msgr2=0x7f286c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.274+0000 7f28708e9640 1 --2- 172.21.15.6:0/106072682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f286c100e20 0x7f286c101200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f285c009900 tx=0x7f285c02a480 comp rx=0 tx=0).stop 2024-09-11T23:56:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.274+0000 7f28708e9640 1 -- 172.21.15.6:0/106072682 shutdown_connections 2024-09-11T23:56:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.274+0000 7f28708e9640 1 --2- 172.21.15.6:0/106072682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c102ef0 0x7f286c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.274+0000 7f28708e9640 1 --2- 172.21.15.6:0/106072682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f286c102570 0x7f286c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.274+0000 7f28708e9640 1 --2- 172.21.15.6:0/106072682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f286c100e20 0x7f286c101200 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.274+0000 7f28708e9640 1 -- 172.21.15.6:0/106072682 >> 172.21.15.6:0/106072682 conn(0x7f286c0fc7d0 msgr2=0x7f286c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.274+0000 7f28708e9640 1 -- 172.21.15.6:0/106072682 shutdown_connections 2024-09-11T23:56:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.274+0000 7f28708e9640 1 -- 172.21.15.6:0/106072682 wait complete. 2024-09-11T23:56:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f28708e9640 1 Processor -- start 2024-09-11T23:56:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f28708e9640 1 -- start start 2024-09-11T23:56:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f28708e9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f286c100e20 0x7f286c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f28708e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f286c102570 0x7f286c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f28708e9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c102ef0 0x7f286c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f28708e9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f286c110ed0 con 0x7f286c102570 2024-09-11T23:56:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f28708e9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f286c110d50 con 0x7f286c102ef0 2024-09-11T23:56:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f28708e9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f286c111050 con 0x7f286c100e20 2024-09-11T23:56:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f2869d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f286c102570 0x7f286c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f2869d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f286c102570 0x7f286c198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40098/0 (socket says 172.21.15.6:40098) 2024-09-11T23:56:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f2869d9b640 1 -- 172.21.15.6:0/3275061536 learned_addr learned my addr 172.21.15.6:0/3275061536 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f286ad9d640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c102ef0 0x7f286c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f286a59c640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f286c100e20 0x7f286c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f2869d9b640 1 -- 172.21.15.6:0/3275061536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f286c100e20 msgr2=0x7f286c198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f2869d9b640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f286c100e20 0x7f286c198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f2869d9b640 1 -- 172.21.15.6:0/3275061536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c102ef0 msgr2=0x7f286c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f2869d9b640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c102ef0 0x7f286c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f2869d9b640 1 -- 172.21.15.6:0/3275061536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c19d500 con 0x7f286c102570 2024-09-11T23:56:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.275+0000 7f2869d9b640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f286c102570 0x7f286c198a90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f285400b4a0 tx=0x7f285400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.276+0000 7f28637fe640 1 -- 172.21.15.6:0/3275061536 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854014070 con 0x7f286c102570 2024-09-11T23:56:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.276+0000 7f28637fe640 1 -- 172.21.15.6:0/3275061536 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2854010ac0 con 0x7f286c102570 2024-09-11T23:56:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.276+0000 7f28708e9640 1 -- 172.21.15.6:0/3275061536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286c19d7f0 con 0x7f286c102570 2024-09-11T23:56:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.276+0000 7f28637fe640 1 -- 172.21.15.6:0/3275061536 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854017c30 con 0x7f286c102570 2024-09-11T23:56:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.276+0000 7f28708e9640 1 -- 172.21.15.6:0/3275061536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286c1a50d0 con 0x7f286c102570 2024-09-11T23:56:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.277+0000 7f28708e9640 1 -- 172.21.15.6:0/3275061536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286c101200 con 0x7f286c102570 2024-09-11T23:56:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.278+0000 7f28637fe640 1 -- 172.21.15.6:0/3275061536 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2854017070 con 0x7f286c102570 2024-09-11T23:56:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.279+0000 7f28637fe640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f28580a2c00 0x7f28580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.279+0000 7f286a59c640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f28580a2c00 0x7f28580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.279+0000 7f28637fe640 1 -- 172.21.15.6:0/3275061536 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f28540ce1d0 con 0x7f286c102570 2024-09-11T23:56:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.279+0000 7f286a59c640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f28580a2c00 0x7f28580a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f285c009230 tx=0x7f285c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.282+0000 7f28637fe640 1 -- 172.21.15.6:0/3275061536 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f285409af80 con 0x7f286c102570 2024-09-11T23:56:09.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:08 smithi039 ceph-mon[34543]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.459+0000 7f28708e9640 1 -- 172.21.15.6:0/3275061536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f286c1998b0 con 0x7f286c102570 2024-09-11T23:56:09.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.460+0000 7f28637fe640 1 -- 172.21.15.6:0/3275061536 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18399 (secure 0 0 0) 0x7f286c1998b0 con 0x7f286c102570 2024-09-11T23:56:09.460 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:09.461 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":75,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-11T23:56:06.845897+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:56:09.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.463+0000 7f28708e9640 1 -- 172.21.15.6:0/3275061536 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f28580a2c00 msgr2=0x7f28580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:09.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.463+0000 7f28708e9640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f28580a2c00 0x7f28580a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f285c009230 tx=0x7f285c0058d0 comp rx=0 tx=0).stop 2024-09-11T23:56:09.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.463+0000 7f28708e9640 1 -- 172.21.15.6:0/3275061536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f286c102570 msgr2=0x7f286c198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:09.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.463+0000 7f28708e9640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f286c102570 0x7f286c198a90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f285400b4a0 tx=0x7f285400b960 comp rx=0 tx=0).stop 2024-09-11T23:56:09.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.463+0000 7f28708e9640 1 -- 172.21.15.6:0/3275061536 shutdown_connections 2024-09-11T23:56:09.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.463+0000 7f28708e9640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f28580a2c00 0x7f28580a50c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:09.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.463+0000 7f28708e9640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c102ef0 0x7f286c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:09.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.463+0000 7f28708e9640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f286c102570 0x7f286c198a90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:09.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.463+0000 7f28708e9640 1 --2- 172.21.15.6:0/3275061536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f286c100e20 0x7f286c198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:09.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.463+0000 7f28708e9640 1 -- 172.21.15.6:0/3275061536 >> 172.21.15.6:0/3275061536 conn(0x7f286c0fc7d0 msgr2=0x7f286c06a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:09.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.463+0000 7f28708e9640 1 -- 172.21.15.6:0/3275061536 shutdown_connections 2024-09-11T23:56:09.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:09.463+0000 7f28708e9640 1 -- 172.21.15.6:0/3275061536 wait complete. 2024-09-11T23:56:10.114 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:09 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3275061536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:56:10.145 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:52:17.346320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:56:10.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-11T23:56:10.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:09 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3275061536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:56:10.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:09 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3275061536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:56:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:10.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.887+0000 7f841a5a6640 1 -- 172.21.15.6:0/4101031724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414100e20 msgr2=0x7f8414101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:10.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.887+0000 7f841a5a6640 1 --2- 172.21.15.6:0/4101031724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414100e20 0x7f8414101200 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8404009900 tx=0x7f840402a480 comp rx=0 tx=0).stop 2024-09-11T23:56:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.887+0000 7f841a5a6640 1 -- 172.21.15.6:0/4101031724 shutdown_connections 2024-09-11T23:56:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.887+0000 7f841a5a6640 1 --2- 172.21.15.6:0/4101031724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8414102ef0 0x7f841410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.887+0000 7f841a5a6640 1 --2- 172.21.15.6:0/4101031724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8414102570 0x7f84141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.887+0000 7f841a5a6640 1 --2- 172.21.15.6:0/4101031724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414100e20 0x7f8414101200 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.887+0000 7f841a5a6640 1 -- 172.21.15.6:0/4101031724 >> 172.21.15.6:0/4101031724 conn(0x7f84140fc7d0 msgr2=0x7f84140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.887+0000 7f841a5a6640 1 -- 172.21.15.6:0/4101031724 shutdown_connections 2024-09-11T23:56:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.887+0000 7f841a5a6640 1 -- 172.21.15.6:0/4101031724 wait complete. 2024-09-11T23:56:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f841a5a6640 1 Processor -- start 2024-09-11T23:56:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f841a5a6640 1 -- start start 2024-09-11T23:56:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f841a5a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8414100e20 0x7f8414198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f841a5a6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8414102570 0x7f8414198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f841a5a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414102ef0 0x7f841419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f841a5a6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8414110e30 con 0x7f8414102ef0 2024-09-11T23:56:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f841a5a6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8414110cb0 con 0x7f8414102570 2024-09-11T23:56:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f841a5a6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8414110fb0 con 0x7f8414100e20 2024-09-11T23:56:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f8418b43640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414102ef0 0x7f841419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f8418b43640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414102ef0 0x7f841419cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40850/0 (socket says 172.21.15.6:40850) 2024-09-11T23:56:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f8418b43640 1 -- 172.21.15.6:0/1361208144 learned_addr learned my addr 172.21.15.6:0/1361208144 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f8413fff640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8414100e20 0x7f8414198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f84137fe640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8414102570 0x7f8414198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f8418b43640 1 -- 172.21.15.6:0/1361208144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8414100e20 msgr2=0x7f8414198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f8418b43640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8414100e20 0x7f8414198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f8418b43640 1 -- 172.21.15.6:0/1361208144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8414102570 msgr2=0x7f8414198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f8418b43640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8414102570 0x7f8414198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.888+0000 7f8418b43640 1 -- 172.21.15.6:0/1361208144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841419d3f0 con 0x7f8414102ef0 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.889+0000 7f84137fe640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8414102570 0x7f8414198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.889+0000 7f8418b43640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414102ef0 0x7f841419cd10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f840c00eaa0 tx=0x7f840c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.889+0000 7f84117fa640 1 -- 172.21.15.6:0/1361208144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c00cdb0 con 0x7f8414102ef0 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.889+0000 7f841a5a6640 1 -- 172.21.15.6:0/1361208144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841419d6e0 con 0x7f8414102ef0 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.889+0000 7f84117fa640 1 -- 172.21.15.6:0/1361208144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f840c005020 con 0x7f8414102ef0 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.889+0000 7f84117fa640 1 -- 172.21.15.6:0/1361208144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0116d0 con 0x7f8414102ef0 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.889+0000 7f841a5a6640 1 -- 172.21.15.6:0/1361208144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84141a4fc0 con 0x7f8414102ef0 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.890+0000 7f841a5a6640 1 -- 172.21.15.6:0/1361208144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8414101200 con 0x7f8414102ef0 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.891+0000 7f84117fa640 1 -- 172.21.15.6:0/1361208144 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f840c0051d0 con 0x7f8414102ef0 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.892+0000 7f84117fa640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f83fc0a2b80 0x7f83fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.892+0000 7f8413fff640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f83fc0a2b80 0x7f83fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:10.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.892+0000 7f84117fa640 1 -- 172.21.15.6:0/1361208144 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f840c0cedd0 con 0x7f8414102ef0 2024-09-11T23:56:10.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.892+0000 7f8413fff640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f83fc0a2b80 0x7f83fc0a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8404009230 tx=0x7f84040058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:10.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:10.896+0000 7f84117fa640 1 -- 172.21.15.6:0/1361208144 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f840c016030 con 0x7f8414102ef0 2024-09-11T23:56:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.072+0000 7f841a5a6640 1 -- 172.21.15.6:0/1361208144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f84141a5250 con 0x7f8414102ef0 2024-09-11T23:56:11.072 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:10 smithi006 ceph-mon[30947]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.072+0000 7f84117fa640 1 -- 172.21.15.6:0/1361208144 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f840c09c130 con 0x7f8414102ef0 2024-09-11T23:56:11.072 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-09-11T23:56:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.074+0000 7f841a5a6640 1 -- 172.21.15.6:0/1361208144 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f83fc0a2b80 msgr2=0x7f83fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.074+0000 7f841a5a6640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f83fc0a2b80 0x7f83fc0a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8404009230 tx=0x7f84040058d0 comp rx=0 tx=0).stop 2024-09-11T23:56:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.074+0000 7f841a5a6640 1 -- 172.21.15.6:0/1361208144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414102ef0 msgr2=0x7f841419cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.074+0000 7f841a5a6640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414102ef0 0x7f841419cd10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f840c00eaa0 tx=0x7f840c00ef60 comp rx=0 tx=0).stop 2024-09-11T23:56:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.075+0000 7f841a5a6640 1 -- 172.21.15.6:0/1361208144 shutdown_connections 2024-09-11T23:56:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.075+0000 7f841a5a6640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f83fc0a2b80 0x7f83fc0a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.075+0000 7f841a5a6640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414102ef0 0x7f841419cd10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.075+0000 7f841a5a6640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8414102570 0x7f8414198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.075+0000 7f841a5a6640 1 --2- 172.21.15.6:0/1361208144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8414100e20 0x7f8414198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.075+0000 7f841a5a6640 1 -- 172.21.15.6:0/1361208144 >> 172.21.15.6:0/1361208144 conn(0x7f84140fc7d0 msgr2=0x7f8414069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.075+0000 7f841a5a6640 1 -- 172.21.15.6:0/1361208144 shutdown_connections 2024-09-11T23:56:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:11.075+0000 7f841a5a6640 1 -- 172.21.15.6:0/1361208144 wait complete. 2024-09-11T23:56:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:10 smithi134 ceph-mon[34893]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:11.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:10 smithi039 ceph-mon[34543]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:11.894 INFO:tasks.cephadm:Adding mds.a on smithi006 2024-09-11T23:56:11.894 INFO:tasks.cephadm:Adding mds.d on smithi006 2024-09-11T23:56:11.894 INFO:tasks.cephadm:Adding mds.g on smithi006 2024-09-11T23:56:11.894 INFO:tasks.cephadm:Adding mds.j on smithi006 2024-09-11T23:56:11.895 INFO:tasks.cephadm:Adding mds.b on smithi039 2024-09-11T23:56:11.895 INFO:tasks.cephadm:Adding mds.e on smithi039 2024-09-11T23:56:11.895 INFO:tasks.cephadm:Adding mds.h on smithi039 2024-09-11T23:56:11.895 INFO:tasks.cephadm:Adding mds.k on smithi039 2024-09-11T23:56:11.895 INFO:tasks.cephadm:Adding mds.c on smithi134 2024-09-11T23:56:11.896 INFO:tasks.cephadm:Adding mds.f on smithi134 2024-09-11T23:56:11.896 INFO:tasks.cephadm:Adding mds.i on smithi134 2024-09-11T23:56:11.896 INFO:tasks.cephadm:Adding mds.l on smithi134 2024-09-11T23:56:11.896 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi039=b;smithi039=e;smithi039=h;smithi039=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l' 2024-09-11T23:56:12.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:11 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1361208144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:56:12.155 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:56:12.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:11 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1361208144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:56:12.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:11 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1361208144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:56:12.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.586+0000 7fa369be1640 1 -- 172.21.15.134:0/3576346499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3641037c0 msgr2=0x7fa36410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:12.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.586+0000 7fa369be1640 1 --2- 172.21.15.134:0/3576346499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3641037c0 0x7fa36410a050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009ca0 tx=0x7fa35c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:56:12.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.586+0000 7fa369be1640 1 -- 172.21.15.134:0/3576346499 shutdown_connections 2024-09-11T23:56:12.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.586+0000 7fa369be1640 1 --2- 172.21.15.134:0/3576346499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3641037c0 0x7fa36410a050 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:12.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.586+0000 7fa369be1640 1 --2- 172.21.15.134:0/3576346499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa364102e00 0x7fa364103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:12.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.586+0000 7fa369be1640 1 --2- 172.21.15.134:0/3576346499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa364101c00 0x7fa364102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:12.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.586+0000 7fa369be1640 1 -- 172.21.15.134:0/3576346499 >> 172.21.15.134:0/3576346499 conn(0x7fa3640fd390 msgr2=0x7fa3640ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:12.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.586+0000 7fa369be1640 1 -- 172.21.15.134:0/3576346499 shutdown_connections 2024-09-11T23:56:12.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.586+0000 7fa369be1640 1 -- 172.21.15.134:0/3576346499 wait complete. 2024-09-11T23:56:12.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.587+0000 7fa369be1640 1 Processor -- start 2024-09-11T23:56:12.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.587+0000 7fa369be1640 1 -- start start 2024-09-11T23:56:12.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.587+0000 7fa369be1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa364101c00 0x7fa364197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:12.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.587+0000 7fa369be1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa364102e00 0x7fa364198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:12.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.587+0000 7fa369be1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3641037c0 0x7fa36419f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:12.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.587+0000 7fa369be1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa36410d730 con 0x7fa364102e00 2024-09-11T23:56:12.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.587+0000 7fa369be1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa36410d5b0 con 0x7fa3641037c0 2024-09-11T23:56:12.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.587+0000 7fa369be1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa36410d8b0 con 0x7fa364101c00 2024-09-11T23:56:12.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa3637fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa364101c00 0x7fa364197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:12.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa3637fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa364101c00 0x7fa364197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50662/0 (socket says 172.21.15.134:50662) 2024-09-11T23:56:12.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa3637fe640 1 -- 172.21.15.134:0/3464173518 learned_addr learned my addr 172.21.15.134:0/3464173518 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-11T23:56:12.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa362ffd640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa364102e00 0x7fa364198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:12.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa363fff640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3641037c0 0x7fa36419f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:12.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa3637fe640 1 -- 172.21.15.134:0/3464173518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3641037c0 msgr2=0x7fa36419f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:12.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa3637fe640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3641037c0 0x7fa36419f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:12.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa3637fe640 1 -- 172.21.15.134:0/3464173518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa364102e00 msgr2=0x7fa364198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:12.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa3637fe640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa364102e00 0x7fa364198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:12.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa3637fe640 1 -- 172.21.15.134:0/3464173518 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36419f9f0 con 0x7fa364101c00 2024-09-11T23:56:12.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa362ffd640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa364102e00 0x7fa364198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:12.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa3637fe640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa364101c00 0x7fa364197dc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa35400c970 tx=0x7fa35400ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:12.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa360ff9640 1 -- 172.21.15.134:0/3464173518 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354004220 con 0x7fa364101c00 2024-09-11T23:56:12.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa369be1640 1 -- 172.21.15.134:0/3464173518 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa36419fce0 con 0x7fa364101c00 2024-09-11T23:56:12.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa360ff9640 1 -- 172.21.15.134:0/3464173518 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa3540043c0 con 0x7fa364101c00 2024-09-11T23:56:12.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa360ff9640 1 -- 172.21.15.134:0/3464173518 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354004a00 con 0x7fa364101c00 2024-09-11T23:56:12.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.588+0000 7fa369be1640 1 -- 172.21.15.134:0/3464173518 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3641a0170 con 0x7fa364101c00 2024-09-11T23:56:12.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.589+0000 7fa369be1640 1 -- 172.21.15.134:0/3464173518 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa364109070 con 0x7fa364101c00 2024-09-11T23:56:12.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.591+0000 7fa360ff9640 1 -- 172.21.15.134:0/3464173518 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fa3540079b0 con 0x7fa364101c00 2024-09-11T23:56:12.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.591+0000 7fa360ff9640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa34c0a2bb0 0x7fa34c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:12.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.592+0000 7fa360ff9640 1 -- 172.21.15.134:0/3464173518 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fa3540cee50 con 0x7fa364101c00 2024-09-11T23:56:12.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.592+0000 7fa362ffd640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa34c0a2bb0 0x7fa34c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:12.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.592+0000 7fa362ffd640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa34c0a2bb0 0x7fa34c0a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3580058c0 tx=0x7fa358005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:12.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.595+0000 7fa360ff9640 1 -- 172.21.15.134:0/3464173518 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa354014030 con 0x7fa364101c00 2024-09-11T23:56:12.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.771+0000 7fa369be1640 1 -- 172.21.15.134:0/3464173518 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi039=b;smithi039=e;smithi039=h;smithi039=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l", "target": ["mon-mgr", ""]}) -- 0x7fa364062730 con 0x7fa34c0a2bb0 2024-09-11T23:56:12.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.780+0000 7fa360ff9640 1 -- 172.21.15.134:0/3464173518 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fa364062730 con 0x7fa34c0a2bb0 2024-09-11T23:56:12.780 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mds.all update... 2024-09-11T23:56:12.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.782+0000 7fa369be1640 1 -- 172.21.15.134:0/3464173518 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa34c0a2bb0 msgr2=0x7fa34c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:12.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.782+0000 7fa369be1640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa34c0a2bb0 0x7fa34c0a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3580058c0 tx=0x7fa358005850 comp rx=0 tx=0).stop 2024-09-11T23:56:12.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.782+0000 7fa369be1640 1 -- 172.21.15.134:0/3464173518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa364101c00 msgr2=0x7fa364197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:12.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.782+0000 7fa369be1640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa364101c00 0x7fa364197dc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa35400c970 tx=0x7fa35400ce30 comp rx=0 tx=0).stop 2024-09-11T23:56:12.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.782+0000 7fa369be1640 1 -- 172.21.15.134:0/3464173518 shutdown_connections 2024-09-11T23:56:12.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.782+0000 7fa369be1640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa34c0a2bb0 0x7fa34c0a5070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:12.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.782+0000 7fa369be1640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3641037c0 0x7fa36419f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:12.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.782+0000 7fa369be1640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa364102e00 0x7fa364198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:12.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.782+0000 7fa369be1640 1 --2- 172.21.15.134:0/3464173518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa364101c00 0x7fa364197dc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:12.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.782+0000 7fa369be1640 1 -- 172.21.15.134:0/3464173518 >> 172.21.15.134:0/3464173518 conn(0x7fa3640fd390 msgr2=0x7fa364106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:12.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.782+0000 7fa369be1640 1 -- 172.21.15.134:0/3464173518 shutdown_connections 2024-09-11T23:56:12.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-11T23:56:12.782+0000 7fa369be1640 1 -- 172.21.15.134:0/3464173518 wait complete. 2024-09-11T23:56:13.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:12 smithi006 ceph-mon[30947]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:13.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:12 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:13.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:12 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:13.195 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:12 smithi039 ceph-mon[34543]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:13.195 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:12 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:13.195 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:12 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:12 smithi134 ceph-mon[34893]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:12 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:12 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:13.455 DEBUG:teuthology.orchestra.run.smithi006:mds.a> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.a.service 2024-09-11T23:56:13.458 DEBUG:teuthology.orchestra.run.smithi006:mds.d> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.d.service 2024-09-11T23:56:13.501 DEBUG:teuthology.orchestra.run.smithi006:mds.g> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.g.service 2024-09-11T23:56:13.544 DEBUG:teuthology.orchestra.run.smithi006:mds.j> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.j.service 2024-09-11T23:56:13.588 DEBUG:teuthology.orchestra.run.smithi039:mds.b> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.b.service 2024-09-11T23:56:13.590 DEBUG:teuthology.orchestra.run.smithi039:mds.e> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.e.service 2024-09-11T23:56:13.635 DEBUG:teuthology.orchestra.run.smithi039:mds.h> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.h.service 2024-09-11T23:56:13.678 DEBUG:teuthology.orchestra.run.smithi039:mds.k> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.k.service 2024-09-11T23:56:13.721 DEBUG:teuthology.orchestra.run.smithi134:mds.c> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.c.service 2024-09-11T23:56:13.723 DEBUG:teuthology.orchestra.run.smithi134:mds.f> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.f.service 2024-09-11T23:56:13.766 DEBUG:teuthology.orchestra.run.smithi134:mds.i> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.i.service 2024-09-11T23:56:13.809 DEBUG:teuthology.orchestra.run.smithi134:mds.l> sudo journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.l.service 2024-09-11T23:56:13.852 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-11T23:56:13.852 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:14.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:13 smithi039 ceph-mon[34543]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi039=b;smithi039=e;smithi039=h;smithi039=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:56:14.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:13 smithi039 ceph-mon[34543]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi039=b;smithi039=e;smithi039=h;smithi039=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l;count:12 2024-09-11T23:56:14.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:13 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:14.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:13 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:14.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:13 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:14.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:13 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:14.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:13 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:14.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:13 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:14.112 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:14.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:13 smithi134 ceph-mon[34893]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi039=b;smithi039=e;smithi039=h;smithi039=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:56:14.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:13 smithi134 ceph-mon[34893]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi039=b;smithi039=e;smithi039=h;smithi039=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l;count:12 2024-09-11T23:56:14.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:13 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:14.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:13 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:14.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:13 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:14.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:13 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:14.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:13 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:14.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:13 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:14.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:13 smithi006 ceph-mon[30947]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi039=b;smithi039=e;smithi039=h;smithi039=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:56:14.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:13 smithi006 ceph-mon[30947]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi039=b;smithi039=e;smithi039=h;smithi039=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l;count:12 2024-09-11T23:56:14.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:13 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:14.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:13 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:14.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:13 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:14.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:13 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:14.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:13 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:14.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:13 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.625+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2882600618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c8102790 msgr2=0x7fb8c81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.625+0000 7fb8cd04c640 1 --2- 172.21.15.6:0/2882600618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c8102790 0x7fb8c81067e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009900 tx=0x7fb8b002a3f0 comp rx=0 tx=0).stop 2024-09-11T23:56:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.625+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2882600618 shutdown_connections 2024-09-11T23:56:14.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.625+0000 7fb8cd04c640 1 --2- 172.21.15.6:0/2882600618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c8106f10 0x7fb8c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:14.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.625+0000 7fb8cd04c640 1 --2- 172.21.15.6:0/2882600618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c8102790 0x7fb8c81067e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:14.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.625+0000 7fb8cd04c640 1 --2- 172.21.15.6:0/2882600618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8c8101de0 0x7fb8c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:14.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.625+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2882600618 >> 172.21.15.6:0/2882600618 conn(0x7fb8c80fd8c0 msgr2=0x7fb8c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:14.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.625+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2882600618 shutdown_connections 2024-09-11T23:56:14.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.625+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2882600618 wait complete. 2024-09-11T23:56:14.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.626+0000 7fb8cd04c640 1 Processor -- start 2024-09-11T23:56:14.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.626+0000 7fb8cd04c640 1 -- start start 2024-09-11T23:56:14.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.626+0000 7fb8cd04c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8c8101de0 0x7fb8c80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:14.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.626+0000 7fb8cd04c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c8102790 0x7fb8c8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:14.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.626+0000 7fb8cd04c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c8106f10 0x7fb8c8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:14.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.626+0000 7fb8cd04c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c8111e70 con 0x7fb8c8102790 2024-09-11T23:56:14.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.626+0000 7fb8cd04c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c8111cf0 con 0x7fb8c8106f10 2024-09-11T23:56:14.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.626+0000 7fb8cd04c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c8111ff0 con 0x7fb8c8101de0 2024-09-11T23:56:14.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8c659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c8102790 0x7fb8c8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:14.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8c659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c8102790 0x7fb8c8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40882/0 (socket says 172.21.15.6:40882) 2024-09-11T23:56:14.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8c659c640 1 -- 172.21.15.6:0/2507055466 learned_addr learned my addr 172.21.15.6:0/2507055466 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:14.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8c759e640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c8106f10 0x7fb8c8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:14.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8c6d9d640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8c8101de0 0x7fb8c80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:14.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8c659c640 1 -- 172.21.15.6:0/2507055466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8c8101de0 msgr2=0x7fb8c80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:14.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8c659c640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8c8101de0 0x7fb8c80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:14.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8c659c640 1 -- 172.21.15.6:0/2507055466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c8106f10 msgr2=0x7fb8c8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:14.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8c659c640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c8106f10 0x7fb8c8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:14.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8c659c640 1 -- 172.21.15.6:0/2507055466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c81a67b0 con 0x7fb8c8102790 2024-09-11T23:56:14.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8c659c640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c8102790 0x7fb8c8074a30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0005ab0 tx=0x7fb8b0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:14.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8bffff640 1 -- 172.21.15.6:0/2507055466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b003f070 con 0x7fb8c8102790 2024-09-11T23:56:14.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2507055466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c81a6a40 con 0x7fb8c8102790 2024-09-11T23:56:14.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8bffff640 1 -- 172.21.15.6:0/2507055466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb8b0031d60 con 0x7fb8c8102790 2024-09-11T23:56:14.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8bffff640 1 -- 172.21.15.6:0/2507055466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0035030 con 0x7fb8c8102790 2024-09-11T23:56:14.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.627+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2507055466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c81a6f20 con 0x7fb8c8102790 2024-09-11T23:56:14.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.628+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2507055466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8c81021c0 con 0x7fb8c8102790 2024-09-11T23:56:14.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.629+0000 7fb8bffff640 1 -- 172.21.15.6:0/2507055466 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fb8b0042070 con 0x7fb8c8102790 2024-09-11T23:56:14.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.630+0000 7fb8bffff640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb8b40a2b80 0x7fb8b40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:14.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.630+0000 7fb8c6d9d640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb8b40a2b80 0x7fb8b40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:14.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.630+0000 7fb8bffff640 1 -- 172.21.15.6:0/2507055466 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb8b00ef3f0 con 0x7fb8c8102790 2024-09-11T23:56:14.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.631+0000 7fb8c6d9d640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb8b40a2b80 0x7fb8b40a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800bbe0 tx=0x7fb8b800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:14.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.634+0000 7fb8bffff640 1 -- 172.21.15.6:0/2507055466 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb8b00bc1a0 con 0x7fb8c8102790 2024-09-11T23:56:14.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.843+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2507055466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8c810a150 con 0x7fb8c8102790 2024-09-11T23:56:14.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.844+0000 7fb8bffff640 1 -- 172.21.15.6:0/2507055466 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fb8b00c04a0 con 0x7fb8c8102790 2024-09-11T23:56:14.844 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:14.844 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":1,"btime":"2024-09-11T23:49:14:063630+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-11T23:56:14.844 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 1 2024-09-11T23:56:14.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.846+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2507055466 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb8b40a2b80 msgr2=0x7fb8b40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:14.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.846+0000 7fb8cd04c640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb8b40a2b80 0x7fb8b40a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800bbe0 tx=0x7fb8b800b390 comp rx=0 tx=0).stop 2024-09-11T23:56:14.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.846+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2507055466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c8102790 msgr2=0x7fb8c8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:14.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.846+0000 7fb8cd04c640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c8102790 0x7fb8c8074a30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0005ab0 tx=0x7fb8b0003cd0 comp rx=0 tx=0).stop 2024-09-11T23:56:14.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.846+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2507055466 shutdown_connections 2024-09-11T23:56:14.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.846+0000 7fb8cd04c640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb8b40a2b80 0x7fb8b40a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:14.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.846+0000 7fb8cd04c640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c8106f10 0x7fb8c8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:14.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.846+0000 7fb8cd04c640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c8102790 0x7fb8c8074a30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:14.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.846+0000 7fb8cd04c640 1 --2- 172.21.15.6:0/2507055466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8c8101de0 0x7fb8c80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:14.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.846+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2507055466 >> 172.21.15.6:0/2507055466 conn(0x7fb8c80fd8c0 msgr2=0x7fb8c80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:14.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.846+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2507055466 shutdown_connections 2024-09-11T23:56:14.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:14.846+0000 7fb8cd04c640 1 -- 172.21.15.6:0/2507055466 wait complete. 2024-09-11T23:56:15.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:14 smithi006 ceph-mon[30947]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:15.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:14 smithi006 ceph-mon[30947]: Deploying daemon mds.l on smithi134 2024-09-11T23:56:15.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:14 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2507055466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:15.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:14 smithi134 ceph-mon[34893]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:15.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:14 smithi134 ceph-mon[34893]: Deploying daemon mds.l on smithi134 2024-09-11T23:56:15.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:14 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2507055466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:15.204 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 11 23:56:15 smithi134 systemd[1]: Starting Ceph mds.l for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:15.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:14 smithi039 ceph-mon[34543]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:15.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:14 smithi039 ceph-mon[34543]: Deploying daemon mds.l on smithi134 2024-09-11T23:56:15.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:14 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2507055466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:15.572 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 11 23:56:15 smithi134 podman[64717]: 2024-09-11 23:56:15.216174166 +0000 UTC m=+0.016484733 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:15.572 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 11 23:56:15 smithi134 podman[64717]: 2024-09-11 23:56:15.329271543 +0000 UTC m=+0.129582107 container create 750e15f3a5c661915950d36da8bf4e42defdc5ee60563e474af02bfcb0842d35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:56:15.573 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 11 23:56:15 smithi134 podman[64717]: 2024-09-11 23:56:15.573919354 +0000 UTC m=+0.374229923 container init 750e15f3a5c661915950d36da8bf4e42defdc5ee60563e474af02bfcb0842d35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:56:15.953 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 11 23:56:15 smithi134 podman[64717]: 2024-09-11 23:56:15.576764881 +0000 UTC m=+0.377075453 container start 750e15f3a5c661915950d36da8bf4e42defdc5ee60563e474af02bfcb0842d35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:56:15.953 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 11 23:56:15 smithi134 ceph-mds[64736]: -- 172.21.15.134:0/1979571773 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d53e4d5860 con 0x55d53e4b3000 2024-09-11T23:56:15.953 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 11 23:56:15 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l[64732]: starting mds.l at 2024-09-11T23:56:15.953 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 11 23:56:15 smithi134 bash[64717]: 750e15f3a5c661915950d36da8bf4e42defdc5ee60563e474af02bfcb0842d35 2024-09-11T23:56:15.953 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 11 23:56:15 smithi134 systemd[1]: Started Ceph mds.l for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:16 smithi039 ceph-mon[34543]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:16 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.134:6832/3891726228,v1:172.21.15.134:6833/3891726228] up:boot 2024-09-11T23:56:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:16 smithi039 ceph-mon[34543]: fsmap 1 up:standby 2024-09-11T23:56:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:56:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:16.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:16.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:16 smithi039 ceph-mon[34543]: Deploying daemon mds.k on smithi039 2024-09-11T23:56:16.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:16 smithi006 ceph-mon[30947]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:16 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.134:6832/3891726228,v1:172.21.15.134:6833/3891726228] up:boot 2024-09-11T23:56:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:16 smithi006 ceph-mon[30947]: fsmap 1 up:standby 2024-09-11T23:56:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:56:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:16.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:16 smithi006 ceph-mon[30947]: Deploying daemon mds.k on smithi039 2024-09-11T23:56:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:16 smithi134 ceph-mon[34893]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:16 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.134:6832/3891726228,v1:172.21.15.134:6833/3891726228] up:boot 2024-09-11T23:56:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:16 smithi134 ceph-mon[34893]: fsmap 1 up:standby 2024-09-11T23:56:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:56:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:16.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:16.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:16.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:16.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:16.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:16 smithi134 ceph-mon[34893]: Deploying daemon mds.k on smithi039 2024-09-11T23:56:17.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:18.044 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 11 23:56:17 smithi039 systemd[1]: Starting Ceph mds.k for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:18.455 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 11 23:56:18 smithi039 podman[64023]: 2024-09-11 23:56:18.094658698 +0000 UTC m=+0.016377279 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:18.455 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 11 23:56:18 smithi039 podman[64023]: 2024-09-11 23:56:18.211398702 +0000 UTC m=+0.133117316 container create 0897b5e624143833118cb4d1fb0ed29251f1ad5d42a30e04121bb8f99db15401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-11T23:56:18.455 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 11 23:56:18 smithi039 podman[64023]: 2024-09-11 23:56:18.455824787 +0000 UTC m=+0.377543355 container init 0897b5e624143833118cb4d1fb0ed29251f1ad5d42a30e04121bb8f99db15401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-k, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T23:56:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.445+0000 7ff86ab12640 1 -- 172.21.15.6:0/2445666072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864100a80 msgr2=0x7ff864100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.445+0000 7ff86ab12640 1 --2- 172.21.15.6:0/2445666072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864100a80 0x7ff864100ee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009cd0 tx=0x7ff84c02a8e0 comp rx=0 tx=0).stop 2024-09-11T23:56:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.445+0000 7ff86ab12640 1 -- 172.21.15.6:0/2445666072 shutdown_connections 2024-09-11T23:56:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.445+0000 7ff86ab12640 1 --2- 172.21.15.6:0/2445666072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff864101420 0x7ff86410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.445+0000 7ff86ab12640 1 --2- 172.21.15.6:0/2445666072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864100a80 0x7ff864100ee0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.445+0000 7ff86ab12640 1 --2- 172.21.15.6:0/2445666072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff864106a80 0x7ff864106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.445+0000 7ff86ab12640 1 -- 172.21.15.6:0/2445666072 >> 172.21.15.6:0/2445666072 conn(0x7ff8640fc7a0 msgr2=0x7ff8640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.445+0000 7ff86ab12640 1 -- 172.21.15.6:0/2445666072 shutdown_connections 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.445+0000 7ff86ab12640 1 -- 172.21.15.6:0/2445666072 wait complete. 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.446+0000 7ff86ab12640 1 Processor -- start 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.446+0000 7ff86ab12640 1 -- start start 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.446+0000 7ff86ab12640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff864100a80 0x7ff8641983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.446+0000 7ff86ab12640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff864101420 0x7ff864198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.446+0000 7ff86ab12640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864106a80 0x7ff86419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.446+0000 7ff86ab12640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff864111e50 con 0x7ff864106a80 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.446+0000 7ff86ab12640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff864111cd0 con 0x7ff864101420 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.446+0000 7ff86ab12640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff864111fd0 con 0x7ff864100a80 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.446+0000 7ff8690af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864106a80 0x7ff86419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.446+0000 7ff8690af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864106a80 0x7ff86419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40896/0 (socket says 172.21.15.6:40896) 2024-09-11T23:56:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.446+0000 7ff8690af640 1 -- 172.21.15.6:0/1678020964 learned_addr learned my addr 172.21.15.6:0/1678020964 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff863fff640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff864101420 0x7ff864198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff8688ae640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff864100a80 0x7ff8641983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff8690af640 1 -- 172.21.15.6:0/1678020964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff864100a80 msgr2=0x7ff8641983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff8690af640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff864100a80 0x7ff8641983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff8690af640 1 -- 172.21.15.6:0/1678020964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff864101420 msgr2=0x7ff864198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff8690af640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff864101420 0x7ff864198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff8690af640 1 -- 172.21.15.6:0/1678020964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86419d3a0 con 0x7ff864106a80 2024-09-11T23:56:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff863fff640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff864101420 0x7ff864198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff8690af640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864106a80 0x7ff86419ccc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00c970 tx=0x7ff85c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff861ffb640 1 -- 172.21.15.6:0/1678020964 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c007bb0 con 0x7ff864106a80 2024-09-11T23:56:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff861ffb640 1 -- 172.21.15.6:0/1678020964 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff85c007d50 con 0x7ff864106a80 2024-09-11T23:56:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff86ab12640 1 -- 172.21.15.6:0/1678020964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86419d690 con 0x7ff864106a80 2024-09-11T23:56:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff861ffb640 1 -- 172.21.15.6:0/1678020964 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c004e10 con 0x7ff864106a80 2024-09-11T23:56:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.447+0000 7ff86ab12640 1 -- 172.21.15.6:0/1678020964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8641a4f70 con 0x7ff864106a80 2024-09-11T23:56:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.448+0000 7ff86ab12640 1 -- 172.21.15.6:0/1678020964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff864100ee0 con 0x7ff864106a80 2024-09-11T23:56:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.449+0000 7ff861ffb640 1 -- 172.21.15.6:0/1678020964 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff85c005020 con 0x7ff864106a80 2024-09-11T23:56:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.450+0000 7ff861ffb640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff8500a2c00 0x7ff8500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.450+0000 7ff861ffb640 1 -- 172.21.15.6:0/1678020964 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7ff85c0ce8a0 con 0x7ff864106a80 2024-09-11T23:56:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.450+0000 7ff8688ae640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff8500a2c00 0x7ff8500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.450+0000 7ff8688ae640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff8500a2c00 0x7ff8500a50c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff854005fd0 tx=0x7ff854005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.454+0000 7ff861ffb640 1 -- 172.21.15.6:0/1678020964 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff85c014030 con 0x7ff864106a80 2024-09-11T23:56:18.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:18 smithi006 ceph-mon[30947]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:18.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.668+0000 7ff86ab12640 1 -- 172.21.15.6:0/1678020964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff864109050 con 0x7ff864106a80 2024-09-11T23:56:18.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.669+0000 7ff861ffb640 1 -- 172.21.15.6:0/1678020964 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7ff85c09bca0 con 0x7ff864106a80 2024-09-11T23:56:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:18.669 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"btime":"2024-09-11T23:56:18:609426+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:56:18.669 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2024-09-11T23:56:18.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.672+0000 7ff86ab12640 1 -- 172.21.15.6:0/1678020964 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff8500a2c00 msgr2=0x7ff8500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.672+0000 7ff86ab12640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff8500a2c00 0x7ff8500a50c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff854005fd0 tx=0x7ff854005850 comp rx=0 tx=0).stop 2024-09-11T23:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.672+0000 7ff86ab12640 1 -- 172.21.15.6:0/1678020964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864106a80 msgr2=0x7ff86419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.672+0000 7ff86ab12640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864106a80 0x7ff86419ccc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00c970 tx=0x7ff85c00ce30 comp rx=0 tx=0).stop 2024-09-11T23:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.672+0000 7ff86ab12640 1 -- 172.21.15.6:0/1678020964 shutdown_connections 2024-09-11T23:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.672+0000 7ff86ab12640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff8500a2c00 0x7ff8500a50c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.672+0000 7ff86ab12640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864106a80 0x7ff86419ccc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.672+0000 7ff86ab12640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff864101420 0x7ff864198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.672+0000 7ff86ab12640 1 --2- 172.21.15.6:0/1678020964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff864100a80 0x7ff8641983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.672+0000 7ff86ab12640 1 -- 172.21.15.6:0/1678020964 >> 172.21.15.6:0/1678020964 conn(0x7ff8640fc7a0 msgr2=0x7ff8640fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.673+0000 7ff86ab12640 1 -- 172.21.15.6:0/1678020964 shutdown_connections 2024-09-11T23:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:18.673+0000 7ff86ab12640 1 -- 172.21.15.6:0/1678020964 wait complete. 2024-09-11T23:56:18.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:18 smithi039 ceph-mon[34543]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:18.794 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 11 23:56:18 smithi039 podman[64023]: 2024-09-11 23:56:18.459116566 +0000 UTC m=+0.380835143 container start 0897b5e624143833118cb4d1fb0ed29251f1ad5d42a30e04121bb8f99db15401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-k, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-11T23:56:18.794 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 11 23:56:18 smithi039 ceph-mds[64042]: -- 172.21.15.39:0/2065493972 <== mon.2 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5572c5671c20 con 0x5572c564f400 2024-09-11T23:56:18.794 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 11 23:56:18 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-k[64038]: starting mds.k at 2024-09-11T23:56:18.794 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 11 23:56:18 smithi039 bash[64023]: 0897b5e624143833118cb4d1fb0ed29251f1ad5d42a30e04121bb8f99db15401 2024-09-11T23:56:18.794 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 11 23:56:18 smithi039 systemd[1]: Started Ceph mds.k for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:18.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:18 smithi134 ceph-mon[34893]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:19.847 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:19 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.39:6832/3540998066,v1:172.21.15.39:6833/3540998066] up:boot 2024-09-11T23:56:19.847 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:19 smithi006 ceph-mon[30947]: fsmap 2 up:standby 2024-09-11T23:56:19.847 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:56:19.847 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:19.847 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:19.848 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:19.848 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:19.848 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:19.848 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:19 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:19.848 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:19 smithi006 ceph-mon[30947]: Deploying daemon mds.j on smithi006 2024-09-11T23:56:19.848 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:19 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1678020964' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:19.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:19 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.39:6832/3540998066,v1:172.21.15.39:6833/3540998066] up:boot 2024-09-11T23:56:19.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:19 smithi134 ceph-mon[34893]: fsmap 2 up:standby 2024-09-11T23:56:19.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:56:19.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:19.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:19.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:19.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:19.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:19.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:19 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:19.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:19 smithi134 ceph-mon[34893]: Deploying daemon mds.j on smithi006 2024-09-11T23:56:19.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:19 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1678020964' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:20.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:19 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.39:6832/3540998066,v1:172.21.15.39:6833/3540998066] up:boot 2024-09-11T23:56:20.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:19 smithi039 ceph-mon[34543]: fsmap 2 up:standby 2024-09-11T23:56:20.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:56:20.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:20.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:20.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:20.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:20.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:20.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:19 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:20.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:19 smithi039 ceph-mon[34543]: Deploying daemon mds.j on smithi006 2024-09-11T23:56:20.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:19 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1678020964' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:20.829 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:20 smithi006 ceph-mon[30947]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:20.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:20 smithi134 ceph-mon[34893]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:21.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:20 smithi039 ceph-mon[34543]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:21.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:21.537 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 11 23:56:21 smithi006 systemd[1]: Starting Ceph mds.j for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:21.820 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 11 23:56:21 smithi006 podman[70954]: 2024-09-11 23:56:21.441605916 +0000 UTC m=+0.016419265 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:21.821 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 11 23:56:21 smithi006 podman[70954]: 2024-09-11 23:56:21.566080458 +0000 UTC m=+0.140893806 container create d581500acb011c572a0bd8a3cf991febea49b9b0341ead764e7d78302f5476b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T23:56:21.821 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 11 23:56:21 smithi006 podman[70954]: 2024-09-11 23:56:21.819302308 +0000 UTC m=+0.394115656 container init d581500acb011c572a0bd8a3cf991febea49b9b0341ead764e7d78302f5476b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-j, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T23:56:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:22.118 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 11 23:56:21 smithi006 podman[70954]: 2024-09-11 23:56:21.822524181 +0000 UTC m=+0.397337532 container start d581500acb011c572a0bd8a3cf991febea49b9b0341ead764e7d78302f5476b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-j, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-11T23:56:22.119 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 11 23:56:21 smithi006 ceph-mds[71002]: -- 172.21.15.6:0/4294236044 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b254c99860 con 0x55b254c77000 2024-09-11T23:56:22.119 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 11 23:56:21 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-j[70987]: starting mds.j at 2024-09-11T23:56:22.119 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 11 23:56:21 smithi006 bash[70954]: d581500acb011c572a0bd8a3cf991febea49b9b0341ead764e7d78302f5476b8 2024-09-11T23:56:22.119 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 11 23:56:21 smithi006 systemd[1]: Started Ceph mds.j for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.522+0000 7f52eed97640 1 -- 172.21.15.6:0/1873784289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e8102790 msgr2=0x7f52e81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.522+0000 7f52eed97640 1 --2- 172.21.15.6:0/1873784289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e8102790 0x7f52e81067e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009900 tx=0x7f52d802a410 comp rx=0 tx=0).stop 2024-09-11T23:56:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.522+0000 7f52eed97640 1 -- 172.21.15.6:0/1873784289 shutdown_connections 2024-09-11T23:56:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.522+0000 7f52eed97640 1 --2- 172.21.15.6:0/1873784289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e8106f10 0x7f52e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.522+0000 7f52eed97640 1 --2- 172.21.15.6:0/1873784289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e8102790 0x7f52e81067e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.522+0000 7f52eed97640 1 --2- 172.21.15.6:0/1873784289 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52e8101de0 0x7f52e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.522+0000 7f52eed97640 1 -- 172.21.15.6:0/1873784289 >> 172.21.15.6:0/1873784289 conn(0x7f52e80fd8c0 msgr2=0x7f52e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.522+0000 7f52eed97640 1 -- 172.21.15.6:0/1873784289 shutdown_connections 2024-09-11T23:56:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.522+0000 7f52eed97640 1 -- 172.21.15.6:0/1873784289 wait complete. 2024-09-11T23:56:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.523+0000 7f52eed97640 1 Processor -- start 2024-09-11T23:56:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.523+0000 7f52eed97640 1 -- start start 2024-09-11T23:56:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.523+0000 7f52eed97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e8101de0 0x7f52e8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.523+0000 7f52eed97640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e8102790 0x7f52e81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.523+0000 7f52eed97640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52e8106f10 0x7f52e819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.523+0000 7f52eed97640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f52e8111e20 con 0x7f52e8101de0 2024-09-11T23:56:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.523+0000 7f52eed97640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f52e8111ca0 con 0x7f52e8106f10 2024-09-11T23:56:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.523+0000 7f52eed97640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52e8111fa0 con 0x7f52e8102790 2024-09-11T23:56:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.523+0000 7f52ecb33640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e8101de0 0x7f52e8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.523+0000 7f52ecb33640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e8101de0 0x7f52e8198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37700/0 (socket says 172.21.15.6:37700) 2024-09-11T23:56:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.523+0000 7f52ecb33640 1 -- 172.21.15.6:0/2463207323 learned_addr learned my addr 172.21.15.6:0/2463207323 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52ed334640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52e8106f10 0x7f52e819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52dffff640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e8102790 0x7f52e81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52ecb33640 1 -- 172.21.15.6:0/2463207323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e8102790 msgr2=0x7f52e81988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52ecb33640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e8102790 0x7f52e81988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52ecb33640 1 -- 172.21.15.6:0/2463207323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52e8106f10 msgr2=0x7f52e819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52ecb33640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52e8106f10 0x7f52e819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52ecb33640 1 -- 172.21.15.6:0/2463207323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e819d310 con 0x7f52e8101de0 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52ecb33640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e8101de0 0x7f52e8198360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f52e400d950 tx=0x7f52e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52ddffb640 1 -- 172.21.15.6:0/2463207323 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4017070 con 0x7f52e8101de0 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52eed97640 1 -- 172.21.15.6:0/2463207323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e819d600 con 0x7f52e8101de0 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52ddffb640 1 -- 172.21.15.6:0/2463207323 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f52e4009c30 con 0x7f52e8101de0 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52ddffb640 1 -- 172.21.15.6:0/2463207323 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e400f620 con 0x7f52e8101de0 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.524+0000 7f52eed97640 1 -- 172.21.15.6:0/2463207323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e81a4ee0 con 0x7f52e8101de0 2024-09-11T23:56:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.525+0000 7f52eed97640 1 -- 172.21.15.6:0/2463207323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e81021c0 con 0x7f52e8101de0 2024-09-11T23:56:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.526+0000 7f52ddffb640 1 -- 172.21.15.6:0/2463207323 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f52e40109a0 con 0x7f52e8101de0 2024-09-11T23:56:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.527+0000 7f52ddffb640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f52d00a2b80 0x7f52d00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.527+0000 7f52ddffb640 1 -- 172.21.15.6:0/2463207323 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f52e40ce890 con 0x7f52e8101de0 2024-09-11T23:56:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.527+0000 7f52dffff640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f52d00a2b80 0x7f52d00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.528+0000 7f52dffff640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f52d00a2b80 0x7f52d00a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f52d8006010 tx=0x7f52d8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.531+0000 7f52ddffb640 1 -- 172.21.15.6:0/2463207323 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52e4009de0 con 0x7f52e8101de0 2024-09-11T23:56:22.714 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:22 smithi006 ceph-mon[30947]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:22.714 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:22 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:22.714 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:22 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:22.714 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:22 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:22.715 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:22 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:22.715 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:22 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:22.715 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:22 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.752+0000 7f52eed97640 1 -- 172.21.15.6:0/2463207323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52e810a0f0 con 0x7f52e8101de0 2024-09-11T23:56:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.753+0000 7f52ddffb640 1 -- 172.21.15.6:0/2463207323 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f52e409bc90 con 0x7f52e8101de0 2024-09-11T23:56:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:22.753 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":4,"btime":"2024-09-11T23:56:22:640345+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:56:22.753 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 4 2024-09-11T23:56:22.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.755+0000 7f52eed97640 1 -- 172.21.15.6:0/2463207323 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f52d00a2b80 msgr2=0x7f52d00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:22.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.755+0000 7f52eed97640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f52d00a2b80 0x7f52d00a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f52d8006010 tx=0x7f52d8000bc0 comp rx=0 tx=0).stop 2024-09-11T23:56:22.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.755+0000 7f52eed97640 1 -- 172.21.15.6:0/2463207323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e8101de0 msgr2=0x7f52e8198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:22.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.755+0000 7f52eed97640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e8101de0 0x7f52e8198360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f52e400d950 tx=0x7f52e400de10 comp rx=0 tx=0).stop 2024-09-11T23:56:22.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.755+0000 7f52eed97640 1 -- 172.21.15.6:0/2463207323 shutdown_connections 2024-09-11T23:56:22.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.755+0000 7f52eed97640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f52d00a2b80 0x7f52d00a5040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:22.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.755+0000 7f52eed97640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52e8106f10 0x7f52e819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:22.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.755+0000 7f52eed97640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e8102790 0x7f52e81988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:22.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.755+0000 7f52eed97640 1 --2- 172.21.15.6:0/2463207323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e8101de0 0x7f52e8198360 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:22.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.755+0000 7f52eed97640 1 -- 172.21.15.6:0/2463207323 >> 172.21.15.6:0/2463207323 conn(0x7f52e80fd8c0 msgr2=0x7f52e80fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:22.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.755+0000 7f52eed97640 1 -- 172.21.15.6:0/2463207323 shutdown_connections 2024-09-11T23:56:22.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:22.755+0000 7f52eed97640 1 -- 172.21.15.6:0/2463207323 wait complete. 2024-09-11T23:56:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:22 smithi134 ceph-mon[34893]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:22 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:22 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:22 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:22 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:22 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:22.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:22 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:23.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:22 smithi039 ceph-mon[34543]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:23.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:22 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:23.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:22 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:23.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:22 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:23.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:22 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:23.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:22 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:23.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:22 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:23.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:23 smithi006 ceph-mon[30947]: Deploying daemon mds.d on smithi006 2024-09-11T23:56:23.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:23 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.6:6834/3405315500,v1:172.21.15.6:6835/3405315500] up:boot 2024-09-11T23:56:23.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:23 smithi006 ceph-mon[30947]: fsmap 3 up:standby 2024-09-11T23:56:23.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:56:23.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:23 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2463207323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:23.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:23 smithi134 ceph-mon[34893]: Deploying daemon mds.d on smithi006 2024-09-11T23:56:23.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:23 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.6:6834/3405315500,v1:172.21.15.6:6835/3405315500] up:boot 2024-09-11T23:56:23.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:23 smithi134 ceph-mon[34893]: fsmap 3 up:standby 2024-09-11T23:56:23.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:56:23.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:23 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2463207323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:24.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:23 smithi039 ceph-mon[34543]: Deploying daemon mds.d on smithi006 2024-09-11T23:56:24.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:23 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.6:6834/3405315500,v1:172.21.15.6:6835/3405315500] up:boot 2024-09-11T23:56:24.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:23 smithi039 ceph-mon[34543]: fsmap 3 up:standby 2024-09-11T23:56:24.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:56:24.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:23 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2463207323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:24.785 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:24 smithi006 ceph-mon[30947]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:24.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:24 smithi134 ceph-mon[34893]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:25.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:24 smithi039 ceph-mon[34543]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:25.118 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 11 23:56:24 smithi006 systemd[1]: Starting Ceph mds.d for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:25.479 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 11 23:56:25 smithi006 podman[71371]: 2024-09-11 23:56:25.094024244 +0000 UTC m=+0.016833620 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:25.479 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 11 23:56:25 smithi006 podman[71371]: 2024-09-11 23:56:25.202731851 +0000 UTC m=+0.125541263 container create 74910b18e73354137377d733d7fd3419374167726931d93edb2d4df4e386bd11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T23:56:25.480 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 11 23:56:25 smithi006 podman[71371]: 2024-09-11 23:56:25.480947424 +0000 UTC m=+0.403756807 container init 74910b18e73354137377d733d7fd3419374167726931d93edb2d4df4e386bd11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T23:56:25.698 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:25.833 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 11 23:56:25 smithi006 podman[71371]: 2024-09-11 23:56:25.484993047 +0000 UTC m=+0.407802422 container start 74910b18e73354137377d733d7fd3419374167726931d93edb2d4df4e386bd11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:56:25.833 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 11 23:56:25 smithi006 ceph-mds[71391]: -- 172.21.15.6:0/1542421307 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a0d7d15860 con 0x55a0d7cf3400 2024-09-11T23:56:25.833 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 11 23:56:25 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-d[71386]: starting mds.d at 2024-09-11T23:56:25.834 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 11 23:56:25 smithi006 bash[71371]: 74910b18e73354137377d733d7fd3419374167726931d93edb2d4df4e386bd11 2024-09-11T23:56:25.834 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 11 23:56:25 smithi006 systemd[1]: Started Ceph mds.d for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:26.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.491+0000 7fa3c93b1640 1 -- 172.21.15.6:0/3490587285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c4102790 msgr2=0x7fa3c41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.491+0000 7fa3c93b1640 1 --2- 172.21.15.6:0/3490587285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c4102790 0x7fa3c41067e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009900 tx=0x7fa3b802a410 comp rx=0 tx=0).stop 2024-09-11T23:56:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.491+0000 7fa3c93b1640 1 -- 172.21.15.6:0/3490587285 shutdown_connections 2024-09-11T23:56:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.491+0000 7fa3c93b1640 1 --2- 172.21.15.6:0/3490587285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3c4106f10 0x7fa3c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.491+0000 7fa3c93b1640 1 --2- 172.21.15.6:0/3490587285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c4102790 0x7fa3c41067e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.491+0000 7fa3c93b1640 1 --2- 172.21.15.6:0/3490587285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4101de0 0x7fa3c41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.491+0000 7fa3c93b1640 1 -- 172.21.15.6:0/3490587285 >> 172.21.15.6:0/3490587285 conn(0x7fa3c40fd8c0 msgr2=0x7fa3c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.491+0000 7fa3c93b1640 1 -- 172.21.15.6:0/3490587285 shutdown_connections 2024-09-11T23:56:26.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.491+0000 7fa3c93b1640 1 -- 172.21.15.6:0/3490587285 wait complete. 2024-09-11T23:56:26.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.492+0000 7fa3c93b1640 1 Processor -- start 2024-09-11T23:56:26.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.492+0000 7fa3c93b1640 1 -- start start 2024-09-11T23:56:26.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c93b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3c4101de0 0x7fa3c40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:26.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c93b1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4102790 0x7fa3c4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:26.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c93b1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c4106f10 0x7fa3c4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:26.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c93b1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4111e70 con 0x7fa3c4106f10 2024-09-11T23:56:26.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c93b1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4111cf0 con 0x7fa3c4102790 2024-09-11T23:56:26.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c93b1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4111ff0 con 0x7fa3c4101de0 2024-09-11T23:56:26.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c4106f10 0x7fa3c4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:26.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c4106f10 0x7fa3c4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37736/0 (socket says 172.21.15.6:37736) 2024-09-11T23:56:26.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c37fe640 1 -- 172.21.15.6:0/1762338325 learned_addr learned my addr 172.21.15.6:0/1762338325 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:26.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c27fc640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4102790 0x7fa3c4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:26.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c2ffd640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3c4101de0 0x7fa3c40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:26.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c37fe640 1 -- 172.21.15.6:0/1762338325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3c4101de0 msgr2=0x7fa3c40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:26.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c37fe640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3c4101de0 0x7fa3c40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:26.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c37fe640 1 -- 172.21.15.6:0/1762338325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4102790 msgr2=0x7fa3c4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:26.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c37fe640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4102790 0x7fa3c4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:26.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c37fe640 1 -- 172.21.15.6:0/1762338325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c41a6850 con 0x7fa3c4106f10 2024-09-11T23:56:26.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.493+0000 7fa3c37fe640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c4106f10 0x7fa3c4074f70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00eaa0 tx=0x7fa3bc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:26.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.494+0000 7fa3abfff640 1 -- 172.21.15.6:0/1762338325 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc00cdb0 con 0x7fa3c4106f10 2024-09-11T23:56:26.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.494+0000 7fa3c93b1640 1 -- 172.21.15.6:0/1762338325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c41a6b40 con 0x7fa3c4106f10 2024-09-11T23:56:26.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.494+0000 7fa3c93b1640 1 -- 172.21.15.6:0/1762338325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c41a70a0 con 0x7fa3c4106f10 2024-09-11T23:56:26.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.494+0000 7fa3abfff640 1 -- 172.21.15.6:0/1762338325 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa3bc005020 con 0x7fa3c4106f10 2024-09-11T23:56:26.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.494+0000 7fa3abfff640 1 -- 172.21.15.6:0/1762338325 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0116d0 con 0x7fa3c4106f10 2024-09-11T23:56:26.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.495+0000 7fa3c93b1640 1 -- 172.21.15.6:0/1762338325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b0005290 con 0x7fa3c4106f10 2024-09-11T23:56:26.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.497+0000 7fa3abfff640 1 -- 172.21.15.6:0/1762338325 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fa3bc004a40 con 0x7fa3c4106f10 2024-09-11T23:56:26.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.498+0000 7fa3abfff640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa3ac0a2c00 0x7fa3ac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:26.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.498+0000 7fa3c2ffd640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa3ac0a2c00 0x7fa3ac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:26.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.498+0000 7fa3abfff640 1 -- 172.21.15.6:0/1762338325 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fa3bc0ceed0 con 0x7fa3c4106f10 2024-09-11T23:56:26.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.498+0000 7fa3c2ffd640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa3ac0a2c00 0x7fa3ac0a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4005fd0 tx=0x7fa3b400b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:26.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.501+0000 7fa3abfff640 1 -- 172.21.15.6:0/1762338325 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3bc016030 con 0x7fa3c4106f10 2024-09-11T23:56:26.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.714+0000 7fa3c93b1640 1 -- 172.21.15.6:0/1762338325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3b0005580 con 0x7fa3c4106f10 2024-09-11T23:56:26.715 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:26 smithi006 ceph-mon[30947]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:26.715 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:26.715 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:26.715 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:26.715 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:26.715 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:26 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.6:6836/2319638912,v1:172.21.15.6:6837/2319638912] up:boot 2024-09-11T23:56:26.715 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:26 smithi006 ceph-mon[30947]: fsmap 4 up:standby 2024-09-11T23:56:26.715 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:56:26.715 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:26.716 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:26.716 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:26 smithi006 ceph-mon[30947]: Deploying daemon mds.e on smithi039 2024-09-11T23:56:26.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.715+0000 7fa3abfff640 1 -- 172.21.15.6:0/1762338325 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7fa3bc09c350 con 0x7fa3c4106f10 2024-09-11T23:56:26.716 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"btime":"2024-09-11T23:56:25:662384+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:56:26.717 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 5 2024-09-11T23:56:26.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.718+0000 7fa3c93b1640 1 -- 172.21.15.6:0/1762338325 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa3ac0a2c00 msgr2=0x7fa3ac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:26.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.718+0000 7fa3c93b1640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa3ac0a2c00 0x7fa3ac0a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4005fd0 tx=0x7fa3b400b590 comp rx=0 tx=0).stop 2024-09-11T23:56:26.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.718+0000 7fa3c93b1640 1 -- 172.21.15.6:0/1762338325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c4106f10 msgr2=0x7fa3c4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:26.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.718+0000 7fa3c93b1640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c4106f10 0x7fa3c4074f70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00eaa0 tx=0x7fa3bc00ef60 comp rx=0 tx=0).stop 2024-09-11T23:56:26.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.718+0000 7fa3c93b1640 1 -- 172.21.15.6:0/1762338325 shutdown_connections 2024-09-11T23:56:26.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.718+0000 7fa3c93b1640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa3ac0a2c00 0x7fa3ac0a50c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:26.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.718+0000 7fa3c93b1640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c4106f10 0x7fa3c4074f70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:26.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.718+0000 7fa3c93b1640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4102790 0x7fa3c4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:26.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.718+0000 7fa3c93b1640 1 --2- 172.21.15.6:0/1762338325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3c4101de0 0x7fa3c40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:26.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.718+0000 7fa3c93b1640 1 -- 172.21.15.6:0/1762338325 >> 172.21.15.6:0/1762338325 conn(0x7fa3c40fd8c0 msgr2=0x7fa3c40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:26.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.718+0000 7fa3c93b1640 1 -- 172.21.15.6:0/1762338325 shutdown_connections 2024-09-11T23:56:26.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:26.718+0000 7fa3c93b1640 1 -- 172.21.15.6:0/1762338325 wait complete. 2024-09-11T23:56:26.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:26 smithi039 ceph-mon[34543]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:26.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:26.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:26.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:26.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:26.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:26 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.6:6836/2319638912,v1:172.21.15.6:6837/2319638912] up:boot 2024-09-11T23:56:26.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:26 smithi039 ceph-mon[34543]: fsmap 4 up:standby 2024-09-11T23:56:26.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:56:26.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:26.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:26.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:26 smithi039 ceph-mon[34543]: Deploying daemon mds.e on smithi039 2024-09-11T23:56:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:26 smithi134 ceph-mon[34893]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:26 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.6:6836/2319638912,v1:172.21.15.6:6837/2319638912] up:boot 2024-09-11T23:56:26.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:26 smithi134 ceph-mon[34893]: fsmap 4 up:standby 2024-09-11T23:56:26.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:56:26.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:26.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:26.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:26 smithi134 ceph-mon[34893]: Deploying daemon mds.e on smithi039 2024-09-11T23:56:27.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:27 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1762338325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:27.795 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 11 23:56:27 smithi039 systemd[1]: Starting Ceph mds.e for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:27.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:27 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1762338325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:27.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:27 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1762338325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:28.202 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 11 23:56:27 smithi039 podman[64326]: 2024-09-11 23:56:27.846122733 +0000 UTC m=+0.016282235 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:28.202 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 11 23:56:27 smithi039 podman[64326]: 2024-09-11 23:56:27.967692206 +0000 UTC m=+0.137851706 container create 6701705a598455db479d892fa8b9eafd9d6ab0370699d923fb4d8e2802cb57ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T23:56:28.202 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 11 23:56:28 smithi039 podman[64326]: 2024-09-11 23:56:28.203904445 +0000 UTC m=+0.374063938 container init 6701705a598455db479d892fa8b9eafd9d6ab0370699d923fb4d8e2802cb57ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T23:56:28.544 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 11 23:56:28 smithi039 podman[64326]: 2024-09-11 23:56:28.207015158 +0000 UTC m=+0.377174651 container start 6701705a598455db479d892fa8b9eafd9d6ab0370699d923fb4d8e2802cb57ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-11T23:56:28.544 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 11 23:56:28 smithi039 ceph-mds[64345]: -- 172.21.15.39:0/2056356440 <== mon.2 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a7b4bf1860 con 0x55a7b4bce800 2024-09-11T23:56:28.544 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 11 23:56:28 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-e[64341]: starting mds.e at 2024-09-11T23:56:28.544 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 11 23:56:28 smithi039 bash[64326]: 6701705a598455db479d892fa8b9eafd9d6ab0370699d923fb4d8e2802cb57ce 2024-09-11T23:56:28.544 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 11 23:56:28 smithi039 systemd[1]: Started Ceph mds.e for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:28 smithi134 ceph-mon[34893]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:28 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:28 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:28.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:28 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:28.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:28 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:28.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:28 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:28.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:28 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:29.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:28 smithi039 ceph-mon[34543]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:29.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:28 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:29.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:28 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:29.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:28 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:29.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:28 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:29.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:28 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:29.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:28 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:29.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:28 smithi006 ceph-mon[30947]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:29.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:28 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:29.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:28 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:29.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:28 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:29.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:28 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:29.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:28 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:29.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:28 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:29.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:29.753 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:29.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:29 smithi006 ceph-mon[30947]: Deploying daemon mds.f on smithi134 2024-09-11T23:56:29.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:29 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.39:6834/2372527607,v1:172.21.15.39:6835/2372527607] up:boot 2024-09-11T23:56:29.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:29 smithi006 ceph-mon[30947]: fsmap 5 up:standby 2024-09-11T23:56:29.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:29 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:56:29.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:29 smithi134 ceph-mon[34893]: Deploying daemon mds.f on smithi134 2024-09-11T23:56:29.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:29 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.39:6834/2372527607,v1:172.21.15.39:6835/2372527607] up:boot 2024-09-11T23:56:29.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:29 smithi134 ceph-mon[34893]: fsmap 5 up:standby 2024-09-11T23:56:29.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:29 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:56:30.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:29 smithi039 ceph-mon[34543]: Deploying daemon mds.f on smithi134 2024-09-11T23:56:30.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:29 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.39:6834/2372527607,v1:172.21.15.39:6835/2372527607] up:boot 2024-09-11T23:56:30.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:29 smithi039 ceph-mon[34543]: fsmap 5 up:standby 2024-09-11T23:56:30.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:29 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:56:30.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.291+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/2685262203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2ec101de0 msgr2=0x7fc2ec1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:30.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.291+0000 7fc2f1cfc640 1 --2- 172.21.15.6:0/2685262203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2ec101de0 0x7fc2ec1021c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009900 tx=0x7fc2dc02a410 comp rx=0 tx=0).stop 2024-09-11T23:56:30.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.291+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/2685262203 shutdown_connections 2024-09-11T23:56:30.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.291+0000 7fc2f1cfc640 1 --2- 172.21.15.6:0/2685262203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec106f10 0x7fc2ec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:30.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.291+0000 7fc2f1cfc640 1 --2- 172.21.15.6:0/2685262203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2ec102790 0x7fc2ec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:30.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.291+0000 7fc2f1cfc640 1 --2- 172.21.15.6:0/2685262203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2ec101de0 0x7fc2ec1021c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:30.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.291+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/2685262203 >> 172.21.15.6:0/2685262203 conn(0x7fc2ec0fd8c0 msgr2=0x7fc2ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:30.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.291+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/2685262203 shutdown_connections 2024-09-11T23:56:30.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.291+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/2685262203 wait complete. 2024-09-11T23:56:30.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.292+0000 7fc2f1cfc640 1 Processor -- start 2024-09-11T23:56:30.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.292+0000 7fc2f1cfc640 1 -- start start 2024-09-11T23:56:30.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.292+0000 7fc2f1cfc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2ec101de0 0x7fc2ec1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.292+0000 7fc2f1cfc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec102790 0x7fc2ec198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.292+0000 7fc2f1cfc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2ec106f10 0x7fc2ec19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2f1cfc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec111e20 con 0x7fc2ec101de0 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2f1cfc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec111ca0 con 0x7fc2ec102790 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2f1cfc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec111fa0 con 0x7fc2ec106f10 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2eb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2ec101de0 0x7fc2ec1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2eb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2ec101de0 0x7fc2ec1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37758/0 (socket says 172.21.15.6:37758) 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2eb7fe640 1 -- 172.21.15.6:0/1737622992 learned_addr learned my addr 172.21.15.6:0/1737622992 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2ebfff640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2ec106f10 0x7fc2ec19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2eaffd640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec102790 0x7fc2ec198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2eb7fe640 1 -- 172.21.15.6:0/1737622992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2ec106f10 msgr2=0x7fc2ec19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2eb7fe640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2ec106f10 0x7fc2ec19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:30.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2eb7fe640 1 -- 172.21.15.6:0/1737622992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec102790 msgr2=0x7fc2ec198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2eb7fe640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec102790 0x7fc2ec198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2eb7fe640 1 -- 172.21.15.6:0/1737622992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec19d290 con 0x7fc2ec101de0 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2eaffd640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec102790 0x7fc2ec198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2eb7fe640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2ec101de0 0x7fc2ec1982e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc005940 tx=0x7fc2dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2e8ff9640 1 -- 172.21.15.6:0/1737622992 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc03f030 con 0x7fc2ec101de0 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2e8ff9640 1 -- 172.21.15.6:0/1737622992 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2dc003cb0 con 0x7fc2ec101de0 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/1737622992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ec19d520 con 0x7fc2ec101de0 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2e8ff9640 1 -- 172.21.15.6:0/1737622992 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc035070 con 0x7fc2ec101de0 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.293+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/1737622992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ec1a4e60 con 0x7fc2ec101de0 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.294+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/1737622992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ec1032c0 con 0x7fc2ec101de0 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.295+0000 7fc2e8ff9640 1 -- 172.21.15.6:0/1737622992 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc2dc042030 con 0x7fc2ec101de0 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.296+0000 7fc2e8ff9640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2d40a2b80 0x7fc2d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.296+0000 7fc2eaffd640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2d40a2b80 0x7fc2d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:30.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.297+0000 7fc2e8ff9640 1 -- 172.21.15.6:0/1737622992 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fc2dc0ef3c0 con 0x7fc2ec101de0 2024-09-11T23:56:30.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.297+0000 7fc2eaffd640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2d40a2b80 0x7fc2d40a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0fdd50 tx=0x7fc2e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:30.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.301+0000 7fc2e8ff9640 1 -- 172.21.15.6:0/1737622992 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2dc0bc7c0 con 0x7fc2ec101de0 2024-09-11T23:56:30.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.513+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/1737622992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2ec10a0f0 con 0x7fc2ec101de0 2024-09-11T23:56:30.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.514+0000 7fc2e8ff9640 1 -- 172.21.15.6:0/1737622992 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7fc2dc0bc0c0 con 0x7fc2ec101de0 2024-09-11T23:56:30.514 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:30.514 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":6,"btime":"2024-09-11T23:56:28:659196+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-11T23:56:30.514 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 6 2024-09-11T23:56:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.516+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/1737622992 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2d40a2b80 msgr2=0x7fc2d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.516+0000 7fc2f1cfc640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2d40a2b80 0x7fc2d40a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0fdd50 tx=0x7fc2e0005f90 comp rx=0 tx=0).stop 2024-09-11T23:56:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.516+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/1737622992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2ec101de0 msgr2=0x7fc2ec1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.516+0000 7fc2f1cfc640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2ec101de0 0x7fc2ec1982e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc005940 tx=0x7fc2dc0042f0 comp rx=0 tx=0).stop 2024-09-11T23:56:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.516+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/1737622992 shutdown_connections 2024-09-11T23:56:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.516+0000 7fc2f1cfc640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2d40a2b80 0x7fc2d40a5040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.516+0000 7fc2f1cfc640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2ec106f10 0x7fc2ec19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.516+0000 7fc2f1cfc640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec102790 0x7fc2ec198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.516+0000 7fc2f1cfc640 1 --2- 172.21.15.6:0/1737622992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2ec101de0 0x7fc2ec1982e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.516+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/1737622992 >> 172.21.15.6:0/1737622992 conn(0x7fc2ec0fd8c0 msgr2=0x7fc2ec0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.517+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/1737622992 shutdown_connections 2024-09-11T23:56:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:30.517+0000 7fc2f1cfc640 1 -- 172.21.15.6:0/1737622992 wait complete. 2024-09-11T23:56:30.590 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 11 23:56:30 smithi134 podman[65019]: 2024-09-11 23:56:30.455784603 +0000 UTC m=+0.016178277 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:30.590 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 11 23:56:30 smithi134 podman[65019]: 2024-09-11 23:56:30.591410435 +0000 UTC m=+0.151804106 container create 0df0a443c5a9e88dca44b657a2d5de0820c3221be28b6df61df69186b9ff9da7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-f, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True) 2024-09-11T23:56:30.851 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:30 smithi134 ceph-mon[34893]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:30.851 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:30 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1737622992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:30.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:30 smithi006 ceph-mon[30947]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:30.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:30 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1737622992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:31.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:30 smithi039 ceph-mon[34543]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:31.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:30 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1737622992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:31.203 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 11 23:56:30 smithi134 podman[65019]: 2024-09-11 23:56:30.852460741 +0000 UTC m=+0.412854411 container init 0df0a443c5a9e88dca44b657a2d5de0820c3221be28b6df61df69186b9ff9da7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-f, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-11T23:56:31.203 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 11 23:56:30 smithi134 podman[65019]: 2024-09-11 23:56:30.855688112 +0000 UTC m=+0.416081788 container start 0df0a443c5a9e88dca44b657a2d5de0820c3221be28b6df61df69186b9ff9da7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-11T23:56:31.203 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 11 23:56:30 smithi134 ceph-mds[65038]: -- 172.21.15.134:0/2364045566 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f480891860 con 0x55f48086f000 2024-09-11T23:56:31.203 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 11 23:56:30 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-f[65034]: starting mds.f at 2024-09-11T23:56:31.203 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 11 23:56:30 smithi134 bash[65019]: 0df0a443c5a9e88dca44b657a2d5de0820c3221be28b6df61df69186b9ff9da7 2024-09-11T23:56:31.203 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 11 23:56:30 smithi134 systemd[1]: Started Ceph mds.f for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:32.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:31 smithi039 ceph-mon[34543]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:32.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:32.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:32.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:32.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:32.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:32.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:32.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:31 smithi039 ceph-mon[34543]: Deploying daemon mds.c on smithi134 2024-09-11T23:56:32.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:31 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] up:boot 2024-09-11T23:56:32.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:31 smithi039 ceph-mon[34543]: fsmap 6 up:standby 2024-09-11T23:56:32.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:31 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:56:32.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:31 smithi006 ceph-mon[30947]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:32.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:32.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:32.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:32.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:32.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:32.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:32.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:31 smithi006 ceph-mon[30947]: Deploying daemon mds.c on smithi134 2024-09-11T23:56:32.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:31 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] up:boot 2024-09-11T23:56:32.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:31 smithi006 ceph-mon[30947]: fsmap 6 up:standby 2024-09-11T23:56:32.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:31 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:56:32.434 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:31 smithi134 ceph-mon[34893]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:32.434 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:32.434 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:32.434 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:32.434 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:32.435 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:32.435 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:32.435 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:31 smithi134 ceph-mon[34893]: Deploying daemon mds.c on smithi134 2024-09-11T23:56:32.435 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:31 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] up:boot 2024-09-11T23:56:32.435 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:31 smithi134 ceph-mon[34893]: fsmap 6 up:standby 2024-09-11T23:56:32.435 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:31 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:56:33.145 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 11 23:56:32 smithi134 systemd[1]: Starting Ceph mds.c for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:33.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:33.425 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 11 23:56:33 smithi134 podman[65320]: 2024-09-11 23:56:33.048747606 +0000 UTC m=+0.016763181 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:33.425 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 11 23:56:33 smithi134 podman[65320]: 2024-09-11 23:56:33.157073697 +0000 UTC m=+0.125089259 container create ef0578a1e4080cb506c2358f60d31bdcddb612c8348846a3c9fae35c225d0d9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-11T23:56:33.425 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 11 23:56:33 smithi134 podman[65320]: 2024-09-11 23:56:33.426790689 +0000 UTC m=+0.394806258 container init ef0578a1e4080cb506c2358f60d31bdcddb612c8348846a3c9fae35c225d0d9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T23:56:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:33.703 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 11 23:56:33 smithi134 podman[65320]: 2024-09-11 23:56:33.429810872 +0000 UTC m=+0.397826441 container start ef0578a1e4080cb506c2358f60d31bdcddb612c8348846a3c9fae35c225d0d9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-c, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-11T23:56:33.704 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 11 23:56:33 smithi134 ceph-mds[65340]: -- 172.21.15.134:0/1083720034 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5560acb81860 con 0x5560acb5e800 2024-09-11T23:56:33.704 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 11 23:56:33 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-c[65336]: starting mds.c at 2024-09-11T23:56:33.704 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 11 23:56:33 smithi134 bash[65320]: ef0578a1e4080cb506c2358f60d31bdcddb612c8348846a3c9fae35c225d0d9f 2024-09-11T23:56:33.704 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 11 23:56:33 smithi134 systemd[1]: Started Ceph mds.c for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.018+0000 7f00b0f22640 1 -- 172.21.15.6:0/3082882761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ac103660 msgr2=0x7f00ac10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.018+0000 7f00b0f22640 1 --2- 172.21.15.6:0/3082882761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ac103660 0x7f00ac10bb50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009900 tx=0x7f00a002a480 comp rx=0 tx=0).stop 2024-09-11T23:56:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.018+0000 7f00b0f22640 1 -- 172.21.15.6:0/3082882761 shutdown_connections 2024-09-11T23:56:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.018+0000 7f00b0f22640 1 --2- 172.21.15.6:0/3082882761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00ac10c170 0x7f00ac10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.018+0000 7f00b0f22640 1 --2- 172.21.15.6:0/3082882761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ac103660 0x7f00ac10bb50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.018+0000 7f00b0f22640 1 --2- 172.21.15.6:0/3082882761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ac102d40 0x7f00ac103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.018+0000 7f00b0f22640 1 -- 172.21.15.6:0/3082882761 >> 172.21.15.6:0/3082882761 conn(0x7f00ac0fc7a0 msgr2=0x7f00ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.018+0000 7f00b0f22640 1 -- 172.21.15.6:0/3082882761 shutdown_connections 2024-09-11T23:56:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.018+0000 7f00b0f22640 1 -- 172.21.15.6:0/3082882761 wait complete. 2024-09-11T23:56:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00b0f22640 1 Processor -- start 2024-09-11T23:56:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00b0f22640 1 -- start start 2024-09-11T23:56:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00b0f22640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ac102d40 0x7f00ac1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00b0f22640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ac103660 0x7f00ac1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00b0f22640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00ac10c170 0x7f00ac19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00b0f22640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac111e20 con 0x7f00ac102d40 2024-09-11T23:56:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00b0f22640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac111ca0 con 0x7f00ac103660 2024-09-11T23:56:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00b0f22640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac111fa0 con 0x7f00ac10c170 2024-09-11T23:56:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00aa59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ac102d40 0x7f00ac1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00aa59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ac102d40 0x7f00ac1983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54630/0 (socket says 172.21.15.6:54630) 2024-09-11T23:56:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00aa59c640 1 -- 172.21.15.6:0/818806919 learned_addr learned my addr 172.21.15.6:0/818806919 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00aad9d640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00ac10c170 0x7f00ac19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00a9d9b640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ac103660 0x7f00ac1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00aa59c640 1 -- 172.21.15.6:0/818806919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00ac10c170 msgr2=0x7f00ac19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00aa59c640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00ac10c170 0x7f00ac19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00aa59c640 1 -- 172.21.15.6:0/818806919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ac103660 msgr2=0x7f00ac1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00aa59c640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ac103660 0x7f00ac1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00aa59c640 1 -- 172.21.15.6:0/818806919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ac19d350 con 0x7f00ac102d40 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00aad9d640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00ac10c170 0x7f00ac19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.019+0000 7f00a9d9b640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ac103660 0x7f00ac1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.020+0000 7f00aa59c640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ac102d40 0x7f00ac1983a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f009c00e9f0 tx=0x7f009c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.020+0000 7f009b7fe640 1 -- 172.21.15.6:0/818806919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c00cd80 con 0x7f00ac102d40 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.020+0000 7f009b7fe640 1 -- 172.21.15.6:0/818806919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f009c0108e0 con 0x7f00ac102d40 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.020+0000 7f00b0f22640 1 -- 172.21.15.6:0/818806919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ac19d640 con 0x7f00ac102d40 2024-09-11T23:56:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.020+0000 7f009b7fe640 1 -- 172.21.15.6:0/818806919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c018920 con 0x7f00ac102d40 2024-09-11T23:56:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.020+0000 7f00b0f22640 1 -- 172.21.15.6:0/818806919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ac1a4f20 con 0x7f00ac102d40 2024-09-11T23:56:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.021+0000 7f00b0f22640 1 -- 172.21.15.6:0/818806919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00ac103120 con 0x7f00ac102d40 2024-09-11T23:56:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.022+0000 7f009b7fe640 1 -- 172.21.15.6:0/818806919 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f009c010a90 con 0x7f00ac102d40 2024-09-11T23:56:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.023+0000 7f009b7fe640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f00940a2c00 0x7f00940a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.023+0000 7f00a9d9b640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f00940a2c00 0x7f00940a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.023+0000 7f009b7fe640 1 -- 172.21.15.6:0/818806919 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f009c0cf490 con 0x7f00ac102d40 2024-09-11T23:56:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.023+0000 7f00a9d9b640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f00940a2c00 0x7f00940a50c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00a0000c00 tx=0x7f00a0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.026+0000 7f009b7fe640 1 -- 172.21.15.6:0/818806919 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f009c09c7f0 con 0x7f00ac102d40 2024-09-11T23:56:34.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.238+0000 7f00b0f22640 1 -- 172.21.15.6:0/818806919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00ac02d7c0 con 0x7f00ac102d40 2024-09-11T23:56:34.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.239+0000 7f009b7fe640 1 -- 172.21.15.6:0/818806919 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6385 (secure 0 0 0) 0x7f009c09c0f0 con 0x7f00ac102d40 2024-09-11T23:56:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:34.239 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"btime":"2024-09-11T23:56:33:995019+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-11T23:56:34.240 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-09-11T23:56:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.241+0000 7f00b0f22640 1 -- 172.21.15.6:0/818806919 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f00940a2c00 msgr2=0x7f00940a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.241+0000 7f00b0f22640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f00940a2c00 0x7f00940a50c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00a0000c00 tx=0x7f00a0031400 comp rx=0 tx=0).stop 2024-09-11T23:56:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.241+0000 7f00b0f22640 1 -- 172.21.15.6:0/818806919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ac102d40 msgr2=0x7f00ac1983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.241+0000 7f00b0f22640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ac102d40 0x7f00ac1983a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f009c00e9f0 tx=0x7f009c00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.241+0000 7f00b0f22640 1 -- 172.21.15.6:0/818806919 shutdown_connections 2024-09-11T23:56:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.241+0000 7f00b0f22640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f00940a2c00 0x7f00940a50c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.241+0000 7f00b0f22640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00ac10c170 0x7f00ac19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.241+0000 7f00b0f22640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ac103660 0x7f00ac1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.241+0000 7f00b0f22640 1 --2- 172.21.15.6:0/818806919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ac102d40 0x7f00ac1983a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.241+0000 7f00b0f22640 1 -- 172.21.15.6:0/818806919 >> 172.21.15.6:0/818806919 conn(0x7f00ac0fc7a0 msgr2=0x7f00ac0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.241+0000 7f00b0f22640 1 -- 172.21.15.6:0/818806919 shutdown_connections 2024-09-11T23:56:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:34.241+0000 7f00b0f22640 1 -- 172.21.15.6:0/818806919 wait complete. 2024-09-11T23:56:34.867 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:34 smithi134 ceph-mon[34893]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:34.867 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:34.867 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:34.867 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:34.867 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:34.868 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:34.868 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:34.868 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:34 smithi134 ceph-mon[34893]: Deploying daemon mds.h on smithi039 2024-09-11T23:56:34.868 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:34 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] up:boot 2024-09-11T23:56:34.868 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:34 smithi134 ceph-mon[34893]: fsmap 7 up:standby 2024-09-11T23:56:34.868 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:56:34.868 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:34 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/818806919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:34.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:34 smithi006 ceph-mon[30947]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:34 smithi006 ceph-mon[30947]: Deploying daemon mds.h on smithi039 2024-09-11T23:56:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:34 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] up:boot 2024-09-11T23:56:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:34 smithi006 ceph-mon[30947]: fsmap 7 up:standby 2024-09-11T23:56:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:56:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:34 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/818806919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:34 smithi039 ceph-mon[34543]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:34 smithi039 ceph-mon[34543]: Deploying daemon mds.h on smithi039 2024-09-11T23:56:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:34 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] up:boot 2024-09-11T23:56:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:34 smithi039 ceph-mon[34543]: fsmap 7 up:standby 2024-09-11T23:56:35.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:56:35.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:34 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/818806919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:35.794 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 11 23:56:35 smithi039 systemd[1]: Starting Ceph mds.h for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:36.159 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 11 23:56:35 smithi039 podman[64625]: 2024-09-11 23:56:35.783708119 +0000 UTC m=+0.016907075 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:36.159 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 11 23:56:35 smithi039 podman[64625]: 2024-09-11 23:56:35.890755899 +0000 UTC m=+0.123954839 container create 8d283df81d1e12e74f06efccd732132b0ddabe3167f6ad5ddbfc5b715e7e0935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-11T23:56:36.159 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 11 23:56:36 smithi039 podman[64625]: 2024-09-11 23:56:36.160513055 +0000 UTC m=+0.393712002 container init 8d283df81d1e12e74f06efccd732132b0ddabe3167f6ad5ddbfc5b715e7e0935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T23:56:36.544 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 11 23:56:36 smithi039 podman[64625]: 2024-09-11 23:56:36.163352092 +0000 UTC m=+0.396551036 container start 8d283df81d1e12e74f06efccd732132b0ddabe3167f6ad5ddbfc5b715e7e0935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:56:36.544 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 11 23:56:36 smithi039 ceph-mds[64644]: -- 172.21.15.39:0/2754783342 <== mon.2 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e0e2df9860 con 0x55e0e2dd6800 2024-09-11T23:56:36.544 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 11 23:56:36 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-h[64640]: starting mds.h at 2024-09-11T23:56:36.544 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 11 23:56:36 smithi039 bash[64625]: 8d283df81d1e12e74f06efccd732132b0ddabe3167f6ad5ddbfc5b715e7e0935 2024-09-11T23:56:36.544 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 11 23:56:36 smithi039 systemd[1]: Started Ceph mds.h for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:36.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:36 smithi006 ceph-mon[30947]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:36.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:36 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:36.879 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:36 smithi134 ceph-mon[34893]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:36.879 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:36.879 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:36.879 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:36.880 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:36.880 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:36.880 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:36 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:36.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:37.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:36 smithi039 ceph-mon[34543]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:37.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:37.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:37.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:37.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:37.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:37.046 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:36 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:37.197 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.676+0000 7fc4f3a88640 1 -- 172.21.15.6:0/2539738505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ec106f30 msgr2=0x7fc4ec10eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.676+0000 7fc4f3a88640 1 --2- 172.21.15.6:0/2539738505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ec106f30 0x7fc4ec10eab0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009ca0 tx=0x7fc4e402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:56:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.676+0000 7fc4f3a88640 1 -- 172.21.15.6:0/2539738505 shutdown_connections 2024-09-11T23:56:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.676+0000 7fc4f3a88640 1 --2- 172.21.15.6:0/2539738505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ec106f30 0x7fc4ec10eab0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.676+0000 7fc4f3a88640 1 --2- 172.21.15.6:0/2539738505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ec100cc0 0x7fc4ec106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.676+0000 7fc4f3a88640 1 --2- 172.21.15.6:0/2539738505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4ec100310 0x7fc4ec1006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.676+0000 7fc4f3a88640 1 -- 172.21.15.6:0/2539738505 >> 172.21.15.6:0/2539738505 conn(0x7fc4ec077210 msgr2=0x7fc4ec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.676+0000 7fc4f3a88640 1 -- 172.21.15.6:0/2539738505 shutdown_connections 2024-09-11T23:56:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.676+0000 7fc4f3a88640 1 -- 172.21.15.6:0/2539738505 wait complete. 2024-09-11T23:56:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.677+0000 7fc4f3a88640 1 Processor -- start 2024-09-11T23:56:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.677+0000 7fc4f3a88640 1 -- start start 2024-09-11T23:56:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.677+0000 7fc4f3a88640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ec100310 0x7fc4ec1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.677+0000 7fc4f3a88640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ec100cc0 0x7fc4ec1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:37.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.677+0000 7fc4f3a88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4ec106f30 0x7fc4ec19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:37.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.677+0000 7fc4f3a88640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec111e40 con 0x7fc4ec100310 2024-09-11T23:56:37.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.677+0000 7fc4f3a88640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec111cc0 con 0x7fc4ec106f30 2024-09-11T23:56:37.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.677+0000 7fc4f3a88640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec111fc0 con 0x7fc4ec100cc0 2024-09-11T23:56:37.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f1824640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ec100310 0x7fc4ec1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:37.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f1824640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ec100310 0x7fc4ec1983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54646/0 (socket says 172.21.15.6:54646) 2024-09-11T23:56:37.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f1824640 1 -- 172.21.15.6:0/632204456 learned_addr learned my addr 172.21.15.6:0/632204456 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:37.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f2025640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4ec106f30 0x7fc4ec19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:37.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f1023640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ec100cc0 0x7fc4ec1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:37.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f1824640 1 -- 172.21.15.6:0/632204456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ec100cc0 msgr2=0x7fc4ec1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f1824640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ec100cc0 0x7fc4ec1988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f1824640 1 -- 172.21.15.6:0/632204456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4ec106f30 msgr2=0x7fc4ec19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f1824640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4ec106f30 0x7fc4ec19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f1824640 1 -- 172.21.15.6:0/632204456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ec19d350 con 0x7fc4ec100310 2024-09-11T23:56:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f1824640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ec100310 0x7fc4ec1983a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800d950 tx=0x7fc4e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4e2ffd640 1 -- 172.21.15.6:0/632204456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8017030 con 0x7fc4ec100310 2024-09-11T23:56:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4e2ffd640 1 -- 172.21.15.6:0/632204456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc4e8004020 con 0x7fc4ec100310 2024-09-11T23:56:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f3a88640 1 -- 172.21.15.6:0/632204456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ec19d640 con 0x7fc4ec100310 2024-09-11T23:56:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4e2ffd640 1 -- 172.21.15.6:0/632204456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80047a0 con 0x7fc4ec100310 2024-09-11T23:56:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.678+0000 7fc4f3a88640 1 -- 172.21.15.6:0/632204456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ec1a4f20 con 0x7fc4ec100310 2024-09-11T23:56:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.679+0000 7fc4f3a88640 1 -- 172.21.15.6:0/632204456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ec1006f0 con 0x7fc4ec100310 2024-09-11T23:56:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.680+0000 7fc4e2ffd640 1 -- 172.21.15.6:0/632204456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc4e80041d0 con 0x7fc4ec100310 2024-09-11T23:56:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.681+0000 7fc4e2ffd640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc4d80a2b80 0x7fc4d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.681+0000 7fc4e2ffd640 1 -- 172.21.15.6:0/632204456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fc4e80ce640 con 0x7fc4ec100310 2024-09-11T23:56:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.681+0000 7fc4f1023640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc4d80a2b80 0x7fc4d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.682+0000 7fc4f1023640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc4d80a2b80 0x7fc4d80a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc005d80 tx=0x7fc4dc005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.685+0000 7fc4e2ffd640 1 -- 172.21.15.6:0/632204456 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc4e809ba40 con 0x7fc4ec100310 2024-09-11T23:56:37.851 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:37 smithi134 ceph-mon[34893]: Deploying daemon mds.i on smithi134 2024-09-11T23:56:37.852 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:37 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] up:boot 2024-09-11T23:56:37.852 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:37 smithi134 ceph-mon[34893]: fsmap 8 up:standby 2024-09-11T23:56:37.852 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:37 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:56:37.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:37 smithi006 ceph-mon[30947]: Deploying daemon mds.i on smithi134 2024-09-11T23:56:37.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:37 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] up:boot 2024-09-11T23:56:37.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:37 smithi006 ceph-mon[30947]: fsmap 8 up:standby 2024-09-11T23:56:37.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:37 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:56:37.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.897+0000 7fc4f3a88640 1 -- 172.21.15.6:0/632204456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4ec10a170 con 0x7fc4ec100310 2024-09-11T23:56:37.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.897+0000 7fc4e2ffd640 1 -- 172.21.15.6:0/632204456 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7207 (secure 0 0 0) 0x7fc4e809b340 con 0x7fc4ec100310 2024-09-11T23:56:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:37.898 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"btime":"2024-09-11T23:56:36:578461+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-11T23:56:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2024-09-11T23:56:37.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.899+0000 7fc4f3a88640 1 -- 172.21.15.6:0/632204456 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc4d80a2b80 msgr2=0x7fc4d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:37.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.899+0000 7fc4f3a88640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc4d80a2b80 0x7fc4d80a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc005d80 tx=0x7fc4dc005c90 comp rx=0 tx=0).stop 2024-09-11T23:56:37.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.899+0000 7fc4f3a88640 1 -- 172.21.15.6:0/632204456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ec100310 msgr2=0x7fc4ec1983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.899+0000 7fc4f3a88640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ec100310 0x7fc4ec1983a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800d950 tx=0x7fc4e800de10 comp rx=0 tx=0).stop 2024-09-11T23:56:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.899+0000 7fc4f3a88640 1 -- 172.21.15.6:0/632204456 shutdown_connections 2024-09-11T23:56:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.899+0000 7fc4f3a88640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc4d80a2b80 0x7fc4d80a5040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.899+0000 7fc4f3a88640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4ec106f30 0x7fc4ec19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.899+0000 7fc4f3a88640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ec100cc0 0x7fc4ec1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.899+0000 7fc4f3a88640 1 --2- 172.21.15.6:0/632204456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ec100310 0x7fc4ec1983a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.899+0000 7fc4f3a88640 1 -- 172.21.15.6:0/632204456 >> 172.21.15.6:0/632204456 conn(0x7fc4ec077210 msgr2=0x7fc4ec105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.900+0000 7fc4f3a88640 1 -- 172.21.15.6:0/632204456 shutdown_connections 2024-09-11T23:56:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:37.900+0000 7fc4f3a88640 1 -- 172.21.15.6:0/632204456 wait complete. 2024-09-11T23:56:38.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:37 smithi039 ceph-mon[34543]: Deploying daemon mds.i on smithi134 2024-09-11T23:56:38.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:37 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] up:boot 2024-09-11T23:56:38.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:37 smithi039 ceph-mon[34543]: fsmap 8 up:standby 2024-09-11T23:56:38.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:37 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:56:38.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:38 smithi006 ceph-mon[30947]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:38.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:38 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/632204456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:38.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:38 smithi134 ceph-mon[34893]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:38.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:38 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/632204456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:38.954 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 11 23:56:38 smithi134 systemd[1]: Started Ceph mds.i for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:39.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:38 smithi039 ceph-mon[34543]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:39.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:38 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/632204456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:40.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:39 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:40.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:39 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:40.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:39 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:40.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:39 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:40.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:39 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:40.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:39 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:40.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:39 smithi134 ceph-mon[34893]: Deploying daemon mds.g on smithi006 2024-09-11T23:56:40.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:39 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] up:boot 2024-09-11T23:56:40.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:39 smithi134 ceph-mon[34893]: fsmap 9 up:standby 2024-09-11T23:56:40.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:39 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:56:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:39 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:39 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:39 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:39 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:39 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:39 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:39 smithi039 ceph-mon[34543]: Deploying daemon mds.g on smithi006 2024-09-11T23:56:40.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:39 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] up:boot 2024-09-11T23:56:40.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:39 smithi039 ceph-mon[34543]: fsmap 9 up:standby 2024-09-11T23:56:40.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:39 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:56:40.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:39 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:40.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:39 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:40.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:39 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:40.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:39 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:40.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:39 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:40.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:39 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:40.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:39 smithi006 ceph-mon[30947]: Deploying daemon mds.g on smithi006 2024-09-11T23:56:40.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:39 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] up:boot 2024-09-11T23:56:40.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:39 smithi006 ceph-mon[30947]: fsmap 9 up:standby 2024-09-11T23:56:40.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:39 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:56:40.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:40.919 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:41.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:40 smithi006 ceph-mon[30947]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:41.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:40 smithi134 ceph-mon[34893]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:41.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:40 smithi039 ceph-mon[34543]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:41.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.404+0000 7f999652c640 1 -- 172.21.15.6:0/1634544380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990106f10 msgr2=0x7f999010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:41.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.404+0000 7f999652c640 1 --2- 172.21.15.6:0/1634544380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990106f10 0x7f999010ea90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9988009ca0 tx=0x7f998802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.404+0000 7f999652c640 1 -- 172.21.15.6:0/1634544380 shutdown_connections 2024-09-11T23:56:41.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.404+0000 7f999652c640 1 --2- 172.21.15.6:0/1634544380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990106f10 0x7f999010ea90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.404+0000 7f999652c640 1 --2- 172.21.15.6:0/1634544380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9990102790 0x7f99901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.404+0000 7f999652c640 1 --2- 172.21.15.6:0/1634544380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9990101de0 0x7f99901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.404+0000 7f999652c640 1 -- 172.21.15.6:0/1634544380 >> 172.21.15.6:0/1634544380 conn(0x7f99900fd8c0 msgr2=0x7f99900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:41.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.404+0000 7f999652c640 1 -- 172.21.15.6:0/1634544380 shutdown_connections 2024-09-11T23:56:41.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.404+0000 7f999652c640 1 -- 172.21.15.6:0/1634544380 wait complete. 2024-09-11T23:56:41.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.405+0000 7f999652c640 1 Processor -- start 2024-09-11T23:56:41.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.405+0000 7f999652c640 1 -- start start 2024-09-11T23:56:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f999652c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9990101de0 0x7f9990198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f999652c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990102790 0x7f9990198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f999652c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9990106f10 0x7f999019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f999652c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9990111e20 con 0x7f9990102790 2024-09-11T23:56:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f999652c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9990111ca0 con 0x7f9990101de0 2024-09-11T23:56:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f999652c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9990111fa0 con 0x7f9990106f10 2024-09-11T23:56:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990102790 0x7f9990198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990102790 0x7f9990198780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50744/0 (socket says 172.21.15.6:50744) 2024-09-11T23:56:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998f7fe640 1 -- 172.21.15.6:0/817697739 learned_addr learned my addr 172.21.15.6:0/817697739 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998ffff640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9990101de0 0x7f9990198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f9994ac9640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9990106f10 0x7f999019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998f7fe640 1 -- 172.21.15.6:0/817697739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9990106f10 msgr2=0x7f999019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998f7fe640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9990106f10 0x7f999019cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998f7fe640 1 -- 172.21.15.6:0/817697739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9990101de0 msgr2=0x7f9990198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998f7fe640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9990101de0 0x7f9990198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998f7fe640 1 -- 172.21.15.6:0/817697739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999019d1f0 con 0x7f9990102790 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f9994ac9640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9990106f10 0x7f999019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998f7fe640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990102790 0x7f9990198780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f998400c890 tx=0x7f998400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998d7fa640 1 -- 172.21.15.6:0/817697739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984004220 con 0x7f9990102790 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998d7fa640 1 -- 172.21.15.6:0/817697739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f99840043c0 con 0x7f9990102790 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f999652c640 1 -- 172.21.15.6:0/817697739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f999019d4e0 con 0x7f9990102790 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.406+0000 7f998d7fa640 1 -- 172.21.15.6:0/817697739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984004a00 con 0x7f9990102790 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.407+0000 7f999652c640 1 -- 172.21.15.6:0/817697739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99901a4dc0 con 0x7f9990102790 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.408+0000 7f999652c640 1 -- 172.21.15.6:0/817697739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99901021c0 con 0x7f9990102790 2024-09-11T23:56:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.409+0000 7f998d7fa640 1 -- 172.21.15.6:0/817697739 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f99840079b0 con 0x7f9990102790 2024-09-11T23:56:41.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.410+0000 7f998d7fa640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f99780a2c00 0x7f99780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:41.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.410+0000 7f998ffff640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f99780a2c00 0x7f99780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:41.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.410+0000 7f998d7fa640 1 -- 172.21.15.6:0/817697739 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f99840ce790 con 0x7f9990102790 2024-09-11T23:56:41.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.410+0000 7f998ffff640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f99780a2c00 0x7f99780a50c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f998000abe0 tx=0x7f998000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:41.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.414+0000 7f998d7fa640 1 -- 172.21.15.6:0/817697739 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9984014030 con 0x7f9990102790 2024-09-11T23:56:41.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.629+0000 7f999652c640 1 -- 172.21.15.6:0/817697739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f999002d7c0 con 0x7f9990102790 2024-09-11T23:56:41.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.630+0000 7f998d7fa640 1 -- 172.21.15.6:0/817697739 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8031 (secure 0 0 0) 0x7f998409bb90 con 0x7f9990102790 2024-09-11T23:56:41.634 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:41.634 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"btime":"2024-09-11T23:56:39:609160+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T23:56:41.635 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 10 2024-09-11T23:56:41.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.632+0000 7f999652c640 1 -- 172.21.15.6:0/817697739 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f99780a2c00 msgr2=0x7f99780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:41.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.632+0000 7f999652c640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f99780a2c00 0x7f99780a50c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f998000abe0 tx=0x7f998000a2d0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.632+0000 7f999652c640 1 -- 172.21.15.6:0/817697739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990102790 msgr2=0x7f9990198780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.632+0000 7f999652c640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990102790 0x7f9990198780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f998400c890 tx=0x7f998400cc90 comp rx=0 tx=0).stop 2024-09-11T23:56:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.632+0000 7f999652c640 1 -- 172.21.15.6:0/817697739 shutdown_connections 2024-09-11T23:56:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.632+0000 7f999652c640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f99780a2c00 0x7f99780a50c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.632+0000 7f999652c640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9990106f10 0x7f999019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.632+0000 7f999652c640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990102790 0x7f9990198780 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.632+0000 7f999652c640 1 --2- 172.21.15.6:0/817697739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9990101de0 0x7f9990198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.632+0000 7f999652c640 1 -- 172.21.15.6:0/817697739 >> 172.21.15.6:0/817697739 conn(0x7f99900fd8c0 msgr2=0x7f99900fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.632+0000 7f999652c640 1 -- 172.21.15.6:0/817697739 shutdown_connections 2024-09-11T23:56:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:41.632+0000 7f999652c640 1 -- 172.21.15.6:0/817697739 wait complete. 2024-09-11T23:56:42.160 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:41 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/817697739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:42.161 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 11 23:56:42 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-g[72270]: starting mds.g at 2024-09-11T23:56:42.161 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 11 23:56:42 smithi006 bash[72242]: d4c228503df0730ec48d4c20bf6c37a6b2766542a8d96172a631a378c1b9667c 2024-09-11T23:56:42.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:41 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/817697739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:42.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:41 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/817697739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:42.589 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 11 23:56:42 smithi006 systemd[1]: Started Ceph mds.g for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:43.195 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:42 smithi039 ceph-mon[34543]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:43.195 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:42 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:43.195 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:42 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:43.195 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:42 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:43.195 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:42 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:43.196 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:42 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:43.196 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:42 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:43.196 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:42 smithi039 ceph-mon[34543]: Deploying daemon mds.a on smithi006 2024-09-11T23:56:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:42 smithi134 ceph-mon[34893]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:42 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:42 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:42 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:42 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:42 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:42 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:42 smithi134 ceph-mon[34893]: Deploying daemon mds.a on smithi006 2024-09-11T23:56:43.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:42 smithi006 ceph-mon[30947]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:43.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:42 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:43.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:42 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:43.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:42 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:43.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:42 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:43.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:42 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:43.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:42 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:43.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:42 smithi006 ceph-mon[30947]: Deploying daemon mds.a on smithi006 2024-09-11T23:56:44.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:43 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.6:6838/809129212,v1:172.21.15.6:6839/809129212] up:boot 2024-09-11T23:56:44.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:43 smithi006 ceph-mon[30947]: fsmap 10 up:standby 2024-09-11T23:56:44.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:43 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:56:44.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:43 smithi006 ceph-mon[30947]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:44.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:43 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.6:6838/809129212,v1:172.21.15.6:6839/809129212] up:boot 2024-09-11T23:56:44.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:43 smithi134 ceph-mon[34893]: fsmap 10 up:standby 2024-09-11T23:56:44.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:43 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:56:44.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:43 smithi134 ceph-mon[34893]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:44.208 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:43 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.6:6838/809129212,v1:172.21.15.6:6839/809129212] up:boot 2024-09-11T23:56:44.208 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:43 smithi039 ceph-mon[34543]: fsmap 10 up:standby 2024-09-11T23:56:44.208 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:43 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:56:44.208 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:43 smithi039 ceph-mon[34543]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:44.369 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 11 23:56:44 smithi006 systemd[1]: Starting Ceph mds.a for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:44.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:44.786 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 11 23:56:44 smithi006 podman[72562]: 2024-09-11 23:56:44.412659895 +0000 UTC m=+0.016349485 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:44.786 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 11 23:56:44 smithi006 podman[72562]: 2024-09-11 23:56:44.534832973 +0000 UTC m=+0.138522555 container create 8541334edb50cdf17972933e4393b4286ab094899603952902a44a945dce9241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-11T23:56:44.786 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 11 23:56:44 smithi006 podman[72562]: 2024-09-11 23:56:44.787661478 +0000 UTC m=+0.391351069 container init 8541334edb50cdf17972933e4393b4286ab094899603952902a44a945dce9241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:56:44.956 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:45.080 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 11 23:56:44 smithi006 podman[72562]: 2024-09-11 23:56:44.791045153 +0000 UTC m=+0.394734733 container start 8541334edb50cdf17972933e4393b4286ab094899603952902a44a945dce9241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-11T23:56:45.081 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 11 23:56:44 smithi006 ceph-mds[72600]: -- 172.21.15.6:0/3187671547 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56378c797860 con 0x56378c775400 2024-09-11T23:56:45.081 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 11 23:56:44 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-a[72594]: starting mds.a at 2024-09-11T23:56:45.081 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 11 23:56:44 smithi006 bash[72562]: 8541334edb50cdf17972933e4393b4286ab094899603952902a44a945dce9241 2024-09-11T23:56:45.081 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 11 23:56:44 smithi006 systemd[1]: Started Ceph mds.a for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:45.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.448+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3481709292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3cc101240 msgr2=0x7ff3cc101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:45.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.448+0000 7ff3d47ad640 1 --2- 172.21.15.6:0/3481709292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3cc101240 0x7ff3cc101680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009900 tx=0x7ff3bc02a410 comp rx=0 tx=0).stop 2024-09-11T23:56:45.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.448+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3481709292 shutdown_connections 2024-09-11T23:56:45.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.448+0000 7ff3d47ad640 1 --2- 172.21.15.6:0/3481709292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3cc101bc0 0x7ff3cc10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.448+0000 7ff3d47ad640 1 --2- 172.21.15.6:0/3481709292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3cc101240 0x7ff3cc101680 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.448+0000 7ff3d47ad640 1 --2- 172.21.15.6:0/3481709292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3cc105a90 0x7ff3cc105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.448+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3481709292 >> 172.21.15.6:0/3481709292 conn(0x7ff3cc077210 msgr2=0x7ff3cc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:45.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.448+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3481709292 shutdown_connections 2024-09-11T23:56:45.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.448+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3481709292 wait complete. 2024-09-11T23:56:45.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d47ad640 1 Processor -- start 2024-09-11T23:56:45.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d47ad640 1 -- start start 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d47ad640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3cc101240 0x7ff3cc0fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d47ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3cc101bc0 0x7ff3cc0fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d47ad640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3cc105a90 0x7ff3cc0fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d47ad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc110e70 con 0x7ff3cc101bc0 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d47ad640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc110cf0 con 0x7ff3cc105a90 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d47ad640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc110ff0 con 0x7ff3cc101240 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d1d48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3cc101bc0 0x7ff3cc0fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d1d48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3cc101bc0 0x7ff3cc0fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50782/0 (socket says 172.21.15.6:50782) 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d1d48640 1 -- 172.21.15.6:0/3951478712 learned_addr learned my addr 172.21.15.6:0/3951478712 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d2d4a640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3cc105a90 0x7ff3cc0fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.449+0000 7ff3d2549640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3cc101240 0x7ff3cc0fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.450+0000 7ff3d2d4a640 1 -- 172.21.15.6:0/3951478712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3cc101240 msgr2=0x7ff3cc0fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:45.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.450+0000 7ff3d2d4a640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3cc101240 0x7ff3cc0fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.450+0000 7ff3d2d4a640 1 -- 172.21.15.6:0/3951478712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3cc101bc0 msgr2=0x7ff3cc0fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.450+0000 7ff3d2d4a640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3cc101bc0 0x7ff3cc0fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.450+0000 7ff3d2d4a640 1 -- 172.21.15.6:0/3951478712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc1a68d0 con 0x7ff3cc105a90 2024-09-11T23:56:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.450+0000 7ff3d1d48640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3cc101bc0 0x7ff3cc0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:56:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.450+0000 7ff3d2d4a640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3cc105a90 0x7ff3cc0fd110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009fd0 tx=0x7ff3c400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.450+0000 7ff3c37fe640 1 -- 172.21.15.6:0/3951478712 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400ce20 con 0x7ff3cc105a90 2024-09-11T23:56:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.450+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3951478712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3cc1a6bc0 con 0x7ff3cc105a90 2024-09-11T23:56:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.450+0000 7ff3c37fe640 1 -- 172.21.15.6:0/3951478712 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3c4005020 con 0x7ff3cc105a90 2024-09-11T23:56:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.450+0000 7ff3c37fe640 1 -- 172.21.15.6:0/3951478712 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4010690 con 0x7ff3cc105a90 2024-09-11T23:56:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.450+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3951478712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3cc1a7100 con 0x7ff3cc105a90 2024-09-11T23:56:45.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.451+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3951478712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3cc101680 con 0x7ff3cc105a90 2024-09-11T23:56:45.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.452+0000 7ff3c37fe640 1 -- 172.21.15.6:0/3951478712 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff3c40051d0 con 0x7ff3cc105a90 2024-09-11T23:56:45.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.453+0000 7ff3c37fe640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff3b80a2b80 0x7ff3b80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:45.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.453+0000 7ff3d2549640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff3b80a2b80 0x7ff3b80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:45.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.453+0000 7ff3c37fe640 1 -- 172.21.15.6:0/3951478712 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7ff3c40cf310 con 0x7ff3cc105a90 2024-09-11T23:56:45.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.453+0000 7ff3d2549640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff3b80a2b80 0x7ff3b80a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8005fd0 tx=0x7ff3c800b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:45.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.458+0000 7ff3c37fe640 1 -- 172.21.15.6:0/3951478712 <== mon.2 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3c409c710 con 0x7ff3cc105a90 2024-09-11T23:56:45.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.671+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3951478712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3cc109fc0 con 0x7ff3cc105a90 2024-09-11T23:56:45.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.672+0000 7ff3c37fe640 1 -- 172.21.15.6:0/3951478712 <== mon.2 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9671 (secure 0 0 0) 0x7ff3c409c010 con 0x7ff3cc105a90 2024-09-11T23:56:45.672 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:45.673 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":12,"btime":"2024-09-11T23:56:44:930101+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/809129212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":809129212},{"type":"v1","addr":"172.21.15.6:6839","nonce":809129212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/500771395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":500771395},{"type":"v1","addr":"172.21.15.6:6841","nonce":500771395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T23:56:45.673 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2024-09-11T23:56:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.674+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3951478712 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff3b80a2b80 msgr2=0x7ff3b80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.674+0000 7ff3d47ad640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff3b80a2b80 0x7ff3b80a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8005fd0 tx=0x7ff3c800b510 comp rx=0 tx=0).stop 2024-09-11T23:56:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.674+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3951478712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3cc105a90 msgr2=0x7ff3cc0fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.674+0000 7ff3d47ad640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3cc105a90 0x7ff3cc0fd110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009fd0 tx=0x7ff3c400ef10 comp rx=0 tx=0).stop 2024-09-11T23:56:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.675+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3951478712 shutdown_connections 2024-09-11T23:56:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.675+0000 7ff3d47ad640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff3b80a2b80 0x7ff3b80a5040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.675+0000 7ff3d47ad640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3cc105a90 0x7ff3cc0fd110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.675+0000 7ff3d47ad640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3cc101bc0 0x7ff3cc0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.675+0000 7ff3d47ad640 1 --2- 172.21.15.6:0/3951478712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3cc101240 0x7ff3cc0fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.675+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3951478712 >> 172.21.15.6:0/3951478712 conn(0x7ff3cc077210 msgr2=0x7ff3cc100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.675+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3951478712 shutdown_connections 2024-09-11T23:56:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:45.675+0000 7ff3d47ad640 1 -- 172.21.15.6:0/3951478712 wait complete. 2024-09-11T23:56:46.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:45 smithi039 ceph-mon[34543]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:46.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:45 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.6:6840/500771395,v1:172.21.15.6:6841/500771395] up:boot 2024-09-11T23:56:46.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:45 smithi039 ceph-mon[34543]: fsmap 11 up:standby 2024-09-11T23:56:46.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:45 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:56:46.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:45 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:46.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:45 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:46.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:45 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:46.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:45 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:46.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:45 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:46.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:45 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:46.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:45 smithi039 ceph-mon[34543]: Deploying daemon mds.b on smithi039 2024-09-11T23:56:46.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:45 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3951478712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:46.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:45 smithi134 ceph-mon[34893]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:46.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:45 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.6:6840/500771395,v1:172.21.15.6:6841/500771395] up:boot 2024-09-11T23:56:46.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:45 smithi134 ceph-mon[34893]: fsmap 11 up:standby 2024-09-11T23:56:46.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:45 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:56:46.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:45 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:46.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:45 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:46.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:45 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:46.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:45 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:46.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:45 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:46.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:45 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:46.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:45 smithi134 ceph-mon[34893]: Deploying daemon mds.b on smithi039 2024-09-11T23:56:46.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:45 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3951478712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:46.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:45 smithi006 ceph-mon[30947]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:46.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:45 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.6:6840/500771395,v1:172.21.15.6:6841/500771395] up:boot 2024-09-11T23:56:46.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:45 smithi006 ceph-mon[30947]: fsmap 11 up:standby 2024-09-11T23:56:46.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:45 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:56:46.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:45 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:46.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:45 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:46.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:45 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:46.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:45 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:46.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:45 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:46.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:45 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:46.322 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:45 smithi006 ceph-mon[30947]: Deploying daemon mds.b on smithi039 2024-09-11T23:56:46.322 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:45 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3951478712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:47.224 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:56:47 smithi039 systemd[1]: Starting Ceph mds.b for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:47.490 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:56:47 smithi039 podman[64941]: 2024-09-11 23:56:47.128466694 +0000 UTC m=+0.016560961 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:47.491 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:56:47 smithi039 podman[64941]: 2024-09-11 23:56:47.230668587 +0000 UTC m=+0.118762886 container create af7e0b346c48122f849b39048d9fda8e71162bddc8a1139f2092fe4d3d749801 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-11T23:56:47.794 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:56:47 smithi039 podman[64941]: 2024-09-11 23:56:47.492040339 +0000 UTC m=+0.380134599 container init af7e0b346c48122f849b39048d9fda8e71162bddc8a1139f2092fe4d3d749801 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3) 2024-09-11T23:56:47.794 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:56:47 smithi039 podman[64941]: 2024-09-11 23:56:47.494981021 +0000 UTC m=+0.383075279 container start af7e0b346c48122f849b39048d9fda8e71162bddc8a1139f2092fe4d3d749801 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T23:56:47.794 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:56:47 smithi039 ceph-mds[64960]: -- 172.21.15.39:0/3596690961 <== mon.2 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559dd1bc1860 con 0x559dd1b9f000 2024-09-11T23:56:47.794 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:56:47 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b[64956]: starting mds.b at 2024-09-11T23:56:47.794 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:56:47 smithi039 bash[64941]: af7e0b346c48122f849b39048d9fda8e71162bddc8a1139f2092fe4d3d749801 2024-09-11T23:56:47.794 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:56:47 smithi039 systemd[1]: Started Ceph mds.b for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:48.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:48.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:48 smithi039 ceph-mon[34543]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:48.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:48.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:48.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:48.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:48.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:48.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:48.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:48 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] up:boot 2024-09-11T23:56:48.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:48 smithi039 ceph-mon[34543]: fsmap 12 up:standby 2024-09-11T23:56:48.795 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:48 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:56:48.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:48 smithi134 ceph-mon[34893]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:48.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:48.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:48.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:48.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:48.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:48.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:48.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:48 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] up:boot 2024-09-11T23:56:48.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:48 smithi134 ceph-mon[34893]: fsmap 12 up:standby 2024-09-11T23:56:48.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:48 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:56:48.959 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:49.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:48 smithi006 ceph-mon[30947]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:49.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:49.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:49.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:49.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:49.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:49.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:49.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:48 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] up:boot 2024-09-11T23:56:49.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:48 smithi006 ceph-mon[30947]: fsmap 12 up:standby 2024-09-11T23:56:49.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:48 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:56:49.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.481+0000 7f4183dd5640 1 -- 172.21.15.6:0/2489142335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c102d40 msgr2=0x7f417c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:49.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.481+0000 7f4183dd5640 1 --2- 172.21.15.6:0/2489142335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c102d40 0x7f417c103120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4178009900 tx=0x7f417802a480 comp rx=0 tx=0).stop 2024-09-11T23:56:49.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.481+0000 7f4183dd5640 1 -- 172.21.15.6:0/2489142335 shutdown_connections 2024-09-11T23:56:49.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.481+0000 7f4183dd5640 1 --2- 172.21.15.6:0/2489142335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f417c10c170 0x7f417c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.481+0000 7f4183dd5640 1 --2- 172.21.15.6:0/2489142335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c103660 0x7f417c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.481+0000 7f4183dd5640 1 --2- 172.21.15.6:0/2489142335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c102d40 0x7f417c103120 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.481+0000 7f4183dd5640 1 -- 172.21.15.6:0/2489142335 >> 172.21.15.6:0/2489142335 conn(0x7f417c0fc7a0 msgr2=0x7f417c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:49.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.481+0000 7f4183dd5640 1 -- 172.21.15.6:0/2489142335 shutdown_connections 2024-09-11T23:56:49.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.481+0000 7f4183dd5640 1 -- 172.21.15.6:0/2489142335 wait complete. 2024-09-11T23:56:49.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.481+0000 7f4183dd5640 1 Processor -- start 2024-09-11T23:56:49.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.481+0000 7f4183dd5640 1 -- start start 2024-09-11T23:56:49.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4183dd5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c102d40 0x7f417c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4183dd5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f417c103660 0x7f417c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4183dd5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c10c170 0x7f417c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4183dd5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f417c111e20 con 0x7f417c102d40 2024-09-11T23:56:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4183dd5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f417c111ca0 con 0x7f417c103660 2024-09-11T23:56:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4183dd5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f417c111fa0 con 0x7f417c10c170 2024-09-11T23:56:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4181b71640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c102d40 0x7f417c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4181b71640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c102d40 0x7f417c1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50806/0 (socket says 172.21.15.6:50806) 2024-09-11T23:56:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4181b71640 1 -- 172.21.15.6:0/906102530 learned_addr learned my addr 172.21.15.6:0/906102530 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4181370640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f417c103660 0x7f417c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4182372640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c10c170 0x7f417c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4181b71640 1 -- 172.21.15.6:0/906102530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c10c170 msgr2=0x7f417c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4181b71640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c10c170 0x7f417c19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4181b71640 1 -- 172.21.15.6:0/906102530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f417c103660 msgr2=0x7f417c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4181b71640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f417c103660 0x7f417c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4181b71640 1 -- 172.21.15.6:0/906102530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c19d390 con 0x7f417c102d40 2024-09-11T23:56:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4181370640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f417c103660 0x7f417c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:56:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4181b71640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c102d40 0x7f417c1983e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4178005940 tx=0x7f41780040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4172ffd640 1 -- 172.21.15.6:0/906102530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417803f030 con 0x7f417c102d40 2024-09-11T23:56:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4172ffd640 1 -- 172.21.15.6:0/906102530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41780044c0 con 0x7f417c102d40 2024-09-11T23:56:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4183dd5640 1 -- 172.21.15.6:0/906102530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c19d620 con 0x7f417c102d40 2024-09-11T23:56:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.482+0000 7f4172ffd640 1 -- 172.21.15.6:0/906102530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178035070 con 0x7f417c102d40 2024-09-11T23:56:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.483+0000 7f4183dd5640 1 -- 172.21.15.6:0/906102530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c1a4f60 con 0x7f417c102d40 2024-09-11T23:56:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.484+0000 7f4183dd5640 1 -- 172.21.15.6:0/906102530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417c06b070 con 0x7f417c102d40 2024-09-11T23:56:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.485+0000 7f4172ffd640 1 -- 172.21.15.6:0/906102530 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4178042030 con 0x7f417c102d40 2024-09-11T23:56:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.485+0000 7f4172ffd640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f41680a2b80 0x7f41680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.485+0000 7f4181370640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f41680a2b80 0x7f41680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.485+0000 7f4172ffd640 1 -- 172.21.15.6:0/906102530 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f41780eeed0 con 0x7f417c102d40 2024-09-11T23:56:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.486+0000 7f4181370640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f41680a2b80 0x7f41680a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f417c0fee10 tx=0x7f416c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.490+0000 7f4172ffd640 1 -- 172.21.15.6:0/906102530 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41780bc2d0 con 0x7f417c102d40 2024-09-11T23:56:49.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.744+0000 7f4183dd5640 1 -- 172.21.15.6:0/906102530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f417c1071e0 con 0x7f417c102d40 2024-09-11T23:56:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.745+0000 7f4172ffd640 1 -- 172.21.15.6:0/906102530 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10497 (secure 0 0 0) 0x7f41780bbbd0 con 0x7f417c102d40 2024-09-11T23:56:49.745 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:49.745 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":13,"btime":"2024-09-11T23:56:47:939814+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/809129212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":809129212},{"type":"v1","addr":"172.21.15.6:6839","nonce":809129212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/500771395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":500771395},{"type":"v1","addr":"172.21.15.6:6841","nonce":500771395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24491,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3561706320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3561706320},{"type":"v1","addr":"172.21.15.39:6839","nonce":3561706320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-11T23:56:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 13 2024-09-11T23:56:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.748+0000 7f4183dd5640 1 -- 172.21.15.6:0/906102530 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f41680a2b80 msgr2=0x7f41680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.748+0000 7f4183dd5640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f41680a2b80 0x7f41680a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f417c0fee10 tx=0x7f416c005f90 comp rx=0 tx=0).stop 2024-09-11T23:56:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.748+0000 7f4183dd5640 1 -- 172.21.15.6:0/906102530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c102d40 msgr2=0x7f417c1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.748+0000 7f4183dd5640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c102d40 0x7f417c1983e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4178005940 tx=0x7f41780040c0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.748+0000 7f4183dd5640 1 -- 172.21.15.6:0/906102530 shutdown_connections 2024-09-11T23:56:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.748+0000 7f4183dd5640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f41680a2b80 0x7f41680a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.748+0000 7f4183dd5640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c10c170 0x7f417c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.748+0000 7f4183dd5640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f417c103660 0x7f417c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.748+0000 7f4183dd5640 1 --2- 172.21.15.6:0/906102530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c102d40 0x7f417c1983e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.748+0000 7f4183dd5640 1 -- 172.21.15.6:0/906102530 >> 172.21.15.6:0/906102530 conn(0x7f417c0fc7a0 msgr2=0x7f417c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.748+0000 7f4183dd5640 1 -- 172.21.15.6:0/906102530 shutdown_connections 2024-09-11T23:56:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:49.748+0000 7f4183dd5640 1 -- 172.21.15.6:0/906102530 wait complete. 2024-09-11T23:56:50.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:50 smithi006 ceph-mon[30947]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:50.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.487 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:50 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/906102530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:50.487 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.487 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.487 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:50.487 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:50.487 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.487 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:50 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:50.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-11T23:56:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:50 smithi039 ceph-mon[34543]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:50 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/906102530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:50 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:50.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:50 smithi134 ceph-mon[34893]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:50.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:50 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/906102530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:50.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:50.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:50.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:50.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:50 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:51.417 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:51.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.920+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/615220618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a98100e20 msgr2=0x7f4a98101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:51.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.920+0000 7f4a9e0eb640 1 --2- 172.21.15.6:0/615220618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a98100e20 0x7f4a98101200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009900 tx=0x7f4a8802a480 comp rx=0 tx=0).stop 2024-09-11T23:56:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.920+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/615220618 shutdown_connections 2024-09-11T23:56:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.920+0000 7f4a9e0eb640 1 --2- 172.21.15.6:0/615220618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a98102ef0 0x7f4a9810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.920+0000 7f4a9e0eb640 1 --2- 172.21.15.6:0/615220618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a98102570 0x7f4a981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.920+0000 7f4a9e0eb640 1 --2- 172.21.15.6:0/615220618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a98100e20 0x7f4a98101200 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.920+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/615220618 >> 172.21.15.6:0/615220618 conn(0x7f4a980fc7d0 msgr2=0x7f4a980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.920+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/615220618 shutdown_connections 2024-09-11T23:56:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.920+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/615220618 wait complete. 2024-09-11T23:56:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.920+0000 7f4a9e0eb640 1 Processor -- start 2024-09-11T23:56:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a9e0eb640 1 -- start start 2024-09-11T23:56:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a9e0eb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a98100e20 0x7f4a98198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a9e0eb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a98102570 0x7f4a98198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a9e0eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a98102ef0 0x7f4a9819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a9e0eb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98110e00 con 0x7f4a98102570 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a9e0eb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98110c80 con 0x7f4a98102ef0 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a9e0eb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98110f80 con 0x7f4a98100e20 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a96ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a98102570 0x7f4a98198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a96ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a98102570 0x7f4a98198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52390/0 (socket says 172.21.15.6:52390) 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a96ffd640 1 -- 172.21.15.6:0/1088539812 learned_addr learned my addr 172.21.15.6:0/1088539812 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a977fe640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a98100e20 0x7f4a98198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a97fff640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a98102ef0 0x7f4a9819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a96ffd640 1 -- 172.21.15.6:0/1088539812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a98100e20 msgr2=0x7f4a98198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a96ffd640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a98100e20 0x7f4a98198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a96ffd640 1 -- 172.21.15.6:0/1088539812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a98102ef0 msgr2=0x7f4a9819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a96ffd640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a98102ef0 0x7f4a9819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a96ffd640 1 -- 172.21.15.6:0/1088539812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9819d3b0 con 0x7f4a98102570 2024-09-11T23:56:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.921+0000 7f4a96ffd640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a98102570 0x7f4a98198940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00d950 tx=0x7f4a8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.922+0000 7f4a94ff9640 1 -- 172.21.15.6:0/1088539812 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c017070 con 0x7f4a98102570 2024-09-11T23:56:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.922+0000 7f4a94ff9640 1 -- 172.21.15.6:0/1088539812 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a8c009c30 con 0x7f4a98102570 2024-09-11T23:56:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.922+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/1088539812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9819d6a0 con 0x7f4a98102570 2024-09-11T23:56:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.922+0000 7f4a94ff9640 1 -- 172.21.15.6:0/1088539812 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c00f620 con 0x7f4a98102570 2024-09-11T23:56:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.922+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/1088539812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a981a4f80 con 0x7f4a98102570 2024-09-11T23:56:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.923+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/1088539812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a98101200 con 0x7f4a98102570 2024-09-11T23:56:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.924+0000 7f4a94ff9640 1 -- 172.21.15.6:0/1088539812 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4a8c0109a0 con 0x7f4a98102570 2024-09-11T23:56:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.924+0000 7f4a94ff9640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4a800a2b80 0x7f4a800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.925+0000 7f4a977fe640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4a800a2b80 0x7f4a800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.925+0000 7f4a94ff9640 1 -- 172.21.15.6:0/1088539812 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f4a8c0ce740 con 0x7f4a98102570 2024-09-11T23:56:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.925+0000 7f4a977fe640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4a800a2b80 0x7f4a800a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009230 tx=0x7f4a880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:51.929+0000 7f4a94ff9640 1 -- 172.21.15.6:0/1088539812 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a8c009de0 con 0x7f4a98102570 2024-09-11T23:56:52.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:51 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:51 smithi006 ceph-mon[30947]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:52.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:51 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:51 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:51 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:51 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.135+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/1088539812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4a981a5150 con 0x7f4a98102570 2024-09-11T23:56:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.135+0000 7f4a94ff9640 1 -- 172.21.15.6:0/1088539812 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f4a8c09b4f0 con 0x7f4a98102570 2024-09-11T23:56:52.135 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:56:52.135 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-09-11T23:56:52.135 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-11T23:56:52.135 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-09-11T23:56:52.136 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-09-11T23:56:52.136 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-11T23:56:52.136 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-09-11T23:56:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.137+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/1088539812 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4a800a2b80 msgr2=0x7f4a800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.138+0000 7f4a9e0eb640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4a800a2b80 0x7f4a800a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009230 tx=0x7f4a880058d0 comp rx=0 tx=0).stop 2024-09-11T23:56:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.138+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/1088539812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a98102570 msgr2=0x7f4a98198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.138+0000 7f4a9e0eb640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a98102570 0x7f4a98198940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00d950 tx=0x7f4a8c00de10 comp rx=0 tx=0).stop 2024-09-11T23:56:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.138+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/1088539812 shutdown_connections 2024-09-11T23:56:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.138+0000 7f4a9e0eb640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4a800a2b80 0x7f4a800a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.138+0000 7f4a9e0eb640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a98102ef0 0x7f4a9819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.138+0000 7f4a9e0eb640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a98102570 0x7f4a98198940 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.138+0000 7f4a9e0eb640 1 --2- 172.21.15.6:0/1088539812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a98100e20 0x7f4a98198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.138+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/1088539812 >> 172.21.15.6:0/1088539812 conn(0x7f4a980fc7d0 msgr2=0x7f4a98069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.138+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/1088539812 shutdown_connections 2024-09-11T23:56:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:52.138+0000 7f4a9e0eb640 1 -- 172.21.15.6:0/1088539812 wait complete. 2024-09-11T23:56:52.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:51 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:51 smithi134 ceph-mon[34893]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:52.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:51 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:51 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:51 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:51 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:51 smithi039 ceph-mon[34543]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:52.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:51 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:52.818 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:56:52.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:56:53.075 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:53.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:52 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1088539812' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T23:56:53.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:53.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:53.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:53.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:53.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:52 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:53.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:52 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1088539812' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T23:56:53.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:53.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:53.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:53.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:53.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:52 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:53.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:52 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1088539812' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T23:56:53.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:53.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:53.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:53.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:53.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:52 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:56:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.580+0000 7f30e9dcf640 1 -- 172.21.15.6:0/4228488000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4100e20 msgr2=0x7f30e4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.580+0000 7f30e9dcf640 1 --2- 172.21.15.6:0/4228488000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4100e20 0x7f30e4101200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009900 tx=0x7f30d402a480 comp rx=0 tx=0).stop 2024-09-11T23:56:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.581+0000 7f30e9dcf640 1 -- 172.21.15.6:0/4228488000 shutdown_connections 2024-09-11T23:56:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.581+0000 7f30e9dcf640 1 --2- 172.21.15.6:0/4228488000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e4102ef0 0x7f30e410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.581+0000 7f30e9dcf640 1 --2- 172.21.15.6:0/4228488000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4102570 0x7f30e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.581+0000 7f30e9dcf640 1 --2- 172.21.15.6:0/4228488000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4100e20 0x7f30e4101200 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.581+0000 7f30e9dcf640 1 -- 172.21.15.6:0/4228488000 >> 172.21.15.6:0/4228488000 conn(0x7f30e40fc7d0 msgr2=0x7f30e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.581+0000 7f30e9dcf640 1 -- 172.21.15.6:0/4228488000 shutdown_connections 2024-09-11T23:56:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.581+0000 7f30e9dcf640 1 -- 172.21.15.6:0/4228488000 wait complete. 2024-09-11T23:56:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.581+0000 7f30e9dcf640 1 Processor -- start 2024-09-11T23:56:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.581+0000 7f30e9dcf640 1 -- start start 2024-09-11T23:56:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30e9dcf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4100e20 0x7f30e4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30e9dcf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4102570 0x7f30e4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30e9dcf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e4102ef0 0x7f30e419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30e9dcf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f30e4110e50 con 0x7f30e4102570 2024-09-11T23:56:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30e9dcf640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30e4110cd0 con 0x7f30e4100e20 2024-09-11T23:56:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30e9dcf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f30e4110fd0 con 0x7f30e4102ef0 2024-09-11T23:56:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30daffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4102570 0x7f30e4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30e37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4100e20 0x7f30e4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30daffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4102570 0x7f30e4198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52414/0 (socket says 172.21.15.6:52414) 2024-09-11T23:56:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30daffd640 1 -- 172.21.15.6:0/2847935092 learned_addr learned my addr 172.21.15.6:0/2847935092 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30e3fff640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e4102ef0 0x7f30e419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30daffd640 1 -- 172.21.15.6:0/2847935092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e4102ef0 msgr2=0x7f30e419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30daffd640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e4102ef0 0x7f30e419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30daffd640 1 -- 172.21.15.6:0/2847935092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4100e20 msgr2=0x7f30e4198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30daffd640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4100e20 0x7f30e4198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30daffd640 1 -- 172.21.15.6:0/2847935092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e419d400 con 0x7f30e4102570 2024-09-11T23:56:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30e37fe640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4100e20 0x7f30e4198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:56:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.582+0000 7f30daffd640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4102570 0x7f30e4198990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00d950 tx=0x7f30cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.583+0000 7f30e17fa640 1 -- 172.21.15.6:0/2847935092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc017070 con 0x7f30e4102570 2024-09-11T23:56:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.583+0000 7f30e17fa640 1 -- 172.21.15.6:0/2847935092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30cc009c30 con 0x7f30e4102570 2024-09-11T23:56:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.583+0000 7f30e9dcf640 1 -- 172.21.15.6:0/2847935092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e419d6f0 con 0x7f30e4102570 2024-09-11T23:56:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.583+0000 7f30e17fa640 1 -- 172.21.15.6:0/2847935092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00f620 con 0x7f30e4102570 2024-09-11T23:56:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.583+0000 7f30e9dcf640 1 -- 172.21.15.6:0/2847935092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e41a4fd0 con 0x7f30e4102570 2024-09-11T23:56:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.584+0000 7f30e9dcf640 1 -- 172.21.15.6:0/2847935092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e4101200 con 0x7f30e4102570 2024-09-11T23:56:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.585+0000 7f30e17fa640 1 -- 172.21.15.6:0/2847935092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f30cc0109a0 con 0x7f30e4102570 2024-09-11T23:56:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.586+0000 7f30e17fa640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f30d00a2c00 0x7f30d00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.586+0000 7f30e37fe640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f30d00a2c00 0x7f30d00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.586+0000 7f30e17fa640 1 -- 172.21.15.6:0/2847935092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f30cc0ce720 con 0x7f30e4102570 2024-09-11T23:56:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.586+0000 7f30e37fe640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f30d00a2c00 0x7f30d00a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009230 tx=0x7f30d40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.590+0000 7f30e17fa640 1 -- 172.21.15.6:0/2847935092 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30cc009de0 con 0x7f30e4102570 2024-09-11T23:56:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:53.765+0000 7f30e9dcf640 1 -- 172.21.15.6:0/2847935092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f30e41a51a0 con 0x7f30e4102570 2024-09-11T23:56:54.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.254+0000 7f30e17fa640 1 -- 172.21.15.6:0/2847935092 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7f30cc09b470 con 0x7f30e4102570 2024-09-11T23:56:54.255 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-09-11T23:56:54.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.257+0000 7f30e9dcf640 1 -- 172.21.15.6:0/2847935092 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f30d00a2c00 msgr2=0x7f30d00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.257+0000 7f30e9dcf640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f30d00a2c00 0x7f30d00a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009230 tx=0x7f30d40058d0 comp rx=0 tx=0).stop 2024-09-11T23:56:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.257+0000 7f30e9dcf640 1 -- 172.21.15.6:0/2847935092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4102570 msgr2=0x7f30e4198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.257+0000 7f30e9dcf640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4102570 0x7f30e4198990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00d950 tx=0x7f30cc00de10 comp rx=0 tx=0).stop 2024-09-11T23:56:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.257+0000 7f30e9dcf640 1 -- 172.21.15.6:0/2847935092 shutdown_connections 2024-09-11T23:56:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.257+0000 7f30e9dcf640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f30d00a2c00 0x7f30d00a50c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.257+0000 7f30e9dcf640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e4102ef0 0x7f30e419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.257+0000 7f30e9dcf640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4102570 0x7f30e4198990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.257+0000 7f30e9dcf640 1 --2- 172.21.15.6:0/2847935092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4100e20 0x7f30e4198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.257+0000 7f30e9dcf640 1 -- 172.21.15.6:0/2847935092 >> 172.21.15.6:0/2847935092 conn(0x7f30e40fc7d0 msgr2=0x7f30e4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.257+0000 7f30e9dcf640 1 -- 172.21.15.6:0/2847935092 shutdown_connections 2024-09-11T23:56:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:54.257+0000 7f30e9dcf640 1 -- 172.21.15.6:0/2847935092 wait complete. 2024-09-11T23:56:54.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:54 smithi039 ceph-mon[34543]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:54.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:54 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2847935092' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:56:54.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:54 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2847935092' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T23:56:54.574 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:54 smithi006 ceph-mon[30947]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:54.574 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:54 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2847935092' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:56:54.574 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:54 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2847935092' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T23:56:54.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:54 smithi134 ceph-mon[34893]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:54.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:54 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2847935092' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:56:54.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:54 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2847935092' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T23:56:54.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-11T23:56:55.211 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:55.516 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:55 smithi006 ceph-mon[30947]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T23:56:55.516 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:55 smithi006 ceph-mon[30947]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T23:56:55.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:55 smithi039 ceph-mon[34543]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T23:56:55.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:55 smithi039 ceph-mon[34543]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T23:56:55.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:55 smithi134 ceph-mon[34893]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T23:56:55.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:55 smithi134 ceph-mon[34893]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T23:56:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.710+0000 7f4f71d7e640 1 -- 172.21.15.6:0/3233451380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c102da0 msgr2=0x7f4f6c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.710+0000 7f4f71d7e640 1 --2- 172.21.15.6:0/3233451380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c102da0 0x7f4f6c103180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009900 tx=0x7f4f5c02a480 comp rx=0 tx=0).stop 2024-09-11T23:56:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.710+0000 7f4f71d7e640 1 -- 172.21.15.6:0/3233451380 shutdown_connections 2024-09-11T23:56:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.710+0000 7f4f71d7e640 1 --2- 172.21.15.6:0/3233451380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f6c10c180 0x7f4f6c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.710+0000 7f4f71d7e640 1 --2- 172.21.15.6:0/3233451380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c1036c0 0x7f4f6c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.710+0000 7f4f71d7e640 1 --2- 172.21.15.6:0/3233451380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c102da0 0x7f4f6c103180 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.710+0000 7f4f71d7e640 1 -- 172.21.15.6:0/3233451380 >> 172.21.15.6:0/3233451380 conn(0x7f4f6c0fc7a0 msgr2=0x7f4f6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.710+0000 7f4f71d7e640 1 -- 172.21.15.6:0/3233451380 shutdown_connections 2024-09-11T23:56:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.710+0000 7f4f71d7e640 1 -- 172.21.15.6:0/3233451380 wait complete. 2024-09-11T23:56:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f71d7e640 1 Processor -- start 2024-09-11T23:56:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f71d7e640 1 -- start start 2024-09-11T23:56:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f71d7e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102da0 0x7f4f6c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f71d7e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f6c1036c0 0x7f4f6c1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f71d7e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c10c180 0x7f4f6c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f71d7e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c111e50 con 0x7f4f6c10c180 2024-09-11T23:56:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f71d7e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c111cd0 con 0x7f4f6c1036c0 2024-09-11T23:56:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f71d7e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c111fd0 con 0x7f4f6c102da0 2024-09-11T23:56:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f6bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c10c180 0x7f4f6c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f6bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c10c180 0x7f4f6c19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52420/0 (socket says 172.21.15.6:52420) 2024-09-11T23:56:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f6bfff640 1 -- 172.21.15.6:0/80869154 learned_addr learned my addr 172.21.15.6:0/80869154 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f6b7fe640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102da0 0x7f4f6c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f6affd640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f6c1036c0 0x7f4f6c1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f6bfff640 1 -- 172.21.15.6:0/80869154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102da0 msgr2=0x7f4f6c198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f6bfff640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102da0 0x7f4f6c198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f6bfff640 1 -- 172.21.15.6:0/80869154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f6c1036c0 msgr2=0x7f4f6c1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f6bfff640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f6c1036c0 0x7f4f6c1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.711+0000 7f4f6bfff640 1 -- 172.21.15.6:0/80869154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6c19d340 con 0x7f4f6c10c180 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.712+0000 7f4f6bfff640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c10c180 0x7f4f6c19cc60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009fd0 tx=0x7f4f6400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.712+0000 7f4f68ff9640 1 -- 172.21.15.6:0/80869154 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f64011830 con 0x7f4f6c10c180 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.712+0000 7f4f68ff9640 1 -- 172.21.15.6:0/80869154 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f64016070 con 0x7f4f6c10c180 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.712+0000 7f4f71d7e640 1 -- 172.21.15.6:0/80869154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6c19d630 con 0x7f4f6c10c180 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.712+0000 7f4f68ff9640 1 -- 172.21.15.6:0/80869154 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f64010de0 con 0x7f4f6c10c180 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.712+0000 7f4f71d7e640 1 -- 172.21.15.6:0/80869154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6c1a4f10 con 0x7f4f6c10c180 2024-09-11T23:56:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.713+0000 7f4f71d7e640 1 -- 172.21.15.6:0/80869154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f6c103180 con 0x7f4f6c10c180 2024-09-11T23:56:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.714+0000 7f4f68ff9640 1 -- 172.21.15.6:0/80869154 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4f640119d0 con 0x7f4f6c10c180 2024-09-11T23:56:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.715+0000 7f4f68ff9640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4f540a2b80 0x7f4f540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.715+0000 7f4f6b7fe640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4f540a2b80 0x7f4f540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.715+0000 7f4f68ff9640 1 -- 172.21.15.6:0/80869154 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7f4f640ce9f0 con 0x7f4f6c10c180 2024-09-11T23:56:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.715+0000 7f4f6b7fe640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4f540a2b80 0x7f4f540a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c031440 tx=0x7f4f5c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.719+0000 7f4f68ff9640 1 -- 172.21.15.6:0/80869154 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4f6409bc80 con 0x7f4f6c10c180 2024-09-11T23:56:55.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:55.894+0000 7f4f71d7e640 1 -- 172.21.15.6:0/80869154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f4f6c106c90 con 0x7f4f6c10c180 2024-09-11T23:56:56.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.328+0000 7f4f68ff9640 1 -- 172.21.15.6:0/80869154 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v78) ==== 171+0+0 (secure 0 0 0) 0x7f4f6409b580 con 0x7f4f6c10c180 2024-09-11T23:56:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-09-11T23:56:56.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.330+0000 7f4f71d7e640 1 -- 172.21.15.6:0/80869154 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4f540a2b80 msgr2=0x7f4f540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.330+0000 7f4f71d7e640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4f540a2b80 0x7f4f540a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c031440 tx=0x7f4f5c005b50 comp rx=0 tx=0).stop 2024-09-11T23:56:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.330+0000 7f4f71d7e640 1 -- 172.21.15.6:0/80869154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c10c180 msgr2=0x7f4f6c19cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.330+0000 7f4f71d7e640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c10c180 0x7f4f6c19cc60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009fd0 tx=0x7f4f6400b8e0 comp rx=0 tx=0).stop 2024-09-11T23:56:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.330+0000 7f4f71d7e640 1 -- 172.21.15.6:0/80869154 shutdown_connections 2024-09-11T23:56:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.330+0000 7f4f71d7e640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4f540a2b80 0x7f4f540a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.330+0000 7f4f71d7e640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c10c180 0x7f4f6c19cc60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.330+0000 7f4f71d7e640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f6c1036c0 0x7f4f6c1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.330+0000 7f4f71d7e640 1 --2- 172.21.15.6:0/80869154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102da0 0x7f4f6c198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.330+0000 7f4f71d7e640 1 -- 172.21.15.6:0/80869154 >> 172.21.15.6:0/80869154 conn(0x7f4f6c0fc7a0 msgr2=0x7f4f6c0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.330+0000 7f4f71d7e640 1 -- 172.21.15.6:0/80869154 shutdown_connections 2024-09-11T23:56:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:56.330+0000 7f4f71d7e640 1 -- 172.21.15.6:0/80869154 wait complete. 2024-09-11T23:56:56.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:56 smithi006 ceph-mon[30947]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:56:56.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:56 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/80869154' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T23:56:56.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:56 smithi134 ceph-mon[34893]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:56:56.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:56 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/80869154' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T23:56:56.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:56 smithi039 ceph-mon[34543]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:56:56.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:56 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/80869154' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T23:56:57.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:56:57.307 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:57.610 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:57 smithi006 ceph-mon[30947]: pgmap v273: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:57.611 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:57 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/80869154' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T23:56:57.611 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:57 smithi006 ceph-mon[30947]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T23:56:57.611 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:57 smithi006 ceph-mon[30947]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T23:56:57.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:57 smithi134 ceph-mon[34893]: pgmap v273: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:57.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:57 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/80869154' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T23:56:57.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:57 smithi134 ceph-mon[34893]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T23:56:57.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:57 smithi134 ceph-mon[34893]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T23:56:57.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:57 smithi039 ceph-mon[34543]: pgmap v273: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:57.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:57 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/80869154' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T23:56:57.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:57 smithi039 ceph-mon[34543]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T23:56:57.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:57 smithi039 ceph-mon[34543]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T23:56:57.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.842+0000 7f7ba47f7640 1 -- 172.21.15.6:0/1531437870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b9c103780 msgr2=0x7f7b9c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:57.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.842+0000 7f7ba47f7640 1 --2- 172.21.15.6:0/1531437870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b9c103780 0x7f7b9c107bc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c009930 tx=0x7f7b8c02a420 comp rx=0 tx=0).stop 2024-09-11T23:56:57.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.842+0000 7f7ba47f7640 1 -- 172.21.15.6:0/1531437870 shutdown_connections 2024-09-11T23:56:57.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.842+0000 7f7ba47f7640 1 --2- 172.21.15.6:0/1531437870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b9c108300 0x7f7b9c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:57.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.842+0000 7f7ba47f7640 1 --2- 172.21.15.6:0/1531437870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b9c103780 0x7f7b9c107bc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:57.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.842+0000 7f7ba47f7640 1 --2- 172.21.15.6:0/1531437870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b9c102dd0 0x7f7b9c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:57.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.842+0000 7f7ba47f7640 1 -- 172.21.15.6:0/1531437870 >> 172.21.15.6:0/1531437870 conn(0x7f7b9c0fc7d0 msgr2=0x7f7b9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:57.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.842+0000 7f7ba47f7640 1 -- 172.21.15.6:0/1531437870 shutdown_connections 2024-09-11T23:56:57.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.842+0000 7f7ba47f7640 1 -- 172.21.15.6:0/1531437870 wait complete. 2024-09-11T23:56:57.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.842+0000 7f7ba47f7640 1 Processor -- start 2024-09-11T23:56:57.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.842+0000 7f7ba47f7640 1 -- start start 2024-09-11T23:56:57.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba47f7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b9c102dd0 0x7f7b9c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:57.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba47f7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b9c103780 0x7f7b9c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba47f7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b9c108300 0x7f7b9c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba47f7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c111f80 con 0x7f7b9c108300 2024-09-11T23:56:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba47f7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c111e00 con 0x7f7b9c102dd0 2024-09-11T23:56:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba47f7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c112100 con 0x7f7b9c103780 2024-09-11T23:56:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba2d94640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b9c108300 0x7f7b9c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba2d94640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b9c108300 0x7f7b9c19ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52436/0 (socket says 172.21.15.6:52436) 2024-09-11T23:56:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba2d94640 1 -- 172.21.15.6:0/4115028451 learned_addr learned my addr 172.21.15.6:0/4115028451 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba2593640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b9c102dd0 0x7f7b9c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba1d92640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b9c103780 0x7f7b9c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba2d94640 1 -- 172.21.15.6:0/4115028451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b9c103780 msgr2=0x7f7b9c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba2d94640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b9c103780 0x7f7b9c198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba2d94640 1 -- 172.21.15.6:0/4115028451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b9c102dd0 msgr2=0x7f7b9c198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba2d94640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b9c102dd0 0x7f7b9c198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba2d94640 1 -- 172.21.15.6:0/4115028451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9c19d530 con 0x7f7b9c108300 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba2593640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b9c102dd0 0x7f7b9c198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba2d94640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b9c108300 0x7f7b9c19ce50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400b970 tx=0x7f7b9400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7b937fe640 1 -- 172.21.15.6:0/4115028451 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94019070 con 0x7f7b9c108300 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7b937fe640 1 -- 172.21.15.6:0/4115028451 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7b94014440 con 0x7f7b9c108300 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7ba47f7640 1 -- 172.21.15.6:0/4115028451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b9c19d820 con 0x7f7b9c108300 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.843+0000 7f7b937fe640 1 -- 172.21.15.6:0/4115028451 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b940075d0 con 0x7f7b9c108300 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.844+0000 7f7ba47f7640 1 -- 172.21.15.6:0/4115028451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b9c1a5100 con 0x7f7b9c108300 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.845+0000 7f7ba47f7640 1 -- 172.21.15.6:0/4115028451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b9c1031b0 con 0x7f7b9c108300 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.846+0000 7f7b937fe640 1 -- 172.21.15.6:0/4115028451 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7b9401c070 con 0x7f7b9c108300 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.846+0000 7f7b937fe640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7b880a2b80 0x7f7b880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.846+0000 7f7b937fe640 1 -- 172.21.15.6:0/4115028451 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f7b940ce510 con 0x7f7b9c108300 2024-09-11T23:56:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.846+0000 7f7ba2593640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7b880a2b80 0x7f7b880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:57.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.847+0000 7f7ba2593640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7b880a2b80 0x7f7b880a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b98005fd0 tx=0x7f7b9800b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:57.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:57.851+0000 7f7b937fe640 1 -- 172.21.15.6:0/4115028451 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b9409b620 con 0x7f7b9c108300 2024-09-11T23:56:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.061+0000 7f7ba47f7640 1 -- 172.21.15.6:0/4115028451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7b9c10a2e0 con 0x7f7b9c108300 2024-09-11T23:56:58.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.356+0000 7f7b937fe640 1 -- 172.21.15.6:0/4115028451 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f7b9409af20 con 0x7f7b9c108300 2024-09-11T23:56:58.356 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T23:56:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.359+0000 7f7ba47f7640 1 -- 172.21.15.6:0/4115028451 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7b880a2b80 msgr2=0x7f7b880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.359+0000 7f7ba47f7640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7b880a2b80 0x7f7b880a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b98005fd0 tx=0x7f7b9800b5f0 comp rx=0 tx=0).stop 2024-09-11T23:56:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.359+0000 7f7ba47f7640 1 -- 172.21.15.6:0/4115028451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b9c108300 msgr2=0x7f7b9c19ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.359+0000 7f7ba47f7640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b9c108300 0x7f7b9c19ce50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400b970 tx=0x7f7b9400be30 comp rx=0 tx=0).stop 2024-09-11T23:56:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.359+0000 7f7ba47f7640 1 -- 172.21.15.6:0/4115028451 shutdown_connections 2024-09-11T23:56:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.359+0000 7f7ba47f7640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7b880a2b80 0x7f7b880a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.359+0000 7f7ba47f7640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b9c108300 0x7f7b9c19ce50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.359+0000 7f7ba47f7640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b9c103780 0x7f7b9c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.359+0000 7f7ba47f7640 1 --2- 172.21.15.6:0/4115028451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b9c102dd0 0x7f7b9c198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.359+0000 7f7ba47f7640 1 -- 172.21.15.6:0/4115028451 >> 172.21.15.6:0/4115028451 conn(0x7f7b9c0fc7d0 msgr2=0x7f7b9c105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.359+0000 7f7ba47f7640 1 -- 172.21.15.6:0/4115028451 shutdown_connections 2024-09-11T23:56:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:58.359+0000 7f7ba47f7640 1 -- 172.21.15.6:0/4115028451 wait complete. 2024-09-11T23:56:58.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:58 smithi006 ceph-mon[30947]: pgmap v276: 97 pgs: 11 creating+peering, 74 unknown, 12 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:58.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:58 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/4115028451' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T23:56:58.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:58 smithi006 ceph-mon[30947]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T23:56:58.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:58 smithi134 ceph-mon[34893]: pgmap v276: 97 pgs: 11 creating+peering, 74 unknown, 12 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:58.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:58 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/4115028451' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T23:56:58.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:58 smithi134 ceph-mon[34893]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T23:56:58.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:58 smithi039 ceph-mon[34543]: pgmap v276: 97 pgs: 11 creating+peering, 74 unknown, 12 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:58.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:58 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/4115028451' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T23:56:58.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:58 smithi039 ceph-mon[34543]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T23:56:59.050 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-11T23:56:59.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-11T23:56:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:59.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:59 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/4115028451' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T23:56:59.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:59 smithi134 ceph-mon[34893]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T23:56:59.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:59 smithi134 ceph-mon[34893]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T23:56:59.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:59 smithi134 ceph-mon[34893]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T23:56:59.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:59 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] up:active 2024-09-11T23:56:59.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:56:59 smithi134 ceph-mon[34893]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:56:59.722 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:59 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/4115028451' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T23:56:59.722 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:59 smithi006 ceph-mon[30947]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T23:56:59.722 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:59 smithi006 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T23:56:59.722 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:59 smithi006 ceph-mon[30947]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T23:56:59.722 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:59 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] up:active 2024-09-11T23:56:59.722 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:56:59 smithi006 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:56:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:59 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/4115028451' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T23:56:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:59 smithi039 ceph-mon[34543]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T23:56:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:59 smithi039 ceph-mon[34543]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T23:56:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:59 smithi039 ceph-mon[34543]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T23:56:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:59 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] up:active 2024-09-11T23:56:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:56:59 smithi039 ceph-mon[34543]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:56:59.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 -- 172.21.15.6:0/513175281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73d8102d30 msgr2=0x7f73d8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:59.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 --2- 172.21.15.6:0/513175281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73d8102d30 0x7f73d8103110 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009930 tx=0x7f73c802a420 comp rx=0 tx=0).stop 2024-09-11T23:56:59.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 -- 172.21.15.6:0/513175281 shutdown_connections 2024-09-11T23:56:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 --2- 172.21.15.6:0/513175281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73d81082a0 0x7f73d810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 --2- 172.21.15.6:0/513175281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73d81036e0 0x7f73d8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 --2- 172.21.15.6:0/513175281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73d8102d30 0x7f73d8103110 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 -- 172.21.15.6:0/513175281 >> 172.21.15.6:0/513175281 conn(0x7f73d80fc7d0 msgr2=0x7f73d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 -- 172.21.15.6:0/513175281 shutdown_connections 2024-09-11T23:56:59.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 -- 172.21.15.6:0/513175281 wait complete. 2024-09-11T23:56:59.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 Processor -- start 2024-09-11T23:56:59.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 -- start start 2024-09-11T23:56:59.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73d8102d30 0x7f73d8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:59.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.810+0000 7f73ded0a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73d81036e0 0x7f73d8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:59.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73ded0a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73d81082a0 0x7f73d8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:59.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73ded0a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f73d8111f90 con 0x7f73d81082a0 2024-09-11T23:56:59.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73ded0a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f73d8111e10 con 0x7f73d81036e0 2024-09-11T23:56:59.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73ded0a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73d8112110 con 0x7f73d8102d30 2024-09-11T23:56:59.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73dd2a7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73d81082a0 0x7f73d8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:59.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73dd2a7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73d81082a0 0x7f73d8101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52456/0 (socket says 172.21.15.6:52456) 2024-09-11T23:56:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73dd2a7640 1 -- 172.21.15.6:0/2214745132 learned_addr learned my addr 172.21.15.6:0/2214745132 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:56:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73d7fff640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73d81036e0 0x7f73d8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73dd2a7640 1 -- 172.21.15.6:0/2214745132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73d8102d30 msgr2=0x7f73d8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73dcaa6640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73d8102d30 0x7f73d8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73dd2a7640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73d8102d30 0x7f73d8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:59.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73dd2a7640 1 -- 172.21.15.6:0/2214745132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73d81036e0 msgr2=0x7f73d8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:59.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73dd2a7640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73d81036e0 0x7f73d8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:59.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73dd2a7640 1 -- 172.21.15.6:0/2214745132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d81a6940 con 0x7f73d81082a0 2024-09-11T23:56:59.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73d7fff640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73d81036e0 0x7f73d8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:56:59.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73dd2a7640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73d81082a0 0x7f73d8101410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f73d000eb10 tx=0x7f73d000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:59.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73d5ffb640 1 -- 172.21.15.6:0/2214745132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0004b20 con 0x7f73d81082a0 2024-09-11T23:56:59.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73ded0a640 1 -- 172.21.15.6:0/2214745132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d81a6c30 con 0x7f73d81082a0 2024-09-11T23:56:59.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73d5ffb640 1 -- 172.21.15.6:0/2214745132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73d0004cc0 con 0x7f73d81082a0 2024-09-11T23:56:59.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.811+0000 7f73d5ffb640 1 -- 172.21.15.6:0/2214745132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0010690 con 0x7f73d81082a0 2024-09-11T23:56:59.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.812+0000 7f73ded0a640 1 -- 172.21.15.6:0/2214745132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d81a7170 con 0x7f73d81082a0 2024-09-11T23:56:59.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.812+0000 7f73ded0a640 1 -- 172.21.15.6:0/2214745132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d806a850 con 0x7f73d81082a0 2024-09-11T23:56:59.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.814+0000 7f73d5ffb640 1 -- 172.21.15.6:0/2214745132 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f73d0005020 con 0x7f73d81082a0 2024-09-11T23:56:59.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.814+0000 7f73d5ffb640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73c00a2b80 0x7f73c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:59.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.814+0000 7f73dcaa6640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73c00a2b80 0x7f73c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:59.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.814+0000 7f73d5ffb640 1 -- 172.21.15.6:0/2214745132 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f73d00cf5a0 con 0x7f73d81082a0 2024-09-11T23:56:59.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.815+0000 7f73dcaa6640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73c00a2b80 0x7f73c00a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009930 tx=0x7f73c8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:59.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:56:59.818+0000 7f73d5ffb640 1 -- 172.21.15.6:0/2214745132 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73d009c650 con 0x7f73d81082a0 2024-09-11T23:57:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.001+0000 7f73ded0a640 1 -- 172.21.15.6:0/2214745132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f73d810a2b0 con 0x7f73d81082a0 2024-09-11T23:57:00.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.374+0000 7f73d5ffb640 1 -- 172.21.15.6:0/2214745132 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v81) ==== 157+0+0 (secure 0 0 0) 0x7f73d009bf50 con 0x7f73d81082a0 2024-09-11T23:57:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.377+0000 7f73ded0a640 1 -- 172.21.15.6:0/2214745132 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73c00a2b80 msgr2=0x7f73c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.377+0000 7f73ded0a640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73c00a2b80 0x7f73c00a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009930 tx=0x7f73c8005fd0 comp rx=0 tx=0).stop 2024-09-11T23:57:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.377+0000 7f73ded0a640 1 -- 172.21.15.6:0/2214745132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73d81082a0 msgr2=0x7f73d8101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.377+0000 7f73ded0a640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73d81082a0 0x7f73d8101410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f73d000eb10 tx=0x7f73d000c2d0 comp rx=0 tx=0).stop 2024-09-11T23:57:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.377+0000 7f73ded0a640 1 -- 172.21.15.6:0/2214745132 shutdown_connections 2024-09-11T23:57:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.377+0000 7f73ded0a640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73c00a2b80 0x7f73c00a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.377+0000 7f73ded0a640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73d81082a0 0x7f73d8101410 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.377+0000 7f73ded0a640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73d81036e0 0x7f73d8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.377+0000 7f73ded0a640 1 --2- 172.21.15.6:0/2214745132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73d8102d30 0x7f73d8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:00.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.377+0000 7f73ded0a640 1 -- 172.21.15.6:0/2214745132 >> 172.21.15.6:0/2214745132 conn(0x7f73d80fc7d0 msgr2=0x7f73d8106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:00.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.377+0000 7f73ded0a640 1 -- 172.21.15.6:0/2214745132 shutdown_connections 2024-09-11T23:57:00.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:00.377+0000 7f73ded0a640 1 -- 172.21.15.6:0/2214745132 wait complete. 2024-09-11T23:57:00.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:00 smithi134 ceph-mon[34893]: pgmap v279: 97 pgs: 17 creating+peering, 41 unknown, 39 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-11T23:57:00.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:00 smithi134 ceph-mon[34893]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T23:57:00.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:00 smithi134 ceph-mon[34893]: Cluster is now healthy 2024-09-11T23:57:00.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:00 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2214745132' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T23:57:00.743 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:00 smithi006 ceph-mon[30947]: pgmap v279: 97 pgs: 17 creating+peering, 41 unknown, 39 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-11T23:57:00.743 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:00 smithi006 ceph-mon[30947]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T23:57:00.743 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:00 smithi006 ceph-mon[30947]: Cluster is now healthy 2024-09-11T23:57:00.743 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:00 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2214745132' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T23:57:00.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:00 smithi039 ceph-mon[34543]: pgmap v279: 97 pgs: 17 creating+peering, 41 unknown, 39 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-11T23:57:00.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:00 smithi039 ceph-mon[34543]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T23:57:00.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:00 smithi039 ceph-mon[34543]: Cluster is now healthy 2024-09-11T23:57:00.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:00 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2214745132' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T23:57:01.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:57:01.363 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:01.634 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:01 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2214745132' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T23:57:01.634 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:01 smithi006 ceph-mon[30947]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T23:57:01.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:01 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2214745132' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T23:57:01.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:01 smithi134 ceph-mon[34893]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T23:57:01.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:01 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2214745132' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T23:57:01.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:01 smithi039 ceph-mon[34543]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T23:57:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.856+0000 7f80aef45640 1 -- 172.21.15.6:0/4045611184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80a8102790 msgr2=0x7f80a81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.856+0000 7f80aef45640 1 --2- 172.21.15.6:0/4045611184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80a8102790 0x7f80a81067e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8098009900 tx=0x7f809802a410 comp rx=0 tx=0).stop 2024-09-11T23:57:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.856+0000 7f80aef45640 1 -- 172.21.15.6:0/4045611184 shutdown_connections 2024-09-11T23:57:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.856+0000 7f80aef45640 1 --2- 172.21.15.6:0/4045611184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a8106f10 0x7f80a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.856+0000 7f80aef45640 1 --2- 172.21.15.6:0/4045611184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80a8102790 0x7f80a81067e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.856+0000 7f80aef45640 1 --2- 172.21.15.6:0/4045611184 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a8101de0 0x7f80a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.856+0000 7f80aef45640 1 -- 172.21.15.6:0/4045611184 >> 172.21.15.6:0/4045611184 conn(0x7f80a80fd8c0 msgr2=0x7f80a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.856+0000 7f80aef45640 1 -- 172.21.15.6:0/4045611184 shutdown_connections 2024-09-11T23:57:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.856+0000 7f80aef45640 1 -- 172.21.15.6:0/4045611184 wait complete. 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f80aef45640 1 Processor -- start 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f80aef45640 1 -- start start 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f80aef45640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a8101de0 0x7f80a819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f80aef45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80a8102790 0x7f80a819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f80aef45640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a8106f10 0x7f80a819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f80aef45640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f80a8111e40 con 0x7f80a8102790 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f80aef45640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f80a8111cc0 con 0x7f80a8101de0 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f80aef45640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f80a8111fc0 con 0x7f80a8106f10 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f809ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80a8102790 0x7f80a819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f809ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80a8102790 0x7f80a819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57018/0 (socket says 172.21.15.6:57018) 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f809ffff640 1 -- 172.21.15.6:0/3497215610 learned_addr learned my addr 172.21.15.6:0/3497215610 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f80acce1640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a8101de0 0x7f80a819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f80ad4e2640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a8106f10 0x7f80a819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f809ffff640 1 -- 172.21.15.6:0/3497215610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a8106f10 msgr2=0x7f80a819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f809ffff640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a8106f10 0x7f80a819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f809ffff640 1 -- 172.21.15.6:0/3497215610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a8101de0 msgr2=0x7f80a819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f809ffff640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a8101de0 0x7f80a819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.857+0000 7f809ffff640 1 -- 172.21.15.6:0/3497215610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a819f5b0 con 0x7f80a8102790 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.858+0000 7f809ffff640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80a8102790 0x7f80a819ab40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8098006010 tx=0x7f8098004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.858+0000 7f809dffb640 1 -- 172.21.15.6:0/3497215610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809803f030 con 0x7f80a8102790 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.858+0000 7f80aef45640 1 -- 172.21.15.6:0/3497215610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a819f840 con 0x7f80a8102790 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.858+0000 7f809dffb640 1 -- 172.21.15.6:0/3497215610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f80980035f0 con 0x7f80a8102790 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.858+0000 7f809dffb640 1 -- 172.21.15.6:0/3497215610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098035070 con 0x7f80a8102790 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.858+0000 7f80aef45640 1 -- 172.21.15.6:0/3497215610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a81a7180 con 0x7f80a8102790 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.859+0000 7f80aef45640 1 -- 172.21.15.6:0/3497215610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a81032c0 con 0x7f80a8102790 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.860+0000 7f809dffb640 1 -- 172.21.15.6:0/3497215610 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8098003b10 con 0x7f80a8102790 2024-09-11T23:57:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.861+0000 7f809dffb640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f80900a2b80 0x7f80900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:01.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.861+0000 7f80acce1640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f80900a2b80 0x7f80900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:01.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.861+0000 7f809dffb640 1 -- 172.21.15.6:0/3497215610 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8277+0+0 (secure 0 0 0) 0x7f80980efc50 con 0x7f80a8102790 2024-09-11T23:57:01.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.861+0000 7f80acce1640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f80900a2b80 0x7f80900a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f80a40058c0 tx=0x7f80a400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:01.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:01.865+0000 7f809dffb640 1 -- 172.21.15.6:0/3497215610 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f80980bcb20 con 0x7f80a8102790 2024-09-11T23:57:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:02.041+0000 7f80aef45640 1 -- 172.21.15.6:0/3497215610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f80a81a7380 con 0x7f80a8102790 2024-09-11T23:57:03.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:02 smithi006 ceph-mon[30947]: pgmap v281: 97 pgs: 17 creating+peering, 8 unknown, 72 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 8 op/s 2024-09-11T23:57:03.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:02 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3497215610' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T23:57:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:02 smithi134 ceph-mon[34893]: pgmap v281: 97 pgs: 17 creating+peering, 8 unknown, 72 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 8 op/s 2024-09-11T23:57:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:02 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3497215610' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T23:57:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:02 smithi039 ceph-mon[34543]: pgmap v281: 97 pgs: 17 creating+peering, 8 unknown, 72 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 8 op/s 2024-09-11T23:57:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:02 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3497215610' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T23:57:03.294 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:57:02 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b[64956]: 2024-09-11T23:57:02.948+0000 7fcd353f9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:57:03.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.395+0000 7f809dffb640 1 -- 172.21.15.6:0/3497215610 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v83) ==== 228+0+0 (secure 0 0 0) 0x7f80980bc420 con 0x7f80a8102790 2024-09-11T23:57:03.394 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data_ec' created 2024-09-11T23:57:03.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.398+0000 7f80aef45640 1 -- 172.21.15.6:0/3497215610 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f80900a2b80 msgr2=0x7f80900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:03.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.398+0000 7f80aef45640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f80900a2b80 0x7f80900a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f80a40058c0 tx=0x7f80a400a2d0 comp rx=0 tx=0).stop 2024-09-11T23:57:03.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.398+0000 7f80aef45640 1 -- 172.21.15.6:0/3497215610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80a8102790 msgr2=0x7f80a819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:03.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.398+0000 7f80aef45640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80a8102790 0x7f80a819ab40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8098006010 tx=0x7f8098004270 comp rx=0 tx=0).stop 2024-09-11T23:57:03.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.398+0000 7f80aef45640 1 -- 172.21.15.6:0/3497215610 shutdown_connections 2024-09-11T23:57:03.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.398+0000 7f80aef45640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f80900a2b80 0x7f80900a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:03.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.398+0000 7f80aef45640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a8106f10 0x7f80a819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:03.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.398+0000 7f80aef45640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80a8102790 0x7f80a819ab40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:03.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.398+0000 7f80aef45640 1 --2- 172.21.15.6:0/3497215610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a8101de0 0x7f80a819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:03.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.398+0000 7f80aef45640 1 -- 172.21.15.6:0/3497215610 >> 172.21.15.6:0/3497215610 conn(0x7f80a80fd8c0 msgr2=0x7f80a80fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:03.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.398+0000 7f80aef45640 1 -- 172.21.15.6:0/3497215610 shutdown_connections 2024-09-11T23:57:03.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:03.398+0000 7f80aef45640 1 -- 172.21.15.6:0/3497215610 wait complete. 2024-09-11T23:57:04.103 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:03 smithi006 ceph-mon[30947]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T23:57:04.104 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:03 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3497215610' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T23:57:04.104 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:03 smithi006 ceph-mon[30947]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T23:57:04.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:03 smithi134 ceph-mon[34893]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T23:57:04.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:03 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3497215610' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T23:57:04.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:03 smithi134 ceph-mon[34893]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T23:57:04.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-11T23:57:04.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:03 smithi039 ceph-mon[34543]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T23:57:04.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:03 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3497215610' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T23:57:04.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:03 smithi039 ceph-mon[34543]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T23:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:04.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.929+0000 7f6a997ef640 1 -- 172.21.15.6:0/4091469260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a94102790 msgr2=0x7f6a941067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:04.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.929+0000 7f6a997ef640 1 --2- 172.21.15.6:0/4091469260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a94102790 0x7f6a941067e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009900 tx=0x7f6a8802a410 comp rx=0 tx=0).stop 2024-09-11T23:57:04.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.929+0000 7f6a997ef640 1 -- 172.21.15.6:0/4091469260 shutdown_connections 2024-09-11T23:57:04.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.929+0000 7f6a997ef640 1 --2- 172.21.15.6:0/4091469260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a94106f10 0x7f6a9410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:04.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.929+0000 7f6a997ef640 1 --2- 172.21.15.6:0/4091469260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a94102790 0x7f6a941067e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:04.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.929+0000 7f6a997ef640 1 --2- 172.21.15.6:0/4091469260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a94101de0 0x7f6a941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:04.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.929+0000 7f6a997ef640 1 -- 172.21.15.6:0/4091469260 >> 172.21.15.6:0/4091469260 conn(0x7f6a940fd8c0 msgr2=0x7f6a940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:04.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.930+0000 7f6a997ef640 1 -- 172.21.15.6:0/4091469260 shutdown_connections 2024-09-11T23:57:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.930+0000 7f6a997ef640 1 -- 172.21.15.6:0/4091469260 wait complete. 2024-09-11T23:57:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.930+0000 7f6a997ef640 1 Processor -- start 2024-09-11T23:57:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.930+0000 7f6a997ef640 1 -- start start 2024-09-11T23:57:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a997ef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a94101de0 0x7f6a94198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a997ef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a94102790 0x7f6a94198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a997ef640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a94106f10 0x7f6a9419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a997ef640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6a94111e40 con 0x7f6a94106f10 2024-09-11T23:57:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a997ef640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6a94111cc0 con 0x7f6a94102790 2024-09-11T23:57:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a997ef640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6a94111fc0 con 0x7f6a94101de0 2024-09-11T23:57:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a94106f10 0x7f6a9419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:04.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a94106f10 0x7f6a9419ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57030/0 (socket says 172.21.15.6:57030) 2024-09-11T23:57:04.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a937fe640 1 -- 172.21.15.6:0/3072947931 learned_addr learned my addr 172.21.15.6:0/3072947931 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:04.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a927fc640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a94102790 0x7f6a94198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:04.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a92ffd640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a94101de0 0x7f6a94198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:04.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a937fe640 1 -- 172.21.15.6:0/3072947931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a94101de0 msgr2=0x7f6a94198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:04.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a937fe640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a94101de0 0x7f6a94198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:04.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a937fe640 1 -- 172.21.15.6:0/3072947931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a94102790 msgr2=0x7f6a94198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:04.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a937fe640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a94102790 0x7f6a94198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:04.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a937fe640 1 -- 172.21.15.6:0/3072947931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9419d3d0 con 0x7f6a94106f10 2024-09-11T23:57:04.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.931+0000 7f6a937fe640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a94106f10 0x7f6a9419ccf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00eaa0 tx=0x7f6a8c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.932+0000 7f6a7bfff640 1 -- 172.21.15.6:0/3072947931 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00cdb0 con 0x7f6a94106f10 2024-09-11T23:57:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.932+0000 7f6a7bfff640 1 -- 172.21.15.6:0/3072947931 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a8c005020 con 0x7f6a94106f10 2024-09-11T23:57:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.932+0000 7f6a997ef640 1 -- 172.21.15.6:0/3072947931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9419d6c0 con 0x7f6a94106f10 2024-09-11T23:57:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.932+0000 7f6a7bfff640 1 -- 172.21.15.6:0/3072947931 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0116d0 con 0x7f6a94106f10 2024-09-11T23:57:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.932+0000 7f6a997ef640 1 -- 172.21.15.6:0/3072947931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a941a4fa0 con 0x7f6a94106f10 2024-09-11T23:57:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.933+0000 7f6a997ef640 1 -- 172.21.15.6:0/3072947931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a941021c0 con 0x7f6a94106f10 2024-09-11T23:57:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.934+0000 7f6a7bfff640 1 -- 172.21.15.6:0/3072947931 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f6a8c0051d0 con 0x7f6a94106f10 2024-09-11T23:57:04.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.935+0000 7f6a7bfff640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6a7c0a2b80 0x7f6a7c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:04.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.935+0000 7f6a92ffd640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6a7c0a2b80 0x7f6a7c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:04.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.935+0000 7f6a7bfff640 1 -- 172.21.15.6:0/3072947931 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8770+0+0 (secure 0 0 0) 0x7f6a8c0cf470 con 0x7f6a94106f10 2024-09-11T23:57:04.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.935+0000 7f6a92ffd640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6a7c0a2b80 0x7f6a7c0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009890 tx=0x7f6a84008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:04.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:04.939+0000 7f6a7bfff640 1 -- 172.21.15.6:0/3072947931 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a8c016030 con 0x7f6a94106f10 2024-09-11T23:57:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.114+0000 7f6a997ef640 1 -- 172.21.15.6:0/3072947931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f6a94109b60 con 0x7f6a94106f10 2024-09-11T23:57:05.113 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:04 smithi006 ceph-mon[30947]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-11T23:57:05.113 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:04 smithi006 ceph-mon[30947]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T23:57:05.120 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:04 smithi134 ceph-mon[34893]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-11T23:57:05.120 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:04 smithi134 ceph-mon[34893]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T23:57:05.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:04 smithi039 ceph-mon[34543]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-11T23:57:05.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:04 smithi039 ceph-mon[34543]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T23:57:05.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.398+0000 7f6a7bfff640 1 -- 172.21.15.6:0/3072947931 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v85) ==== 169+0+0 (secure 0 0 0) 0x7f6a8c09c1b0 con 0x7f6a94106f10 2024-09-11T23:57:05.397 INFO:teuthology.orchestra.run.smithi006.stderr:set pool 4 allow_ec_overwrites to true 2024-09-11T23:57:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.401+0000 7f6a997ef640 1 -- 172.21.15.6:0/3072947931 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6a7c0a2b80 msgr2=0x7f6a7c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.401+0000 7f6a997ef640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6a7c0a2b80 0x7f6a7c0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009890 tx=0x7f6a84008040 comp rx=0 tx=0).stop 2024-09-11T23:57:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.401+0000 7f6a997ef640 1 -- 172.21.15.6:0/3072947931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a94106f10 msgr2=0x7f6a9419ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.401+0000 7f6a997ef640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a94106f10 0x7f6a9419ccf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00eaa0 tx=0x7f6a8c00ef60 comp rx=0 tx=0).stop 2024-09-11T23:57:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.401+0000 7f6a997ef640 1 -- 172.21.15.6:0/3072947931 shutdown_connections 2024-09-11T23:57:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.401+0000 7f6a997ef640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6a7c0a2b80 0x7f6a7c0a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.401+0000 7f6a997ef640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a94106f10 0x7f6a9419ccf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.401+0000 7f6a997ef640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a94102790 0x7f6a94198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.401+0000 7f6a997ef640 1 --2- 172.21.15.6:0/3072947931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a94101de0 0x7f6a94198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.401+0000 7f6a997ef640 1 -- 172.21.15.6:0/3072947931 >> 172.21.15.6:0/3072947931 conn(0x7f6a940fd8c0 msgr2=0x7f6a940fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.401+0000 7f6a997ef640 1 -- 172.21.15.6:0/3072947931 shutdown_connections 2024-09-11T23:57:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:05.401+0000 7f6a997ef640 1 -- 172.21.15.6:0/3072947931 wait complete. 2024-09-11T23:57:06.089 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:05 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3072947931' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T23:57:06.089 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:05 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3072947931' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T23:57:06.089 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:05 smithi006 ceph-mon[30947]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T23:57:06.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-11T23:57:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:05 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3072947931' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T23:57:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:05 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3072947931' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T23:57:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:05 smithi134 ceph-mon[34893]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T23:57:06.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:05 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3072947931' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T23:57:06.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:05 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3072947931' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T23:57:06.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:05 smithi039 ceph-mon[34543]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T23:57:06.387 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:06.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.861+0000 7ffafcc31640 1 -- 172.21.15.6:0/3070782912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8102ef0 msgr2=0x7ffaf810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:06.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.861+0000 7ffafcc31640 1 --2- 172.21.15.6:0/3070782912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8102ef0 0x7ffaf810da40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009ca0 tx=0x7ffaf002a950 comp rx=0 tx=0).stop 2024-09-11T23:57:06.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.861+0000 7ffafcc31640 1 -- 172.21.15.6:0/3070782912 shutdown_connections 2024-09-11T23:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.861+0000 7ffafcc31640 1 --2- 172.21.15.6:0/3070782912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8102ef0 0x7ffaf810da40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.861+0000 7ffafcc31640 1 --2- 172.21.15.6:0/3070782912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf8102570 0x7ffaf81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.861+0000 7ffafcc31640 1 --2- 172.21.15.6:0/3070782912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffaf8100e20 0x7ffaf8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.861+0000 7ffafcc31640 1 -- 172.21.15.6:0/3070782912 >> 172.21.15.6:0/3070782912 conn(0x7ffaf80fc7d0 msgr2=0x7ffaf80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.861+0000 7ffafcc31640 1 -- 172.21.15.6:0/3070782912 shutdown_connections 2024-09-11T23:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.861+0000 7ffafcc31640 1 -- 172.21.15.6:0/3070782912 wait complete. 2024-09-11T23:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffafcc31640 1 Processor -- start 2024-09-11T23:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffafcc31640 1 -- start start 2024-09-11T23:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffafcc31640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf8100e20 0x7ffaf8197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffafcc31640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8102570 0x7ffaf8197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffafcc31640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffaf8102ef0 0x7ffaf819bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffafcc31640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf8110e30 con 0x7ffaf8102570 2024-09-11T23:57:06.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffafcc31640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf8110cb0 con 0x7ffaf8102ef0 2024-09-11T23:57:06.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffafcc31640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf8110fb0 con 0x7ffaf8100e20 2024-09-11T23:57:06.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffaf5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8102570 0x7ffaf8197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:06.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffaf5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8102570 0x7ffaf8197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57042/0 (socket says 172.21.15.6:57042) 2024-09-11T23:57:06.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffaf5d9b640 1 -- 172.21.15.6:0/1123299761 learned_addr learned my addr 172.21.15.6:0/1123299761 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:06.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffaf659c640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf8100e20 0x7ffaf8197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:06.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffaf6d9d640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffaf8102ef0 0x7ffaf819bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:06.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffaf5d9b640 1 -- 172.21.15.6:0/1123299761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf8100e20 msgr2=0x7ffaf8197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:06.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffaf5d9b640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf8100e20 0x7ffaf8197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:06.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffaf5d9b640 1 -- 172.21.15.6:0/1123299761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffaf8102ef0 msgr2=0x7ffaf819bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:06.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffaf5d9b640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffaf8102ef0 0x7ffaf819bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:06.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffaf5d9b640 1 -- 172.21.15.6:0/1123299761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf819c2e0 con 0x7ffaf8102570 2024-09-11T23:57:06.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffaf6d9d640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffaf8102ef0 0x7ffaf819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:06.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.862+0000 7ffaf5d9b640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8102570 0x7ffaf8197870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffae000e9f0 tx=0x7ffae000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:06.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.863+0000 7ffaef7fe640 1 -- 172.21.15.6:0/1123299761 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae000cd80 con 0x7ffaf8102570 2024-09-11T23:57:06.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.863+0000 7ffaef7fe640 1 -- 172.21.15.6:0/1123299761 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffae00108e0 con 0x7ffaf8102570 2024-09-11T23:57:06.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.863+0000 7ffafcc31640 1 -- 172.21.15.6:0/1123299761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf819c5d0 con 0x7ffaf8102570 2024-09-11T23:57:06.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.863+0000 7ffaef7fe640 1 -- 172.21.15.6:0/1123299761 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0018920 con 0x7ffaf8102570 2024-09-11T23:57:06.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.863+0000 7ffafcc31640 1 -- 172.21.15.6:0/1123299761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf81a3eb0 con 0x7ffaf8102570 2024-09-11T23:57:06.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.864+0000 7ffafcc31640 1 -- 172.21.15.6:0/1123299761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf8101200 con 0x7ffaf8102570 2024-09-11T23:57:06.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.865+0000 7ffaef7fe640 1 -- 172.21.15.6:0/1123299761 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ffae0010a90 con 0x7ffaf8102570 2024-09-11T23:57:06.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.866+0000 7ffaef7fe640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffae40a2c00 0x7ffae40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:06.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.866+0000 7ffaf659c640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffae40a2c00 0x7ffae40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:06.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.866+0000 7ffaef7fe640 1 -- 172.21.15.6:0/1123299761 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8770+0+0 (secure 0 0 0) 0x7ffae00cf990 con 0x7ffaf8102570 2024-09-11T23:57:06.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.866+0000 7ffaf659c640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffae40a2c00 0x7ffae40a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffae8005d00 tx=0x7ffae800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:06.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:06.869+0000 7ffaef7fe640 1 -- 172.21.15.6:0/1123299761 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffae009c6d0 con 0x7ffaf8102570 2024-09-11T23:57:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.082+0000 7ffafcc31640 1 -- 172.21.15.6:0/1123299761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7ffaf8198690 con 0x7ffaf8102570 2024-09-11T23:57:07.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:06 smithi006 ceph-mon[30947]: pgmap v286: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s wr, 4 op/s 2024-09-11T23:57:07.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:06 smithi006 ceph-mon[30947]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:57:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:06 smithi134 ceph-mon[34893]: pgmap v286: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s wr, 4 op/s 2024-09-11T23:57:07.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:06 smithi134 ceph-mon[34893]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:57:07.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:06 smithi039 ceph-mon[34543]: pgmap v286: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s wr, 4 op/s 2024-09-11T23:57:07.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:06 smithi039 ceph-mon[34543]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:57:07.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.861+0000 7ffaef7fe640 1 -- 172.21.15.6:0/1123299761 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) ==== 137+0+0 (secure 0 0 0) 0x7ffaf8198690 con 0x7ffaf8102570 2024-09-11T23:57:07.860 INFO:teuthology.orchestra.run.smithi006.stderr:added data pool 4 to fsmap 2024-09-11T23:57:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.864+0000 7ffafcc31640 1 -- 172.21.15.6:0/1123299761 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffae40a2c00 msgr2=0x7ffae40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.864+0000 7ffafcc31640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffae40a2c00 0x7ffae40a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffae8005d00 tx=0x7ffae800b410 comp rx=0 tx=0).stop 2024-09-11T23:57:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.864+0000 7ffafcc31640 1 -- 172.21.15.6:0/1123299761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8102570 msgr2=0x7ffaf8197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.864+0000 7ffafcc31640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8102570 0x7ffaf8197870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffae000e9f0 tx=0x7ffae000eeb0 comp rx=0 tx=0).stop 2024-09-11T23:57:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.864+0000 7ffafcc31640 1 -- 172.21.15.6:0/1123299761 shutdown_connections 2024-09-11T23:57:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.864+0000 7ffafcc31640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffae40a2c00 0x7ffae40a50c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.864+0000 7ffafcc31640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffaf8102ef0 0x7ffaf819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.864+0000 7ffafcc31640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8102570 0x7ffaf8197870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.864+0000 7ffafcc31640 1 --2- 172.21.15.6:0/1123299761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf8100e20 0x7ffaf8197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.864+0000 7ffafcc31640 1 -- 172.21.15.6:0/1123299761 >> 172.21.15.6:0/1123299761 conn(0x7ffaf80fc7d0 msgr2=0x7ffaf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.864+0000 7ffafcc31640 1 -- 172.21.15.6:0/1123299761 shutdown_connections 2024-09-11T23:57:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:07.864+0000 7ffafcc31640 1 -- 172.21.15.6:0/1123299761 wait complete. 2024-09-11T23:57:08.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:07 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1123299761' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T23:57:08.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:07 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1123299761' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T23:57:08.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:07 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1123299761' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T23:57:08.572 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:57:08.835 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:09.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:08 smithi006 ceph-mon[30947]: pgmap v288: 129 pgs: 11 creating+peering, 6 unknown, 112 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 451 B/s wr, 1 op/s 2024-09-11T23:57:09.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:08 smithi006 ceph-mon[30947]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T23:57:09.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:08 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1123299761' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T23:57:09.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:08 smithi006 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:57:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:08 smithi134 ceph-mon[34893]: pgmap v288: 129 pgs: 11 creating+peering, 6 unknown, 112 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 451 B/s wr, 1 op/s 2024-09-11T23:57:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:08 smithi134 ceph-mon[34893]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T23:57:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:08 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1123299761' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T23:57:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:08 smithi134 ceph-mon[34893]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:57:09.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:08 smithi039 ceph-mon[34543]: pgmap v288: 129 pgs: 11 creating+peering, 6 unknown, 112 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 451 B/s wr, 1 op/s 2024-09-11T23:57:09.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:08 smithi039 ceph-mon[34543]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T23:57:09.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:08 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1123299761' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T23:57:09.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:08 smithi039 ceph-mon[34543]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:57:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.318+0000 7ffb1a291640 1 -- 172.21.15.6:0/23701678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14106f10 msgr2=0x7ffb1410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:09.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.318+0000 7ffb1a291640 1 --2- 172.21.15.6:0/23701678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14106f10 0x7ffb1410ea90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009ca0 tx=0x7ffb0c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.318+0000 7ffb1a291640 1 -- 172.21.15.6:0/23701678 shutdown_connections 2024-09-11T23:57:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.318+0000 7ffb1a291640 1 --2- 172.21.15.6:0/23701678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14106f10 0x7ffb1410ea90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.318+0000 7ffb1a291640 1 --2- 172.21.15.6:0/23701678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb14102790 0x7ffb141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.318+0000 7ffb1a291640 1 --2- 172.21.15.6:0/23701678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb14101de0 0x7ffb141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.318+0000 7ffb1a291640 1 -- 172.21.15.6:0/23701678 >> 172.21.15.6:0/23701678 conn(0x7ffb140fd8c0 msgr2=0x7ffb140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.318+0000 7ffb1a291640 1 -- 172.21.15.6:0/23701678 shutdown_connections 2024-09-11T23:57:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.318+0000 7ffb1a291640 1 -- 172.21.15.6:0/23701678 wait complete. 2024-09-11T23:57:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb1a291640 1 Processor -- start 2024-09-11T23:57:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb1a291640 1 -- start start 2024-09-11T23:57:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb1a291640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14101de0 0x7ffb14198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb1a291640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb14102790 0x7ffb14198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb1a291640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb14106f10 0x7ffb1419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb1a291640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffb14111e20 con 0x7ffb14101de0 2024-09-11T23:57:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb1a291640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ffb14111ca0 con 0x7ffb14102790 2024-09-11T23:57:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb1a291640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb14111fa0 con 0x7ffb14106f10 2024-09-11T23:57:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14101de0 0x7ffb14198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14101de0 0x7ffb14198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57060/0 (socket says 172.21.15.6:57060) 2024-09-11T23:57:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb13fff640 1 -- 172.21.15.6:0/3238665186 learned_addr learned my addr 172.21.15.6:0/3238665186 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb1882e640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb14106f10 0x7ffb1419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb137fe640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb14102790 0x7ffb14198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb13fff640 1 -- 172.21.15.6:0/3238665186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb14106f10 msgr2=0x7ffb1419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb13fff640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb14106f10 0x7ffb1419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb13fff640 1 -- 172.21.15.6:0/3238665186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb14102790 msgr2=0x7ffb14198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb13fff640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb14102790 0x7ffb14198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb13fff640 1 -- 172.21.15.6:0/3238665186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1419d2d0 con 0x7ffb14101de0 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.319+0000 7ffb137fe640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb14102790 0x7ffb14198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.320+0000 7ffb13fff640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14101de0 0x7ffb14198320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400d770 tx=0x7ffb0400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.320+0000 7ffb117fa640 1 -- 172.21.15.6:0/3238665186 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb04017070 con 0x7ffb14101de0 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.320+0000 7ffb1a291640 1 -- 172.21.15.6:0/3238665186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1419d5c0 con 0x7ffb14101de0 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.320+0000 7ffb117fa640 1 -- 172.21.15.6:0/3238665186 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb040054d0 con 0x7ffb14101de0 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.320+0000 7ffb117fa640 1 -- 172.21.15.6:0/3238665186 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb04004cf0 con 0x7ffb14101de0 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.320+0000 7ffb1a291640 1 -- 172.21.15.6:0/3238665186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb141a4ea0 con 0x7ffb14101de0 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.321+0000 7ffb1a291640 1 -- 172.21.15.6:0/3238665186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb141021c0 con 0x7ffb14101de0 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.322+0000 7ffb117fa640 1 -- 172.21.15.6:0/3238665186 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ffb04004e90 con 0x7ffb14101de0 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.323+0000 7ffb117fa640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffafc0a2b80 0x7ffafc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.323+0000 7ffb117fa640 1 -- 172.21.15.6:0/3238665186 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7ffb040cecf0 con 0x7ffb14101de0 2024-09-11T23:57:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.323+0000 7ffb137fe640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffafc0a2b80 0x7ffafc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.323+0000 7ffb137fe640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffafc0a2b80 0x7ffafc0a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb08005fd0 tx=0x7ffb080094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.327+0000 7ffb117fa640 1 -- 172.21.15.6:0/3238665186 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb040d3070 con 0x7ffb14101de0 2024-09-11T23:57:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.538+0000 7ffb1a291640 1 -- 172.21.15.6:0/3238665186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb1410a150 con 0x7ffb14101de0 2024-09-11T23:57:09.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.539+0000 7ffb117fa640 1 -- 172.21.15.6:0/3238665186 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11815 (secure 0 0 0) 0x7ffb0409ba10 con 0x7ffb14101de0 2024-09-11T23:57:09.640 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:57:09.640 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"btime":"2024-09-11T23:57:07:846602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/809129212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":809129212},{"type":"v1","addr":"172.21.15.6:6839","nonce":809129212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/500771395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":500771395},{"type":"v1","addr":"172.21.15.6:6841","nonce":500771395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:56:58.063963+0000","modified":"2024-09-11T23:57:07.083423+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.39:6839/3561706320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3561706320},{"type":"v1","addr":"172.21.15.39:6839","nonce":3561706320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24491,"qdb_cluster":[24491]},"id":1}]} 2024-09-11T23:57:09.641 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 16 2024-09-11T23:57:09.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.541+0000 7ffb1a291640 1 -- 172.21.15.6:0/3238665186 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffafc0a2b80 msgr2=0x7ffafc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:09.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.541+0000 7ffb1a291640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffafc0a2b80 0x7ffafc0a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb08005fd0 tx=0x7ffb080094d0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.541+0000 7ffb1a291640 1 -- 172.21.15.6:0/3238665186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14101de0 msgr2=0x7ffb14198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:09.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.541+0000 7ffb1a291640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14101de0 0x7ffb14198320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400d770 tx=0x7ffb0400dc30 comp rx=0 tx=0).stop 2024-09-11T23:57:09.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.541+0000 7ffb1a291640 1 -- 172.21.15.6:0/3238665186 shutdown_connections 2024-09-11T23:57:09.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.541+0000 7ffb1a291640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffafc0a2b80 0x7ffafc0a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.541+0000 7ffb1a291640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb14106f10 0x7ffb1419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.541+0000 7ffb1a291640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb14102790 0x7ffb14198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.541+0000 7ffb1a291640 1 --2- 172.21.15.6:0/3238665186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14101de0 0x7ffb14198320 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.541+0000 7ffb1a291640 1 -- 172.21.15.6:0/3238665186 >> 172.21.15.6:0/3238665186 conn(0x7ffb140fd8c0 msgr2=0x7ffb140fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.541+0000 7ffb1a291640 1 -- 172.21.15.6:0/3238665186 shutdown_connections 2024-09-11T23:57:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:09.541+0000 7ffb1a291640 1 -- 172.21.15.6:0/3238665186 wait complete. 2024-09-11T23:57:10.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:09 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3238665186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:10.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:09 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3238665186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:10.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:57:10.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:09 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3238665186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:10.478 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:10.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.976+0000 7f70d377d640 1 -- 172.21.15.6:0/1126200326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc106f10 msgr2=0x7f70cc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:10.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.976+0000 7f70d377d640 1 --2- 172.21.15.6:0/1126200326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc106f10 0x7f70cc10ea90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009ca0 tx=0x7f70c402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:57:10.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.976+0000 7f70d377d640 1 -- 172.21.15.6:0/1126200326 shutdown_connections 2024-09-11T23:57:10.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.976+0000 7f70d377d640 1 --2- 172.21.15.6:0/1126200326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc106f10 0x7f70cc10ea90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:10.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.976+0000 7f70d377d640 1 --2- 172.21.15.6:0/1126200326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc102790 0x7f70cc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:10.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.976+0000 7f70d377d640 1 --2- 172.21.15.6:0/1126200326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70cc101de0 0x7f70cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:10.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.976+0000 7f70d377d640 1 -- 172.21.15.6:0/1126200326 >> 172.21.15.6:0/1126200326 conn(0x7f70cc0fd8c0 msgr2=0x7f70cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:10.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.976+0000 7f70d377d640 1 -- 172.21.15.6:0/1126200326 shutdown_connections 2024-09-11T23:57:10.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.976+0000 7f70d377d640 1 -- 172.21.15.6:0/1126200326 wait complete. 2024-09-11T23:57:10.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d377d640 1 Processor -- start 2024-09-11T23:57:10.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d377d640 1 -- start start 2024-09-11T23:57:10.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d377d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc101de0 0x7f70cc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:10.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d377d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc102790 0x7f70cc198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:10.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d377d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70cc106f10 0x7f70cc19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:10.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d377d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc111e20 con 0x7f70cc101de0 2024-09-11T23:57:10.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d377d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc111ca0 con 0x7f70cc106f10 2024-09-11T23:57:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d377d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc111fa0 con 0x7f70cc102790 2024-09-11T23:57:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d1519640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc101de0 0x7f70cc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d1519640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc101de0 0x7f70cc198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50712/0 (socket says 172.21.15.6:50712) 2024-09-11T23:57:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d1519640 1 -- 172.21.15.6:0/3446511422 learned_addr learned my addr 172.21.15.6:0/3446511422 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d1d1a640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70cc106f10 0x7f70cc19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:10.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.977+0000 7f70d0d18640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc102790 0x7f70cc198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:10.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.978+0000 7f70d1519640 1 -- 172.21.15.6:0/3446511422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc102790 msgr2=0x7f70cc198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:10.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.978+0000 7f70d1519640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc102790 0x7f70cc198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:10.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.978+0000 7f70d1519640 1 -- 172.21.15.6:0/3446511422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70cc106f10 msgr2=0x7f70cc19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:10.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.978+0000 7f70d1519640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70cc106f10 0x7f70cc19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:10.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.978+0000 7f70d1519640 1 -- 172.21.15.6:0/3446511422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc19d2f0 con 0x7f70cc101de0 2024-09-11T23:57:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.978+0000 7f70d1d1a640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70cc106f10 0x7f70cc19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.978+0000 7f70d1519640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc101de0 0x7f70cc198340 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00d950 tx=0x7f70bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.978+0000 7f70c27fc640 1 -- 172.21.15.6:0/3446511422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc017070 con 0x7f70cc101de0 2024-09-11T23:57:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.978+0000 7f70c27fc640 1 -- 172.21.15.6:0/3446511422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70bc009c30 con 0x7f70cc101de0 2024-09-11T23:57:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.978+0000 7f70d377d640 1 -- 172.21.15.6:0/3446511422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70cc19d5e0 con 0x7f70cc101de0 2024-09-11T23:57:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.978+0000 7f70c27fc640 1 -- 172.21.15.6:0/3446511422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc00f620 con 0x7f70cc101de0 2024-09-11T23:57:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.978+0000 7f70d377d640 1 -- 172.21.15.6:0/3446511422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70cc1a4ec0 con 0x7f70cc101de0 2024-09-11T23:57:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.979+0000 7f70d377d640 1 -- 172.21.15.6:0/3446511422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70cc1021c0 con 0x7f70cc101de0 2024-09-11T23:57:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.980+0000 7f70c27fc640 1 -- 172.21.15.6:0/3446511422 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f70bc0109a0 con 0x7f70cc101de0 2024-09-11T23:57:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.981+0000 7f70c27fc640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f70b80a2c00 0x7f70b80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.981+0000 7f70d0d18640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f70b80a2c00 0x7f70b80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:10.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.981+0000 7f70c27fc640 1 -- 172.21.15.6:0/3446511422 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f70bc0ceef0 con 0x7f70cc101de0 2024-09-11T23:57:10.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.982+0000 7f70d0d18640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f70b80a2c00 0x7f70b80a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f70c8005fd0 tx=0x7f70c8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:10.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:10.986+0000 7f70c27fc640 1 -- 172.21.15.6:0/3446511422 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70bc009de0 con 0x7f70cc101de0 2024-09-11T23:57:11.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:10 smithi006 ceph-mon[30947]: pgmap v290: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:11.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:10 smithi006 ceph-mon[30947]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T23:57:11.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:10 smithi006 ceph-mon[30947]: Cluster is now healthy 2024-09-11T23:57:11.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.160+0000 7f70d377d640 1 -- 172.21.15.6:0/3446511422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70cc109b60 con 0x7f70cc101de0 2024-09-11T23:57:11.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.162+0000 7f70c27fc640 1 -- 172.21.15.6:0/3446511422 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24143 (secure 0 0 0) 0x7f70bc09bc10 con 0x7f70cc101de0 2024-09-11T23:57:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:57:11.161 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-11T23:57:07.083294+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:56:54.204314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:56:56.327143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:57:02.826677+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:57:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.164+0000 7f70d377d640 1 -- 172.21.15.6:0/3446511422 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f70b80a2c00 msgr2=0x7f70b80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.164+0000 7f70d377d640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f70b80a2c00 0x7f70b80a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f70c8005fd0 tx=0x7f70c8005850 comp rx=0 tx=0).stop 2024-09-11T23:57:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.164+0000 7f70d377d640 1 -- 172.21.15.6:0/3446511422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc101de0 msgr2=0x7f70cc198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.164+0000 7f70d377d640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc101de0 0x7f70cc198340 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00d950 tx=0x7f70bc00de10 comp rx=0 tx=0).stop 2024-09-11T23:57:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.164+0000 7f70d377d640 1 -- 172.21.15.6:0/3446511422 shutdown_connections 2024-09-11T23:57:11.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.164+0000 7f70d377d640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f70b80a2c00 0x7f70b80a50c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:11.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.164+0000 7f70d377d640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70cc106f10 0x7f70cc19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:11.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.164+0000 7f70d377d640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc102790 0x7f70cc198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:11.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.164+0000 7f70d377d640 1 --2- 172.21.15.6:0/3446511422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc101de0 0x7f70cc198340 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:11.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.164+0000 7f70d377d640 1 -- 172.21.15.6:0/3446511422 >> 172.21.15.6:0/3446511422 conn(0x7f70cc0fd8c0 msgr2=0x7f70cc0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:11.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.164+0000 7f70d377d640 1 -- 172.21.15.6:0/3446511422 shutdown_connections 2024-09-11T23:57:11.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:11.164+0000 7f70d377d640 1 -- 172.21.15.6:0/3446511422 wait complete. 2024-09-11T23:57:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:10 smithi134 ceph-mon[34893]: pgmap v290: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:10 smithi134 ceph-mon[34893]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T23:57:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:10 smithi134 ceph-mon[34893]: Cluster is now healthy 2024-09-11T23:57:11.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:10 smithi039 ceph-mon[34543]: pgmap v290: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:11.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:10 smithi039 ceph-mon[34543]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T23:57:11.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:10 smithi039 ceph-mon[34543]: Cluster is now healthy 2024-09-11T23:57:11.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:57:12.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:11 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3446511422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:12.149 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:12.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:11 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3446511422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:12.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:11 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3446511422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.634+0000 7f0e1a294640 1 -- 172.21.15.6:0/1950935992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e1410c180 msgr2=0x7f0e1410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.634+0000 7f0e1a294640 1 --2- 172.21.15.6:0/1950935992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e1410c180 0x7f0e1410e610 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009ca0 tx=0x7f0e0c02a950 comp rx=0 tx=0).stop 2024-09-11T23:57:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.634+0000 7f0e1a294640 1 -- 172.21.15.6:0/1950935992 shutdown_connections 2024-09-11T23:57:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.634+0000 7f0e1a294640 1 --2- 172.21.15.6:0/1950935992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e1410c180 0x7f0e1410e610 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.634+0000 7f0e1a294640 1 --2- 172.21.15.6:0/1950935992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e14103700 0x7f0e1410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.634+0000 7f0e1a294640 1 --2- 172.21.15.6:0/1950935992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e14102de0 0x7f0e141031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.634+0000 7f0e1a294640 1 -- 172.21.15.6:0/1950935992 >> 172.21.15.6:0/1950935992 conn(0x7f0e140fc7a0 msgr2=0x7f0e140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.634+0000 7f0e1a294640 1 -- 172.21.15.6:0/1950935992 shutdown_connections 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.634+0000 7f0e1a294640 1 -- 172.21.15.6:0/1950935992 wait complete. 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.635+0000 7f0e1a294640 1 Processor -- start 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.635+0000 7f0e1a294640 1 -- start start 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.635+0000 7f0e1a294640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e14102de0 0x7f0e14198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.635+0000 7f0e1a294640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e14103700 0x7f0e14198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.635+0000 7f0e1a294640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1410c180 0x7f0e1419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.635+0000 7f0e1a294640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0e14111e80 con 0x7f0e14103700 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.635+0000 7f0e1a294640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0e14111d00 con 0x7f0e14102de0 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.635+0000 7f0e1a294640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0e14112000 con 0x7f0e1410c180 2024-09-11T23:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.635+0000 7f0e137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e14103700 0x7f0e14198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.635+0000 7f0e137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e14103700 0x7f0e14198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50740/0 (socket says 172.21.15.6:50740) 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.635+0000 7f0e137fe640 1 -- 172.21.15.6:0/2354585283 learned_addr learned my addr 172.21.15.6:0/2354585283 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e13fff640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e14102de0 0x7f0e14198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e18831640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1410c180 0x7f0e1419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e137fe640 1 -- 172.21.15.6:0/2354585283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1410c180 msgr2=0x7f0e1419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e137fe640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1410c180 0x7f0e1419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e137fe640 1 -- 172.21.15.6:0/2354585283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e14102de0 msgr2=0x7f0e14198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e137fe640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e14102de0 0x7f0e14198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e137fe640 1 -- 172.21.15.6:0/2354585283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1419d3e0 con 0x7f0e14103700 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e13fff640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e14102de0 0x7f0e14198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e137fe640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e14103700 0x7f0e14198970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800d770 tx=0x7f0e0800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e117fa640 1 -- 172.21.15.6:0/2354585283 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e08017070 con 0x7f0e14103700 2024-09-11T23:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e117fa640 1 -- 172.21.15.6:0/2354585283 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e080054d0 con 0x7f0e14103700 2024-09-11T23:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e1a294640 1 -- 172.21.15.6:0/2354585283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1419d6d0 con 0x7f0e14103700 2024-09-11T23:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e117fa640 1 -- 172.21.15.6:0/2354585283 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e08004cf0 con 0x7f0e14103700 2024-09-11T23:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.636+0000 7f0e1a294640 1 -- 172.21.15.6:0/2354585283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e141a4fb0 con 0x7f0e14103700 2024-09-11T23:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.637+0000 7f0e1a294640 1 -- 172.21.15.6:0/2354585283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e141031c0 con 0x7f0e14103700 2024-09-11T23:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.638+0000 7f0e117fa640 1 -- 172.21.15.6:0/2354585283 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f0e08004e90 con 0x7f0e14103700 2024-09-11T23:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.639+0000 7f0e117fa640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0dfc0a2c00 0x7f0dfc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.639+0000 7f0e13fff640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0dfc0a2c00 0x7f0dfc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.639+0000 7f0e117fa640 1 -- 172.21.15.6:0/2354585283 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f0e080ced80 con 0x7f0e14103700 2024-09-11T23:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.640+0000 7f0e13fff640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0dfc0a2c00 0x7f0dfc0a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009930 tx=0x7f0e04008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.643+0000 7f0e117fa640 1 -- 172.21.15.6:0/2354585283 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e0809ba40 con 0x7f0e14103700 2024-09-11T23:57:12.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.821+0000 7f0e1a294640 1 -- 172.21.15.6:0/2354585283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e14107260 con 0x7f0e14103700 2024-09-11T23:57:12.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.823+0000 7f0e117fa640 1 -- 172.21.15.6:0/2354585283 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24143 (secure 0 0 0) 0x7f0e08080e60 con 0x7f0e14103700 2024-09-11T23:57:12.822 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:57:12.822 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-11T23:57:07.083294+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:56:54.204314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:56:56.327143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:57:02.826677+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:57:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.825+0000 7f0e1a294640 1 -- 172.21.15.6:0/2354585283 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0dfc0a2c00 msgr2=0x7f0dfc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.825+0000 7f0e1a294640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0dfc0a2c00 0x7f0dfc0a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009930 tx=0x7f0e04008040 comp rx=0 tx=0).stop 2024-09-11T23:57:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.825+0000 7f0e1a294640 1 -- 172.21.15.6:0/2354585283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e14103700 msgr2=0x7f0e14198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.825+0000 7f0e1a294640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e14103700 0x7f0e14198970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800d770 tx=0x7f0e0800dc30 comp rx=0 tx=0).stop 2024-09-11T23:57:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.825+0000 7f0e1a294640 1 -- 172.21.15.6:0/2354585283 shutdown_connections 2024-09-11T23:57:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.825+0000 7f0e1a294640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0dfc0a2c00 0x7f0dfc0a50c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.825+0000 7f0e1a294640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1410c180 0x7f0e1419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.825+0000 7f0e1a294640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e14103700 0x7f0e14198970 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.825+0000 7f0e1a294640 1 --2- 172.21.15.6:0/2354585283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e14102de0 0x7f0e14198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.825+0000 7f0e1a294640 1 -- 172.21.15.6:0/2354585283 >> 172.21.15.6:0/2354585283 conn(0x7f0e140fc7a0 msgr2=0x7f0e140fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.825+0000 7f0e1a294640 1 -- 172.21.15.6:0/2354585283 shutdown_connections 2024-09-11T23:57:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:12.825+0000 7f0e1a294640 1 -- 172.21.15.6:0/2354585283 wait complete. 2024-09-11T23:57:13.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:12 smithi006 ceph-mon[30947]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:13.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:12 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2354585283' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:13.195 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:12 smithi039 ceph-mon[34543]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:13.195 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:12 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2354585283' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:12 smithi134 ceph-mon[34893]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:12 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2354585283' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:13.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:57:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:14.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.482+0000 7f585169c640 1 -- 172.21.15.6:0/4024811175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f584c102ef0 msgr2=0x7f584c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:14.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.482+0000 7f585169c640 1 --2- 172.21.15.6:0/4024811175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f584c102ef0 0x7f584c10da40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5844009ca0 tx=0x7f584402a950 comp rx=0 tx=0).stop 2024-09-11T23:57:14.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.482+0000 7f585169c640 1 -- 172.21.15.6:0/4024811175 shutdown_connections 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.482+0000 7f585169c640 1 --2- 172.21.15.6:0/4024811175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f584c102ef0 0x7f584c10da40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.482+0000 7f585169c640 1 --2- 172.21.15.6:0/4024811175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f584c102570 0x7f584c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.482+0000 7f585169c640 1 --2- 172.21.15.6:0/4024811175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f584c100e20 0x7f584c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.482+0000 7f585169c640 1 -- 172.21.15.6:0/4024811175 >> 172.21.15.6:0/4024811175 conn(0x7f584c0fc7d0 msgr2=0x7f584c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.482+0000 7f585169c640 1 -- 172.21.15.6:0/4024811175 shutdown_connections 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.482+0000 7f585169c640 1 -- 172.21.15.6:0/4024811175 wait complete. 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.483+0000 7f585169c640 1 Processor -- start 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.483+0000 7f585169c640 1 -- start start 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.483+0000 7f585169c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f584c100e20 0x7f584c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.483+0000 7f585169c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f584c102570 0x7f584c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.483+0000 7f585169c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f584c102ef0 0x7f584c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.483+0000 7f585169c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f584c110e30 con 0x7f584c100e20 2024-09-11T23:57:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.483+0000 7f585169c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f584c110cb0 con 0x7f584c102570 2024-09-11T23:57:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.483+0000 7f585169c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f584c110fb0 con 0x7f584c102ef0 2024-09-11T23:57:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.483+0000 7f584affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f584c100e20 0x7f584c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.483+0000 7f584affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f584c100e20 0x7f584c19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50758/0 (socket says 172.21.15.6:50758) 2024-09-11T23:57:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.483+0000 7f584affd640 1 -- 172.21.15.6:0/2467103570 learned_addr learned my addr 172.21.15.6:0/2467103570 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.483+0000 7f5843fff640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f584c102570 0x7f584c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f584b7fe640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f584c102ef0 0x7f584c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f584affd640 1 -- 172.21.15.6:0/2467103570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f584c102ef0 msgr2=0x7f584c19ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f584affd640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f584c102ef0 0x7f584c19ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f584affd640 1 -- 172.21.15.6:0/2467103570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f584c102570 msgr2=0x7f584c19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f584affd640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f584c102570 0x7f584c19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f584affd640 1 -- 172.21.15.6:0/2467103570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c19f520 con 0x7f584c100e20 2024-09-11T23:57:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f584b7fe640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f584c102ef0 0x7f584c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f584affd640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f584c100e20 0x7f584c19a570 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f583c00e9f0 tx=0x7f583c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f5848ff9640 1 -- 172.21.15.6:0/2467103570 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c00cd80 con 0x7f584c100e20 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f585169c640 1 -- 172.21.15.6:0/2467103570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f584c19f810 con 0x7f584c100e20 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f5848ff9640 1 -- 172.21.15.6:0/2467103570 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f583c0108e0 con 0x7f584c100e20 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f5848ff9640 1 -- 172.21.15.6:0/2467103570 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c018920 con 0x7f584c100e20 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.484+0000 7f585169c640 1 -- 172.21.15.6:0/2467103570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f584c1a70f0 con 0x7f584c100e20 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.485+0000 7f585169c640 1 -- 172.21.15.6:0/2467103570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f584c101200 con 0x7f584c100e20 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.486+0000 7f5848ff9640 1 -- 172.21.15.6:0/2467103570 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f583c010a90 con 0x7f584c100e20 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.487+0000 7f5848ff9640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f58380a2b80 0x7f58380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.487+0000 7f5843fff640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f58380a2b80 0x7f58380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.487+0000 7f5848ff9640 1 -- 172.21.15.6:0/2467103570 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f583c0cfb40 con 0x7f584c100e20 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.487+0000 7f5843fff640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f58380a2b80 0x7f58380a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f584c104c00 tx=0x7f583400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.490+0000 7f5848ff9640 1 -- 172.21.15.6:0/2467103570 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f583c09c800 con 0x7f584c100e20 2024-09-11T23:57:14.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.702+0000 7f585169c640 1 -- 172.21.15.6:0/2467103570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f584c1a72f0 con 0x7f584c100e20 2024-09-11T23:57:14.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.703+0000 7f5848ff9640 1 -- 172.21.15.6:0/2467103570 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11815 (secure 0 0 0) 0x7f583c09c100 con 0x7f584c100e20 2024-09-11T23:57:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:57:14.702 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"btime":"2024-09-11T23:57:07:846602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/809129212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":809129212},{"type":"v1","addr":"172.21.15.6:6839","nonce":809129212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/500771395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":500771395},{"type":"v1","addr":"172.21.15.6:6841","nonce":500771395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:56:58.063963+0000","modified":"2024-09-11T23:57:07.083423+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.39:6839/3561706320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3561706320},{"type":"v1","addr":"172.21.15.39:6839","nonce":3561706320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24491,"qdb_cluster":[24491]},"id":1}]} 2024-09-11T23:57:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 16 2024-09-11T23:57:14.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.706+0000 7f585169c640 1 -- 172.21.15.6:0/2467103570 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f58380a2b80 msgr2=0x7f58380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:14.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.706+0000 7f585169c640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f58380a2b80 0x7f58380a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f584c104c00 tx=0x7f583400b410 comp rx=0 tx=0).stop 2024-09-11T23:57:14.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.706+0000 7f585169c640 1 -- 172.21.15.6:0/2467103570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f584c100e20 msgr2=0x7f584c19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:14.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.706+0000 7f585169c640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f584c100e20 0x7f584c19a570 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f583c00e9f0 tx=0x7f583c00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:57:14.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.706+0000 7f585169c640 1 -- 172.21.15.6:0/2467103570 shutdown_connections 2024-09-11T23:57:14.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.706+0000 7f585169c640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f58380a2b80 0x7f58380a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:14.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.706+0000 7f585169c640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f584c102ef0 0x7f584c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:14.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.706+0000 7f585169c640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f584c102570 0x7f584c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:14.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.706+0000 7f585169c640 1 --2- 172.21.15.6:0/2467103570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f584c100e20 0x7f584c19a570 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:14.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.706+0000 7f585169c640 1 -- 172.21.15.6:0/2467103570 >> 172.21.15.6:0/2467103570 conn(0x7f584c0fc7d0 msgr2=0x7f584c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:14.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.707+0000 7f585169c640 1 -- 172.21.15.6:0/2467103570 shutdown_connections 2024-09-11T23:57:14.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:14.707+0000 7f585169c640 1 -- 172.21.15.6:0/2467103570 wait complete. 2024-09-11T23:57:15.112 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:14 smithi006 ceph-mon[30947]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:15.112 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:14 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2467103570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:15.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:14 smithi134 ceph-mon[34893]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:15.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:14 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2467103570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:15.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:14 smithi039 ceph-mon[34543]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:15.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:14 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2467103570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:15.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:57:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:16.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.383+0000 7f5858385640 1 -- 172.21.15.6:0/1432282477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5850100e20 msgr2=0x7f5850101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:16.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.383+0000 7f5858385640 1 --2- 172.21.15.6:0/1432282477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5850100e20 0x7f5850101200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f584c009900 tx=0x7f584c02a480 comp rx=0 tx=0).stop 2024-09-11T23:57:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.383+0000 7f5858385640 1 -- 172.21.15.6:0/1432282477 shutdown_connections 2024-09-11T23:57:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.383+0000 7f5858385640 1 --2- 172.21.15.6:0/1432282477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850102ef0 0x7f585010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.383+0000 7f5858385640 1 --2- 172.21.15.6:0/1432282477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5850102570 0x7f58501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.383+0000 7f5858385640 1 --2- 172.21.15.6:0/1432282477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5850100e20 0x7f5850101200 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.383+0000 7f5858385640 1 -- 172.21.15.6:0/1432282477 >> 172.21.15.6:0/1432282477 conn(0x7f58500fc7d0 msgr2=0x7f58500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.383+0000 7f5858385640 1 -- 172.21.15.6:0/1432282477 shutdown_connections 2024-09-11T23:57:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.383+0000 7f5858385640 1 -- 172.21.15.6:0/1432282477 wait complete. 2024-09-11T23:57:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.383+0000 7f5858385640 1 Processor -- start 2024-09-11T23:57:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.383+0000 7f5858385640 1 -- start start 2024-09-11T23:57:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5858385640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5850100e20 0x7f5850198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5858385640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850102570 0x7f5850198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5858385640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5850102ef0 0x7f585019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5858385640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5850110ed0 con 0x7f5850102ef0 2024-09-11T23:57:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5858385640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5850110d50 con 0x7f5850102570 2024-09-11T23:57:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5858385640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5850111050 con 0x7f5850100e20 2024-09-11T23:57:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5856922640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5850102ef0 0x7f585019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5856922640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5850102ef0 0x7f585019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50776/0 (socket says 172.21.15.6:50776) 2024-09-11T23:57:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5856922640 1 -- 172.21.15.6:0/2617026680 learned_addr learned my addr 172.21.15.6:0/2617026680 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5855920640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850102570 0x7f5850198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5856922640 1 -- 172.21.15.6:0/2617026680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5850100e20 msgr2=0x7f5850198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5856922640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5850100e20 0x7f5850198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5856922640 1 -- 172.21.15.6:0/2617026680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850102570 msgr2=0x7f5850198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5856922640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850102570 0x7f5850198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5856922640 1 -- 172.21.15.6:0/2617026680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585019d4b0 con 0x7f5850102ef0 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.384+0000 7f5856922640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5850102ef0 0x7f585019cdd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f584800b970 tx=0x7f584800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.385+0000 7f58477fe640 1 -- 172.21.15.6:0/2617026680 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848019070 con 0x7f5850102ef0 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.385+0000 7f58477fe640 1 -- 172.21.15.6:0/2617026680 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5848014440 con 0x7f5850102ef0 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.385+0000 7f5858385640 1 -- 172.21.15.6:0/2617026680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585019d7a0 con 0x7f5850102ef0 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.385+0000 7f58477fe640 1 -- 172.21.15.6:0/2617026680 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58480075d0 con 0x7f5850102ef0 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.385+0000 7f5858385640 1 -- 172.21.15.6:0/2617026680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58501a5080 con 0x7f5850102ef0 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.386+0000 7f5858385640 1 -- 172.21.15.6:0/2617026680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5850101200 con 0x7f5850102ef0 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.387+0000 7f58477fe640 1 -- 172.21.15.6:0/2617026680 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f584801c070 con 0x7f5850102ef0 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.387+0000 7f58477fe640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f583c0a2c00 0x7f583c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.388+0000 7f5856121640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f583c0a2c00 0x7f583c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.388+0000 7f58477fe640 1 -- 172.21.15.6:0/2617026680 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f58480ce7c0 con 0x7f5850102ef0 2024-09-11T23:57:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.388+0000 7f5856121640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f583c0a2c00 0x7f583c0a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f584c02a9a0 tx=0x7f584c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:16.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.392+0000 7f58477fe640 1 -- 172.21.15.6:0/2617026680 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f584809b4e0 con 0x7f5850102ef0 2024-09-11T23:57:16.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.568+0000 7f5858385640 1 -- 172.21.15.6:0/2617026680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f585010a0a0 con 0x7f5850102ef0 2024-09-11T23:57:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.569+0000 7f58477fe640 1 -- 172.21.15.6:0/2617026680 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24143 (secure 0 0 0) 0x7f584809ade0 con 0x7f5850102ef0 2024-09-11T23:57:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:57:16.569 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-11T23:57:07.083294+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:56:54.204314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:56:56.327143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:57:02.826677+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:57:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.572+0000 7f5858385640 1 -- 172.21.15.6:0/2617026680 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f583c0a2c00 msgr2=0x7f583c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.572+0000 7f5858385640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f583c0a2c00 0x7f583c0a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f584c02a9a0 tx=0x7f584c000bc0 comp rx=0 tx=0).stop 2024-09-11T23:57:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.572+0000 7f5858385640 1 -- 172.21.15.6:0/2617026680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5850102ef0 msgr2=0x7f585019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.572+0000 7f5858385640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5850102ef0 0x7f585019cdd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f584800b970 tx=0x7f584800bd70 comp rx=0 tx=0).stop 2024-09-11T23:57:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.572+0000 7f5858385640 1 -- 172.21.15.6:0/2617026680 shutdown_connections 2024-09-11T23:57:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.572+0000 7f5858385640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f583c0a2c00 0x7f583c0a50c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.572+0000 7f5858385640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5850102ef0 0x7f585019cdd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.572+0000 7f5858385640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850102570 0x7f5850198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.572+0000 7f5858385640 1 --2- 172.21.15.6:0/2617026680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5850100e20 0x7f5850198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.572+0000 7f5858385640 1 -- 172.21.15.6:0/2617026680 >> 172.21.15.6:0/2617026680 conn(0x7f58500fc7d0 msgr2=0x7f585006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.573+0000 7f5858385640 1 -- 172.21.15.6:0/2617026680 shutdown_connections 2024-09-11T23:57:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:16.573+0000 7f5858385640 1 -- 172.21.15.6:0/2617026680 wait complete. 2024-09-11T23:57:17.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:16 smithi006 ceph-mon[30947]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:17.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:16 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2617026680' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:16 smithi134 ceph-mon[34893]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:16 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2617026680' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:17.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:16 smithi039 ceph-mon[34543]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:17.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:16 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2617026680' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:17.325 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:56:58.063963+0000', 'modified': '2024-09-11T23:57:07.083423+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24491}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.39:6839/3561706320', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6838', 'nonce': 3561706320}, {'type': 'v1', 'addr': '172.21.15.39:6839', 'nonce': 3561706320}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24491, 'qdb_cluster': [24491]} 2024-09-11T23:57:17.325 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:57:17.325 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T23:57:17.590 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.110+0000 7f06fc5e5640 1 -- 172.21.15.6:0/3989725028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06f4102790 msgr2=0x7f06f41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.110+0000 7f06fc5e5640 1 --2- 172.21.15.6:0/3989725028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06f4102790 0x7f06f41067e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009900 tx=0x7f06e802a3f0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.110+0000 7f06fc5e5640 1 -- 172.21.15.6:0/3989725028 shutdown_connections 2024-09-11T23:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.110+0000 7f06fc5e5640 1 --2- 172.21.15.6:0/3989725028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06f4106f10 0x7f06f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.110+0000 7f06fc5e5640 1 --2- 172.21.15.6:0/3989725028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06f4102790 0x7f06f41067e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.110+0000 7f06fc5e5640 1 --2- 172.21.15.6:0/3989725028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f4101de0 0x7f06f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.110+0000 7f06fc5e5640 1 -- 172.21.15.6:0/3989725028 >> 172.21.15.6:0/3989725028 conn(0x7f06f40fd8c0 msgr2=0x7f06f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.110+0000 7f06fc5e5640 1 -- 172.21.15.6:0/3989725028 shutdown_connections 2024-09-11T23:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.111+0000 7f06fc5e5640 1 -- 172.21.15.6:0/3989725028 wait complete. 2024-09-11T23:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.111+0000 7f06fc5e5640 1 Processor -- start 2024-09-11T23:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.111+0000 7f06fc5e5640 1 -- start start 2024-09-11T23:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.111+0000 7f06fc5e5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06f4101de0 0x7f06f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.111+0000 7f06fc5e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06f4102790 0x7f06f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.111+0000 7f06fc5e5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f4106f10 0x7f06f4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.111+0000 7f06fc5e5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4111e20 con 0x7f06f4102790 2024-09-11T23:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.111+0000 7f06fc5e5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4111ca0 con 0x7f06f4101de0 2024-09-11T23:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.111+0000 7f06fc5e5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4111fa0 con 0x7f06f4106f10 2024-09-11T23:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.111+0000 7f06f9b80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06f4102790 0x7f06f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06f9b80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06f4102790 0x7f06f4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50792/0 (socket says 172.21.15.6:50792) 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06f9b80640 1 -- 172.21.15.6:0/347554792 learned_addr learned my addr 172.21.15.6:0/347554792 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06fab82640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f4106f10 0x7f06f4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06fa381640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06f4101de0 0x7f06f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06f9b80640 1 -- 172.21.15.6:0/347554792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f4106f10 msgr2=0x7f06f4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06f9b80640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f4106f10 0x7f06f4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06f9b80640 1 -- 172.21.15.6:0/347554792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06f4101de0 msgr2=0x7f06f40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06f9b80640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06f4101de0 0x7f06f40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06f9b80640 1 -- 172.21.15.6:0/347554792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f41a6720 con 0x7f06f4102790 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06f9b80640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06f4102790 0x7f06f4074a30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f06e8006010 tx=0x7f06e8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06e77fe640 1 -- 172.21.15.6:0/347554792 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e803f030 con 0x7f06f4102790 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06fc5e5640 1 -- 172.21.15.6:0/347554792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f41a69b0 con 0x7f06f4102790 2024-09-11T23:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06e77fe640 1 -- 172.21.15.6:0/347554792 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06e80035f0 con 0x7f06f4102790 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06e77fe640 1 -- 172.21.15.6:0/347554792 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8035070 con 0x7f06f4102790 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.112+0000 7f06fc5e5640 1 -- 172.21.15.6:0/347554792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f41a6e90 con 0x7f06f4102790 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.115+0000 7f06e77fe640 1 -- 172.21.15.6:0/347554792 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f06e8003b10 con 0x7f06f4102790 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.115+0000 7f06fe9be740 1 Processor -- start 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.115+0000 7f06fe9be740 1 -- start start 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.115+0000 7f06fe9be740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc237a9d0 0x562bc237adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.115+0000 7f06fe9be740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 0x562bc2385670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.115+0000 7f06fe9be740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc2385bb0 0x562bc2387fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.115+0000 7f06fe9be740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562bc22e1090 con 0x562bc2385bb0 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.115+0000 7f06fe9be740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562bc2288a70 con 0x562bc237a9d0 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06fe9be740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562bc22dd050 con 0x562bc237b2f0 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06e77fe640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f06e00a2b80 0x7f06e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06f9b80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc2385bb0 0x562bc2387fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06fab82640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc237a9d0 0x562bc237adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06f9b80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc2385bb0 0x562bc2387fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50804/0 (socket says 172.21.15.6:50804) 2024-09-11T23:57:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06f9b80640 1 -- 172.21.15.6:0/2973099032 learned_addr learned my addr 172.21.15.6:0/2973099032 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06fab82640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f06e00a2b80 0x7f06e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06fa381640 1 --2- 172.21.15.6:0/2973099032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 0x562bc2385670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06e77fe640 1 -- 172.21.15.6:0/347554792 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f06e80efe00 con 0x7f06f4102790 2024-09-11T23:57:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06fab82640 1 -- 172.21.15.6:0/2973099032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 msgr2=0x562bc2385670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:57:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06fab82640 1 --2- 172.21.15.6:0/2973099032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 0x562bc2385670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06fab82640 1 -- 172.21.15.6:0/2973099032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc2385bb0 msgr2=0x562bc2387fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:57:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06fab82640 1 --2- 172.21.15.6:0/2973099032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc2385bb0 0x562bc2387fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06fab82640 1 -- 172.21.15.6:0/2973099032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bc2295130 con 0x562bc237a9d0 2024-09-11T23:57:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06f9b80640 1 --2- 172.21.15.6:0/2973099032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc2385bb0 0x562bc2387fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:57:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06fab82640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f06e00a2b80 0x7f06e00a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06ec007fd0 tx=0x7f06ec016000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.116+0000 7f06fab82640 1 --2- 172.21.15.6:0/2973099032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc237a9d0 0x562bc237adb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f06ec014dd0 tx=0x7f06ec0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65c355905f43ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.117+0000 7f06e4ff9640 1 -- 172.21.15.6:0/2973099032 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec024030 con 0x562bc237a9d0 2024-09-11T23:57:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.117+0000 7f06e4ff9640 1 -- 172.21.15.6:0/2973099032 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06ec007ba0 con 0x562bc237a9d0 2024-09-11T23:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.117+0000 7f06e4ff9640 1 -- 172.21.15.6:0/2973099032 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec004030 con 0x562bc237a9d0 2024-09-11T23:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.117+0000 7f06fe9be740 1 -- 172.21.15.6:0/2973099032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc237a9d0 msgr2=0x562bc237adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.117+0000 7f06fe9be740 1 --2- 172.21.15.6:0/2973099032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc237a9d0 0x562bc237adb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f06ec014dd0 tx=0x7f06ec0117b0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.117+0000 7f06fe9be740 1 -- 172.21.15.6:0/2973099032 shutdown_connections 2024-09-11T23:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.117+0000 7f06fe9be740 1 --2- 172.21.15.6:0/2973099032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc2385bb0 0x562bc2387fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.117+0000 7f06fe9be740 1 --2- 172.21.15.6:0/2973099032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 0x562bc2385670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.117+0000 7f06fe9be740 1 --2- 172.21.15.6:0/2973099032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc237a9d0 0x562bc237adb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.117+0000 7f06fe9be740 1 -- 172.21.15.6:0/2973099032 >> 172.21.15.6:0/2973099032 conn(0x562bc2376f60 msgr2=0x562bc2377340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.117+0000 7f06fe9be740 1 -- 172.21.15.6:0/2973099032 shutdown_connections 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.117+0000 7f06fe9be740 1 -- 172.21.15.6:0/2973099032 wait complete. 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fe9be740 1 -- start start 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fe9be740 1 Processor -- start 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fe9be740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc23854b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fe9be740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 0x562bc2382800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fe9be740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc2385bb0 0x562bc2382d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fe9be740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562bc2388780 con 0x562bc237a9d0 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fe9be740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562bc229bf20 con 0x562bc2385bb0 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fe9be740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562bc2388900 con 0x562bc237b2f0 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fe9be740 10 client.0 _ll_register_callbacks cb 0x562bc2265030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fa381640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc23854b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fa381640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc23854b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50816/0 (socket says 172.21.15.6:50816) 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fa381640 1 -- 172.21.15.6:0/1413090564 learned_addr learned my addr 172.21.15.6:0/1413090564 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06f9b80640 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 0x562bc2382800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fab82640 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc2385bb0 0x562bc2382d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.118+0000 7f06fa381640 1 -- 172.21.15.6:0/1413090564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 msgr2=0x562bc2382800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06fa381640 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 0x562bc2382800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06fa381640 1 -- 172.21.15.6:0/1413090564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc2385bb0 msgr2=0x562bc2382d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06fa381640 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc2385bb0 0x562bc2382d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06fa381640 1 -- 172.21.15.6:0/1413090564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bc20522b0 con 0x562bc237a9d0 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06fab82640 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc2385bb0 0x562bc2382d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06fa381640 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc23854b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f06f000cd80 tx=0x7f06f00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed423d0b7a664d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06ddffb640 1 -- 172.21.15.6:0/1413090564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0010840 con 0x562bc237a9d0 2024-09-11T23:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06ddffb640 1 -- 172.21.15.6:0/1413090564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f06f00109e0 con 0x562bc237a9d0 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06fe9be740 1 -- 172.21.15.6:0/1413090564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06ec007ba0 con 0x562bc237a9d0 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06ddffb640 1 -- 172.21.15.6:0/1413090564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f06f0010be0 con 0x562bc237a9d0 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06fe9be740 10 client.14739 fetch_fsmap learned FSMap version 16 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06fe9be740 1 -- 172.21.15.6:0/1413090564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x562bc23940f0 con 0x562bc237a9d0 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.119+0000 7f06ddffb640 1 -- 172.21.15.6:0/1413090564 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06ec007ba0 con 0x562bc237a9d0 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.120+0000 7f06ddffb640 1 -- 172.21.15.6:0/1413090564 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f06f0018020 con 0x562bc237a9d0 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.120+0000 7f06fe9be740 10 client.14739 fetch_fsmap finished waiting for FSMap version 16 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.120+0000 7f06fe9be740 10 client.14739 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.120+0000 7f06fe9be740 20 client.14739 populate_metadata read hostname 'smithi006' 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.120+0000 7f06fe9be740 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562bc2396760 0x562bc2397bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.120+0000 7f06fe9be740 4 client.14739 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.120+0000 7f06fe9be740 1 -- 172.21.15.6:0/1413090564 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bc22ee600 con 0x562bc2396760 2024-09-11T23:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.120+0000 7f06f9b80640 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562bc2396760 0x562bc2397bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.120+0000 7f06f9b80640 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562bc2396760 0x562bc2397bd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5131dcd47c6beccf server_cookie=9c68a7f94437a69a in_seq=0 out_seq=0 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.120+0000 7f06ddffb640 10 client.14739 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.121+0000 7f06ddffb640 1 -- 172.21.15.6:0/1413090564 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562bc22ee600 con 0x562bc2396760 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.121+0000 7f06ddffb640 10 client.14739 handle_command_reply: tid=0 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.121+0000 7f06fe9be740 1 client.14739 shutdown 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.121+0000 7f06fe9be740 1 -- 172.21.15.6:0/1413090564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 msgr2=0x562bc23854b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.121+0000 7f06fe9be740 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc23854b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f06f000cd80 tx=0x7f06f00039c0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.121+0000 7f06fe9be740 1 -- 172.21.15.6:0/1413090564 shutdown_connections 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.121+0000 7f06fe9be740 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc2385bb0 0x562bc2382d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.121+0000 7f06fe9be740 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562bc2396760 0x562bc2397bd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.121+0000 7f06fe9be740 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 0x562bc2382800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.121+0000 7f06fe9be740 1 --2- 172.21.15.6:0/1413090564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc23854b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.122+0000 7f06ddffb640 0 client.14739 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-11T23:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.122+0000 7f06fe9be740 1 -- 172.21.15.6:0/1413090564 >> 172.21.15.6:0/1413090564 conn(0x562bc2376f60 msgr2=0x562bc237cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.122+0000 7f06fe9be740 1 -- 172.21.15.6:0/1413090564 shutdown_connections 2024-09-11T23:57:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.122+0000 7f06fe9be740 1 -- 172.21.15.6:0/1413090564 wait complete. 2024-09-11T23:57:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.122+0000 7f06fe9be740 20 client.14739 trim_cache size 0 max 16384 2024-09-11T23:57:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.139+0000 7f06fe9be740 1 Processor -- start 2024-09-11T23:57:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.139+0000 7f06fe9be740 1 -- start start 2024-09-11T23:57:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.139+0000 7f06fe9be740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc2396760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.139+0000 7f06fe9be740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc237b2f0 0x562bc239feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.139+0000 7f06fe9be740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc2385bb0 0x562bc23a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.139+0000 7f06fe9be740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562bc2395f10 con 0x562bc237a9d0 2024-09-11T23:57:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.139+0000 7f06fe9be740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562bc23965e0 con 0x562bc237b2f0 2024-09-11T23:57:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.139+0000 7f06fe9be740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562bc2396cb0 con 0x562bc2385bb0 2024-09-11T23:57:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06fa381640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc2396760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06fa381640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc2396760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50824/0 (socket says 172.21.15.6:50824) 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06fa381640 1 -- 172.21.15.6:0/852942701 learned_addr learned my addr 172.21.15.6:0/852942701 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06f9b80640 1 --2- 172.21.15.6:0/852942701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc237b2f0 0x562bc239feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06fa381640 1 -- 172.21.15.6:0/852942701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc2385bb0 msgr2=0x562bc23a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06fa381640 1 --2- 172.21.15.6:0/852942701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc2385bb0 0x562bc23a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06fa381640 1 -- 172.21.15.6:0/852942701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc237b2f0 msgr2=0x562bc239feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06fa381640 1 --2- 172.21.15.6:0/852942701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc237b2f0 0x562bc239feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06fa381640 1 -- 172.21.15.6:0/852942701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bc23850d0 con 0x562bc237a9d0 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06f9b80640 1 --2- 172.21.15.6:0/852942701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc237b2f0 0x562bc239feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06fa381640 1 --2- 172.21.15.6:0/852942701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc2396760 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f06f0000c00 tx=0x7f06f00040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2196146181d340a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06dffff640 1 -- 172.21.15.6:0/852942701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f002f070 con 0x562bc237a9d0 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06dffff640 1 -- 172.21.15.6:0/852942701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06f00054f0 con 0x562bc237a9d0 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.140+0000 7f06dffff640 1 -- 172.21.15.6:0/852942701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f001aa40 con 0x562bc237a9d0 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.141+0000 7f06fe9be740 1 -- 172.21.15.6:0/852942701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 msgr2=0x562bc2396760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.141+0000 7f06fe9be740 1 --2- 172.21.15.6:0/852942701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc2396760 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f06f0000c00 tx=0x7f06f00040f0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.141+0000 7f06fe9be740 1 -- 172.21.15.6:0/852942701 shutdown_connections 2024-09-11T23:57:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.141+0000 7f06fe9be740 1 --2- 172.21.15.6:0/852942701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc2385bb0 0x562bc23a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.141+0000 7f06fe9be740 1 --2- 172.21.15.6:0/852942701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc237b2f0 0x562bc239feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.141+0000 7f06fe9be740 1 --2- 172.21.15.6:0/852942701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc2396760 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.141+0000 7f06fe9be740 1 -- 172.21.15.6:0/852942701 >> 172.21.15.6:0/852942701 conn(0x562bc2376f60 msgr2=0x562bc23810d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.141+0000 7f06fe9be740 1 -- 172.21.15.6:0/852942701 shutdown_connections 2024-09-11T23:57:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.141+0000 7f06fe9be740 1 -- 172.21.15.6:0/852942701 wait complete. 2024-09-11T23:57:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.141+0000 7f06fe9be740 1 -- start start 2024-09-11T23:57:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.141+0000 7f06fe9be740 1 Processor -- start 2024-09-11T23:57:18.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fe9be740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc239b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fe9be740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 0x562bc239b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fe9be740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc2385bb0 0x562bc23fee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fe9be740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562bc2397a50 con 0x562bc237a9d0 2024-09-11T23:57:18.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fe9be740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562bc2397380 con 0x562bc2385bb0 2024-09-11T23:57:18.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fe9be740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562bc2398120 con 0x562bc237b2f0 2024-09-11T23:57:18.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fa381640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc239b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fe9be740 10 client.0 _ll_register_callbacks cb 0x7f06f0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:57:18.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fa381640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc239b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50826/0 (socket says 172.21.15.6:50826) 2024-09-11T23:57:18.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fa381640 1 -- 172.21.15.6:0/3441469231 learned_addr learned my addr 172.21.15.6:0/3441469231 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:18.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fab82640 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc2385bb0 0x562bc23fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06f9b80640 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 0x562bc239b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fa381640 1 -- 172.21.15.6:0/3441469231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 msgr2=0x562bc239b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fa381640 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 0x562bc239b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fa381640 1 -- 172.21.15.6:0/3441469231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc2385bb0 msgr2=0x562bc23fee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fa381640 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc2385bb0 0x562bc23fee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fa381640 1 -- 172.21.15.6:0/3441469231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bc23ff4a0 con 0x562bc237a9d0 2024-09-11T23:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fa381640 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc239b3f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f06f000cd80 tx=0x7f06f001a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec6b21ed297243f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06ddffb640 1 -- 172.21.15.6:0/3441469231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0039060 con 0x562bc237a9d0 2024-09-11T23:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06ddffb640 1 -- 172.21.15.6:0/3441469231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f06f0021680 con 0x562bc237a9d0 2024-09-11T23:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.142+0000 7f06fe9be740 1 -- 172.21.15.6:0/3441469231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f00054f0 con 0x562bc237a9d0 2024-09-11T23:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.143+0000 7f06ddffb640 1 -- 172.21.15.6:0/3441469231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f06f0040050 con 0x562bc237a9d0 2024-09-11T23:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.143+0000 7f06fe9be740 10 client.14745 fetch_fsmap learned FSMap version 16 2024-09-11T23:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.143+0000 7f06fe9be740 1 -- 172.21.15.6:0/3441469231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x562bc2400780 con 0x562bc237a9d0 2024-09-11T23:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.143+0000 7f06ddffb640 1 -- 172.21.15.6:0/3441469231 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06f00054f0 con 0x562bc237a9d0 2024-09-11T23:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.143+0000 7f06ddffb640 1 -- 172.21.15.6:0/3441469231 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f06f0018070 con 0x562bc237a9d0 2024-09-11T23:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.143+0000 7f06fe9be740 10 client.14745 fetch_fsmap finished waiting for FSMap version 16 2024-09-11T23:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.143+0000 7f06fe9be740 10 client.14745 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.143+0000 7f06fe9be740 20 client.14745 populate_metadata read hostname 'smithi006' 2024-09-11T23:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.143+0000 7f06fe9be740 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562bc2404f20 0x562bc2403c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.143+0000 7f06fe9be740 4 client.14745 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.143+0000 7f06fe9be740 1 -- 172.21.15.6:0/3441469231 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "status"}) -- 0x562bc22e8b10 con 0x562bc2404f20 2024-09-11T23:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.143+0000 7f06f9b80640 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562bc2404f20 0x562bc2403c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06f9b80640 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562bc2404f20 0x562bc2403c30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e53b8611b8d9172 server_cookie=119e50491ad8e3d3 in_seq=0 out_seq=0 2024-09-11T23:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06ddffb640 10 client.14745 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-11T23:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06ddffb640 1 -- 172.21.15.6:0/3441469231 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x562bc22e8b10 con 0x562bc2404f20 2024-09-11T23:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06ddffb640 10 client.14745 handle_command_reply: tid=0 2024-09-11T23:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06fe9be740 1 client.14745 shutdown 2024-09-11T23:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06fe9be740 1 -- 172.21.15.6:0/3441469231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 msgr2=0x562bc239b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06fe9be740 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc239b3f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f06f000cd80 tx=0x7f06f001a9b0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06fe9be740 1 -- 172.21.15.6:0/3441469231 shutdown_connections 2024-09-11T23:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06fe9be740 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bc2385bb0 0x562bc23fee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06fe9be740 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562bc2404f20 0x562bc2403c30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06fe9be740 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bc237b2f0 0x562bc239b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06fe9be740 1 --2- 172.21.15.6:0/3441469231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc237a9d0 0x562bc239b3f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06ddffb640 0 client.14745 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-11T23:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06fe9be740 1 -- 172.21.15.6:0/3441469231 >> 172.21.15.6:0/3441469231 conn(0x562bc2376f60 msgr2=0x562bc2375800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06fe9be740 1 -- 172.21.15.6:0/3441469231 shutdown_connections 2024-09-11T23:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06fe9be740 1 -- 172.21.15.6:0/3441469231 wait complete. 2024-09-11T23:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.144+0000 7f06fe9be740 20 client.14745 trim_cache size 0 max 16384 2024-09-11T23:57:18.152 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:57:18.152 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:57:18.152 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-09-11T23:57:18.152 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24491, 2024-09-11T23:57:18.152 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-11T23:57:18.152 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-11T23:57:18.152 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-11T23:57:18.153 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 19.785775841, 2024-09-11T23:57:18.153 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 16, 2024-09-11T23:57:18.153 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 86, 2024-09-11T23:57:18.153 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:57:18.153 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 30.623172478000001 2024-09-11T23:57:18.153 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:57:18.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.145+0000 7f06fc5e5640 1 -- 172.21.15.6:0/347554792 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f06e00a2b80 msgr2=0x7f06e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:18.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.145+0000 7f06fc5e5640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f06e00a2b80 0x7f06e00a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06ec007fd0 tx=0x7f06ec016000 comp rx=0 tx=0).stop 2024-09-11T23:57:18.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.145+0000 7f06fc5e5640 1 -- 172.21.15.6:0/347554792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06f4102790 msgr2=0x7f06f4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:18.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.145+0000 7f06fc5e5640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06f4102790 0x7f06f4074a30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f06e8006010 tx=0x7f06e8004270 comp rx=0 tx=0).stop 2024-09-11T23:57:18.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.145+0000 7f06fc5e5640 1 -- 172.21.15.6:0/347554792 shutdown_connections 2024-09-11T23:57:18.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.145+0000 7f06fc5e5640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f06e00a2b80 0x7f06e00a5040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.145+0000 7f06fc5e5640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f4106f10 0x7f06f4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.145+0000 7f06fc5e5640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06f4102790 0x7f06f4074a30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.145+0000 7f06fc5e5640 1 --2- 172.21.15.6:0/347554792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06f4101de0 0x7f06f40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.145+0000 7f06fc5e5640 1 -- 172.21.15.6:0/347554792 >> 172.21.15.6:0/347554792 conn(0x7f06f40fd8c0 msgr2=0x7f06f40fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.145+0000 7f06fc5e5640 1 -- 172.21.15.6:0/347554792 shutdown_connections 2024-09-11T23:57:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:18.145+0000 7f06fc5e5640 1 -- 172.21.15.6:0/347554792 wait complete. 2024-09-11T23:57:18.929 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:57:18.929 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:57:18.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T23:57:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:19.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:18 smithi134 ceph-mon[34893]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:19.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:18 smithi039 ceph-mon[34543]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:19.308 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:18 smithi006 ceph-mon[30947]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:19.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.694+0000 7fc286617640 1 -- 172.21.15.6:0/1488596805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280101420 msgr2=0x7fc28010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:19.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.694+0000 7fc286617640 1 --2- 172.21.15.6:0/1488596805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280101420 0x7fc28010d950 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc278009cd0 tx=0x7fc27802a8e0 comp rx=0 tx=0).stop 2024-09-11T23:57:19.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.694+0000 7fc286617640 1 -- 172.21.15.6:0/1488596805 shutdown_connections 2024-09-11T23:57:19.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.694+0000 7fc286617640 1 --2- 172.21.15.6:0/1488596805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280101420 0x7fc28010d950 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:19.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.694+0000 7fc286617640 1 --2- 172.21.15.6:0/1488596805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc280100a80 0x7fc280100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:19.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.694+0000 7fc286617640 1 --2- 172.21.15.6:0/1488596805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc280106a80 0x7fc280106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:19.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.694+0000 7fc286617640 1 -- 172.21.15.6:0/1488596805 >> 172.21.15.6:0/1488596805 conn(0x7fc2800fc7a0 msgr2=0x7fc2800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:19.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.694+0000 7fc286617640 1 -- 172.21.15.6:0/1488596805 shutdown_connections 2024-09-11T23:57:19.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.694+0000 7fc286617640 1 -- 172.21.15.6:0/1488596805 wait complete. 2024-09-11T23:57:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.695+0000 7fc286617640 1 Processor -- start 2024-09-11T23:57:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.695+0000 7fc286617640 1 -- start start 2024-09-11T23:57:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.695+0000 7fc286617640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc280100a80 0x7fc2801982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc286617640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc280101420 0x7fc280198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc286617640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280106a80 0x7fc28019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc286617640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc280110d30 con 0x7fc280106a80 2024-09-11T23:57:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc286617640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc280110bb0 con 0x7fc280101420 2024-09-11T23:57:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc286617640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc280110eb0 con 0x7fc280100a80 2024-09-11T23:57:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc284bb4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280106a80 0x7fc28019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc284bb4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280106a80 0x7fc28019cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50844/0 (socket says 172.21.15.6:50844) 2024-09-11T23:57:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc284bb4640 1 -- 172.21.15.6:0/1894182679 learned_addr learned my addr 172.21.15.6:0/1894182679 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc27ffff640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc280100a80 0x7fc2801982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc27f7fe640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc280101420 0x7fc280198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc284bb4640 1 -- 172.21.15.6:0/1894182679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc280100a80 msgr2=0x7fc2801982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc284bb4640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc280100a80 0x7fc2801982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc284bb4640 1 -- 172.21.15.6:0/1894182679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc280101420 msgr2=0x7fc280198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc284bb4640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc280101420 0x7fc280198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc284bb4640 1 -- 172.21.15.6:0/1894182679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28019d270 con 0x7fc280106a80 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc284bb4640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280106a80 0x7fc28019cb90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc278005cc0 tx=0x7fc278003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc27d7fa640 1 -- 172.21.15.6:0/1894182679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278004450 con 0x7fc280106a80 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc286617640 1 -- 172.21.15.6:0/1894182679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28019d500 con 0x7fc280106a80 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.696+0000 7fc27d7fa640 1 -- 172.21.15.6:0/1894182679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc278031c90 con 0x7fc280106a80 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.697+0000 7fc27d7fa640 1 -- 172.21.15.6:0/1894182679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278030e70 con 0x7fc280106a80 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.697+0000 7fc286617640 1 -- 172.21.15.6:0/1894182679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2801a4e40 con 0x7fc280106a80 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.698+0000 7fc286617640 1 -- 172.21.15.6:0/1894182679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc280100ee0 con 0x7fc280106a80 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.699+0000 7fc27d7fa640 1 -- 172.21.15.6:0/1894182679 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc2780045f0 con 0x7fc280106a80 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.700+0000 7fc27d7fa640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2680a2b80 0x7fc2680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.700+0000 7fc27ffff640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2680a2b80 0x7fc2680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.700+0000 7fc27d7fa640 1 -- 172.21.15.6:0/1894182679 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fc27802e030 con 0x7fc280106a80 2024-09-11T23:57:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.700+0000 7fc27ffff640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2680a2b80 0x7fc2680a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc27000ab60 tx=0x7fc27000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:19.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.703+0000 7fc27d7fa640 1 -- 172.21.15.6:0/1894182679 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc27804b060 con 0x7fc280106a80 2024-09-11T23:57:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.916+0000 7fc286617640 1 -- 172.21.15.6:0/1894182679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc28010a020 con 0x7fc280106a80 2024-09-11T23:57:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.916+0000 7fc27d7fa640 1 -- 172.21.15.6:0/1894182679 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+88 (secure 0 0 0) 0x7fc2780bd9a0 con 0x7fc280106a80 2024-09-11T23:57:19.915 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T23:57:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.918+0000 7fc286617640 1 -- 172.21.15.6:0/1894182679 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2680a2b80 msgr2=0x7fc2680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.918+0000 7fc286617640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2680a2b80 0x7fc2680a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc27000ab60 tx=0x7fc27000a2d0 comp rx=0 tx=0).stop 2024-09-11T23:57:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.918+0000 7fc286617640 1 -- 172.21.15.6:0/1894182679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280106a80 msgr2=0x7fc28019cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.918+0000 7fc286617640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280106a80 0x7fc28019cb90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc278005cc0 tx=0x7fc278003c20 comp rx=0 tx=0).stop 2024-09-11T23:57:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.918+0000 7fc286617640 1 -- 172.21.15.6:0/1894182679 shutdown_connections 2024-09-11T23:57:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.918+0000 7fc286617640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2680a2b80 0x7fc2680a5040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.918+0000 7fc286617640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280106a80 0x7fc28019cb90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.918+0000 7fc286617640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc280101420 0x7fc280198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.918+0000 7fc286617640 1 --2- 172.21.15.6:0/1894182679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc280100a80 0x7fc2801982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.918+0000 7fc286617640 1 -- 172.21.15.6:0/1894182679 >> 172.21.15.6:0/1894182679 conn(0x7fc2800fc7a0 msgr2=0x7fc28006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.918+0000 7fc286617640 1 -- 172.21.15.6:0/1894182679 shutdown_connections 2024-09-11T23:57:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:19.918+0000 7fc286617640 1 -- 172.21.15.6:0/1894182679 wait complete. 2024-09-11T23:57:20.641 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:57:20.642 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:57:20.642 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-09-11T23:57:20.642 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-11T23:57:20.642 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:57:20.643 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:57:20.643 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:57:20.643 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:57:20.643 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T23:57:20.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:57:20.644 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-09-11T23:57:20.662 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:57:20.663 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:57:20.663 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:57:20.663 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:57:20.663 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-09-11T23:57:20.663 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:57:20.663 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:57:20.663 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:57:20.663 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-09-11T23:57:20.663 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:57:20.663 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:57:20.663 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-09-11T23:57:20.664 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:57:20.664 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:57:20.664 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-09-11T23:57:20.664 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T23:57:20.664 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42268sec preferred_lft 42268sec 2024-09-11T23:57:20.664 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2024-09-11T23:57:20.664 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:57:20.664 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:57:20.664 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:57:20.664 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-09-11T23:57:20.669 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:57:20.669 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:57:20.670 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-11T23:57:20.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:57:20.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2024-09-11T23:57:20.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2024-09-11T23:57:20.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:57:20.670 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-11T23:57:20.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:57:20.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:57:20.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:57:20.871 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:57:20.897 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-09-11T23:57:20.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:57:20.899 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-09-11T23:57:20.981 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-09-11T23:57:20.981 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:57:20.981 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T23:57:20.981 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T23:57:20.981 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:57:20.982 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:57:20.982 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-11T23:57:20.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:57:20.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:57:20.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:57:20.983 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-11T23:57:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:57:21.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:20 smithi006 ceph-mon[30947]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:21.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:20 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1894182679' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:57:21.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:20 smithi134 ceph-mon[34893]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:21.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:20 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1894182679' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:57:21.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:57:21.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:57:21.292 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-11T23:57:21.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:20 smithi039 ceph-mon[34543]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:21.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:20 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1894182679' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:57:21.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:57:21.313 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-09-11T23:57:21.369 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:57:21.369 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-11T23:57:21.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:57:21.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-11T23:57:21.369 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-11T23:57:21.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:57:21.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:57:21.489 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-11T23:57:21.489 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:57:21.490 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-11T23:57:21.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-11T23:57:21.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:57:21.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-11T23:57:21.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-11T23:57:21.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-11T23:57:21.490 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-11T23:57:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:57:21.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:57:21.653 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:57:21.653 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-11T23:57:21.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-09-11T23:57:21.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:57:21.653 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-11T23:57:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:57:21.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:57:21.732 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-11T23:57:21.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:57:21.733 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:57:21.749 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T23:57:21.749 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:57:21.749 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:57:21.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-11T23:57:21.874 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:57:21.932 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-11T23:57:21.933 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-11T23:57:21.933 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-11T23:57:21.933 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-11T23:57:21.933 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-11T23:57:21.933 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-11T23:57:21.933 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-11T23:57:21.933 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-11T23:57:21.933 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-11T23:57:21.933 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-11T23:57:21.933 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-11T23:57:21.933 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-11T23:57:21.934 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/b0ed31f593f303c44cc4ce9d8ab25f59d283523d95c87932900bb12276d65312/merged 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/73f2e7d067efc8a88115377d38c2a4b3fb7eda75eb152f512a6a9252ad5b5173/merged 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/98e2a9c70737b7538855e17f7d5fa329104ffc99235f9dd4e9388b6b9a1920d2/merged 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/876f84d9d20194a1dac0aec56353c454ec6ea5ac07879f4f68ae180f7ca7510a/merged 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8f9befd29af261d3ef3e37db80bf310c91eab6ce7d7b3a5bacc91a5f7a393057/merged 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/00409ab6c6fa67372f1d06d53fa184935ee9cac77356c70aa3c96d61fb5bea9d/merged 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/ae5757e571f064c418d9af8358e3d21eeb24ee49dfe88c7975545133e5c426c5/merged 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6924ce0d6e4bdcb154b309a04a2fbda96f9b4a2383e25d7de675b5dabee071e6/merged 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/25b9a3fa1368fe98d6a66742a68c3efda1a75ce2acdcff43de72af7241d0e10a/merged 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8a766fca849e9f765baabad12abf3f377c3077fbc27872b0cd00981497ac2ffb/merged 2024-09-11T23:57:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-11T23:57:21.936 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:57:21.936 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:57:21.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:57:21.936 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-11T23:57:21.989 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:57:21.990 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-11T23:57:22.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-11T23:57:22.059 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:57:22.117 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:57:22.118 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/b0ed31f593f303c44cc4ce9d8ab25f59d283523d95c87932900bb12276d65312/merged 2024-09-11T23:57:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/73f2e7d067efc8a88115377d38c2a4b3fb7eda75eb152f512a6a9252ad5b5173/merged 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/98e2a9c70737b7538855e17f7d5fa329104ffc99235f9dd4e9388b6b9a1920d2/merged 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/876f84d9d20194a1dac0aec56353c454ec6ea5ac07879f4f68ae180f7ca7510a/merged 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8f9befd29af261d3ef3e37db80bf310c91eab6ce7d7b3a5bacc91a5f7a393057/merged 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/00409ab6c6fa67372f1d06d53fa184935ee9cac77356c70aa3c96d61fb5bea9d/merged 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/ae5757e571f064c418d9af8358e3d21eeb24ee49dfe88c7975545133e5c426c5/merged 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6924ce0d6e4bdcb154b309a04a2fbda96f9b4a2383e25d7de675b5dabee071e6/merged 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/25b9a3fa1368fe98d6a66742a68c3efda1a75ce2acdcff43de72af7241d0e10a/merged 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8a766fca849e9f765baabad12abf3f377c3077fbc27872b0cd00981497ac2ffb/merged 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:57:22.120 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:57:22.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:57:22.121 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-11T23:57:22.153 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:2024-09-11T23:57:22.154+0000 7f16e8a1d480 -1 init, newargv = 0x55cb9200fbc0 newargc=15 2024-09-11T23:57:22.153 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[75757]: starting ceph client 2024-09-11T23:57:22.159 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[75757]: starting fuse 2024-09-11T23:57:22.169 INFO:teuthology.orchestra.run.smithi006.stdout:120 2024-09-11T23:57:22.169 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-11T23:57:22.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:57:22.169 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> import re 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-11T23:57:22.170 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2024-09-11T23:57:22.171 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:57:22.171 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:57:22.171 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:57:22.171 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2024-09-11T23:57:22.171 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2024-09-11T23:57:22.171 DEBUG:teuthology.orchestra.run.smithi006:> return f 2024-09-11T23:57:22.171 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:57:22.171 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-11T23:57:22.171 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.admin")) 2024-09-11T23:57:22.171 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-09-11T23:57:22.292 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.admin.75757.asok 2024-09-11T23:57:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:57:22.302 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75757.asok 2024-09-11T23:57:22.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:57:22.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75757.asok status 2024-09-11T23:57:22.442 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:57:22.442 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2024-09-11T23:57:22.442 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:57:22.442 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:57:22.442 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "admin", 2024-09-11T23:57:22.442 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2024-09-11T23:57:22.442 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-11T23:57:22.442 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "75757", 2024-09-11T23:57:22.443 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2024-09-11T23:57:22.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-11T23:57:22.443 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2024-09-11T23:57:22.443 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2024-09-11T23:57:22.443 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 14757, 2024-09-11T23:57:22.443 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2024-09-11T23:57:22.443 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2024-09-11T23:57:22.443 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-09-11T23:57:22.443 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 14757 2024-09-11T23:57:22.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-11T23:57:22.444 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-11T23:57:22.444 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-11T23:57:22.444 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:57:22.444 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3743032120 2024-09-11T23:57:22.444 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-11T23:57:22.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-11T23:57:22.444 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-11T23:57:22.444 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-11T23:57:22.444 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:57:22.445 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3743032120 2024-09-11T23:57:22.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-11T23:57:22.445 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.14757 192.168.0.1:0/3743032120", 2024-09-11T23:57:22.445 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/3743032120", 2024-09-11T23:57:22.445 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2024-09-11T23:57:22.445 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 16, 2024-09-11T23:57:22.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 86, 2024-09-11T23:57:22.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:57:22.445 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2024-09-11T23:57:22.445 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2024-09-11T23:57:22.445 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:57:22.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:57:22.450 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2024-09-11T23:57:22.450 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:57:22.468 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2024-09-11T23:57:22.468 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:57:22.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:57:22.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:57:22.536 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-11T23:57:22.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:57:22.646 INFO:teuthology.orchestra.run.smithi006.stdout:# file: . 2024-09-11T23:57:22.646 INFO:teuthology.orchestra.run.smithi006.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-11T23:57:22.647 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:57:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:57:22.652 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:57:22.652 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:57:22.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T23:57:22.970 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:23.092 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:22 smithi006 ceph-mon[30947]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:23.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:22 smithi134 ceph-mon[34893]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:23.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:22 smithi039 ceph-mon[34543]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:23.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.467+0000 7f2215577640 1 -- 172.21.15.6:0/281457485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2210102e00 msgr2=0x7f22101031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:23.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.467+0000 7f2215577640 1 --2- 172.21.15.6:0/281457485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2210102e00 0x7f22101031e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2200009900 tx=0x7f220002a480 comp rx=0 tx=0).stop 2024-09-11T23:57:23.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.467+0000 7f2215577640 1 -- 172.21.15.6:0/281457485 shutdown_connections 2024-09-11T23:57:23.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.467+0000 7f2215577640 1 --2- 172.21.15.6:0/281457485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f221010c1a0 0x7f221010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.467+0000 7f2215577640 1 --2- 172.21.15.6:0/281457485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2210103720 0x7f221010bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.467+0000 7f2215577640 1 --2- 172.21.15.6:0/281457485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2210102e00 0x7f22101031e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.467+0000 7f2215577640 1 -- 172.21.15.6:0/281457485 >> 172.21.15.6:0/281457485 conn(0x7f22100fc7a0 msgr2=0x7f22100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:23.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.467+0000 7f2215577640 1 -- 172.21.15.6:0/281457485 shutdown_connections 2024-09-11T23:57:23.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.467+0000 7f2215577640 1 -- 172.21.15.6:0/281457485 wait complete. 2024-09-11T23:57:23.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.468+0000 7f2215577640 1 Processor -- start 2024-09-11T23:57:23.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.468+0000 7f2215577640 1 -- start start 2024-09-11T23:57:23.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.468+0000 7f2215577640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2210102e00 0x7f22101982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:23.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.468+0000 7f2215577640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2210103720 0x7f2210198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:23.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.468+0000 7f2215577640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f221010c1a0 0x7f221019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:23.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.468+0000 7f2215577640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2210111e20 con 0x7f2210103720 2024-09-11T23:57:23.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.468+0000 7f2215577640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2210111ca0 con 0x7f221010c1a0 2024-09-11T23:57:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.468+0000 7f2215577640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2210111fa0 con 0x7f2210102e00 2024-09-11T23:57:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f220e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2210103720 0x7f2210198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f220e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2210103720 0x7f2210198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52740/0 (socket says 172.21.15.6:52740) 2024-09-11T23:57:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f220e7fc640 1 -- 172.21.15.6:0/4160796651 learned_addr learned my addr 172.21.15.6:0/4160796651 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f220f7fe640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f221010c1a0 0x7f221019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f220effd640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2210102e00 0x7f22101982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f220e7fc640 1 -- 172.21.15.6:0/4160796651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2210102e00 msgr2=0x7f22101982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f220e7fc640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2210102e00 0x7f22101982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f220e7fc640 1 -- 172.21.15.6:0/4160796651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f221010c1a0 msgr2=0x7f221019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f220e7fc640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f221010c1a0 0x7f221019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f220e7fc640 1 -- 172.21.15.6:0/4160796651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221019d2a0 con 0x7f2210103720 2024-09-11T23:57:23.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f220e7fc640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2210103720 0x7f2210198830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f21f800d770 tx=0x7f21f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:23.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f2207fff640 1 -- 172.21.15.6:0/4160796651 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8017070 con 0x7f2210103720 2024-09-11T23:57:23.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f2215577640 1 -- 172.21.15.6:0/4160796651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f221019d590 con 0x7f2210103720 2024-09-11T23:57:23.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f2207fff640 1 -- 172.21.15.6:0/4160796651 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f21f80054d0 con 0x7f2210103720 2024-09-11T23:57:23.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f2215577640 1 -- 172.21.15.6:0/4160796651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22101a4e70 con 0x7f2210103720 2024-09-11T23:57:23.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.469+0000 7f2207fff640 1 -- 172.21.15.6:0/4160796651 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8004cf0 con 0x7f2210103720 2024-09-11T23:57:23.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.470+0000 7f2215577640 1 -- 172.21.15.6:0/4160796651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22101031e0 con 0x7f2210103720 2024-09-11T23:57:23.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.472+0000 7f2207fff640 1 -- 172.21.15.6:0/4160796651 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f21f8004e90 con 0x7f2210103720 2024-09-11T23:57:23.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.472+0000 7f2207fff640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f21fc0a2c00 0x7f21fc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:23.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.472+0000 7f220effd640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f21fc0a2c00 0x7f21fc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:23.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.472+0000 7f2207fff640 1 -- 172.21.15.6:0/4160796651 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f21f80ced80 con 0x7f2210103720 2024-09-11T23:57:23.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.473+0000 7f220effd640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f21fc0a2c00 0x7f21fc0a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2200031440 tx=0x7f22000095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:23.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.477+0000 7f2207fff640 1 -- 172.21.15.6:0/4160796651 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f21f809ba40 con 0x7f2210103720 2024-09-11T23:57:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.667+0000 7f2215577640 1 -- 172.21.15.6:0/4160796651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f22101072b0 con 0x7f2210103720 2024-09-11T23:57:23.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.668+0000 7f2207fff640 1 -- 172.21.15.6:0/4160796651 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) ==== 81+0+581 (secure 0 0 0) 0x7f21f809b340 con 0x7f2210103720 2024-09-11T23:57:23.668 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4111388064 2024-09-12T23:50:00.847021+0000 2024-09-11T23:57:23.668 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2784482923 2024-09-12T23:50:00.847021+0000 2024-09-11T23:57:23.668 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/2279576750 2024-09-12T23:50:00.847021+0000 2024-09-11T23:57:23.668 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/1826197239 2024-09-12T23:49:36.127456+0000 2024-09-11T23:57:23.668 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/1826197239 2024-09-12T23:49:36.127456+0000 2024-09-11T23:57:23.668 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/619991212 2024-09-12T23:50:00.847021+0000 2024-09-11T23:57:23.668 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3073584278 2024-09-12T23:49:36.127456+0000 2024-09-11T23:57:23.668 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/2279576750 2024-09-12T23:50:00.847021+0000 2024-09-11T23:57:23.668 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3649466939 2024-09-12T23:49:36.127456+0000 2024-09-11T23:57:23.668 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2071921193 2024-09-12T23:49:36.127456+0000 2024-09-11T23:57:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:listed 10 entries 2024-09-11T23:57:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.671+0000 7f2215577640 1 -- 172.21.15.6:0/4160796651 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f21fc0a2c00 msgr2=0x7f21fc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.671+0000 7f2215577640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f21fc0a2c00 0x7f21fc0a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2200031440 tx=0x7f22000095f0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.671+0000 7f2215577640 1 -- 172.21.15.6:0/4160796651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2210103720 msgr2=0x7f2210198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.671+0000 7f2215577640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2210103720 0x7f2210198830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f21f800d770 tx=0x7f21f800dc30 comp rx=0 tx=0).stop 2024-09-11T23:57:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.671+0000 7f2215577640 1 -- 172.21.15.6:0/4160796651 shutdown_connections 2024-09-11T23:57:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.671+0000 7f2215577640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f21fc0a2c00 0x7f21fc0a50c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.671+0000 7f2215577640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f221010c1a0 0x7f221019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.671+0000 7f2215577640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2210103720 0x7f2210198830 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.671+0000 7f2215577640 1 --2- 172.21.15.6:0/4160796651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2210102e00 0x7f22101982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.671+0000 7f2215577640 1 -- 172.21.15.6:0/4160796651 >> 172.21.15.6:0/4160796651 conn(0x7f22100fc7a0 msgr2=0x7f22100fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.671+0000 7f2215577640 1 -- 172.21.15.6:0/4160796651 shutdown_connections 2024-09-11T23:57:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:23.671+0000 7f2215577640 1 -- 172.21.15.6:0/4160796651 wait complete. 2024-09-11T23:57:24.115 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:23 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/4160796651' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:57:24.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:23 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/4160796651' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:57:24.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:23 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/4160796651' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:57:24.470 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:57:24.470 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:57:24.489 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T23:57:24.790 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:25.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:24 smithi134 ceph-mon[34893]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:25.219 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:24 smithi006 ceph-mon[30947]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:25.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:24 smithi039 ceph-mon[34543]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:25.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.306+0000 7f8f2887d640 1 -- 172.21.15.6:0/3446551301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f24102d30 msgr2=0x7f8f24103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:25.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.306+0000 7f8f2887d640 1 --2- 172.21.15.6:0/3446551301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f24102d30 0x7f8f24103110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009930 tx=0x7f8f1402a420 comp rx=0 tx=0).stop 2024-09-11T23:57:25.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.306+0000 7f8f2887d640 1 -- 172.21.15.6:0/3446551301 shutdown_connections 2024-09-11T23:57:25.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.306+0000 7f8f2887d640 1 --2- 172.21.15.6:0/3446551301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f241082a0 0x7f8f2410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.306+0000 7f8f2887d640 1 --2- 172.21.15.6:0/3446551301 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f241036e0 0x7f8f24107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.306+0000 7f8f2887d640 1 --2- 172.21.15.6:0/3446551301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f24102d30 0x7f8f24103110 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.306+0000 7f8f2887d640 1 -- 172.21.15.6:0/3446551301 >> 172.21.15.6:0/3446551301 conn(0x7f8f240fc7d0 msgr2=0x7f8f240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.306+0000 7f8f2887d640 1 -- 172.21.15.6:0/3446551301 shutdown_connections 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.306+0000 7f8f2887d640 1 -- 172.21.15.6:0/3446551301 wait complete. 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.307+0000 7f8f2887d640 1 Processor -- start 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.307+0000 7f8f2887d640 1 -- start start 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.307+0000 7f8f2887d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f24102d30 0x7f8f24100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.307+0000 7f8f2887d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f241036e0 0x7f8f24100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.307+0000 7f8f2887d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f241082a0 0x7f8f24101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.307+0000 7f8f2887d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8f24111f50 con 0x7f8f241082a0 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.307+0000 7f8f2887d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8f24111dd0 con 0x7f8f241036e0 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.307+0000 7f8f2887d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f241120d0 con 0x7f8f24102d30 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.307+0000 7f8f22d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f241082a0 0x7f8f24101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.307+0000 7f8f22d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f241082a0 0x7f8f24101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52752/0 (socket says 172.21.15.6:52752) 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.307+0000 7f8f22d9d640 1 -- 172.21.15.6:0/4122601910 learned_addr learned my addr 172.21.15.6:0/4122601910 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f2259c640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f24102d30 0x7f8f24100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f21d9b640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f241036e0 0x7f8f24100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f22d9d640 1 -- 172.21.15.6:0/4122601910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f24102d30 msgr2=0x7f8f24100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f22d9d640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f24102d30 0x7f8f24100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f22d9d640 1 -- 172.21.15.6:0/4122601910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f241036e0 msgr2=0x7f8f24100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f22d9d640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f241036e0 0x7f8f24100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f22d9d640 1 -- 172.21.15.6:0/4122601910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f241a6960 con 0x7f8f241082a0 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f22d9d640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f241082a0 0x7f8f24101410 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00d950 tx=0x7f8f1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f1b7fe640 1 -- 172.21.15.6:0/4122601910 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c017030 con 0x7f8f241082a0 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f1b7fe640 1 -- 172.21.15.6:0/4122601910 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f1c004020 con 0x7f8f241082a0 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f2887d640 1 -- 172.21.15.6:0/4122601910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f241a6c50 con 0x7f8f241082a0 2024-09-11T23:57:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f1b7fe640 1 -- 172.21.15.6:0/4122601910 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c003b20 con 0x7f8f241082a0 2024-09-11T23:57:25.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.308+0000 7f8f2887d640 1 -- 172.21.15.6:0/4122601910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f241a7140 con 0x7f8f241082a0 2024-09-11T23:57:25.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.309+0000 7f8f2887d640 1 -- 172.21.15.6:0/4122601910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f2406a850 con 0x7f8f241082a0 2024-09-11T23:57:25.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.311+0000 7f8f1b7fe640 1 -- 172.21.15.6:0/4122601910 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8f1c01a070 con 0x7f8f241082a0 2024-09-11T23:57:25.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.312+0000 7f8f1b7fe640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8f100a2b80 0x7f8f100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:25.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.312+0000 7f8f1b7fe640 1 -- 172.21.15.6:0/4122601910 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f8f1c0cee50 con 0x7f8f241082a0 2024-09-11T23:57:25.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.312+0000 7f8f2259c640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8f100a2b80 0x7f8f100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:25.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.313+0000 7f8f2259c640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8f100a2b80 0x7f8f100a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f14000c00 tx=0x7f8f14032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:25.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.315+0000 7f8f1b7fe640 1 -- 172.21.15.6:0/4122601910 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f1c021070 con 0x7f8f241082a0 2024-09-11T23:57:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.505+0000 7f8f2887d640 1 -- 172.21.15.6:0/4122601910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8f24103110 con 0x7f8f241082a0 2024-09-11T23:57:25.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.505+0000 7f8f1b7fe640 1 -- 172.21.15.6:0/4122601910 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) ==== 81+0+581 (secure 0 0 0) 0x7f8f1c09bb10 con 0x7f8f241082a0 2024-09-11T23:57:25.504 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4111388064 2024-09-12T23:50:00.847021+0000 2024-09-11T23:57:25.505 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2784482923 2024-09-12T23:50:00.847021+0000 2024-09-11T23:57:25.505 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/2279576750 2024-09-12T23:50:00.847021+0000 2024-09-11T23:57:25.505 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/1826197239 2024-09-12T23:49:36.127456+0000 2024-09-11T23:57:25.505 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/1826197239 2024-09-12T23:49:36.127456+0000 2024-09-11T23:57:25.505 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/619991212 2024-09-12T23:50:00.847021+0000 2024-09-11T23:57:25.505 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3073584278 2024-09-12T23:49:36.127456+0000 2024-09-11T23:57:25.505 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/2279576750 2024-09-12T23:50:00.847021+0000 2024-09-11T23:57:25.505 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3649466939 2024-09-12T23:49:36.127456+0000 2024-09-11T23:57:25.505 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2071921193 2024-09-12T23:49:36.127456+0000 2024-09-11T23:57:25.505 INFO:teuthology.orchestra.run.smithi006.stderr:listed 10 entries 2024-09-11T23:57:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.509+0000 7f8f2887d640 1 -- 172.21.15.6:0/4122601910 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8f100a2b80 msgr2=0x7f8f100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.509+0000 7f8f2887d640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8f100a2b80 0x7f8f100a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f14000c00 tx=0x7f8f14032c80 comp rx=0 tx=0).stop 2024-09-11T23:57:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.509+0000 7f8f2887d640 1 -- 172.21.15.6:0/4122601910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f241082a0 msgr2=0x7f8f24101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.509+0000 7f8f2887d640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f241082a0 0x7f8f24101410 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00d950 tx=0x7f8f1c00de10 comp rx=0 tx=0).stop 2024-09-11T23:57:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.509+0000 7f8f2887d640 1 -- 172.21.15.6:0/4122601910 shutdown_connections 2024-09-11T23:57:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.509+0000 7f8f2887d640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8f100a2b80 0x7f8f100a5040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.509+0000 7f8f2887d640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f241082a0 0x7f8f24101410 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.509+0000 7f8f2887d640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f241036e0 0x7f8f24100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.509+0000 7f8f2887d640 1 --2- 172.21.15.6:0/4122601910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f24102d30 0x7f8f24100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.509+0000 7f8f2887d640 1 -- 172.21.15.6:0/4122601910 >> 172.21.15.6:0/4122601910 conn(0x7f8f240fc7d0 msgr2=0x7f8f24105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.509+0000 7f8f2887d640 1 -- 172.21.15.6:0/4122601910 shutdown_connections 2024-09-11T23:57:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:25.509+0000 7f8f2887d640 1 -- 172.21.15.6:0/4122601910 wait complete. 2024-09-11T23:57:26.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:25 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/4122601910' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:57:26.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:25 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/4122601910' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:57:26.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:25 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/4122601910' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:57:26.301 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2024-09-11T23:57:26.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:57:26.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:57:26.328 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[75757]: fuse finished with error 0 and tester_r 0 2024-09-11T23:57:26.330 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:57:27.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:26 smithi134 ceph-mon[34893]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:27.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:26 smithi039 ceph-mon[34543]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:27.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:26 smithi006 ceph-mon[30947]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:29.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:28 smithi134 ceph-mon[34893]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:57:29.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:28 smithi039 ceph-mon[34543]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:57:29.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:28 smithi006 ceph-mon[30947]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:57:31.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:30 smithi134 ceph-mon[34893]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:57:31.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:30 smithi039 ceph-mon[34543]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:57:31.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:30 smithi006 ceph-mon[30947]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:57:32.432 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-09-11T23:57:32.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:57:32.432 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-11T23:57:32.464 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:57:32.778 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:33.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:32 smithi006 ceph-mon[30947]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:57:33.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:32 smithi134 ceph-mon[34893]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:57:33.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:32 smithi039 ceph-mon[34543]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:57:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.271+0000 7fc938e6e640 1 -- 172.21.15.6:0/3700080750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934106f10 msgr2=0x7fc93410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.271+0000 7fc938e6e640 1 --2- 172.21.15.6:0/3700080750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934106f10 0x7fc93410ea90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009ca0 tx=0x7fc92c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:57:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.271+0000 7fc938e6e640 1 -- 172.21.15.6:0/3700080750 shutdown_connections 2024-09-11T23:57:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.271+0000 7fc938e6e640 1 --2- 172.21.15.6:0/3700080750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934106f10 0x7fc93410ea90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.271+0000 7fc938e6e640 1 --2- 172.21.15.6:0/3700080750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc934102790 0x7fc9341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.271+0000 7fc938e6e640 1 --2- 172.21.15.6:0/3700080750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc934101de0 0x7fc9341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.271+0000 7fc938e6e640 1 -- 172.21.15.6:0/3700080750 >> 172.21.15.6:0/3700080750 conn(0x7fc9340fd8c0 msgr2=0x7fc9340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.271+0000 7fc938e6e640 1 -- 172.21.15.6:0/3700080750 shutdown_connections 2024-09-11T23:57:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.272+0000 7fc938e6e640 1 -- 172.21.15.6:0/3700080750 wait complete. 2024-09-11T23:57:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.272+0000 7fc938e6e640 1 Processor -- start 2024-09-11T23:57:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.272+0000 7fc938e6e640 1 -- start start 2024-09-11T23:57:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.272+0000 7fc938e6e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc934101de0 0x7fc934198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.272+0000 7fc938e6e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc934102790 0x7fc9341988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.272+0000 7fc938e6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934106f10 0x7fc93419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.272+0000 7fc938e6e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc934111e40 con 0x7fc934106f10 2024-09-11T23:57:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.272+0000 7fc938e6e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc934111cc0 con 0x7fc934101de0 2024-09-11T23:57:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.272+0000 7fc938e6e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc934111fc0 con 0x7fc934102790 2024-09-11T23:57:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc932d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934106f10 0x7fc93419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc932d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934106f10 0x7fc93419cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35148/0 (socket says 172.21.15.6:35148) 2024-09-11T23:57:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc932d9d640 1 -- 172.21.15.6:0/4165542004 learned_addr learned my addr 172.21.15.6:0/4165542004 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc93259c640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc934101de0 0x7fc934198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc92bfff640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc934102790 0x7fc9341988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc932d9d640 1 -- 172.21.15.6:0/4165542004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc934102790 msgr2=0x7fc9341988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc932d9d640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc934102790 0x7fc9341988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc932d9d640 1 -- 172.21.15.6:0/4165542004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc934101de0 msgr2=0x7fc934198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc932d9d640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc934101de0 0x7fc934198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc932d9d640 1 -- 172.21.15.6:0/4165542004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93419d330 con 0x7fc934106f10 2024-09-11T23:57:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc932d9d640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934106f10 0x7fc93419cc50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009dc0 tx=0x7fc92c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc92b7fe640 1 -- 172.21.15.6:0/4165542004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c004040 con 0x7fc934106f10 2024-09-11T23:57:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc938e6e640 1 -- 172.21.15.6:0/4165542004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93419d5c0 con 0x7fc934106f10 2024-09-11T23:57:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc92b7fe640 1 -- 172.21.15.6:0/4165542004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc92c004690 con 0x7fc934106f10 2024-09-11T23:57:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc92b7fe640 1 -- 172.21.15.6:0/4165542004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c030d90 con 0x7fc934106f10 2024-09-11T23:57:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.273+0000 7fc938e6e640 1 -- 172.21.15.6:0/4165542004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9341a4f00 con 0x7fc934106f10 2024-09-11T23:57:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.275+0000 7fc938e6e640 1 -- 172.21.15.6:0/4165542004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9341021c0 con 0x7fc934106f10 2024-09-11T23:57:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.276+0000 7fc92b7fe640 1 -- 172.21.15.6:0/4165542004 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc92c0305c0 con 0x7fc934106f10 2024-09-11T23:57:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.276+0000 7fc92b7fe640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc9200a2b80 0x7fc9200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.277+0000 7fc93259c640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc9200a2b80 0x7fc9200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.277+0000 7fc92b7fe640 1 -- 172.21.15.6:0/4165542004 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fc92c0f0c40 con 0x7fc934106f10 2024-09-11T23:57:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.277+0000 7fc93259c640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc9200a2b80 0x7fc9200a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc924009890 tx=0x7fc924008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.280+0000 7fc92b7fe640 1 -- 172.21.15.6:0/4165542004 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc92c0bd960 con 0x7fc934106f10 2024-09-11T23:57:33.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.458+0000 7fc938e6e640 1 -- 172.21.15.6:0/4165542004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9341996e0 con 0x7fc934106f10 2024-09-11T23:57:33.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.460+0000 7fc92b7fe640 1 -- 172.21.15.6:0/4165542004 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24143 (secure 0 0 0) 0x7fc9341996e0 con 0x7fc934106f10 2024-09-11T23:57:33.459 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:57:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-11T23:57:07.083294+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:56:54.204314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:56:56.327143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:57:02.826677+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:57:33.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.462+0000 7fc938e6e640 1 -- 172.21.15.6:0/4165542004 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc9200a2b80 msgr2=0x7fc9200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:33.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.462+0000 7fc938e6e640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc9200a2b80 0x7fc9200a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc924009890 tx=0x7fc924008040 comp rx=0 tx=0).stop 2024-09-11T23:57:33.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.462+0000 7fc938e6e640 1 -- 172.21.15.6:0/4165542004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934106f10 msgr2=0x7fc93419cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:33.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.462+0000 7fc938e6e640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934106f10 0x7fc93419cc50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009dc0 tx=0x7fc92c003ba0 comp rx=0 tx=0).stop 2024-09-11T23:57:33.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.462+0000 7fc938e6e640 1 -- 172.21.15.6:0/4165542004 shutdown_connections 2024-09-11T23:57:33.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.462+0000 7fc938e6e640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc9200a2b80 0x7fc9200a5040 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:33.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.462+0000 7fc938e6e640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934106f10 0x7fc93419cc50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:33.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.462+0000 7fc938e6e640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc934102790 0x7fc9341988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:33.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.462+0000 7fc938e6e640 1 --2- 172.21.15.6:0/4165542004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc934101de0 0x7fc934198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:33.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.462+0000 7fc938e6e640 1 -- 172.21.15.6:0/4165542004 >> 172.21.15.6:0/4165542004 conn(0x7fc9340fd8c0 msgr2=0x7fc9340fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:33.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.462+0000 7fc938e6e640 1 -- 172.21.15.6:0/4165542004 shutdown_connections 2024-09-11T23:57:33.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:33.462+0000 7fc938e6e640 1 -- 172.21.15.6:0/4165542004 wait complete. 2024-09-11T23:57:34.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:33 smithi134 ceph-mon[34893]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:57:34.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:33 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/4165542004' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:34.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:33 smithi039 ceph-mon[34543]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:57:34.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:33 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/4165542004' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:34.315 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:33 smithi006 ceph-mon[30947]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:57:34.316 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:33 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/4165542004' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:34.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:57:34.615 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.087+0000 7f51c0256640 1 -- 172.21.15.6:0/1920004463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b810e480 msgr2=0x7f51b8110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.087+0000 7f51c0256640 1 --2- 172.21.15.6:0/1920004463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b810e480 0x7f51b8110870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009ca0 tx=0x7f51b002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.087+0000 7f51c0256640 1 -- 172.21.15.6:0/1920004463 shutdown_connections 2024-09-11T23:57:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.087+0000 7f51c0256640 1 --2- 172.21.15.6:0/1920004463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b810e480 0x7f51b8110870 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 --2- 172.21.15.6:0/1920004463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51b8101280 0x7f51b810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 --2- 172.21.15.6:0/1920004463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51b81008d0 0x7f51b8100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 -- 172.21.15.6:0/1920004463 >> 172.21.15.6:0/1920004463 conn(0x7f51b80fc7a0 msgr2=0x7f51b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 -- 172.21.15.6:0/1920004463 shutdown_connections 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 -- 172.21.15.6:0/1920004463 wait complete. 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 Processor -- start 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 -- start start 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51b81008d0 0x7f51b819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b8101280 0x7f51b819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51b810e480 0x7f51b819eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f51b8114030 con 0x7f51b8101280 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f51b8113eb0 con 0x7f51b81008d0 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.088+0000 7f51c0256640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51b81141b0 con 0x7f51b810e480 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51bd7f1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b8101280 0x7f51b819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51bd7f1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b8101280 0x7f51b819ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35170/0 (socket says 172.21.15.6:35170) 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51bd7f1640 1 -- 172.21.15.6:0/2941636220 learned_addr learned my addr 172.21.15.6:0/2941636220 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51be7f3640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51b810e480 0x7f51b819eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51bdff2640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51b81008d0 0x7f51b819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51bd7f1640 1 -- 172.21.15.6:0/2941636220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51b810e480 msgr2=0x7f51b819eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51bd7f1640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51b810e480 0x7f51b819eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51bd7f1640 1 -- 172.21.15.6:0/2941636220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51b81008d0 msgr2=0x7f51b819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51bd7f1640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51b81008d0 0x7f51b819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51bd7f1640 1 -- 172.21.15.6:0/2941636220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b819f580 con 0x7f51b8101280 2024-09-11T23:57:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51bd7f1640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b8101280 0x7f51b819ab10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f51a800e9f0 tx=0x7f51a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51aeffd640 1 -- 172.21.15.6:0/2941636220 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a800cd80 con 0x7f51b8101280 2024-09-11T23:57:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51aeffd640 1 -- 172.21.15.6:0/2941636220 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51a80054d0 con 0x7f51b8101280 2024-09-11T23:57:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51c0256640 1 -- 172.21.15.6:0/2941636220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b819f870 con 0x7f51b8101280 2024-09-11T23:57:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51aeffd640 1 -- 172.21.15.6:0/2941636220 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8010490 con 0x7f51b8101280 2024-09-11T23:57:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.089+0000 7f51c0256640 1 -- 172.21.15.6:0/2941636220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b81a7150 con 0x7f51b8101280 2024-09-11T23:57:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.090+0000 7f51c0256640 1 -- 172.21.15.6:0/2941636220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b8100cb0 con 0x7f51b8101280 2024-09-11T23:57:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.092+0000 7f51aeffd640 1 -- 172.21.15.6:0/2941636220 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f51a8005000 con 0x7f51b8101280 2024-09-11T23:57:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.092+0000 7f51aeffd640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f51a40a2c00 0x7f51a40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.092+0000 7f51bdff2640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f51a40a2c00 0x7f51a40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.092+0000 7f51aeffd640 1 -- 172.21.15.6:0/2941636220 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f51a80cf760 con 0x7f51b8101280 2024-09-11T23:57:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.093+0000 7f51bdff2640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f51a40a2c00 0x7f51a40a50c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f51b4005d00 tx=0x7f51b400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.096+0000 7f51aeffd640 1 -- 172.21.15.6:0/2941636220 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51a80541b0 con 0x7f51b8101280 2024-09-11T23:57:35.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.270+0000 7f51c0256640 1 -- 172.21.15.6:0/2941636220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51b819b930 con 0x7f51b8101280 2024-09-11T23:57:35.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.273+0000 7f51aeffd640 1 -- 172.21.15.6:0/2941636220 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24143 (secure 0 0 0) 0x7f51b819b930 con 0x7f51b8101280 2024-09-11T23:57:35.272 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:57:35.272 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-11T23:57:07.083294+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:56:54.204314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:56:56.327143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:57:02.826677+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:57:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.275+0000 7f51c0256640 1 -- 172.21.15.6:0/2941636220 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f51a40a2c00 msgr2=0x7f51a40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.275+0000 7f51c0256640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f51a40a2c00 0x7f51a40a50c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f51b4005d00 tx=0x7f51b400b410 comp rx=0 tx=0).stop 2024-09-11T23:57:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.275+0000 7f51c0256640 1 -- 172.21.15.6:0/2941636220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b8101280 msgr2=0x7f51b819ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.275+0000 7f51c0256640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b8101280 0x7f51b819ab10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f51a800e9f0 tx=0x7f51a800edf0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.275+0000 7f51c0256640 1 -- 172.21.15.6:0/2941636220 shutdown_connections 2024-09-11T23:57:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.275+0000 7f51c0256640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f51a40a2c00 0x7f51a40a50c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.275+0000 7f51c0256640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51b810e480 0x7f51b819eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.275+0000 7f51c0256640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b8101280 0x7f51b819ab10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.275+0000 7f51c0256640 1 --2- 172.21.15.6:0/2941636220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51b81008d0 0x7f51b819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.275+0000 7f51c0256640 1 -- 172.21.15.6:0/2941636220 >> 172.21.15.6:0/2941636220 conn(0x7f51b80fc7a0 msgr2=0x7f51b80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.275+0000 7f51c0256640 1 -- 172.21.15.6:0/2941636220 shutdown_connections 2024-09-11T23:57:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:35.275+0000 7f51c0256640 1 -- 172.21.15.6:0/2941636220 wait complete. 2024-09-11T23:57:35.908 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:57:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:36.293 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:35 smithi006 ceph-mon[30947]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:57:36.293 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:35 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2941636220' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:36.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:35 smithi039 ceph-mon[34543]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:57:36.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:35 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2941636220' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:36.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:35 smithi134 ceph-mon[34893]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:57:36.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:35 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2941636220' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.674+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/2167613398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd0103660 msgr2=0x7f9cd010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.674+0000 7f9cd5a3d640 1 --2- 172.21.15.6:0/2167613398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd0103660 0x7f9cd010bb50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009900 tx=0x7f9cb802a480 comp rx=0 tx=0).stop 2024-09-11T23:57:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.674+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/2167613398 shutdown_connections 2024-09-11T23:57:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.674+0000 7f9cd5a3d640 1 --2- 172.21.15.6:0/2167613398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cd010c170 0x7f9cd010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.674+0000 7f9cd5a3d640 1 --2- 172.21.15.6:0/2167613398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd0103660 0x7f9cd010bb50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.674+0000 7f9cd5a3d640 1 --2- 172.21.15.6:0/2167613398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cd0102d40 0x7f9cd0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.674+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/2167613398 >> 172.21.15.6:0/2167613398 conn(0x7f9cd00fc7a0 msgr2=0x7f9cd00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.674+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/2167613398 shutdown_connections 2024-09-11T23:57:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.674+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/2167613398 wait complete. 2024-09-11T23:57:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.674+0000 7f9cd5a3d640 1 Processor -- start 2024-09-11T23:57:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cd5a3d640 1 -- start start 2024-09-11T23:57:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cd5a3d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cd0102d40 0x7f9cd0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cd5a3d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd0103660 0x7f9cd0198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cd5a3d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cd010c170 0x7f9cd019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cd5a3d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd0111e60 con 0x7f9cd0103660 2024-09-11T23:57:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cd5a3d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd0111ce0 con 0x7f9cd0102d40 2024-09-11T23:57:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cd5a3d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd0111fe0 con 0x7f9cd010c170 2024-09-11T23:57:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cce7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd0103660 0x7f9cd0198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cce7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd0103660 0x7f9cd0198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35200/0 (socket says 172.21.15.6:35200) 2024-09-11T23:57:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cce7fc640 1 -- 172.21.15.6:0/1553156441 learned_addr learned my addr 172.21.15.6:0/1553156441 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9ccf7fe640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cd010c170 0x7f9cd019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cceffd640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cd0102d40 0x7f9cd0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cce7fc640 1 -- 172.21.15.6:0/1553156441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cd010c170 msgr2=0x7f9cd019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cce7fc640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cd010c170 0x7f9cd019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cce7fc640 1 -- 172.21.15.6:0/1553156441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cd0102d40 msgr2=0x7f9cd0198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cce7fc640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cd0102d40 0x7f9cd0198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.675+0000 7f9cce7fc640 1 -- 172.21.15.6:0/1553156441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd019d3d0 con 0x7f9cd0103660 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.676+0000 7f9cce7fc640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd0103660 0x7f9cd0198960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8006010 tx=0x7f9cb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.676+0000 7f9cd4a3b640 1 -- 172.21.15.6:0/1553156441 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb803f030 con 0x7f9cd0103660 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.676+0000 7f9cd4a3b640 1 -- 172.21.15.6:0/1553156441 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9cb8003800 con 0x7f9cd0103660 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.676+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/1553156441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd019d660 con 0x7f9cd0103660 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.676+0000 7f9cd4a3b640 1 -- 172.21.15.6:0/1553156441 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8035070 con 0x7f9cd0103660 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.676+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/1553156441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd01a4fa0 con 0x7f9cd0103660 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.677+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/1553156441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd006b070 con 0x7f9cd0103660 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.678+0000 7f9cd4a3b640 1 -- 172.21.15.6:0/1553156441 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f9cb8031af0 con 0x7f9cd0103660 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.679+0000 7f9cd4a3b640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9cbc0a2c00 0x7f9cbc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.679+0000 7f9cceffd640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9cbc0a2c00 0x7f9cbc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.679+0000 7f9cd4a3b640 1 -- 172.21.15.6:0/1553156441 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f9cb80efcb0 con 0x7f9cd0103660 2024-09-11T23:57:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.680+0000 7f9cceffd640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9cbc0a2c00 0x7f9cbc0a50c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009890 tx=0x7f9cc0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.682+0000 7f9cd4a3b640 1 -- 172.21.15.6:0/1553156441 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9cb80bc9d0 con 0x7f9cd0103660 2024-09-11T23:57:36.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:36.897+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/1553156441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9cd0103120 con 0x7f9cd0103660 2024-09-11T23:57:36.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.001+0000 7f9cd4a3b640 1 -- 172.21.15.6:0/1553156441 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f9cb80bc2d0 con 0x7f9cd0103660 2024-09-11T23:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.003+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/1553156441 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9cbc0a2c00 msgr2=0x7f9cbc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.003+0000 7f9cd5a3d640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9cbc0a2c00 0x7f9cbc0a50c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009890 tx=0x7f9cc0008040 comp rx=0 tx=0).stop 2024-09-11T23:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.003+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/1553156441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd0103660 msgr2=0x7f9cd0198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.003+0000 7f9cd5a3d640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd0103660 0x7f9cd0198960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8006010 tx=0x7f9cb80042f0 comp rx=0 tx=0).stop 2024-09-11T23:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.003+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/1553156441 shutdown_connections 2024-09-11T23:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.003+0000 7f9cd5a3d640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9cbc0a2c00 0x7f9cbc0a50c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.003+0000 7f9cd5a3d640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cd010c170 0x7f9cd019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.003+0000 7f9cd5a3d640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd0103660 0x7f9cd0198960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.003+0000 7f9cd5a3d640 1 --2- 172.21.15.6:0/1553156441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cd0102d40 0x7f9cd0198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.003+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/1553156441 >> 172.21.15.6:0/1553156441 conn(0x7f9cd00fc7a0 msgr2=0x7f9cd00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.003+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/1553156441 shutdown_connections 2024-09-11T23:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:37.003+0000 7f9cd5a3d640 1 -- 172.21.15.6:0/1553156441 wait complete. 2024-09-11T23:57:37.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:36 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1553156441' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:57:37.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:36 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1553156441' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:57:37.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:36 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1553156441' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:57:37.835 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-11T23:57:37.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-11T23:57:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:38.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:38 smithi006 ceph-mon[30947]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:57:38.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:38 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1553156441' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T23:57:38.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:38 smithi006 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:57:38.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:38 smithi039 ceph-mon[34543]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:57:38.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:38 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1553156441' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T23:57:38.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:38 smithi039 ceph-mon[34543]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:57:38.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:38 smithi134 ceph-mon[34893]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:57:38.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:38 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1553156441' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T23:57:38.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:38 smithi134 ceph-mon[34893]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:57:38.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.618+0000 7ff9acf30640 1 -- 172.21.15.6:0/2657475593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a8102570 msgr2=0x7ff9a81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:38.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.618+0000 7ff9acf30640 1 --2- 172.21.15.6:0/2657475593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a8102570 0x7ff9a81029b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff990009900 tx=0x7ff99002a480 comp rx=0 tx=0).stop 2024-09-11T23:57:38.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.618+0000 7ff9acf30640 1 -- 172.21.15.6:0/2657475593 shutdown_connections 2024-09-11T23:57:38.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.618+0000 7ff9acf30640 1 --2- 172.21.15.6:0/2657475593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a8102ef0 0x7ff9a810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.618+0000 7ff9acf30640 1 --2- 172.21.15.6:0/2657475593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a8102570 0x7ff9a81029b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.618+0000 7ff9acf30640 1 --2- 172.21.15.6:0/2657475593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8100e20 0x7ff9a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.618+0000 7ff9acf30640 1 -- 172.21.15.6:0/2657475593 >> 172.21.15.6:0/2657475593 conn(0x7ff9a80fc7d0 msgr2=0x7ff9a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:38.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.618+0000 7ff9acf30640 1 -- 172.21.15.6:0/2657475593 shutdown_connections 2024-09-11T23:57:38.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.618+0000 7ff9acf30640 1 -- 172.21.15.6:0/2657475593 wait complete. 2024-09-11T23:57:38.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff9acf30640 1 Processor -- start 2024-09-11T23:57:38.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff9acf30640 1 -- start start 2024-09-11T23:57:38.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff9acf30640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a8100e20 0x7ff9a8197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:38.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff9acf30640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8102570 0x7ff9a8197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:38.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff9acf30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a8102ef0 0x7ff9a819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:38.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff9acf30640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8110ea0 con 0x7ff9a8102ef0 2024-09-11T23:57:38.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff9acf30640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8110d20 con 0x7ff9a8100e20 2024-09-11T23:57:38.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff9acf30640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8111020 con 0x7ff9a8102570 2024-09-11T23:57:38.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff9a6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a8102ef0 0x7ff9a819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:38.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff9a6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a8102ef0 0x7ff9a819bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35220/0 (socket says 172.21.15.6:35220) 2024-09-11T23:57:38.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff9a6d9d640 1 -- 172.21.15.6:0/874854831 learned_addr learned my addr 172.21.15.6:0/874854831 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:38.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff99ffff640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8102570 0x7ff9a8197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:38.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.619+0000 7ff9a659c640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a8100e20 0x7ff9a8197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:38.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.620+0000 7ff9a6d9d640 1 -- 172.21.15.6:0/874854831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8102570 msgr2=0x7ff9a8197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:38.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.620+0000 7ff9a6d9d640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8102570 0x7ff9a8197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.620+0000 7ff9a6d9d640 1 -- 172.21.15.6:0/874854831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a8100e20 msgr2=0x7ff9a8197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:38.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.620+0000 7ff9a6d9d640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a8100e20 0x7ff9a8197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.620+0000 7ff9a6d9d640 1 -- 172.21.15.6:0/874854831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a819c2d0 con 0x7ff9a8102ef0 2024-09-11T23:57:38.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.620+0000 7ff9a659c640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a8100e20 0x7ff9a8197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:38.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.620+0000 7ff9a6d9d640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a8102ef0 0x7ff9a819bbf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000cce0 tx=0x7ff9a000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:38.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.620+0000 7ff99f7fe640 1 -- 172.21.15.6:0/874854831 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000f450 con 0x7ff9a8102ef0 2024-09-11T23:57:38.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.620+0000 7ff99f7fe640 1 -- 172.21.15.6:0/874854831 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9a000faa0 con 0x7ff9a8102ef0 2024-09-11T23:57:38.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.620+0000 7ff99f7fe640 1 -- 172.21.15.6:0/874854831 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0018b70 con 0x7ff9a8102ef0 2024-09-11T23:57:38.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.620+0000 7ff9acf30640 1 -- 172.21.15.6:0/874854831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a819c5c0 con 0x7ff9a8102ef0 2024-09-11T23:57:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.620+0000 7ff9acf30640 1 -- 172.21.15.6:0/874854831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a81a3ea0 con 0x7ff9a8102ef0 2024-09-11T23:57:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.621+0000 7ff9acf30640 1 -- 172.21.15.6:0/874854831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a8101200 con 0x7ff9a8102ef0 2024-09-11T23:57:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.622+0000 7ff99f7fe640 1 -- 172.21.15.6:0/874854831 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff9a0018d10 con 0x7ff9a8102ef0 2024-09-11T23:57:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.623+0000 7ff99f7fe640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff9940a2c00 0x7ff9940a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.623+0000 7ff99f7fe640 1 -- 172.21.15.6:0/874854831 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7ff9a00cf620 con 0x7ff9a8102ef0 2024-09-11T23:57:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.623+0000 7ff9a659c640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff9940a2c00 0x7ff9940a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.623+0000 7ff9a659c640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff9940a2c00 0x7ff9940a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff998009930 tx=0x7ff998008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.627+0000 7ff99f7fe640 1 -- 172.21.15.6:0/874854831 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9a0014030 con 0x7ff9a8102ef0 2024-09-11T23:57:38.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:38.839+0000 7ff9acf30640 1 -- 172.21.15.6:0/874854831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7ff9a8108b00 con 0x7ff9a8102ef0 2024-09-11T23:57:39.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.014+0000 7ff99f7fe640 1 -- 172.21.15.6:0/874854831 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7ff9a009c340 con 0x7ff9a8102ef0 2024-09-11T23:57:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.016+0000 7ff9acf30640 1 -- 172.21.15.6:0/874854831 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff9940a2c00 msgr2=0x7ff9940a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.016+0000 7ff9acf30640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff9940a2c00 0x7ff9940a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff998009930 tx=0x7ff998008040 comp rx=0 tx=0).stop 2024-09-11T23:57:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.016+0000 7ff9acf30640 1 -- 172.21.15.6:0/874854831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a8102ef0 msgr2=0x7ff9a819bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.016+0000 7ff9acf30640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a8102ef0 0x7ff9a819bbf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000cce0 tx=0x7ff9a000a620 comp rx=0 tx=0).stop 2024-09-11T23:57:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.016+0000 7ff9acf30640 1 -- 172.21.15.6:0/874854831 shutdown_connections 2024-09-11T23:57:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.016+0000 7ff9acf30640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff9940a2c00 0x7ff9940a50c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.016+0000 7ff9acf30640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a8102ef0 0x7ff9a819bbf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.016+0000 7ff9acf30640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8102570 0x7ff9a8197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.016+0000 7ff9acf30640 1 --2- 172.21.15.6:0/874854831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a8100e20 0x7ff9a8197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.016+0000 7ff9acf30640 1 -- 172.21.15.6:0/874854831 >> 172.21.15.6:0/874854831 conn(0x7ff9a80fc7d0 msgr2=0x7ff9a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.016+0000 7ff9acf30640 1 -- 172.21.15.6:0/874854831 shutdown_connections 2024-09-11T23:57:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:39.016+0000 7ff9acf30640 1 -- 172.21.15.6:0/874854831 wait complete. 2024-09-11T23:57:39.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:39 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/874854831' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-11T23:57:39.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:39 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/874854831' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-11T23:57:39.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:39 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/874854831' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-11T23:57:39.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-11T23:57:40.111 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:40.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:40 smithi006 ceph-mon[30947]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-11T23:57:40.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:40 smithi006 ceph-mon[30947]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T23:57:40.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:40 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/874854831' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-11T23:57:40.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:40 smithi006 ceph-mon[30947]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T23:57:40.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:40 smithi006 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:57:40.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:40 smithi006 ceph-mon[30947]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-11T23:57:40.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:40 smithi006 ceph-mon[30947]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-11T23:57:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:40 smithi039 ceph-mon[34543]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-11T23:57:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:40 smithi039 ceph-mon[34543]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T23:57:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:40 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/874854831' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-11T23:57:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:40 smithi039 ceph-mon[34543]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T23:57:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:40 smithi039 ceph-mon[34543]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:57:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:40 smithi039 ceph-mon[34543]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-11T23:57:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:40 smithi039 ceph-mon[34543]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-11T23:57:40.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:40 smithi134 ceph-mon[34893]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-11T23:57:40.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:40 smithi134 ceph-mon[34893]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T23:57:40.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:40 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/874854831' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-11T23:57:40.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:40 smithi134 ceph-mon[34893]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T23:57:40.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:40 smithi134 ceph-mon[34893]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:57:40.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:40 smithi134 ceph-mon[34893]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-11T23:57:40.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:40 smithi134 ceph-mon[34893]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-11T23:57:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.646+0000 7f63ff0b6640 1 -- 172.21.15.6:0/684735431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f8100a80 msgr2=0x7f63f8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.646+0000 7f63ff0b6640 1 --2- 172.21.15.6:0/684735431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f8100a80 0x7f63f8100ee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009930 tx=0x7f63e002a420 comp rx=0 tx=0).stop 2024-09-11T23:57:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.646+0000 7f63ff0b6640 1 -- 172.21.15.6:0/684735431 shutdown_connections 2024-09-11T23:57:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.646+0000 7f63ff0b6640 1 --2- 172.21.15.6:0/684735431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63f8101420 0x7f63f810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.646+0000 7f63ff0b6640 1 --2- 172.21.15.6:0/684735431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f8100a80 0x7f63f8100ee0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.646+0000 7f63ff0b6640 1 --2- 172.21.15.6:0/684735431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63f8106a80 0x7f63f8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.646+0000 7f63ff0b6640 1 -- 172.21.15.6:0/684735431 >> 172.21.15.6:0/684735431 conn(0x7f63f80fc7a0 msgr2=0x7f63f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.646+0000 7f63ff0b6640 1 -- 172.21.15.6:0/684735431 shutdown_connections 2024-09-11T23:57:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.646+0000 7f63ff0b6640 1 -- 172.21.15.6:0/684735431 wait complete. 2024-09-11T23:57:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.646+0000 7f63ff0b6640 1 Processor -- start 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63ff0b6640 1 -- start start 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63ff0b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f8100a80 0x7f63f8198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63ff0b6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63f8101420 0x7f63f8198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63ff0b6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63f8106a80 0x7f63f819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63ff0b6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8111e10 con 0x7f63f8100a80 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63ff0b6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8111c90 con 0x7f63f8101420 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63ff0b6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8111f90 con 0x7f63f8106a80 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63fce52640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f8100a80 0x7f63f8198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63fce52640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f8100a80 0x7f63f8198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51682/0 (socket says 172.21.15.6:51682) 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63fce52640 1 -- 172.21.15.6:0/961856420 learned_addr learned my addr 172.21.15.6:0/961856420 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63f7fff640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63f8101420 0x7f63f8198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63fd653640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63f8106a80 0x7f63f819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63fce52640 1 -- 172.21.15.6:0/961856420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63f8106a80 msgr2=0x7f63f819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63fce52640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63f8106a80 0x7f63f819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63fce52640 1 -- 172.21.15.6:0/961856420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63f8101420 msgr2=0x7f63f8198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63fce52640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63f8101420 0x7f63f8198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63fce52640 1 -- 172.21.15.6:0/961856420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f819d2c0 con 0x7f63f8100a80 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63f7fff640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63f8101420 0x7f63f8198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.647+0000 7f63fce52640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f8100a80 0x7f63f8198310 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f63e800c920 tx=0x7f63e800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.648+0000 7f63f5ffb640 1 -- 172.21.15.6:0/961856420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e8007c70 con 0x7f63f8100a80 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.648+0000 7f63f5ffb640 1 -- 172.21.15.6:0/961856420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63e8007e10 con 0x7f63f8100a80 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.648+0000 7f63ff0b6640 1 -- 172.21.15.6:0/961856420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f819d5b0 con 0x7f63f8100a80 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.648+0000 7f63f5ffb640 1 -- 172.21.15.6:0/961856420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e8018820 con 0x7f63f8100a80 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.648+0000 7f63ff0b6640 1 -- 172.21.15.6:0/961856420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f81a4e90 con 0x7f63f8100a80 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.649+0000 7f63ff0b6640 1 -- 172.21.15.6:0/961856420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f8100ee0 con 0x7f63f8100a80 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.650+0000 7f63f5ffb640 1 -- 172.21.15.6:0/961856420 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f63e80189c0 con 0x7f63f8100a80 2024-09-11T23:57:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.650+0000 7f63f5ffb640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f63e40a2b80 0x7f63e40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:40.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.651+0000 7f63f7fff640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f63e40a2b80 0x7f63e40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:40.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.651+0000 7f63f5ffb640 1 -- 172.21.15.6:0/961856420 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f63e80cf440 con 0x7f63f8100a80 2024-09-11T23:57:40.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.651+0000 7f63f7fff640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f63e40a2b80 0x7f63e40a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f63e0000c00 tx=0x7f63e0009610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:40.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.655+0000 7f63f5ffb640 1 -- 172.21.15.6:0/961856420 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f63e8014030 con 0x7f63f8100a80 2024-09-11T23:57:40.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:40.868+0000 7f63ff0b6640 1 -- 172.21.15.6:0/961856420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f63f802d7c0 con 0x7f63f8100a80 2024-09-11T23:57:41.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.038+0000 7f63f5ffb640 1 -- 172.21.15.6:0/961856420 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f63e809c160 con 0x7f63f8100a80 2024-09-11T23:57:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.040+0000 7f63ff0b6640 1 -- 172.21.15.6:0/961856420 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f63e40a2b80 msgr2=0x7f63e40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.040+0000 7f63ff0b6640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f63e40a2b80 0x7f63e40a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f63e0000c00 tx=0x7f63e0009610 comp rx=0 tx=0).stop 2024-09-11T23:57:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.040+0000 7f63ff0b6640 1 -- 172.21.15.6:0/961856420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f8100a80 msgr2=0x7f63f8198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.040+0000 7f63ff0b6640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f8100a80 0x7f63f8198310 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f63e800c920 tx=0x7f63e800cde0 comp rx=0 tx=0).stop 2024-09-11T23:57:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.041+0000 7f63ff0b6640 1 -- 172.21.15.6:0/961856420 shutdown_connections 2024-09-11T23:57:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.041+0000 7f63ff0b6640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f63e40a2b80 0x7f63e40a5040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.041+0000 7f63ff0b6640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63f8106a80 0x7f63f819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.041+0000 7f63ff0b6640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63f8101420 0x7f63f8198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:41.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.041+0000 7f63ff0b6640 1 --2- 172.21.15.6:0/961856420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f8100a80 0x7f63f8198310 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:41.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.041+0000 7f63ff0b6640 1 -- 172.21.15.6:0/961856420 >> 172.21.15.6:0/961856420 conn(0x7f63f80fc7a0 msgr2=0x7f63f80fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:41.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.041+0000 7f63ff0b6640 1 -- 172.21.15.6:0/961856420 shutdown_connections 2024-09-11T23:57:41.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:41.041+0000 7f63ff0b6640 1 -- 172.21.15.6:0/961856420 wait complete. 2024-09-11T23:57:41.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:41 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] up:active 2024-09-11T23:57:41.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:41 smithi006 ceph-mon[30947]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T23:57:41.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:41 smithi006 ceph-mon[30947]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-11T23:57:41.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:41 smithi006 ceph-mon[30947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-11T23:57:41.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:41 smithi006 ceph-mon[30947]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T23:57:41.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:41 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/961856420' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:57:41.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:41 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] up:active 2024-09-11T23:57:41.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:41 smithi039 ceph-mon[34543]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T23:57:41.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:41 smithi039 ceph-mon[34543]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-11T23:57:41.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:41 smithi039 ceph-mon[34543]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-11T23:57:41.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:41 smithi039 ceph-mon[34543]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T23:57:41.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:41 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/961856420' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:57:41.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:41 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] up:active 2024-09-11T23:57:41.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:41 smithi134 ceph-mon[34893]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T23:57:41.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:41 smithi134 ceph-mon[34893]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-11T23:57:41.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:41 smithi134 ceph-mon[34893]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-11T23:57:41.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:41 smithi134 ceph-mon[34893]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T23:57:41.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:41 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/961856420' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:57:41.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-11T23:57:42.024 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:42.289 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:42 smithi006 ceph-mon[30947]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 2 op/s 2024-09-11T23:57:42.289 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:42 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/961856420' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T23:57:42.289 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:42 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] up:active 2024-09-11T23:57:42.289 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:42 smithi006 ceph-mon[30947]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-11T23:57:42.289 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:42 smithi006 ceph-mon[30947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-11T23:57:42.289 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:42 smithi006 ceph-mon[30947]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-11T23:57:42.289 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:42 smithi006 ceph-mon[30947]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-11T23:57:42.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:42 smithi039 ceph-mon[34543]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 2 op/s 2024-09-11T23:57:42.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:42 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/961856420' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T23:57:42.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:42 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] up:active 2024-09-11T23:57:42.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:42 smithi039 ceph-mon[34543]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-11T23:57:42.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:42 smithi039 ceph-mon[34543]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-11T23:57:42.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:42 smithi039 ceph-mon[34543]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-11T23:57:42.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:42 smithi039 ceph-mon[34543]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-11T23:57:42.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:42 smithi134 ceph-mon[34893]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 2 op/s 2024-09-11T23:57:42.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:42 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/961856420' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T23:57:42.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:42 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] up:active 2024-09-11T23:57:42.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:42 smithi134 ceph-mon[34893]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-11T23:57:42.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:42 smithi134 ceph-mon[34893]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-11T23:57:42.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:42 smithi134 ceph-mon[34893]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-11T23:57:42.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:42 smithi134 ceph-mon[34893]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-11T23:57:42.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.537+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/704478051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d64101420 msgr2=0x7f4d6410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:42.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.537+0000 7f4d6c4ce640 1 --2- 172.21.15.6:0/704478051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d64101420 0x7f4d6410d950 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009cd0 tx=0x7f4d5c02a8e0 comp rx=0 tx=0).stop 2024-09-11T23:57:42.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/704478051 shutdown_connections 2024-09-11T23:57:42.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 --2- 172.21.15.6:0/704478051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d64101420 0x7f4d6410d950 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 --2- 172.21.15.6:0/704478051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d64100a80 0x7f4d64100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 --2- 172.21.15.6:0/704478051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d64106a80 0x7f4d64106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/704478051 >> 172.21.15.6:0/704478051 conn(0x7f4d640fc7a0 msgr2=0x7f4d640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/704478051 shutdown_connections 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/704478051 wait complete. 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 Processor -- start 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 -- start start 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d64100a80 0x7f4d641983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d64101420 0x7f4d64198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d64106a80 0x7f4d6419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64111eb0 con 0x7f4d64101420 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64111d30 con 0x7f4d64106a80 2024-09-11T23:57:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.538+0000 7f4d6c4ce640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64112030 con 0x7f4d64100a80 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d69a69640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d64101420 0x7f4d64198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d69a69640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d64101420 0x7f4d64198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51692/0 (socket says 172.21.15.6:51692) 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d69a69640 1 -- 172.21.15.6:0/4042240390 learned_addr learned my addr 172.21.15.6:0/4042240390 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d6aa6b640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d64106a80 0x7f4d6419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d6a26a640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d64100a80 0x7f4d641983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d69a69640 1 -- 172.21.15.6:0/4042240390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d64100a80 msgr2=0x7f4d641983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d69a69640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d64100a80 0x7f4d641983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d69a69640 1 -- 172.21.15.6:0/4042240390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d64106a80 msgr2=0x7f4d6419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d69a69640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d64106a80 0x7f4d6419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d69a69640 1 -- 172.21.15.6:0/4042240390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6419d390 con 0x7f4d64101420 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d69a69640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d64101420 0x7f4d64198920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400d950 tx=0x7f4d5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d5b7fe640 1 -- 172.21.15.6:0/4042240390 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54017030 con 0x7f4d64101420 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d5b7fe640 1 -- 172.21.15.6:0/4042240390 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d54004020 con 0x7f4d64101420 2024-09-11T23:57:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/4042240390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6419d680 con 0x7f4d64101420 2024-09-11T23:57:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.539+0000 7f4d5b7fe640 1 -- 172.21.15.6:0/4042240390 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d540047a0 con 0x7f4d64101420 2024-09-11T23:57:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.540+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/4042240390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d641a4f60 con 0x7f4d64101420 2024-09-11T23:57:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.541+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/4042240390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d64100ee0 con 0x7f4d64101420 2024-09-11T23:57:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.542+0000 7f4d5b7fe640 1 -- 172.21.15.6:0/4042240390 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4d540041d0 con 0x7f4d64101420 2024-09-11T23:57:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.543+0000 7f4d5b7fe640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4d500a2c00 0x7f4d500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.543+0000 7f4d6a26a640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4d500a2c00 0x7f4d500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.543+0000 7f4d5b7fe640 1 -- 172.21.15.6:0/4042240390 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f4d540cecd0 con 0x7f4d64101420 2024-09-11T23:57:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.543+0000 7f4d6a26a640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4d500a2c00 0x7f4d500a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009890 tx=0x7f4d60008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.547+0000 7f4d5b7fe640 1 -- 172.21.15.6:0/4042240390 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d5409b9f0 con 0x7f4d64101420 2024-09-11T23:57:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:42.758+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/4042240390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f4d6402d7c0 con 0x7f4d64101420 2024-09-11T23:57:43.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.069+0000 7f4d5b7fe640 1 -- 172.21.15.6:0/4042240390 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f4d5409b2f0 con 0x7f4d64101420 2024-09-11T23:57:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.071+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/4042240390 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4d500a2c00 msgr2=0x7f4d500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:43.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.071+0000 7f4d6c4ce640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4d500a2c00 0x7f4d500a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009890 tx=0x7f4d60008040 comp rx=0 tx=0).stop 2024-09-11T23:57:43.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.071+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/4042240390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d64101420 msgr2=0x7f4d64198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:43.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.071+0000 7f4d6c4ce640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d64101420 0x7f4d64198920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400d950 tx=0x7f4d5400de10 comp rx=0 tx=0).stop 2024-09-11T23:57:43.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.072+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/4042240390 shutdown_connections 2024-09-11T23:57:43.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.072+0000 7f4d6c4ce640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4d500a2c00 0x7f4d500a50c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.072+0000 7f4d6c4ce640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d64106a80 0x7f4d6419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.072+0000 7f4d6c4ce640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d64101420 0x7f4d64198920 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.072+0000 7f4d6c4ce640 1 --2- 172.21.15.6:0/4042240390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d64100a80 0x7f4d641983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.072+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/4042240390 >> 172.21.15.6:0/4042240390 conn(0x7f4d640fc7a0 msgr2=0x7f4d640fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.072+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/4042240390 shutdown_connections 2024-09-11T23:57:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:43.072+0000 7f4d6c4ce640 1 -- 172.21.15.6:0/4042240390 wait complete. 2024-09-11T23:57:43.294 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:57:42 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b[64956]: 2024-09-11T23:57:42.951+0000 7fcd353f9640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-11T23:57:43.294 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:57:42 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b[64956]: 2024-09-11T23:57:42.951+0000 7fcd353f9640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-11T23:57:43.294 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 11 23:57:42 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b[64956]: 2024-09-11T23:57:42.951+0000 7fcd353f9640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-11T23:57:43.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:43 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] up:active 2024-09-11T23:57:43.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:43 smithi039 ceph-mon[34543]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-11T23:57:43.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:43 smithi039 ceph-mon[34543]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T23:57:43.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:43 smithi039 ceph-mon[34543]: Cluster is now healthy 2024-09-11T23:57:43.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:43 smithi039 ceph-mon[34543]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-11T23:57:43.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:43 smithi039 ceph-mon[34543]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-11T23:57:43.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:43 smithi039 ceph-mon[34543]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-11T23:57:43.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:43 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/4042240390' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:57:43.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:43 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] up:active 2024-09-11T23:57:43.694 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:43 smithi006 ceph-mon[30947]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-11T23:57:43.694 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:43 smithi006 ceph-mon[30947]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T23:57:43.694 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:43 smithi006 ceph-mon[30947]: Cluster is now healthy 2024-09-11T23:57:43.694 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:43 smithi006 ceph-mon[30947]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-11T23:57:43.694 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:43 smithi006 ceph-mon[30947]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-11T23:57:43.694 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:43 smithi006 ceph-mon[30947]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-11T23:57:43.694 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:43 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/4042240390' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:57:43.695 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:43 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] up:active 2024-09-11T23:57:43.695 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:43 smithi134 ceph-mon[34893]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-11T23:57:43.695 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:43 smithi134 ceph-mon[34893]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T23:57:43.695 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:43 smithi134 ceph-mon[34893]: Cluster is now healthy 2024-09-11T23:57:43.695 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:43 smithi134 ceph-mon[34893]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-11T23:57:43.695 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:43 smithi134 ceph-mon[34893]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-11T23:57:43.696 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:43 smithi134 ceph-mon[34893]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-11T23:57:43.696 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:43 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/4042240390' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:57:43.746 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-11T23:57:43.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-11T23:57:44.003 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:44.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:44 smithi006 ceph-mon[30947]: pgmap v307: 129 pgs: 129 active+clean; 584 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-11T23:57:44.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:44 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/4042240390' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T23:57:44.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:44 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] up:active 2024-09-11T23:57:44.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:44 smithi006 ceph-mon[30947]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-11T23:57:44.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:44 smithi006 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:57:44.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:44 smithi134 ceph-mon[34893]: pgmap v307: 129 pgs: 129 active+clean; 584 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-11T23:57:44.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:44 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/4042240390' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T23:57:44.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:44 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] up:active 2024-09-11T23:57:44.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:44 smithi134 ceph-mon[34893]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-11T23:57:44.454 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:44 smithi134 ceph-mon[34893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:57:44.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.517+0000 7f0f65068640 1 -- 172.21.15.6:0/2888271074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f60106a80 msgr2=0x7f0f60106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:44.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.517+0000 7f0f65068640 1 --2- 172.21.15.6:0/2888271074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f60106a80 0x7f0f60106e60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009930 tx=0x7f0f5002a420 comp rx=0 tx=0).stop 2024-09-11T23:57:44.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.517+0000 7f0f65068640 1 -- 172.21.15.6:0/2888271074 shutdown_connections 2024-09-11T23:57:44.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.517+0000 7f0f65068640 1 --2- 172.21.15.6:0/2888271074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60101420 0x7f0f6010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.517+0000 7f0f65068640 1 --2- 172.21.15.6:0/2888271074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f60100a80 0x7f0f60100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.517+0000 7f0f65068640 1 --2- 172.21.15.6:0/2888271074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f60106a80 0x7f0f60106e60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.517+0000 7f0f65068640 1 -- 172.21.15.6:0/2888271074 >> 172.21.15.6:0/2888271074 conn(0x7f0f600fc7a0 msgr2=0x7f0f600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.517+0000 7f0f65068640 1 -- 172.21.15.6:0/2888271074 shutdown_connections 2024-09-11T23:57:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.517+0000 7f0f65068640 1 -- 172.21.15.6:0/2888271074 wait complete. 2024-09-11T23:57:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.518+0000 7f0f65068640 1 Processor -- start 2024-09-11T23:57:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.518+0000 7f0f65068640 1 -- start start 2024-09-11T23:57:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f65068640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60100a80 0x7f0f601992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f65068640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f60101420 0x7f0f60199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f65068640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f60106a80 0x7f0f601a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f65068640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0f60110d50 con 0x7f0f60101420 2024-09-11T23:57:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f65068640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0f60110bd0 con 0x7f0f60100a80 2024-09-11T23:57:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f65068640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f60110ed0 con 0x7f0f60106a80 2024-09-11T23:57:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f5e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f60101420 0x7f0f60199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f5e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f60101420 0x7f0f60199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51712/0 (socket says 172.21.15.6:51712) 2024-09-11T23:57:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f5e59c640 1 -- 172.21.15.6:0/846446283 learned_addr learned my addr 172.21.15.6:0/846446283 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f5ed9d640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60100a80 0x7f0f601992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f5f59e640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f60106a80 0x7f0f601a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f5e59c640 1 -- 172.21.15.6:0/846446283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f60106a80 msgr2=0x7f0f601a4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f5e59c640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f60106a80 0x7f0f601a4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f5e59c640 1 -- 172.21.15.6:0/846446283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60100a80 msgr2=0x7f0f601992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f5e59c640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60100a80 0x7f0f601992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f5e59c640 1 -- 172.21.15.6:0/846446283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f601a4880 con 0x7f0f60101420 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f5ed9d640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60100a80 0x7f0f601992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.519+0000 7f0f5e59c640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f60101420 0x7f0f60199800 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400b4a0 tx=0x7f0f5400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.520+0000 7f0f47fff640 1 -- 172.21.15.6:0/846446283 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54014070 con 0x7f0f60101420 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.520+0000 7f0f47fff640 1 -- 172.21.15.6:0/846446283 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f54010ac0 con 0x7f0f60101420 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.520+0000 7f0f65068640 1 -- 172.21.15.6:0/846446283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f601a4a50 con 0x7f0f60101420 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.520+0000 7f0f47fff640 1 -- 172.21.15.6:0/846446283 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54017c30 con 0x7f0f60101420 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.520+0000 7f0f65068640 1 -- 172.21.15.6:0/846446283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f601a4f60 con 0x7f0f60101420 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.521+0000 7f0f65068640 1 -- 172.21.15.6:0/846446283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f60100ee0 con 0x7f0f60101420 2024-09-11T23:57:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.522+0000 7f0f47fff640 1 -- 172.21.15.6:0/846446283 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f0f54017070 con 0x7f0f60101420 2024-09-11T23:57:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.522+0000 7f0f47fff640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0f480a2b80 0x7f0f480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.523+0000 7f0f5ed9d640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0f480a2b80 0x7f0f480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.523+0000 7f0f47fff640 1 -- 172.21.15.6:0/846446283 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f0f540cea00 con 0x7f0f60101420 2024-09-11T23:57:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.523+0000 7f0f5ed9d640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0f480a2b80 0x7f0f480a5040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0f50000c00 tx=0x7f0f50009610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.527+0000 7f0f47fff640 1 -- 172.21.15.6:0/846446283 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f5409b720 con 0x7f0f60101420 2024-09-11T23:57:44.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:44 smithi039 ceph-mon[34543]: pgmap v307: 129 pgs: 129 active+clean; 584 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-11T23:57:44.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:44 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/4042240390' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T23:57:44.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:44 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] up:active 2024-09-11T23:57:44.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:44 smithi039 ceph-mon[34543]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-11T23:57:44.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:44 smithi039 ceph-mon[34543]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:57:44.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.728+0000 7f0f65068640 1 -- 172.21.15.6:0/846446283 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0f60062630 con 0x7f0f480a2b80 2024-09-11T23:57:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.754+0000 7f0f47fff640 1 -- 172.21.15.6:0/846446283 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0f60062630 con 0x7f0f480a2b80 2024-09-11T23:57:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.756+0000 7f0f65068640 1 -- 172.21.15.6:0/846446283 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0f480a2b80 msgr2=0x7f0f480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.756+0000 7f0f65068640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0f480a2b80 0x7f0f480a5040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0f50000c00 tx=0x7f0f50009610 comp rx=0 tx=0).stop 2024-09-11T23:57:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.756+0000 7f0f65068640 1 -- 172.21.15.6:0/846446283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f60101420 msgr2=0x7f0f60199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.756+0000 7f0f65068640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f60101420 0x7f0f60199800 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400b4a0 tx=0x7f0f5400b960 comp rx=0 tx=0).stop 2024-09-11T23:57:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.756+0000 7f0f65068640 1 -- 172.21.15.6:0/846446283 shutdown_connections 2024-09-11T23:57:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.756+0000 7f0f65068640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0f480a2b80 0x7f0f480a5040 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.756+0000 7f0f65068640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f60106a80 0x7f0f601a4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.756+0000 7f0f65068640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f60101420 0x7f0f60199800 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.756+0000 7f0f65068640 1 --2- 172.21.15.6:0/846446283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60100a80 0x7f0f601992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.756+0000 7f0f65068640 1 -- 172.21.15.6:0/846446283 >> 172.21.15.6:0/846446283 conn(0x7f0f600fc7a0 msgr2=0x7f0f600fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.756+0000 7f0f65068640 1 -- 172.21.15.6:0/846446283 shutdown_connections 2024-09-11T23:57:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:44.756+0000 7f0f65068640 1 -- 172.21.15.6:0/846446283 wait complete. 2024-09-11T23:57:45.045 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:57:44 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:57:44.733+0000 7fa4d9299640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:57:45.045 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:57:44 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:57:44.733+0000 7fa4d9299640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:57:45.045 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:57:44 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:57:44.733+0000 7fa4d9299640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:57:45.045 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:57:44 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:57:44.733+0000 7fa4d9299640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:57:45.045 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:57:44 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:57:44.733+0000 7fa4d9299640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:57:45.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:45 smithi006 ceph-mon[30947]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:45.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-11T23:57:45.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:45 smithi134 ceph-mon[34893]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:45.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:45 smithi039 ceph-mon[34543]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:45.672 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:46.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.172+0000 7f3fd954e640 1 -- 172.21.15.6:0/2553707534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fd4106f10 msgr2=0x7f3fd410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:46.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.172+0000 7f3fd954e640 1 --2- 172.21.15.6:0/2553707534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fd4106f10 0x7f3fd410ea90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009ca0 tx=0x7f3fcc02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.172+0000 7f3fd954e640 1 -- 172.21.15.6:0/2553707534 shutdown_connections 2024-09-11T23:57:46.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.172+0000 7f3fd954e640 1 --2- 172.21.15.6:0/2553707534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fd4106f10 0x7f3fd410ea90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.172+0000 7f3fd954e640 1 --2- 172.21.15.6:0/2553707534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4102790 0x7f3fd41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.172+0000 7f3fd954e640 1 --2- 172.21.15.6:0/2553707534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fd4101de0 0x7f3fd41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.172+0000 7f3fd954e640 1 -- 172.21.15.6:0/2553707534 >> 172.21.15.6:0/2553707534 conn(0x7f3fd40fd8c0 msgr2=0x7f3fd40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:46.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.172+0000 7f3fd954e640 1 -- 172.21.15.6:0/2553707534 shutdown_connections 2024-09-11T23:57:46.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.172+0000 7f3fd954e640 1 -- 172.21.15.6:0/2553707534 wait complete. 2024-09-11T23:57:46.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.173+0000 7f3fd954e640 1 Processor -- start 2024-09-11T23:57:46.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.173+0000 7f3fd954e640 1 -- start start 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.173+0000 7f3fd954e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4101de0 0x7f3fd4198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.173+0000 7f3fd954e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fd4102790 0x7f3fd41989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.173+0000 7f3fd954e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fd4106f10 0x7f3fd419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.173+0000 7f3fd954e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd4111ec0 con 0x7f3fd4106f10 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.173+0000 7f3fd954e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd4111d40 con 0x7f3fd4102790 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.173+0000 7f3fd954e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd4112040 con 0x7f3fd4101de0 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.173+0000 7f3fd37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fd4106f10 0x7f3fd419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.173+0000 7f3fd37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fd4106f10 0x7f3fd419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51740/0 (socket says 172.21.15.6:51740) 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.173+0000 7f3fd37fe640 1 -- 172.21.15.6:0/3620386716 learned_addr learned my addr 172.21.15.6:0/3620386716 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fd2ffd640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4101de0 0x7f3fd4198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fcbfff640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fd4102790 0x7f3fd41989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fd37fe640 1 -- 172.21.15.6:0/3620386716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4101de0 msgr2=0x7f3fd4198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fd37fe640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4101de0 0x7f3fd4198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fd37fe640 1 -- 172.21.15.6:0/3620386716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fd4102790 msgr2=0x7f3fd41989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fd37fe640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fd4102790 0x7f3fd41989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fd37fe640 1 -- 172.21.15.6:0/3620386716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd419d430 con 0x7f3fd4106f10 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fd37fe640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fd4106f10 0x7f3fd419cd50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009dc0 tx=0x7f3fcc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fd0ff9640 1 -- 172.21.15.6:0/3620386716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc004040 con 0x7f3fd4106f10 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fd0ff9640 1 -- 172.21.15.6:0/3620386716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3fcc004690 con 0x7f3fd4106f10 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fd0ff9640 1 -- 172.21.15.6:0/3620386716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc030d90 con 0x7f3fd4106f10 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fd954e640 1 -- 172.21.15.6:0/3620386716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd419d6c0 con 0x7f3fd4106f10 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.174+0000 7f3fd954e640 1 -- 172.21.15.6:0/3620386716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd41a5000 con 0x7f3fd4106f10 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.175+0000 7f3fd954e640 1 -- 172.21.15.6:0/3620386716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd41021c0 con 0x7f3fd4106f10 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.176+0000 7f3fd0ff9640 1 -- 172.21.15.6:0/3620386716 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3fcc0305c0 con 0x7f3fd4106f10 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.177+0000 7f3fd0ff9640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f3fc00a2c10 0x7f3fc00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.177+0000 7f3fd2ffd640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f3fc00a2c10 0x7f3fc00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.178+0000 7f3fd0ff9640 1 -- 172.21.15.6:0/3620386716 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f3fcc0f0c30 con 0x7f3fd4106f10 2024-09-11T23:57:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.178+0000 7f3fd2ffd640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f3fc00a2c10 0x7f3fc00a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009890 tx=0x7f3fc4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.182+0000 7f3fd0ff9640 1 -- 172.21.15.6:0/3620386716 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fcc0bd900 con 0x7f3fd4106f10 2024-09-11T23:57:46.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:46 smithi006 ceph-mon[30947]: pgmap v308: 129 pgs: 129 active+clean; 586 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-09-11T23:57:46.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:46 smithi006 ceph-mon[30947]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-11T23:57:46.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.382+0000 7f3fd954e640 1 -- 172.21.15.6:0/3620386716 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3fd410a150 con 0x7f3fc00a2c10 2024-09-11T23:57:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.408+0000 7f3fd0ff9640 1 -- 172.21.15.6:0/3620386716 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3fd410a150 con 0x7f3fc00a2c10 2024-09-11T23:57:46.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.410+0000 7f3fd954e640 1 -- 172.21.15.6:0/3620386716 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f3fc00a2c10 msgr2=0x7f3fc00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:46.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.410+0000 7f3fd954e640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f3fc00a2c10 0x7f3fc00a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009890 tx=0x7f3fc4008040 comp rx=0 tx=0).stop 2024-09-11T23:57:46.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.410+0000 7f3fd954e640 1 -- 172.21.15.6:0/3620386716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fd4106f10 msgr2=0x7f3fd419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:46.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.410+0000 7f3fd954e640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fd4106f10 0x7f3fd419cd50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009dc0 tx=0x7f3fcc003ba0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.410+0000 7f3fd954e640 1 -- 172.21.15.6:0/3620386716 shutdown_connections 2024-09-11T23:57:46.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.410+0000 7f3fd954e640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f3fc00a2c10 0x7f3fc00a50d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.410+0000 7f3fd954e640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fd4106f10 0x7f3fd419cd50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.410+0000 7f3fd954e640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fd4102790 0x7f3fd41989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.410+0000 7f3fd954e640 1 --2- 172.21.15.6:0/3620386716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4101de0 0x7f3fd4198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.410+0000 7f3fd954e640 1 -- 172.21.15.6:0/3620386716 >> 172.21.15.6:0/3620386716 conn(0x7f3fd40fd8c0 msgr2=0x7f3fd40fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:46.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.410+0000 7f3fd954e640 1 -- 172.21.15.6:0/3620386716 shutdown_connections 2024-09-11T23:57:46.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:46.410+0000 7f3fd954e640 1 -- 172.21.15.6:0/3620386716 wait complete. 2024-09-11T23:57:46.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:46 smithi134 ceph-mon[34893]: pgmap v308: 129 pgs: 129 active+clean; 586 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-09-11T23:57:46.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:46 smithi134 ceph-mon[34893]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-11T23:57:46.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:46 smithi039 ceph-mon[34543]: pgmap v308: 129 pgs: 129 active+clean; 586 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-09-11T23:57:46.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:46 smithi039 ceph-mon[34543]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-11T23:57:47.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-11T23:57:47.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:47 smithi006 ceph-mon[30947]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:47.385 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:47.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:47 smithi134 ceph-mon[34893]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:47.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:47 smithi039 ceph-mon[34543]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.839+0000 7fc69b846640 1 -- 172.21.15.6:0/2290619278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694102570 msgr2=0x7fc6941029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.839+0000 7fc69b846640 1 --2- 172.21.15.6:0/2290619278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694102570 0x7fc6941029b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc684009900 tx=0x7fc68402a480 comp rx=0 tx=0).stop 2024-09-11T23:57:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.839+0000 7fc69b846640 1 -- 172.21.15.6:0/2290619278 shutdown_connections 2024-09-11T23:57:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.839+0000 7fc69b846640 1 --2- 172.21.15.6:0/2290619278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc694102ef0 0x7fc69410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.839+0000 7fc69b846640 1 --2- 172.21.15.6:0/2290619278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694102570 0x7fc6941029b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.839+0000 7fc69b846640 1 --2- 172.21.15.6:0/2290619278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc694100e20 0x7fc694101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.839+0000 7fc69b846640 1 -- 172.21.15.6:0/2290619278 >> 172.21.15.6:0/2290619278 conn(0x7fc6940fc7d0 msgr2=0x7fc6940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.839+0000 7fc69b846640 1 -- 172.21.15.6:0/2290619278 shutdown_connections 2024-09-11T23:57:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.840+0000 7fc69b846640 1 -- 172.21.15.6:0/2290619278 wait complete. 2024-09-11T23:57:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.840+0000 7fc69b846640 1 Processor -- start 2024-09-11T23:57:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.840+0000 7fc69b846640 1 -- start start 2024-09-11T23:57:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.840+0000 7fc69b846640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694100e20 0x7fc69419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.840+0000 7fc69b846640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc694102570 0x7fc69419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.840+0000 7fc69b846640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc694102ef0 0x7fc69419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.840+0000 7fc69b846640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc694110e00 con 0x7fc694100e20 2024-09-11T23:57:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.840+0000 7fc69b846640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc694110c80 con 0x7fc694102570 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc69b846640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc694110f80 con 0x7fc694102ef0 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc6995e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694100e20 0x7fc69419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc6995e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694100e20 0x7fc69419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51762/0 (socket says 172.21.15.6:51762) 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc6995e2640 1 -- 172.21.15.6:0/526701626 learned_addr learned my addr 172.21.15.6:0/526701626 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc699de3640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc694102ef0 0x7fc69419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc698de1640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc694102570 0x7fc69419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc6995e2640 1 -- 172.21.15.6:0/526701626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc694102ef0 msgr2=0x7fc69419ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc6995e2640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc694102ef0 0x7fc69419ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc6995e2640 1 -- 172.21.15.6:0/526701626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc694102570 msgr2=0x7fc69419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc6995e2640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc694102570 0x7fc69419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc6995e2640 1 -- 172.21.15.6:0/526701626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69419f540 con 0x7fc694100e20 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc6995e2640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694100e20 0x7fc69419a590 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc69000c920 tx=0x7fc69000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc68a7fc640 1 -- 172.21.15.6:0/526701626 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690007c70 con 0x7fc694100e20 2024-09-11T23:57:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc69b846640 1 -- 172.21.15.6:0/526701626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69419f830 con 0x7fc694100e20 2024-09-11T23:57:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc68a7fc640 1 -- 172.21.15.6:0/526701626 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc690007e10 con 0x7fc694100e20 2024-09-11T23:57:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc68a7fc640 1 -- 172.21.15.6:0/526701626 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690018820 con 0x7fc694100e20 2024-09-11T23:57:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.841+0000 7fc69b846640 1 -- 172.21.15.6:0/526701626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6941a7110 con 0x7fc694100e20 2024-09-11T23:57:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.842+0000 7fc69b846640 1 -- 172.21.15.6:0/526701626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc694101200 con 0x7fc694100e20 2024-09-11T23:57:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.844+0000 7fc68a7fc640 1 -- 172.21.15.6:0/526701626 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fc6900189c0 con 0x7fc694100e20 2024-09-11T23:57:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.844+0000 7fc68a7fc640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc6800a2c10 0x7fc6800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.844+0000 7fc698de1640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc6800a2c10 0x7fc6800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.844+0000 7fc68a7fc640 1 -- 172.21.15.6:0/526701626 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fc6900cf540 con 0x7fc694100e20 2024-09-11T23:57:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.845+0000 7fc698de1640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc6800a2c10 0x7fc6800a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc694104c00 tx=0x7fc684005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:47.849+0000 7fc68a7fc640 1 -- 172.21.15.6:0/526701626 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc690014030 con 0x7fc694100e20 2024-09-11T23:57:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.051+0000 7fc69b846640 1 -- 172.21.15.6:0/526701626 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fc69410cda0 con 0x7fc6800a2c10 2024-09-11T23:57:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.055+0000 7fc68a7fc640 1 -- 172.21.15.6:0/526701626 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc69410cda0 con 0x7fc6800a2c10 2024-09-11T23:57:48.055 INFO:teuthology.orchestra.run.smithi006.stdout:/volumes/qa/sv_0/56b1cd4b-989d-4ef6-986d-f369a19625d5 2024-09-11T23:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.057+0000 7fc69b846640 1 -- 172.21.15.6:0/526701626 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc6800a2c10 msgr2=0x7fc6800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.057+0000 7fc69b846640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc6800a2c10 0x7fc6800a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc694104c00 tx=0x7fc684005a20 comp rx=0 tx=0).stop 2024-09-11T23:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.057+0000 7fc69b846640 1 -- 172.21.15.6:0/526701626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694100e20 msgr2=0x7fc69419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.057+0000 7fc69b846640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694100e20 0x7fc69419a590 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc69000c920 tx=0x7fc69000cde0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.057+0000 7fc69b846640 1 -- 172.21.15.6:0/526701626 shutdown_connections 2024-09-11T23:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.057+0000 7fc69b846640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc6800a2c10 0x7fc6800a50d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.057+0000 7fc69b846640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc694102ef0 0x7fc69419ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.057+0000 7fc69b846640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc694102570 0x7fc69419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.057+0000 7fc69b846640 1 --2- 172.21.15.6:0/526701626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694100e20 0x7fc69419a590 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.057+0000 7fc69b846640 1 -- 172.21.15.6:0/526701626 >> 172.21.15.6:0/526701626 conn(0x7fc6940fc7d0 msgr2=0x7fc69406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.057+0000 7fc69b846640 1 -- 172.21.15.6:0/526701626 shutdown_connections 2024-09-11T23:57:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:48.057+0000 7fc69b846640 1 -- 172.21.15.6:0/526701626 wait complete. 2024-09-11T23:57:48.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:48 smithi006 ceph-mon[30947]: pgmap v309: 129 pgs: 129 active+clean; 593 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.8 KiB/s wr, 17 op/s 2024-09-11T23:57:48.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:48 smithi134 ceph-mon[34893]: pgmap v309: 129 pgs: 129 active+clean; 593 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.8 KiB/s wr, 17 op/s 2024-09-11T23:57:48.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:48 smithi039 ceph-mon[34543]: pgmap v309: 129 pgs: 129 active+clean; 593 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.8 KiB/s wr, 17 op/s 2024-09-11T23:57:48.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-11T23:57:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:49.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:49 smithi006 ceph-mon[30947]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:49.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:49 smithi134 ceph-mon[34893]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:49.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:49 smithi039 ceph-mon[34543]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.608+0000 7f542fe22640 1 -- 172.21.15.6:0/3358274816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5428102570 msgr2=0x7f54281029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.608+0000 7f542fe22640 1 --2- 172.21.15.6:0/3358274816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5428102570 0x7f54281029b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5418009900 tx=0x7f541802a480 comp rx=0 tx=0).stop 2024-09-11T23:57:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.608+0000 7f542fe22640 1 -- 172.21.15.6:0/3358274816 shutdown_connections 2024-09-11T23:57:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.608+0000 7f542fe22640 1 --2- 172.21.15.6:0/3358274816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5428102ef0 0x7f542810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.608+0000 7f542fe22640 1 --2- 172.21.15.6:0/3358274816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5428102570 0x7f54281029b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.608+0000 7f542fe22640 1 --2- 172.21.15.6:0/3358274816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5428100e20 0x7f5428101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.608+0000 7f542fe22640 1 -- 172.21.15.6:0/3358274816 >> 172.21.15.6:0/3358274816 conn(0x7f54280fc7d0 msgr2=0x7f54280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.608+0000 7f542fe22640 1 -- 172.21.15.6:0/3358274816 shutdown_connections 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.608+0000 7f542fe22640 1 -- 172.21.15.6:0/3358274816 wait complete. 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.608+0000 7f542fe22640 1 Processor -- start 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542fe22640 1 -- start start 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542fe22640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5428100e20 0x7f5428198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542fe22640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5428102570 0x7f5428198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542fe22640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5428102ef0 0x7f542819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542fe22640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5428111f10 con 0x7f5428102ef0 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542fe22640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5428111d90 con 0x7f5428102570 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542fe22640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5428112090 con 0x7f5428100e20 2024-09-11T23:57:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542e3bf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5428102ef0 0x7f542819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542e3bf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5428102ef0 0x7f542819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51768/0 (socket says 172.21.15.6:51768) 2024-09-11T23:57:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542e3bf640 1 -- 172.21.15.6:0/110568314 learned_addr learned my addr 172.21.15.6:0/110568314 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542d3bd640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5428102570 0x7f5428198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542dbbe640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5428100e20 0x7f5428198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542e3bf640 1 -- 172.21.15.6:0/110568314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5428100e20 msgr2=0x7f5428198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542e3bf640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5428100e20 0x7f5428198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542e3bf640 1 -- 172.21.15.6:0/110568314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5428102570 msgr2=0x7f5428198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542e3bf640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5428102570 0x7f5428198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542e3bf640 1 -- 172.21.15.6:0/110568314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542819d3e0 con 0x7f5428102ef0 2024-09-11T23:57:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f542e3bf640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5428102ef0 0x7f542819cd00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f542000eaa0 tx=0x7f542000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.609+0000 7f541effd640 1 -- 172.21.15.6:0/110568314 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542000cdb0 con 0x7f5428102ef0 2024-09-11T23:57:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.610+0000 7f541effd640 1 -- 172.21.15.6:0/110568314 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5420005020 con 0x7f5428102ef0 2024-09-11T23:57:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.610+0000 7f542fe22640 1 -- 172.21.15.6:0/110568314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542819d6d0 con 0x7f5428102ef0 2024-09-11T23:57:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.610+0000 7f541effd640 1 -- 172.21.15.6:0/110568314 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54200116d0 con 0x7f5428102ef0 2024-09-11T23:57:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.610+0000 7f542fe22640 1 -- 172.21.15.6:0/110568314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54281a4fb0 con 0x7f5428102ef0 2024-09-11T23:57:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.611+0000 7f542fe22640 1 -- 172.21.15.6:0/110568314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5428101200 con 0x7f5428102ef0 2024-09-11T23:57:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.612+0000 7f541effd640 1 -- 172.21.15.6:0/110568314 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f54200051d0 con 0x7f5428102ef0 2024-09-11T23:57:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.612+0000 7f541effd640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f54140a2c10 0x7f54140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.613+0000 7f541effd640 1 -- 172.21.15.6:0/110568314 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f54200cf960 con 0x7f5428102ef0 2024-09-11T23:57:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.613+0000 7f542dbbe640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f54140a2c10 0x7f54140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.613+0000 7f542dbbe640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f54140a2c10 0x7f54140a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5424005d00 tx=0x7f5424005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.616+0000 7f541effd640 1 -- 172.21.15.6:0/110568314 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5420016030 con 0x7f5428102ef0 2024-09-11T23:57:49.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.818+0000 7f542fe22640 1 -- 172.21.15.6:0/110568314 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5428109100 con 0x7f54140a2c10 2024-09-11T23:57:49.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.843+0000 7f541effd640 1 -- 172.21.15.6:0/110568314 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f542400bc60 con 0x7f54140a2c10 2024-09-11T23:57:49.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.845+0000 7f542fe22640 1 -- 172.21.15.6:0/110568314 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f54140a2c10 msgr2=0x7f54140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:49.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.845+0000 7f542fe22640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f54140a2c10 0x7f54140a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5424005d00 tx=0x7f5424005c50 comp rx=0 tx=0).stop 2024-09-11T23:57:49.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.845+0000 7f542fe22640 1 -- 172.21.15.6:0/110568314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5428102ef0 msgr2=0x7f542819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.845+0000 7f542fe22640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5428102ef0 0x7f542819cd00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f542000eaa0 tx=0x7f542000ef60 comp rx=0 tx=0).stop 2024-09-11T23:57:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.845+0000 7f542fe22640 1 -- 172.21.15.6:0/110568314 shutdown_connections 2024-09-11T23:57:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.845+0000 7f542fe22640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f54140a2c10 0x7f54140a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.845+0000 7f542fe22640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5428102ef0 0x7f542819cd00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.845+0000 7f542fe22640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5428102570 0x7f5428198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.845+0000 7f542fe22640 1 --2- 172.21.15.6:0/110568314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5428100e20 0x7f5428198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.845+0000 7f542fe22640 1 -- 172.21.15.6:0/110568314 >> 172.21.15.6:0/110568314 conn(0x7f54280fc7d0 msgr2=0x7f54280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.845+0000 7f542fe22640 1 -- 172.21.15.6:0/110568314 shutdown_connections 2024-09-11T23:57:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:49.845+0000 7f542fe22640 1 -- 172.21.15.6:0/110568314 wait complete. 2024-09-11T23:57:50.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:50 smithi006 ceph-mon[30947]: pgmap v310: 129 pgs: 129 active+clean; 594 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.0 KiB/s wr, 19 op/s 2024-09-11T23:57:50.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:50 smithi006 ceph-mon[30947]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:50.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:50 smithi134 ceph-mon[34893]: pgmap v310: 129 pgs: 129 active+clean; 594 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.0 KiB/s wr, 19 op/s 2024-09-11T23:57:50.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:50 smithi134 ceph-mon[34893]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:50.509 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-11T23:57:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:50 smithi039 ceph-mon[34543]: pgmap v310: 129 pgs: 129 active+clean; 594 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.0 KiB/s wr, 19 op/s 2024-09-11T23:57:50.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:50 smithi039 ceph-mon[34543]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:50.769 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:51.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.269+0000 7f0530ea2640 1 -- 172.21.15.6:0/2802343711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f052c101de0 msgr2=0x7f052c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.269+0000 7f0530ea2640 1 --2- 172.21.15.6:0/2802343711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f052c101de0 0x7f052c1021c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f051c009900 tx=0x7f051c02a410 comp rx=0 tx=0).stop 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.269+0000 7f0530ea2640 1 -- 172.21.15.6:0/2802343711 shutdown_connections 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.269+0000 7f0530ea2640 1 --2- 172.21.15.6:0/2802343711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f052c106f10 0x7f052c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.269+0000 7f0530ea2640 1 --2- 172.21.15.6:0/2802343711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052c102790 0x7f052c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.269+0000 7f0530ea2640 1 --2- 172.21.15.6:0/2802343711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f052c101de0 0x7f052c1021c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.269+0000 7f0530ea2640 1 -- 172.21.15.6:0/2802343711 >> 172.21.15.6:0/2802343711 conn(0x7f052c0fd8c0 msgr2=0x7f052c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.269+0000 7f0530ea2640 1 -- 172.21.15.6:0/2802343711 shutdown_connections 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.269+0000 7f0530ea2640 1 -- 172.21.15.6:0/2802343711 wait complete. 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.270+0000 7f0530ea2640 1 Processor -- start 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.270+0000 7f0530ea2640 1 -- start start 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.270+0000 7f0530ea2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052c101de0 0x7f052c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.270+0000 7f0530ea2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f052c102790 0x7f052c1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.270+0000 7f0530ea2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f052c106f10 0x7f052c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.270+0000 7f0530ea2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f052c111e30 con 0x7f052c102790 2024-09-11T23:57:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.270+0000 7f0530ea2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f052c111cb0 con 0x7f052c106f10 2024-09-11T23:57:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.270+0000 7f0530ea2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f052c111fb0 con 0x7f052c101de0 2024-09-11T23:57:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f0523fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f052c102790 0x7f052c1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f0523fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f052c102790 0x7f052c1988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49910/0 (socket says 172.21.15.6:49910) 2024-09-11T23:57:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f0523fff640 1 -- 172.21.15.6:0/156563519 learned_addr learned my addr 172.21.15.6:0/156563519 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f052ad9d640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f052c106f10 0x7f052c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f052a59c640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052c101de0 0x7f052c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f0523fff640 1 -- 172.21.15.6:0/156563519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052c101de0 msgr2=0x7f052c198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f0523fff640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052c101de0 0x7f052c198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f0523fff640 1 -- 172.21.15.6:0/156563519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f052c106f10 msgr2=0x7f052c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f0523fff640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f052c106f10 0x7f052c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f0523fff640 1 -- 172.21.15.6:0/156563519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052c19d340 con 0x7f052c102790 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f0523fff640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f052c102790 0x7f052c1988d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f051400c920 tx=0x7f051400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f05237fe640 1 -- 172.21.15.6:0/156563519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0514007c70 con 0x7f052c102790 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f05237fe640 1 -- 172.21.15.6:0/156563519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0514007e10 con 0x7f052c102790 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f0530ea2640 1 -- 172.21.15.6:0/156563519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052c19d630 con 0x7f052c102790 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f05237fe640 1 -- 172.21.15.6:0/156563519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0514018820 con 0x7f052c102790 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.271+0000 7f0530ea2640 1 -- 172.21.15.6:0/156563519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f052c1a4f10 con 0x7f052c102790 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.272+0000 7f0530ea2640 1 -- 172.21.15.6:0/156563519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f052c1021c0 con 0x7f052c102790 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.273+0000 7f05237fe640 1 -- 172.21.15.6:0/156563519 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f05140189c0 con 0x7f052c102790 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.274+0000 7f05237fe640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f05180a2c10 0x7f05180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.274+0000 7f052a59c640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f05180a2c10 0x7f05180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.274+0000 7f05237fe640 1 -- 172.21.15.6:0/156563519 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f05140cf5a0 con 0x7f052c102790 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.275+0000 7f052a59c640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f05180a2c10 0x7f05180a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f051c000c00 tx=0x7f051c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.278+0000 7f05237fe640 1 -- 172.21.15.6:0/156563519 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0514014030 con 0x7f052c102790 2024-09-11T23:57:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.481+0000 7f0530ea2640 1 -- 172.21.15.6:0/156563519 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f052c062630 con 0x7f05180a2c10 2024-09-11T23:57:51.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.486+0000 7f05237fe640 1 -- 172.21.15.6:0/156563519 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f052c062630 con 0x7f05180a2c10 2024-09-11T23:57:51.486 INFO:teuthology.orchestra.run.smithi006.stdout:/volumes/qa/sv_1/561ccfdc-b31d-49f6-b6c5-74a85feebab0 2024-09-11T23:57:51.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.488+0000 7f0530ea2640 1 -- 172.21.15.6:0/156563519 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f05180a2c10 msgr2=0x7f05180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:51.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.488+0000 7f0530ea2640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f05180a2c10 0x7f05180a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f051c000c00 tx=0x7f051c031400 comp rx=0 tx=0).stop 2024-09-11T23:57:51.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.488+0000 7f0530ea2640 1 -- 172.21.15.6:0/156563519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f052c102790 msgr2=0x7f052c1988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:51.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.488+0000 7f0530ea2640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f052c102790 0x7f052c1988d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f051400c920 tx=0x7f051400cde0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.488+0000 7f0530ea2640 1 -- 172.21.15.6:0/156563519 shutdown_connections 2024-09-11T23:57:51.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.488+0000 7f0530ea2640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f05180a2c10 0x7f05180a50d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.488+0000 7f0530ea2640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f052c106f10 0x7f052c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.488+0000 7f0530ea2640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f052c102790 0x7f052c1988d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.488+0000 7f0530ea2640 1 --2- 172.21.15.6:0/156563519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052c101de0 0x7f052c198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.488+0000 7f0530ea2640 1 -- 172.21.15.6:0/156563519 >> 172.21.15.6:0/156563519 conn(0x7f052c0fd8c0 msgr2=0x7f052c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:51.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.488+0000 7f0530ea2640 1 -- 172.21.15.6:0/156563519 shutdown_connections 2024-09-11T23:57:51.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:51.488+0000 7f0530ea2640 1 -- 172.21.15.6:0/156563519 wait complete. 2024-09-11T23:57:52.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:52 smithi006 ceph-mon[30947]: pgmap v311: 129 pgs: 129 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.2 KiB/s wr, 23 op/s 2024-09-11T23:57:52.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:52 smithi006 ceph-mon[30947]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:52.184 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:57:52.445 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:52.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:52 smithi134 ceph-mon[34893]: pgmap v311: 129 pgs: 129 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.2 KiB/s wr, 23 op/s 2024-09-11T23:57:52.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:52 smithi134 ceph-mon[34893]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:52 smithi039 ceph-mon[34543]: pgmap v311: 129 pgs: 129 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.2 KiB/s wr, 23 op/s 2024-09-11T23:57:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:52 smithi039 ceph-mon[34543]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.940+0000 7f258f1c4640 1 -- 172.21.15.6:0/21135521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2588103ff0 msgr2=0x7f25881043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.940+0000 7f258f1c4640 1 --2- 172.21.15.6:0/21135521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2588103ff0 0x7f25881043d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f257c009900 tx=0x7f257c02a410 comp rx=0 tx=0).stop 2024-09-11T23:57:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.940+0000 7f258f1c4640 1 -- 172.21.15.6:0/21135521 shutdown_connections 2024-09-11T23:57:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.940+0000 7f258f1c4640 1 --2- 172.21.15.6:0/21135521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2588109120 0x7f2588110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.940+0000 7f258f1c4640 1 --2- 172.21.15.6:0/21135521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25881049a0 0x7f25881089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.940+0000 7f258f1c4640 1 --2- 172.21.15.6:0/21135521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2588103ff0 0x7f25881043d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.940+0000 7f258f1c4640 1 -- 172.21.15.6:0/21135521 >> 172.21.15.6:0/21135521 conn(0x7f25880ffa90 msgr2=0x7f2588101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.940+0000 7f258f1c4640 1 -- 172.21.15.6:0/21135521 shutdown_connections 2024-09-11T23:57:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.940+0000 7f258f1c4640 1 -- 172.21.15.6:0/21135521 wait complete. 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.940+0000 7f258f1c4640 1 Processor -- start 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.940+0000 7f258f1c4640 1 -- start start 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258f1c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2588103ff0 0x7f258819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258f1c4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25881049a0 0x7f258819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258f1c4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2588109120 0x7f258819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258f1c4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2588113fd0 con 0x7f2588109120 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258f1c4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2588113e50 con 0x7f25881049a0 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258f1c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2588114150 con 0x7f2588103ff0 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258d761640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2588109120 0x7f258819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f2587fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25881049a0 0x7f258819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258d761640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2588109120 0x7f258819eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49932/0 (socket says 172.21.15.6:49932) 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258d761640 1 -- 172.21.15.6:0/1286153025 learned_addr learned my addr 172.21.15.6:0/1286153025 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258cf60640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2588103ff0 0x7f258819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258d761640 1 -- 172.21.15.6:0/1286153025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2588103ff0 msgr2=0x7f258819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258d761640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2588103ff0 0x7f258819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258d761640 1 -- 172.21.15.6:0/1286153025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25881049a0 msgr2=0x7f258819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258d761640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25881049a0 0x7f258819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258d761640 1 -- 172.21.15.6:0/1286153025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258819f480 con 0x7f2588109120 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258d761640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2588109120 0x7f258819eda0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f258000cad0 tx=0x7f258000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f2585ffb640 1 -- 172.21.15.6:0/1286153025 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258000ad60 con 0x7f2588109120 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f2585ffb640 1 -- 172.21.15.6:0/1286153025 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2580005020 con 0x7f2588109120 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.941+0000 7f258f1c4640 1 -- 172.21.15.6:0/1286153025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258819f770 con 0x7f2588109120 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.942+0000 7f2585ffb640 1 -- 172.21.15.6:0/1286153025 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258000f6b0 con 0x7f2588109120 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.942+0000 7f258f1c4640 1 -- 172.21.15.6:0/1286153025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25881a7050 con 0x7f2588109120 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.943+0000 7f258f1c4640 1 -- 172.21.15.6:0/1286153025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25881043d0 con 0x7f2588109120 2024-09-11T23:57:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.945+0000 7f2585ffb640 1 -- 172.21.15.6:0/1286153025 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f25800051d0 con 0x7f2588109120 2024-09-11T23:57:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.945+0000 7f2585ffb640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f25780a2c10 0x7f25780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.946+0000 7f258cf60640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f25780a2c10 0x7f25780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.946+0000 7f2585ffb640 1 -- 172.21.15.6:0/1286153025 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f25800cf6f0 con 0x7f2588109120 2024-09-11T23:57:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.946+0000 7f258cf60640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f25780a2c10 0x7f25780a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f257c031440 tx=0x7f257c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:52.949+0000 7f2585ffb640 1 -- 172.21.15.6:0/1286153025 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2580014030 con 0x7f2588109120 2024-09-11T23:57:53.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:53 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:57:53.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.173+0000 7f258f1c4640 1 -- 172.21.15.6:0/1286153025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f258819b830 con 0x7f2588109120 2024-09-11T23:57:53.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.174+0000 7f2585ffb640 1 -- 172.21.15.6:0/1286153025 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11950 (secure 0 0 0) 0x7f258819b830 con 0x7f2588109120 2024-09-11T23:57:53.175 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:57:53.175 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"btime":"2024-09-11T23:57:43:074223+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:56:58.063963+0000","modified":"2024-09-11T23:57:43.074202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24478,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/809129212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":809129212},{"type":"v1","addr":"172.21.15.6:6839","nonce":809129212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/500771395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":500771395},{"type":"v1","addr":"172.21.15.6:6841","nonce":500771395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":18,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":19,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":18,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.39:6839/3561706320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3561706320},{"type":"v1","addr":"172.21.15.39:6839","nonce":3561706320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24490,24491,24478,24472,24461]},"id":1}]} 2024-09-11T23:57:53.175 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-09-11T23:57:53.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.176+0000 7f258f1c4640 1 -- 172.21.15.6:0/1286153025 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f25780a2c10 msgr2=0x7f25780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:53.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.176+0000 7f258f1c4640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f25780a2c10 0x7f25780a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f257c031440 tx=0x7f257c005e80 comp rx=0 tx=0).stop 2024-09-11T23:57:53.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.176+0000 7f258f1c4640 1 -- 172.21.15.6:0/1286153025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2588109120 msgr2=0x7f258819eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:53.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.176+0000 7f258f1c4640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2588109120 0x7f258819eda0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f258000cad0 tx=0x7f258000ced0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.177+0000 7f258f1c4640 1 -- 172.21.15.6:0/1286153025 shutdown_connections 2024-09-11T23:57:53.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.177+0000 7f258f1c4640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f25780a2c10 0x7f25780a50d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.177+0000 7f258f1c4640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2588109120 0x7f258819eda0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.177+0000 7f258f1c4640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25881049a0 0x7f258819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.177+0000 7f258f1c4640 1 --2- 172.21.15.6:0/1286153025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2588103ff0 0x7f258819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.177+0000 7f258f1c4640 1 -- 172.21.15.6:0/1286153025 >> 172.21.15.6:0/1286153025 conn(0x7f25880ffa90 msgr2=0x7f2588100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:53.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.177+0000 7f258f1c4640 1 -- 172.21.15.6:0/1286153025 shutdown_connections 2024-09-11T23:57:53.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:53.177+0000 7f258f1c4640 1 -- 172.21.15.6:0/1286153025 wait complete. 2024-09-11T23:57:53.426 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:53 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:57:53.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:53 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:57:53.810 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:57:54.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:54 smithi006 ceph-mon[30947]: pgmap v312: 129 pgs: 129 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.9 KiB/s wr, 22 op/s 2024-09-11T23:57:54.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:54 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1286153025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:54.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:54 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:54.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:54 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:54.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:54 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:54.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:54 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:54.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:54 smithi134 ceph-mon[34893]: pgmap v312: 129 pgs: 129 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.9 KiB/s wr, 22 op/s 2024-09-11T23:57:54.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:54 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1286153025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:54.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:54 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:54.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:54 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:54.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:54 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:54.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:54 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:54.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:54 smithi039 ceph-mon[34543]: pgmap v312: 129 pgs: 129 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.9 KiB/s wr, 22 op/s 2024-09-11T23:57:54.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:54 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1286153025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:54.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:54 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:54.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:54 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:54.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:54 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:54.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:54 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:54.575 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.064+0000 7fe2f64d5640 1 -- 172.21.15.6:0/730050051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f0100a80 msgr2=0x7fe2f0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.064+0000 7fe2f64d5640 1 --2- 172.21.15.6:0/730050051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f0100a80 0x7fe2f0100ee0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009930 tx=0x7fe2e402a420 comp rx=0 tx=0).stop 2024-09-11T23:57:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.064+0000 7fe2f64d5640 1 -- 172.21.15.6:0/730050051 shutdown_connections 2024-09-11T23:57:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.064+0000 7fe2f64d5640 1 --2- 172.21.15.6:0/730050051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2f0101420 0x7fe2f010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.064+0000 7fe2f64d5640 1 --2- 172.21.15.6:0/730050051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f0100a80 0x7fe2f0100ee0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.064+0000 7fe2f64d5640 1 --2- 172.21.15.6:0/730050051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2f0106a80 0x7fe2f0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.064+0000 7fe2f64d5640 1 -- 172.21.15.6:0/730050051 >> 172.21.15.6:0/730050051 conn(0x7fe2f00fc7a0 msgr2=0x7fe2f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.064+0000 7fe2f64d5640 1 -- 172.21.15.6:0/730050051 shutdown_connections 2024-09-11T23:57:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.064+0000 7fe2f64d5640 1 -- 172.21.15.6:0/730050051 wait complete. 2024-09-11T23:57:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2f64d5640 1 Processor -- start 2024-09-11T23:57:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2f64d5640 1 -- start start 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2f64d5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2f0100a80 0x7fe2f0198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2f64d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f0101420 0x7fe2f01988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2f64d5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2f0106a80 0x7fe2f019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2f64d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f0110d30 con 0x7fe2f0101420 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2f64d5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f0110bb0 con 0x7fe2f0106a80 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2f64d5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f0110eb0 con 0x7fe2f0100a80 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2ef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f0101420 0x7fe2f01988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2ef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f0101420 0x7fe2f01988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49940/0 (socket says 172.21.15.6:49940) 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2ef7fe640 1 -- 172.21.15.6:0/3206504042 learned_addr learned my addr 172.21.15.6:0/3206504042 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2effff640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2f0100a80 0x7fe2f0198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.065+0000 7fe2f4a72640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2f0106a80 0x7fe2f019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.066+0000 7fe2ef7fe640 1 -- 172.21.15.6:0/3206504042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2f0100a80 msgr2=0x7fe2f0198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.066+0000 7fe2ef7fe640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2f0100a80 0x7fe2f0198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.066+0000 7fe2ef7fe640 1 -- 172.21.15.6:0/3206504042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2f0106a80 msgr2=0x7fe2f019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.066+0000 7fe2ef7fe640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2f0106a80 0x7fe2f019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.066+0000 7fe2ef7fe640 1 -- 172.21.15.6:0/3206504042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f019d320 con 0x7fe2f0101420 2024-09-11T23:57:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.066+0000 7fe2ef7fe640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f0101420 0x7fe2f01988b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4005940 tx=0x7fe2e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.066+0000 7fe2ed7fa640 1 -- 172.21.15.6:0/3206504042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e403f030 con 0x7fe2f0101420 2024-09-11T23:57:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.066+0000 7fe2ed7fa640 1 -- 172.21.15.6:0/3206504042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2e40318a0 con 0x7fe2f0101420 2024-09-11T23:57:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.066+0000 7fe2f64d5640 1 -- 172.21.15.6:0/3206504042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f019d5b0 con 0x7fe2f0101420 2024-09-11T23:57:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.066+0000 7fe2ed7fa640 1 -- 172.21.15.6:0/3206504042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4035070 con 0x7fe2f0101420 2024-09-11T23:57:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.066+0000 7fe2f64d5640 1 -- 172.21.15.6:0/3206504042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f01a4ef0 con 0x7fe2f0101420 2024-09-11T23:57:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.067+0000 7fe2f64d5640 1 -- 172.21.15.6:0/3206504042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f0100ee0 con 0x7fe2f0101420 2024-09-11T23:57:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.068+0000 7fe2ed7fa640 1 -- 172.21.15.6:0/3206504042 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe2e4042030 con 0x7fe2f0101420 2024-09-11T23:57:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.069+0000 7fe2ed7fa640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe2d80a2c10 0x7fe2d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.069+0000 7fe2effff640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe2d80a2c10 0x7fe2d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.069+0000 7fe2ed7fa640 1 -- 172.21.15.6:0/3206504042 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fe2e40ef6c0 con 0x7fe2f0101420 2024-09-11T23:57:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.069+0000 7fe2effff640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe2d80a2c10 0x7fe2d80a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000bb60 tx=0x7fe2e000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.074+0000 7fe2ed7fa640 1 -- 172.21.15.6:0/3206504042 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe2e40bbc30 con 0x7fe2f0101420 2024-09-11T23:57:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.266+0000 7fe2f64d5640 1 -- 172.21.15.6:0/3206504042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2f010a060 con 0x7fe2f0101420 2024-09-11T23:57:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.268+0000 7fe2ed7fa640 1 -- 172.21.15.6:0/3206504042 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24143 (secure 0 0 0) 0x7fe2e40bff30 con 0x7fe2f0101420 2024-09-11T23:57:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:57:55.268 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-11T23:57:07.083294+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:56:54.204314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:56:56.327143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:57:02.826677+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:57:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.270+0000 7fe2f64d5640 1 -- 172.21.15.6:0/3206504042 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe2d80a2c10 msgr2=0x7fe2d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.270+0000 7fe2f64d5640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe2d80a2c10 0x7fe2d80a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000bb60 tx=0x7fe2e000b390 comp rx=0 tx=0).stop 2024-09-11T23:57:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.270+0000 7fe2f64d5640 1 -- 172.21.15.6:0/3206504042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f0101420 msgr2=0x7fe2f01988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.270+0000 7fe2f64d5640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f0101420 0x7fe2f01988b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4005940 tx=0x7fe2e40042f0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.271+0000 7fe2f64d5640 1 -- 172.21.15.6:0/3206504042 shutdown_connections 2024-09-11T23:57:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.271+0000 7fe2f64d5640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe2d80a2c10 0x7fe2d80a50d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.271+0000 7fe2f64d5640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2f0106a80 0x7fe2f019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.271+0000 7fe2f64d5640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f0101420 0x7fe2f01988b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.271+0000 7fe2f64d5640 1 --2- 172.21.15.6:0/3206504042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2f0100a80 0x7fe2f0198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.271+0000 7fe2f64d5640 1 -- 172.21.15.6:0/3206504042 >> 172.21.15.6:0/3206504042 conn(0x7fe2f00fc7a0 msgr2=0x7fe2f006ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.271+0000 7fe2f64d5640 1 -- 172.21.15.6:0/3206504042 shutdown_connections 2024-09-11T23:57:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:55.271+0000 7fe2f64d5640 1 -- 172.21.15.6:0/3206504042 wait complete. 2024-09-11T23:57:56.033 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T23:57:56.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:57:56.315 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:56.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:56 smithi006 ceph-mon[30947]: pgmap v313: 129 pgs: 129 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.8 KiB/s wr, 21 op/s 2024-09-11T23:57:56.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:56 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3206504042' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:56.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:56 smithi134 ceph-mon[34893]: pgmap v313: 129 pgs: 129 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.8 KiB/s wr, 21 op/s 2024-09-11T23:57:56.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:56 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3206504042' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:56.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:56 smithi039 ceph-mon[34543]: pgmap v313: 129 pgs: 129 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.8 KiB/s wr, 21 op/s 2024-09-11T23:57:56.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:56 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3206504042' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.877+0000 7fa959aad640 1 -- 172.21.15.6:0/1311517700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa954102ef0 msgr2=0x7fa95410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.877+0000 7fa959aad640 1 --2- 172.21.15.6:0/1311517700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa954102ef0 0x7fa95410da40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009ca0 tx=0x7fa94c02a950 comp rx=0 tx=0).stop 2024-09-11T23:57:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.877+0000 7fa959aad640 1 -- 172.21.15.6:0/1311517700 shutdown_connections 2024-09-11T23:57:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.877+0000 7fa959aad640 1 --2- 172.21.15.6:0/1311517700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa954102ef0 0x7fa95410da40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.877+0000 7fa959aad640 1 --2- 172.21.15.6:0/1311517700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa954102570 0x7fa9541029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.877+0000 7fa959aad640 1 --2- 172.21.15.6:0/1311517700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa954100e20 0x7fa954101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.877+0000 7fa959aad640 1 -- 172.21.15.6:0/1311517700 >> 172.21.15.6:0/1311517700 conn(0x7fa9540fc7d0 msgr2=0x7fa9540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.877+0000 7fa959aad640 1 -- 172.21.15.6:0/1311517700 shutdown_connections 2024-09-11T23:57:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.877+0000 7fa959aad640 1 -- 172.21.15.6:0/1311517700 wait complete. 2024-09-11T23:57:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.878+0000 7fa959aad640 1 Processor -- start 2024-09-11T23:57:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.878+0000 7fa959aad640 1 -- start start 2024-09-11T23:57:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.878+0000 7fa959aad640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa954100e20 0x7fa954199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.878+0000 7fa959aad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa954102570 0x7fa954199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.878+0000 7fa959aad640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa954102ef0 0x7fa9541a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.878+0000 7fa959aad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa954110e30 con 0x7fa954102570 2024-09-11T23:57:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.878+0000 7fa959aad640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa954110cb0 con 0x7fa954102ef0 2024-09-11T23:57:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.878+0000 7fa959aad640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa954110fb0 con 0x7fa954100e20 2024-09-11T23:57:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.878+0000 7fa952ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa954102570 0x7fa954199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.878+0000 7fa952ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa954102570 0x7fa954199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49952/0 (socket says 172.21.15.6:49952) 2024-09-11T23:57:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.878+0000 7fa952ffd640 1 -- 172.21.15.6:0/2679759851 learned_addr learned my addr 172.21.15.6:0/2679759851 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.878+0000 7fa9537fe640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa954100e20 0x7fa954199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.879+0000 7fa953fff640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa954102ef0 0x7fa9541a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.879+0000 7fa952ffd640 1 -- 172.21.15.6:0/2679759851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa954100e20 msgr2=0x7fa954199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.879+0000 7fa952ffd640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa954100e20 0x7fa954199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.879+0000 7fa952ffd640 1 -- 172.21.15.6:0/2679759851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa954102ef0 msgr2=0x7fa9541a4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.879+0000 7fa952ffd640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa954102ef0 0x7fa9541a4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.879+0000 7fa952ffd640 1 -- 172.21.15.6:0/2679759851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9541a47d0 con 0x7fa954102570 2024-09-11T23:57:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.879+0000 7fa952ffd640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa954102570 0x7fa954199750 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa94800d950 tx=0x7fa94800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.879+0000 7fa950ff9640 1 -- 172.21.15.6:0/2679759851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948017070 con 0x7fa954102570 2024-09-11T23:57:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.879+0000 7fa950ff9640 1 -- 172.21.15.6:0/2679759851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa948009c30 con 0x7fa954102570 2024-09-11T23:57:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.879+0000 7fa959aad640 1 -- 172.21.15.6:0/2679759851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9541a49a0 con 0x7fa954102570 2024-09-11T23:57:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.879+0000 7fa950ff9640 1 -- 172.21.15.6:0/2679759851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94800f620 con 0x7fa954102570 2024-09-11T23:57:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.879+0000 7fa959aad640 1 -- 172.21.15.6:0/2679759851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9541a4ee0 con 0x7fa954102570 2024-09-11T23:57:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.880+0000 7fa959aad640 1 -- 172.21.15.6:0/2679759851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa954101200 con 0x7fa954102570 2024-09-11T23:57:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.881+0000 7fa950ff9640 1 -- 172.21.15.6:0/2679759851 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fa9480109a0 con 0x7fa954102570 2024-09-11T23:57:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.882+0000 7fa950ff9640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa93c0a2c90 0x7fa93c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.882+0000 7fa9537fe640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa93c0a2c90 0x7fa93c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.882+0000 7fa950ff9640 1 -- 172.21.15.6:0/2679759851 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fa9480cefa0 con 0x7fa954102570 2024-09-11T23:57:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.882+0000 7fa9537fe640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa93c0a2c90 0x7fa93c0a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa944005fd0 tx=0x7fa94400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:56.886+0000 7fa950ff9640 1 -- 172.21.15.6:0/2679759851 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa948009de0 con 0x7fa954102570 2024-09-11T23:57:57.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.063+0000 7fa959aad640 1 -- 172.21.15.6:0/2679759851 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa954062630 con 0x7fa93c0a2c90 2024-09-11T23:57:57.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.073+0000 7fa950ff9640 1 -- 172.21.15.6:0/2679759851 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340637 (secure 0 0 0) 0x7fa954062630 con 0x7fa93c0a2c90 2024-09-11T23:57:57.076 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:57:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-11T23:57:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.077+0000 7fa959aad640 1 -- 172.21.15.6:0/2679759851 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa93c0a2c90 msgr2=0x7fa93c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.077+0000 7fa959aad640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa93c0a2c90 0x7fa93c0a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa944005fd0 tx=0x7fa94400b390 comp rx=0 tx=0).stop 2024-09-11T23:57:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.077+0000 7fa959aad640 1 -- 172.21.15.6:0/2679759851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa954102570 msgr2=0x7fa954199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.077+0000 7fa959aad640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa954102570 0x7fa954199750 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa94800d950 tx=0x7fa94800de10 comp rx=0 tx=0).stop 2024-09-11T23:57:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.077+0000 7fa959aad640 1 -- 172.21.15.6:0/2679759851 shutdown_connections 2024-09-11T23:57:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.077+0000 7fa959aad640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa93c0a2c90 0x7fa93c0a5150 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.077+0000 7fa959aad640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa954102ef0 0x7fa9541a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.077+0000 7fa959aad640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa954102570 0x7fa954199750 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.077+0000 7fa959aad640 1 --2- 172.21.15.6:0/2679759851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa954100e20 0x7fa954199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.077+0000 7fa959aad640 1 -- 172.21.15.6:0/2679759851 >> 172.21.15.6:0/2679759851 conn(0x7fa9540fc7d0 msgr2=0x7fa9540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.077+0000 7fa959aad640 1 -- 172.21.15.6:0/2679759851 shutdown_connections 2024-09-11T23:57:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:57.077+0000 7fa959aad640 1 -- 172.21.15.6:0/2679759851 wait complete. 2024-09-11T23:57:57.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:57.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:57.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:57.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:57:57.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:57.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:57.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:57.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:57.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:57:57.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:57.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:57.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:57.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:57.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:57:57.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:57:57.821 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-09-11T23:57:56.944785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649830,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":286,"num_read_kb":257,"num_write":424,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360888,"kb_used_data":11640,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580936,"statfs":{"total":1151940427776,"available":1151570878464,"internally_reserved":0,"allocated":11919360,"data_stored":7634256,"data_compressed":322275,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49376,"num_objects":14,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":139,"num_read_kb":129,"num_write":64,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003516"},"pg_stats":[{"pgid":"2.1f","version":"86'13","reported_seq":56,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:54.099855+0000","last_change":"2024-09-11T23:56:55.272753+0000","last_active":"2024-09-11T23:57:54.099855+0000","last_peered":"2024-09-11T23:57:54.099855+0000","last_clean":"2024-09-11T23:57:54.099855+0000","last_became_active":"2024-09-11T23:56:55.272342+0000","last_became_peered":"2024-09-11T23:56:55.272342+0000","last_unstale":"2024-09-11T23:57:54.099855+0000","last_undegraded":"2024-09-11T23:57:54.099855+0000","last_fullsized":"2024-09-11T23:57:54.099855+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:43.856651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850076+0000","last_change":"2024-09-11T23:56:57.349492+0000","last_active":"2024-09-11T23:57:07.850076+0000","last_peered":"2024-09-11T23:57:07.850076+0000","last_clean":"2024-09-11T23:57:07.850076+0000","last_became_active":"2024-09-11T23:56:57.349098+0000","last_became_peered":"2024-09-11T23:56:57.349098+0000","last_unstale":"2024-09-11T23:57:07.850076+0000","last_undegraded":"2024-09-11T23:57:07.850076+0000","last_fullsized":"2024-09-11T23:57:07.850076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:06.520492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022092+0000","last_change":"2024-09-11T23:57:04.417135+0000","last_active":"2024-09-11T23:57:08.022092+0000","last_peered":"2024-09-11T23:57:08.022092+0000","last_clean":"2024-09-11T23:57:08.022092+0000","last_became_active":"2024-09-11T23:57:04.416697+0000","last_became_peered":"2024-09-11T23:57:04.416697+0000","last_unstale":"2024-09-11T23:57:08.022092+0000","last_undegraded":"2024-09-11T23:57:08.022092+0000","last_fullsized":"2024-09-11T23:57:08.022092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:48.794840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850542+0000","last_change":"2024-09-11T23:56:55.593961+0000","last_active":"2024-09-11T23:57:07.850542+0000","last_peered":"2024-09-11T23:57:07.850542+0000","last_clean":"2024-09-11T23:57:07.850542+0000","last_became_active":"2024-09-11T23:56:55.593624+0000","last_became_peered":"2024-09-11T23:56:55.593624+0000","last_unstale":"2024-09-11T23:57:07.850542+0000","last_undegraded":"2024-09-11T23:57:07.850542+0000","last_fullsized":"2024-09-11T23:57:07.850542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:32.510264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022450+0000","last_change":"2024-09-11T23:56:57.364450+0000","last_active":"2024-09-11T23:57:08.022450+0000","last_peered":"2024-09-11T23:57:08.022450+0000","last_clean":"2024-09-11T23:57:08.022450+0000","last_became_active":"2024-09-11T23:56:57.363583+0000","last_became_peered":"2024-09-11T23:56:57.363583+0000","last_unstale":"2024-09-11T23:57:08.022450+0000","last_undegraded":"2024-09-11T23:57:08.022450+0000","last_fullsized":"2024-09-11T23:57:08.022450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:31.761036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.857536+0000","last_change":"2024-09-11T23:57:04.419305+0000","last_active":"2024-09-11T23:57:07.857536+0000","last_peered":"2024-09-11T23:57:07.857536+0000","last_clean":"2024-09-11T23:57:07.857536+0000","last_became_active":"2024-09-11T23:57:04.418774+0000","last_became_peered":"2024-09-11T23:57:04.418774+0000","last_unstale":"2024-09-11T23:57:07.857536+0000","last_undegraded":"2024-09-11T23:57:07.857536+0000","last_fullsized":"2024-09-11T23:57:07.857536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.910125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:43.080286+0000","last_change":"2024-09-11T23:56:55.275373+0000","last_active":"2024-09-11T23:57:43.080286+0000","last_peered":"2024-09-11T23:57:43.080286+0000","last_clean":"2024-09-11T23:57:43.080286+0000","last_became_active":"2024-09-11T23:56:55.274400+0000","last_became_peered":"2024-09-11T23:56:55.274400+0000","last_unstale":"2024-09-11T23:57:43.080286+0000","last_undegraded":"2024-09-11T23:57:43.080286+0000","last_fullsized":"2024-09-11T23:57:43.080286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:41.019225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022376+0000","last_change":"2024-09-11T23:56:57.346037+0000","last_active":"2024-09-11T23:57:08.022376+0000","last_peered":"2024-09-11T23:57:08.022376+0000","last_clean":"2024-09-11T23:57:08.022376+0000","last_became_active":"2024-09-11T23:56:57.345712+0000","last_became_peered":"2024-09-11T23:56:57.345712+0000","last_unstale":"2024-09-11T23:57:08.022376+0000","last_undegraded":"2024-09-11T23:57:08.022376+0000","last_fullsized":"2024-09-11T23:57:08.022376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:20.643812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.858153+0000","last_change":"2024-09-11T23:57:04.424212+0000","last_active":"2024-09-11T23:57:07.858153+0000","last_peered":"2024-09-11T23:57:07.858153+0000","last_clean":"2024-09-11T23:57:07.858153+0000","last_became_active":"2024-09-11T23:57:04.423501+0000","last_became_peered":"2024-09-11T23:57:04.423501+0000","last_unstale":"2024-09-11T23:57:07.858153+0000","last_undegraded":"2024-09-11T23:57:07.858153+0000","last_fullsized":"2024-09-11T23:57:07.858153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:52.680484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.069163+0000","last_change":"2024-09-11T23:56:55.275919+0000","last_active":"2024-09-11T23:57:42.069163+0000","last_peered":"2024-09-11T23:57:42.069163+0000","last_clean":"2024-09-11T23:57:42.069163+0000","last_became_active":"2024-09-11T23:56:55.275326+0000","last_became_peered":"2024-09-11T23:56:55.275326+0000","last_unstale":"2024-09-11T23:57:42.069163+0000","last_undegraded":"2024-09-11T23:57:42.069163+0000","last_fullsized":"2024-09-11T23:57:42.069163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:47.201282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850923+0000","last_change":"2024-09-11T23:56:57.360200+0000","last_active":"2024-09-11T23:57:07.850923+0000","last_peered":"2024-09-11T23:57:07.850923+0000","last_clean":"2024-09-11T23:57:07.850923+0000","last_became_active":"2024-09-11T23:56:57.359868+0000","last_became_peered":"2024-09-11T23:56:57.359868+0000","last_unstale":"2024-09-11T23:57:07.850923+0000","last_undegraded":"2024-09-11T23:57:07.850923+0000","last_fullsized":"2024-09-11T23:57:07.850923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:57.321711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.857626+0000","last_change":"2024-09-11T23:57:04.419886+0000","last_active":"2024-09-11T23:57:07.857626+0000","last_peered":"2024-09-11T23:57:07.857626+0000","last_clean":"2024-09-11T23:57:07.857626+0000","last_became_active":"2024-09-11T23:57:04.419419+0000","last_became_peered":"2024-09-11T23:57:04.419419+0000","last_unstale":"2024-09-11T23:57:07.857626+0000","last_undegraded":"2024-09-11T23:57:07.857626+0000","last_fullsized":"2024-09-11T23:57:07.857626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.768235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022759+0000","last_change":"2024-09-11T23:56:57.364619+0000","last_active":"2024-09-11T23:57:08.022759+0000","last_peered":"2024-09-11T23:57:08.022759+0000","last_clean":"2024-09-11T23:57:08.022759+0000","last_became_active":"2024-09-11T23:56:57.364279+0000","last_became_peered":"2024-09-11T23:56:57.364279+0000","last_unstale":"2024-09-11T23:57:08.022759+0000","last_undegraded":"2024-09-11T23:57:08.022759+0000","last_fullsized":"2024-09-11T23:57:08.022759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:13.540493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:39.030761+0000","last_change":"2024-09-11T23:56:55.274995+0000","last_active":"2024-09-11T23:57:39.030761+0000","last_peered":"2024-09-11T23:57:39.030761+0000","last_clean":"2024-09-11T23:57:39.030761+0000","last_became_active":"2024-09-11T23:56:55.274017+0000","last_became_peered":"2024-09-11T23:56:55.274017+0000","last_unstale":"2024-09-11T23:57:39.030761+0000","last_undegraded":"2024-09-11T23:57:39.030761+0000","last_fullsized":"2024-09-11T23:57:39.030761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:37.324085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.857776+0000","last_change":"2024-09-11T23:57:04.419999+0000","last_active":"2024-09-11T23:57:07.857776+0000","last_peered":"2024-09-11T23:57:07.857776+0000","last_clean":"2024-09-11T23:57:07.857776+0000","last_became_active":"2024-09-11T23:57:04.419579+0000","last_became_peered":"2024-09-11T23:57:04.419579+0000","last_unstale":"2024-09-11T23:57:07.857776+0000","last_undegraded":"2024-09-11T23:57:07.857776+0000","last_fullsized":"2024-09-11T23:57:07.857776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:08.830864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850136+0000","last_change":"2024-09-11T23:56:57.358959+0000","last_active":"2024-09-11T23:57:07.850136+0000","last_peered":"2024-09-11T23:57:07.850136+0000","last_clean":"2024-09-11T23:57:07.850136+0000","last_became_active":"2024-09-11T23:56:57.358676+0000","last_became_peered":"2024-09-11T23:56:57.358676+0000","last_unstale":"2024-09-11T23:57:07.850136+0000","last_undegraded":"2024-09-11T23:57:07.850136+0000","last_fullsized":"2024-09-11T23:57:07.850136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:03.243973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.052075+0000","last_change":"2024-09-11T23:56:55.274068+0000","last_active":"2024-09-11T23:57:41.052075+0000","last_peered":"2024-09-11T23:57:41.052075+0000","last_clean":"2024-09-11T23:57:41.052075+0000","last_became_active":"2024-09-11T23:56:55.273689+0000","last_became_peered":"2024-09-11T23:56:55.273689+0000","last_unstale":"2024-09-11T23:57:41.052075+0000","last_undegraded":"2024-09-11T23:57:41.052075+0000","last_fullsized":"2024-09-11T23:57:41.052075+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:36.315956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.858161+0000","last_change":"2024-09-11T23:57:04.424832+0000","last_active":"2024-09-11T23:57:07.858161+0000","last_peered":"2024-09-11T23:57:07.858161+0000","last_clean":"2024-09-11T23:57:07.858161+0000","last_became_active":"2024-09-11T23:57:04.424398+0000","last_became_peered":"2024-09-11T23:57:04.424398+0000","last_unstale":"2024-09-11T23:57:07.858161+0000","last_undegraded":"2024-09-11T23:57:07.858161+0000","last_fullsized":"2024-09-11T23:57:07.858161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:11.134123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021643+0000","last_change":"2024-09-11T23:56:57.349603+0000","last_active":"2024-09-11T23:57:08.021643+0000","last_peered":"2024-09-11T23:57:08.021643+0000","last_clean":"2024-09-11T23:57:08.021643+0000","last_became_active":"2024-09-11T23:56:57.349269+0000","last_became_peered":"2024-09-11T23:56:57.349269+0000","last_unstale":"2024-09-11T23:57:08.021643+0000","last_undegraded":"2024-09-11T23:57:08.021643+0000","last_fullsized":"2024-09-11T23:57:08.021643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:46.269274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.066202+0000","last_change":"2024-09-11T23:56:55.271033+0000","last_active":"2024-09-11T23:57:42.066202+0000","last_peered":"2024-09-11T23:57:42.066202+0000","last_clean":"2024-09-11T23:57:42.066202+0000","last_became_active":"2024-09-11T23:56:55.270704+0000","last_became_peered":"2024-09-11T23:56:55.270704+0000","last_unstale":"2024-09-11T23:57:42.066202+0000","last_undegraded":"2024-09-11T23:57:42.066202+0000","last_fullsized":"2024-09-11T23:57:42.066202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:36.751581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021774+0000","last_change":"2024-09-11T23:57:04.413809+0000","last_active":"2024-09-11T23:57:08.021774+0000","last_peered":"2024-09-11T23:57:08.021774+0000","last_clean":"2024-09-11T23:57:08.021774+0000","last_became_active":"2024-09-11T23:57:04.413338+0000","last_became_peered":"2024-09-11T23:57:04.413338+0000","last_unstale":"2024-09-11T23:57:08.021774+0000","last_undegraded":"2024-09-11T23:57:08.021774+0000","last_fullsized":"2024-09-11T23:57:08.021774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:24.112205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.518959+0000","last_change":"2024-09-11T23:56:57.348815+0000","last_active":"2024-09-11T23:57:08.518959+0000","last_peered":"2024-09-11T23:57:08.518959+0000","last_clean":"2024-09-11T23:57:08.518959+0000","last_became_active":"2024-09-11T23:56:57.348426+0000","last_became_peered":"2024-09-11T23:56:57.348426+0000","last_unstale":"2024-09-11T23:57:08.518959+0000","last_undegraded":"2024-09-11T23:57:08.518959+0000","last_fullsized":"2024-09-11T23:57:08.518959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:47.685615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:39.031699+0000","last_change":"2024-09-11T23:56:55.594325+0000","last_active":"2024-09-11T23:57:39.031699+0000","last_peered":"2024-09-11T23:57:39.031699+0000","last_clean":"2024-09-11T23:57:39.031699+0000","last_became_active":"2024-09-11T23:56:55.594044+0000","last_became_peered":"2024-09-11T23:56:55.594044+0000","last_unstale":"2024-09-11T23:57:39.031699+0000","last_undegraded":"2024-09-11T23:57:39.031699+0000","last_fullsized":"2024-09-11T23:57:39.031699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:05.124980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.857919+0000","last_change":"2024-09-11T23:57:04.425591+0000","last_active":"2024-09-11T23:57:07.857919+0000","last_peered":"2024-09-11T23:57:07.857919+0000","last_clean":"2024-09-11T23:57:07.857919+0000","last_became_active":"2024-09-11T23:57:04.424945+0000","last_became_peered":"2024-09-11T23:57:04.424945+0000","last_unstale":"2024-09-11T23:57:07.857919+0000","last_undegraded":"2024-09-11T23:57:07.857919+0000","last_fullsized":"2024-09-11T23:57:07.857919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:57.541426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021877+0000","last_change":"2024-09-11T23:56:57.363423+0000","last_active":"2024-09-11T23:57:08.021877+0000","last_peered":"2024-09-11T23:57:08.021877+0000","last_clean":"2024-09-11T23:57:08.021877+0000","last_became_active":"2024-09-11T23:56:57.361258+0000","last_became_peered":"2024-09-11T23:56:57.361258+0000","last_unstale":"2024-09-11T23:57:08.021877+0000","last_undegraded":"2024-09-11T23:57:08.021877+0000","last_fullsized":"2024-09-11T23:57:08.021877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:36.743240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.067825+0000","last_change":"2024-09-11T23:56:55.311774+0000","last_active":"2024-09-11T23:57:42.067825+0000","last_peered":"2024-09-11T23:57:42.067825+0000","last_clean":"2024-09-11T23:57:42.067825+0000","last_became_active":"2024-09-11T23:56:55.311409+0000","last_became_peered":"2024-09-11T23:56:55.311409+0000","last_unstale":"2024-09-11T23:57:42.067825+0000","last_undegraded":"2024-09-11T23:57:42.067825+0000","last_fullsized":"2024-09-11T23:57:42.067825+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:50.243993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022280+0000","last_change":"2024-09-11T23:57:04.416973+0000","last_active":"2024-09-11T23:57:08.022280+0000","last_peered":"2024-09-11T23:57:08.022280+0000","last_clean":"2024-09-11T23:57:08.022280+0000","last_became_active":"2024-09-11T23:57:04.416582+0000","last_became_peered":"2024-09-11T23:57:04.416582+0000","last_unstale":"2024-09-11T23:57:08.022280+0000","last_undegraded":"2024-09-11T23:57:08.022280+0000","last_fullsized":"2024-09-11T23:57:08.022280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:13.411939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850530+0000","last_change":"2024-09-11T23:56:57.354790+0000","last_active":"2024-09-11T23:57:07.850530+0000","last_peered":"2024-09-11T23:57:07.850530+0000","last_clean":"2024-09-11T23:57:07.850530+0000","last_became_active":"2024-09-11T23:56:57.354478+0000","last_became_peered":"2024-09-11T23:56:57.354478+0000","last_unstale":"2024-09-11T23:57:07.850530+0000","last_undegraded":"2024-09-11T23:57:07.850530+0000","last_fullsized":"2024-09-11T23:57:07.850530+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:01.109689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'14","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:53.377232+0000","last_change":"2024-09-11T23:56:55.265429+0000","last_active":"2024-09-11T23:57:53.377232+0000","last_peered":"2024-09-11T23:57:53.377232+0000","last_clean":"2024-09-11T23:57:53.377232+0000","last_became_active":"2024-09-11T23:56:55.265104+0000","last_became_peered":"2024-09-11T23:56:55.265104+0000","last_unstale":"2024-09-11T23:57:53.377232+0000","last_undegraded":"2024-09-11T23:57:53.377232+0000","last_fullsized":"2024-09-11T23:57:53.377232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:48.091192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.849619+0000","last_change":"2024-09-11T23:57:04.417058+0000","last_active":"2024-09-11T23:57:07.849619+0000","last_peered":"2024-09-11T23:57:07.849619+0000","last_clean":"2024-09-11T23:57:07.849619+0000","last_became_active":"2024-09-11T23:57:04.416237+0000","last_became_peered":"2024-09-11T23:57:04.416237+0000","last_unstale":"2024-09-11T23:57:07.849619+0000","last_undegraded":"2024-09-11T23:57:07.849619+0000","last_fullsized":"2024-09-11T23:57:07.849619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:47.959023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022832+0000","last_change":"2024-09-11T23:56:57.343131+0000","last_active":"2024-09-11T23:57:08.022832+0000","last_peered":"2024-09-11T23:57:08.022832+0000","last_clean":"2024-09-11T23:57:08.022832+0000","last_became_active":"2024-09-11T23:56:57.342823+0000","last_became_peered":"2024-09-11T23:56:57.342823+0000","last_unstale":"2024-09-11T23:57:08.022832+0000","last_undegraded":"2024-09-11T23:57:08.022832+0000","last_fullsized":"2024-09-11T23:57:08.022832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:00.685220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.068352+0000","last_change":"2024-09-11T23:56:55.594654+0000","last_active":"2024-09-11T23:57:42.068352+0000","last_peered":"2024-09-11T23:57:42.068352+0000","last_clean":"2024-09-11T23:57:42.068352+0000","last_became_active":"2024-09-11T23:56:55.594146+0000","last_became_peered":"2024-09-11T23:56:55.594146+0000","last_unstale":"2024-09-11T23:57:42.068352+0000","last_undegraded":"2024-09-11T23:57:42.068352+0000","last_fullsized":"2024-09-11T23:57:42.068352+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:41.770480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021647+0000","last_change":"2024-09-11T23:57:04.417873+0000","last_active":"2024-09-11T23:57:08.021647+0000","last_peered":"2024-09-11T23:57:08.021647+0000","last_clean":"2024-09-11T23:57:08.021647+0000","last_became_active":"2024-09-11T23:57:04.417477+0000","last_became_peered":"2024-09-11T23:57:04.417477+0000","last_unstale":"2024-09-11T23:57:08.021647+0000","last_undegraded":"2024-09-11T23:57:08.021647+0000","last_fullsized":"2024-09-11T23:57:08.021647+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:20.480850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022599+0000","last_change":"2024-09-11T23:56:57.360695+0000","last_active":"2024-09-11T23:57:08.022599+0000","last_peered":"2024-09-11T23:57:08.022599+0000","last_clean":"2024-09-11T23:57:08.022599+0000","last_became_active":"2024-09-11T23:56:57.357702+0000","last_became_peered":"2024-09-11T23:56:57.357702+0000","last_unstale":"2024-09-11T23:57:08.022599+0000","last_undegraded":"2024-09-11T23:57:08.022599+0000","last_fullsized":"2024-09-11T23:57:08.022599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:04.680682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023108+0000","last_change":"2024-09-11T23:56:55.594503+0000","last_active":"2024-09-11T23:57:08.023108+0000","last_peered":"2024-09-11T23:57:08.023108+0000","last_clean":"2024-09-11T23:57:08.023108+0000","last_became_active":"2024-09-11T23:56:55.594155+0000","last_became_peered":"2024-09-11T23:56:55.594155+0000","last_unstale":"2024-09-11T23:57:08.023108+0000","last_undegraded":"2024-09-11T23:57:08.023108+0000","last_fullsized":"2024-09-11T23:57:08.023108+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:15.181976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.519081+0000","last_change":"2024-09-11T23:57:04.410696+0000","last_active":"2024-09-11T23:57:08.519081+0000","last_peered":"2024-09-11T23:57:08.519081+0000","last_clean":"2024-09-11T23:57:08.519081+0000","last_became_active":"2024-09-11T23:57:04.410281+0000","last_became_peered":"2024-09-11T23:57:04.410281+0000","last_unstale":"2024-09-11T23:57:08.519081+0000","last_undegraded":"2024-09-11T23:57:08.519081+0000","last_fullsized":"2024-09-11T23:57:08.519081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:31.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022656+0000","last_change":"2024-09-11T23:56:57.361458+0000","last_active":"2024-09-11T23:57:08.022656+0000","last_peered":"2024-09-11T23:57:08.022656+0000","last_clean":"2024-09-11T23:57:08.022656+0000","last_became_active":"2024-09-11T23:56:57.361031+0000","last_became_peered":"2024-09-11T23:56:57.361031+0000","last_unstale":"2024-09-11T23:57:08.022656+0000","last_undegraded":"2024-09-11T23:57:08.022656+0000","last_fullsized":"2024-09-11T23:57:08.022656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:23.691469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.098218+0000","last_change":"2024-09-11T23:56:55.276558+0000","last_active":"2024-09-11T23:57:52.098218+0000","last_peered":"2024-09-11T23:57:52.098218+0000","last_clean":"2024-09-11T23:57:52.098218+0000","last_became_active":"2024-09-11T23:56:55.276053+0000","last_became_peered":"2024-09-11T23:56:55.276053+0000","last_unstale":"2024-09-11T23:57:52.098218+0000","last_undegraded":"2024-09-11T23:57:52.098218+0000","last_fullsized":"2024-09-11T23:57:52.098218+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:57.139383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022569+0000","last_change":"2024-09-11T23:57:04.414763+0000","last_active":"2024-09-11T23:57:08.022569+0000","last_peered":"2024-09-11T23:57:08.022569+0000","last_clean":"2024-09-11T23:57:08.022569+0000","last_became_active":"2024-09-11T23:57:04.414248+0000","last_became_peered":"2024-09-11T23:57:04.414248+0000","last_unstale":"2024-09-11T23:57:08.022569+0000","last_undegraded":"2024-09-11T23:57:08.022569+0000","last_fullsized":"2024-09-11T23:57:08.022569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.441399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850391+0000","last_change":"2024-09-11T23:56:57.351549+0000","last_active":"2024-09-11T23:57:07.850391+0000","last_peered":"2024-09-11T23:57:07.850391+0000","last_clean":"2024-09-11T23:57:07.850391+0000","last_became_active":"2024-09-11T23:56:57.351228+0000","last_became_peered":"2024-09-11T23:56:57.351228+0000","last_unstale":"2024-09-11T23:57:07.850391+0000","last_undegraded":"2024-09-11T23:57:07.850391+0000","last_fullsized":"2024-09-11T23:57:07.850391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:03.280698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.097686+0000","last_change":"2024-09-11T23:56:55.594392+0000","last_active":"2024-09-11T23:57:52.097686+0000","last_peered":"2024-09-11T23:57:52.097686+0000","last_clean":"2024-09-11T23:57:52.097686+0000","last_became_active":"2024-09-11T23:56:55.593620+0000","last_became_peered":"2024-09-11T23:56:55.593620+0000","last_unstale":"2024-09-11T23:57:52.097686+0000","last_undegraded":"2024-09-11T23:57:52.097686+0000","last_fullsized":"2024-09-11T23:57:52.097686+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:10.110283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021497+0000","last_change":"2024-09-11T23:57:04.408435+0000","last_active":"2024-09-11T23:57:08.021497+0000","last_peered":"2024-09-11T23:57:08.021497+0000","last_clean":"2024-09-11T23:57:08.021497+0000","last_became_active":"2024-09-11T23:57:04.408067+0000","last_became_peered":"2024-09-11T23:57:04.408067+0000","last_unstale":"2024-09-11T23:57:08.021497+0000","last_undegraded":"2024-09-11T23:57:08.021497+0000","last_fullsized":"2024-09-11T23:57:08.021497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:36.867039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021434+0000","last_change":"2024-09-11T23:56:57.352375+0000","last_active":"2024-09-11T23:57:08.021434+0000","last_peered":"2024-09-11T23:57:08.021434+0000","last_clean":"2024-09-11T23:57:08.021434+0000","last_became_active":"2024-09-11T23:56:57.352034+0000","last_became_peered":"2024-09-11T23:56:57.352034+0000","last_unstale":"2024-09-11T23:57:08.021434+0000","last_undegraded":"2024-09-11T23:57:08.021434+0000","last_fullsized":"2024-09-11T23:57:08.021434+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:02.707277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.035683+0000","last_change":"2024-09-11T23:56:55.279016+0000","last_active":"2024-09-11T23:57:40.035683+0000","last_peered":"2024-09-11T23:57:40.035683+0000","last_clean":"2024-09-11T23:57:40.035683+0000","last_became_active":"2024-09-11T23:56:55.278457+0000","last_became_peered":"2024-09-11T23:56:55.278457+0000","last_unstale":"2024-09-11T23:57:40.035683+0000","last_undegraded":"2024-09-11T23:57:40.035683+0000","last_fullsized":"2024-09-11T23:57:40.035683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:35.851946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.851052+0000","last_change":"2024-09-11T23:57:04.407941+0000","last_active":"2024-09-11T23:57:07.851052+0000","last_peered":"2024-09-11T23:57:07.851052+0000","last_clean":"2024-09-11T23:57:07.851052+0000","last_became_active":"2024-09-11T23:57:04.407517+0000","last_became_peered":"2024-09-11T23:57:04.407517+0000","last_unstale":"2024-09-11T23:57:07.851052+0000","last_undegraded":"2024-09-11T23:57:07.851052+0000","last_fullsized":"2024-09-11T23:57:07.851052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.781127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.849995+0000","last_change":"2024-09-11T23:56:57.344419+0000","last_active":"2024-09-11T23:57:07.849995+0000","last_peered":"2024-09-11T23:57:07.849995+0000","last_clean":"2024-09-11T23:57:07.849995+0000","last_became_active":"2024-09-11T23:56:57.343893+0000","last_became_peered":"2024-09-11T23:56:57.343893+0000","last_unstale":"2024-09-11T23:57:07.849995+0000","last_undegraded":"2024-09-11T23:57:07.849995+0000","last_fullsized":"2024-09-11T23:57:07.849995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:40.888240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:43.080657+0000","last_change":"2024-09-11T23:56:55.270056+0000","last_active":"2024-09-11T23:57:43.080657+0000","last_peered":"2024-09-11T23:57:43.080657+0000","last_clean":"2024-09-11T23:57:43.080657+0000","last_became_active":"2024-09-11T23:56:55.269689+0000","last_became_peered":"2024-09-11T23:56:55.269689+0000","last_unstale":"2024-09-11T23:57:43.080657+0000","last_undegraded":"2024-09-11T23:57:43.080657+0000","last_fullsized":"2024-09-11T23:57:43.080657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:21.085849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":343,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022698+0000","last_change":"2024-09-11T23:55:44.130655+0000","last_active":"2024-09-11T23:57:08.022698+0000","last_peered":"2024-09-11T23:57:08.022698+0000","last_clean":"2024-09-11T23:57:08.022698+0000","last_became_active":"2024-09-11T23:55:44.130263+0000","last_became_peered":"2024-09-11T23:55:44.130263+0000","last_unstale":"2024-09-11T23:57:08.022698+0000","last_undegraded":"2024-09-11T23:57:08.022698+0000","last_fullsized":"2024-09-11T23:57:08.022698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:17.476450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:17.476450+0000","last_clean_scrub_stamp":"2024-09-11T23:52:17.476450+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:38.754760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.126290+0000","last_change":"2024-09-11T23:57:04.417259+0000","last_active":"2024-09-11T23:57:08.126290+0000","last_peered":"2024-09-11T23:57:08.126290+0000","last_clean":"2024-09-11T23:57:08.126290+0000","last_became_active":"2024-09-11T23:57:04.416729+0000","last_became_peered":"2024-09-11T23:57:04.416729+0000","last_unstale":"2024-09-11T23:57:08.126290+0000","last_undegraded":"2024-09-11T23:57:08.126290+0000","last_fullsized":"2024-09-11T23:57:08.126290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:50.508736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023475+0000","last_change":"2024-09-11T23:56:57.362787+0000","last_active":"2024-09-11T23:57:08.023475+0000","last_peered":"2024-09-11T23:57:08.023475+0000","last_clean":"2024-09-11T23:57:08.023475+0000","last_became_active":"2024-09-11T23:56:57.362438+0000","last_became_peered":"2024-09-11T23:56:57.362438+0000","last_unstale":"2024-09-11T23:57:08.023475+0000","last_undegraded":"2024-09-11T23:57:08.023475+0000","last_fullsized":"2024-09-11T23:57:08.023475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:53.969983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:55.101260+0000","last_change":"2024-09-11T23:56:55.594525+0000","last_active":"2024-09-11T23:57:55.101260+0000","last_peered":"2024-09-11T23:57:55.101260+0000","last_clean":"2024-09-11T23:57:55.101260+0000","last_became_active":"2024-09-11T23:56:55.594187+0000","last_became_peered":"2024-09-11T23:56:55.594187+0000","last_unstale":"2024-09-11T23:57:55.101260+0000","last_undegraded":"2024-09-11T23:57:55.101260+0000","last_fullsized":"2024-09-11T23:57:55.101260+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.087663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022243+0000","last_change":"2024-09-11T23:57:04.421266+0000","last_active":"2024-09-11T23:57:08.022243+0000","last_peered":"2024-09-11T23:57:08.022243+0000","last_clean":"2024-09-11T23:57:08.022243+0000","last_became_active":"2024-09-11T23:57:04.420212+0000","last_became_peered":"2024-09-11T23:57:04.420212+0000","last_unstale":"2024-09-11T23:57:08.022243+0000","last_undegraded":"2024-09-11T23:57:08.022243+0000","last_fullsized":"2024-09-11T23:57:08.022243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:51.532509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022715+0000","last_change":"2024-09-11T23:56:57.360393+0000","last_active":"2024-09-11T23:57:08.022715+0000","last_peered":"2024-09-11T23:57:08.022715+0000","last_clean":"2024-09-11T23:57:08.022715+0000","last_became_active":"2024-09-11T23:56:57.359996+0000","last_became_peered":"2024-09-11T23:56:57.359996+0000","last_unstale":"2024-09-11T23:57:08.022715+0000","last_undegraded":"2024-09-11T23:57:08.022715+0000","last_fullsized":"2024-09-11T23:57:08.022715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:48.325137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.067227+0000","last_change":"2024-09-11T23:56:55.273929+0000","last_active":"2024-09-11T23:57:42.067227+0000","last_peered":"2024-09-11T23:57:42.067227+0000","last_clean":"2024-09-11T23:57:42.067227+0000","last_became_active":"2024-09-11T23:56:55.273581+0000","last_became_peered":"2024-09-11T23:56:55.273581+0000","last_unstale":"2024-09-11T23:57:42.067227+0000","last_undegraded":"2024-09-11T23:57:42.067227+0000","last_fullsized":"2024-09-11T23:57:42.067227+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:26.541787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022147+0000","last_change":"2024-09-11T23:57:04.422312+0000","last_active":"2024-09-11T23:57:08.022147+0000","last_peered":"2024-09-11T23:57:08.022147+0000","last_clean":"2024-09-11T23:57:08.022147+0000","last_became_active":"2024-09-11T23:57:04.420675+0000","last_became_peered":"2024-09-11T23:57:04.420675+0000","last_unstale":"2024-09-11T23:57:08.022147+0000","last_undegraded":"2024-09-11T23:57:08.022147+0000","last_fullsized":"2024-09-11T23:57:08.022147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:44.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022155+0000","last_change":"2024-09-11T23:56:57.359358+0000","last_active":"2024-09-11T23:57:08.022155+0000","last_peered":"2024-09-11T23:57:08.022155+0000","last_clean":"2024-09-11T23:57:08.022155+0000","last_became_active":"2024-09-11T23:56:57.358961+0000","last_became_peered":"2024-09-11T23:56:57.358961+0000","last_unstale":"2024-09-11T23:57:08.022155+0000","last_undegraded":"2024-09-11T23:57:08.022155+0000","last_fullsized":"2024-09-11T23:57:08.022155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:22.522047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.065912+0000","last_change":"2024-09-11T23:56:55.273958+0000","last_active":"2024-09-11T23:57:42.065912+0000","last_peered":"2024-09-11T23:57:42.065912+0000","last_clean":"2024-09-11T23:57:42.065912+0000","last_became_active":"2024-09-11T23:56:55.273656+0000","last_became_peered":"2024-09-11T23:56:55.273656+0000","last_unstale":"2024-09-11T23:57:42.065912+0000","last_undegraded":"2024-09-11T23:57:42.065912+0000","last_fullsized":"2024-09-11T23:57:42.065912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:34.357776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850244+0000","last_change":"2024-09-11T23:57:04.415966+0000","last_active":"2024-09-11T23:57:07.850244+0000","last_peered":"2024-09-11T23:57:07.850244+0000","last_clean":"2024-09-11T23:57:07.850244+0000","last_became_active":"2024-09-11T23:57:04.415601+0000","last_became_peered":"2024-09-11T23:57:04.415601+0000","last_unstale":"2024-09-11T23:57:07.850244+0000","last_undegraded":"2024-09-11T23:57:07.850244+0000","last_fullsized":"2024-09-11T23:57:07.850244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:46.244645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021927+0000","last_change":"2024-09-11T23:56:57.354350+0000","last_active":"2024-09-11T23:57:08.021927+0000","last_peered":"2024-09-11T23:57:08.021927+0000","last_clean":"2024-09-11T23:57:08.021927+0000","last_became_active":"2024-09-11T23:56:57.353900+0000","last_became_peered":"2024-09-11T23:56:57.353900+0000","last_unstale":"2024-09-11T23:57:08.021927+0000","last_undegraded":"2024-09-11T23:57:08.021927+0000","last_fullsized":"2024-09-11T23:57:08.021927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:40.559310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.031853+0000","last_change":"2024-09-11T23:56:55.271043+0000","last_active":"2024-09-11T23:57:42.031853+0000","last_peered":"2024-09-11T23:57:42.031853+0000","last_clean":"2024-09-11T23:57:42.031853+0000","last_became_active":"2024-09-11T23:56:55.270748+0000","last_became_peered":"2024-09-11T23:56:55.270748+0000","last_unstale":"2024-09-11T23:57:42.031853+0000","last_undegraded":"2024-09-11T23:57:42.031853+0000","last_fullsized":"2024-09-11T23:57:42.031853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:08.776139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850437+0000","last_change":"2024-09-11T23:57:04.421448+0000","last_active":"2024-09-11T23:57:07.850437+0000","last_peered":"2024-09-11T23:57:07.850437+0000","last_clean":"2024-09-11T23:57:07.850437+0000","last_became_active":"2024-09-11T23:57:04.421000+0000","last_became_peered":"2024-09-11T23:57:04.421000+0000","last_unstale":"2024-09-11T23:57:07.850437+0000","last_undegraded":"2024-09-11T23:57:07.850437+0000","last_fullsized":"2024-09-11T23:57:07.850437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:23.342301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850482+0000","last_change":"2024-09-11T23:56:57.360104+0000","last_active":"2024-09-11T23:57:07.850482+0000","last_peered":"2024-09-11T23:57:07.850482+0000","last_clean":"2024-09-11T23:57:07.850482+0000","last_became_active":"2024-09-11T23:56:57.359773+0000","last_became_peered":"2024-09-11T23:56:57.359773+0000","last_unstale":"2024-09-11T23:57:07.850482+0000","last_undegraded":"2024-09-11T23:57:07.850482+0000","last_fullsized":"2024-09-11T23:57:07.850482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:05.566675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.067963+0000","last_change":"2024-09-11T23:56:55.594731+0000","last_active":"2024-09-11T23:57:42.067963+0000","last_peered":"2024-09-11T23:57:42.067963+0000","last_clean":"2024-09-11T23:57:42.067963+0000","last_became_active":"2024-09-11T23:56:55.594095+0000","last_became_peered":"2024-09-11T23:56:55.594095+0000","last_unstale":"2024-09-11T23:57:42.067963+0000","last_undegraded":"2024-09-11T23:57:42.067963+0000","last_fullsized":"2024-09-11T23:57:42.067963+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:44.847662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022757+0000","last_change":"2024-09-11T23:57:04.413252+0000","last_active":"2024-09-11T23:57:08.022757+0000","last_peered":"2024-09-11T23:57:08.022757+0000","last_clean":"2024-09-11T23:57:08.022757+0000","last_became_active":"2024-09-11T23:57:04.412887+0000","last_became_peered":"2024-09-11T23:57:04.412887+0000","last_unstale":"2024-09-11T23:57:08.022757+0000","last_undegraded":"2024-09-11T23:57:08.022757+0000","last_fullsized":"2024-09-11T23:57:08.022757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:38.778093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022084+0000","last_change":"2024-09-11T23:56:57.354309+0000","last_active":"2024-09-11T23:57:08.022084+0000","last_peered":"2024-09-11T23:57:08.022084+0000","last_clean":"2024-09-11T23:57:08.022084+0000","last_became_active":"2024-09-11T23:56:57.353987+0000","last_became_peered":"2024-09-11T23:56:57.353987+0000","last_unstale":"2024-09-11T23:57:08.022084+0000","last_undegraded":"2024-09-11T23:57:08.022084+0000","last_fullsized":"2024-09-11T23:57:08.022084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:02.248741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.098284+0000","last_change":"2024-09-11T23:56:55.271531+0000","last_active":"2024-09-11T23:57:52.098284+0000","last_peered":"2024-09-11T23:57:52.098284+0000","last_clean":"2024-09-11T23:57:52.098284+0000","last_became_active":"2024-09-11T23:56:55.271150+0000","last_became_peered":"2024-09-11T23:56:55.271150+0000","last_unstale":"2024-09-11T23:57:52.098284+0000","last_undegraded":"2024-09-11T23:57:52.098284+0000","last_fullsized":"2024-09-11T23:57:52.098284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:31.885885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021940+0000","last_change":"2024-09-11T23:57:04.415610+0000","last_active":"2024-09-11T23:57:08.021940+0000","last_peered":"2024-09-11T23:57:08.021940+0000","last_clean":"2024-09-11T23:57:08.021940+0000","last_became_active":"2024-09-11T23:57:04.415168+0000","last_became_peered":"2024-09-11T23:57:04.415168+0000","last_unstale":"2024-09-11T23:57:08.021940+0000","last_undegraded":"2024-09-11T23:57:08.021940+0000","last_fullsized":"2024-09-11T23:57:08.021940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:34.688002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022194+0000","last_change":"2024-09-11T23:56:57.359960+0000","last_active":"2024-09-11T23:57:08.022194+0000","last_peered":"2024-09-11T23:57:08.022194+0000","last_clean":"2024-09-11T23:57:08.022194+0000","last_became_active":"2024-09-11T23:56:57.359417+0000","last_became_peered":"2024-09-11T23:56:57.359417+0000","last_unstale":"2024-09-11T23:57:08.022194+0000","last_undegraded":"2024-09-11T23:57:08.022194+0000","last_fullsized":"2024-09-11T23:57:08.022194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:18.741920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.067514+0000","last_change":"2024-09-11T23:56:55.272561+0000","last_active":"2024-09-11T23:57:42.067514+0000","last_peered":"2024-09-11T23:57:42.067514+0000","last_clean":"2024-09-11T23:57:42.067514+0000","last_became_active":"2024-09-11T23:56:55.272221+0000","last_became_peered":"2024-09-11T23:56:55.272221+0000","last_unstale":"2024-09-11T23:57:42.067514+0000","last_undegraded":"2024-09-11T23:57:42.067514+0000","last_fullsized":"2024-09-11T23:57:42.067514+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:22.151044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021664+0000","last_change":"2024-09-11T23:57:04.417299+0000","last_active":"2024-09-11T23:57:08.021664+0000","last_peered":"2024-09-11T23:57:08.021664+0000","last_clean":"2024-09-11T23:57:08.021664+0000","last_became_active":"2024-09-11T23:57:04.416864+0000","last_became_peered":"2024-09-11T23:57:04.416864+0000","last_unstale":"2024-09-11T23:57:08.021664+0000","last_undegraded":"2024-09-11T23:57:08.021664+0000","last_fullsized":"2024-09-11T23:57:08.021664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:12.582094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022002+0000","last_change":"2024-09-11T23:56:57.352008+0000","last_active":"2024-09-11T23:57:08.022002+0000","last_peered":"2024-09-11T23:57:08.022002+0000","last_clean":"2024-09-11T23:57:08.022002+0000","last_became_active":"2024-09-11T23:56:57.351708+0000","last_became_peered":"2024-09-11T23:56:57.351708+0000","last_unstale":"2024-09-11T23:57:08.022002+0000","last_undegraded":"2024-09-11T23:57:08.022002+0000","last_fullsized":"2024-09-11T23:57:08.022002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:50.908059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:43.080418+0000","last_change":"2024-09-11T23:56:55.275755+0000","last_active":"2024-09-11T23:57:43.080418+0000","last_peered":"2024-09-11T23:57:43.080418+0000","last_clean":"2024-09-11T23:57:43.080418+0000","last_became_active":"2024-09-11T23:56:55.275247+0000","last_became_peered":"2024-09-11T23:56:55.275247+0000","last_unstale":"2024-09-11T23:57:43.080418+0000","last_undegraded":"2024-09-11T23:57:43.080418+0000","last_fullsized":"2024-09-11T23:57:43.080418+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:43.698490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850912+0000","last_change":"2024-09-11T23:57:04.412237+0000","last_active":"2024-09-11T23:57:07.850912+0000","last_peered":"2024-09-11T23:57:07.850912+0000","last_clean":"2024-09-11T23:57:07.850912+0000","last_became_active":"2024-09-11T23:57:04.411799+0000","last_became_peered":"2024-09-11T23:57:04.411799+0000","last_unstale":"2024-09-11T23:57:07.850912+0000","last_undegraded":"2024-09-11T23:57:07.850912+0000","last_fullsized":"2024-09-11T23:57:07.850912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:19.311875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.519332+0000","last_change":"2024-09-11T23:56:57.357667+0000","last_active":"2024-09-11T23:57:08.519332+0000","last_peered":"2024-09-11T23:57:08.519332+0000","last_clean":"2024-09-11T23:57:08.519332+0000","last_became_active":"2024-09-11T23:56:57.356796+0000","last_became_peered":"2024-09-11T23:56:57.356796+0000","last_unstale":"2024-09-11T23:57:08.519332+0000","last_undegraded":"2024-09-11T23:57:08.519332+0000","last_fullsized":"2024-09-11T23:57:08.519332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:46.220102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":93,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:55.104771+0000","last_change":"2024-09-11T23:56:55.276168+0000","last_active":"2024-09-11T23:57:55.104771+0000","last_peered":"2024-09-11T23:57:55.104771+0000","last_clean":"2024-09-11T23:57:55.104771+0000","last_became_active":"2024-09-11T23:56:55.275719+0000","last_became_peered":"2024-09-11T23:56:55.275719+0000","last_unstale":"2024-09-11T23:57:55.104771+0000","last_undegraded":"2024-09-11T23:57:55.104771+0000","last_fullsized":"2024-09-11T23:57:55.104771+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:28.846711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52413,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":67,"num_write":33,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023053+0000","last_change":"2024-09-11T23:57:04.412804+0000","last_active":"2024-09-11T23:57:08.023053+0000","last_peered":"2024-09-11T23:57:08.023053+0000","last_clean":"2024-09-11T23:57:08.023053+0000","last_became_active":"2024-09-11T23:57:04.412366+0000","last_became_peered":"2024-09-11T23:57:04.412366+0000","last_unstale":"2024-09-11T23:57:08.023053+0000","last_undegraded":"2024-09-11T23:57:08.023053+0000","last_fullsized":"2024-09-11T23:57:08.023053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.924598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022488+0000","last_change":"2024-09-11T23:56:57.357530+0000","last_active":"2024-09-11T23:57:08.022488+0000","last_peered":"2024-09-11T23:57:08.022488+0000","last_clean":"2024-09-11T23:57:08.022488+0000","last_became_active":"2024-09-11T23:56:57.356306+0000","last_became_peered":"2024-09-11T23:56:57.356306+0000","last_unstale":"2024-09-11T23:57:08.022488+0000","last_undegraded":"2024-09-11T23:57:08.022488+0000","last_fullsized":"2024-09-11T23:57:08.022488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:10.919120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.052799+0000","last_change":"2024-09-11T23:56:55.594653+0000","last_active":"2024-09-11T23:57:41.052799+0000","last_peered":"2024-09-11T23:57:41.052799+0000","last_clean":"2024-09-11T23:57:41.052799+0000","last_became_active":"2024-09-11T23:56:55.594219+0000","last_became_peered":"2024-09-11T23:56:55.594219+0000","last_unstale":"2024-09-11T23:57:41.052799+0000","last_undegraded":"2024-09-11T23:57:41.052799+0000","last_fullsized":"2024-09-11T23:57:41.052799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:54.361656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.858439+0000","last_change":"2024-09-11T23:57:04.422049+0000","last_active":"2024-09-11T23:57:07.858439+0000","last_peered":"2024-09-11T23:57:07.858439+0000","last_clean":"2024-09-11T23:57:07.858439+0000","last_became_active":"2024-09-11T23:57:04.420845+0000","last_became_peered":"2024-09-11T23:57:04.420845+0000","last_unstale":"2024-09-11T23:57:07.858439+0000","last_undegraded":"2024-09-11T23:57:07.858439+0000","last_fullsized":"2024-09-11T23:57:07.858439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:49.854740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022547+0000","last_change":"2024-09-11T23:56:57.362523+0000","last_active":"2024-09-11T23:57:08.022547+0000","last_peered":"2024-09-11T23:57:08.022547+0000","last_clean":"2024-09-11T23:57:08.022547+0000","last_became_active":"2024-09-11T23:56:57.361361+0000","last_became_peered":"2024-09-11T23:56:57.361361+0000","last_unstale":"2024-09-11T23:57:08.022547+0000","last_undegraded":"2024-09-11T23:57:08.022547+0000","last_fullsized":"2024-09-11T23:57:08.022547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:57.341557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.068208+0000","last_change":"2024-09-11T23:56:55.278291+0000","last_active":"2024-09-11T23:57:42.068208+0000","last_peered":"2024-09-11T23:57:42.068208+0000","last_clean":"2024-09-11T23:57:42.068208+0000","last_became_active":"2024-09-11T23:56:55.277910+0000","last_became_peered":"2024-09-11T23:56:55.277910+0000","last_unstale":"2024-09-11T23:57:42.068208+0000","last_undegraded":"2024-09-11T23:57:42.068208+0000","last_fullsized":"2024-09-11T23:57:42.068208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:31.602177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021304+0000","last_change":"2024-09-11T23:57:04.419006+0000","last_active":"2024-09-11T23:57:08.021304+0000","last_peered":"2024-09-11T23:57:08.021304+0000","last_clean":"2024-09-11T23:57:08.021304+0000","last_became_active":"2024-09-11T23:57:04.418638+0000","last_became_peered":"2024-09-11T23:57:04.418638+0000","last_unstale":"2024-09-11T23:57:08.021304+0000","last_undegraded":"2024-09-11T23:57:08.021304+0000","last_fullsized":"2024-09-11T23:57:08.021304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:22.458414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023017+0000","last_change":"2024-09-11T23:56:57.354481+0000","last_active":"2024-09-11T23:57:08.023017+0000","last_peered":"2024-09-11T23:57:08.023017+0000","last_clean":"2024-09-11T23:57:08.023017+0000","last_became_active":"2024-09-11T23:56:57.354158+0000","last_became_peered":"2024-09-11T23:56:57.354158+0000","last_unstale":"2024-09-11T23:57:08.023017+0000","last_undegraded":"2024-09-11T23:57:08.023017+0000","last_fullsized":"2024-09-11T23:57:08.023017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:58.372231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":59,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:55.100312+0000","last_change":"2024-09-11T23:56:55.275767+0000","last_active":"2024-09-11T23:57:55.100312+0000","last_peered":"2024-09-11T23:57:55.100312+0000","last_clean":"2024-09-11T23:57:55.100312+0000","last_became_active":"2024-09-11T23:56:55.275284+0000","last_became_peered":"2024-09-11T23:56:55.275284+0000","last_unstale":"2024-09-11T23:57:55.100312+0000","last_undegraded":"2024-09-11T23:57:55.100312+0000","last_fullsized":"2024-09-11T23:57:55.100312+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:32.278786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.849875+0000","last_change":"2024-09-11T23:57:04.421329+0000","last_active":"2024-09-11T23:57:07.849875+0000","last_peered":"2024-09-11T23:57:07.849875+0000","last_clean":"2024-09-11T23:57:07.849875+0000","last_became_active":"2024-09-11T23:57:04.420982+0000","last_became_peered":"2024-09-11T23:57:04.420982+0000","last_unstale":"2024-09-11T23:57:07.849875+0000","last_undegraded":"2024-09-11T23:57:07.849875+0000","last_fullsized":"2024-09-11T23:57:07.849875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.580115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021666+0000","last_change":"2024-09-11T23:57:04.419497+0000","last_active":"2024-09-11T23:57:08.021666+0000","last_peered":"2024-09-11T23:57:08.021666+0000","last_clean":"2024-09-11T23:57:08.021666+0000","last_became_active":"2024-09-11T23:57:04.418877+0000","last_became_peered":"2024-09-11T23:57:04.418877+0000","last_unstale":"2024-09-11T23:57:08.021666+0000","last_undegraded":"2024-09-11T23:57:08.021666+0000","last_fullsized":"2024-09-11T23:57:08.021666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:30.895439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021625+0000","last_change":"2024-09-11T23:56:57.354086+0000","last_active":"2024-09-11T23:57:08.021625+0000","last_peered":"2024-09-11T23:57:08.021625+0000","last_clean":"2024-09-11T23:57:08.021625+0000","last_became_active":"2024-09-11T23:56:57.353733+0000","last_became_peered":"2024-09-11T23:56:57.353733+0000","last_unstale":"2024-09-11T23:57:08.021625+0000","last_undegraded":"2024-09-11T23:57:08.021625+0000","last_fullsized":"2024-09-11T23:57:08.021625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:55.169463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.068820+0000","last_change":"2024-09-11T23:56:55.275441+0000","last_active":"2024-09-11T23:57:42.068820+0000","last_peered":"2024-09-11T23:57:42.068820+0000","last_clean":"2024-09-11T23:57:42.068820+0000","last_became_active":"2024-09-11T23:56:55.275109+0000","last_became_peered":"2024-09-11T23:56:55.275109+0000","last_unstale":"2024-09-11T23:57:42.068820+0000","last_undegraded":"2024-09-11T23:57:42.068820+0000","last_fullsized":"2024-09-11T23:57:42.068820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:47.462579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021888+0000","last_change":"2024-09-11T23:57:04.419592+0000","last_active":"2024-09-11T23:57:08.021888+0000","last_peered":"2024-09-11T23:57:08.021888+0000","last_clean":"2024-09-11T23:57:08.021888+0000","last_became_active":"2024-09-11T23:57:04.419124+0000","last_became_peered":"2024-09-11T23:57:04.419124+0000","last_unstale":"2024-09-11T23:57:08.021888+0000","last_undegraded":"2024-09-11T23:57:08.021888+0000","last_fullsized":"2024-09-11T23:57:08.021888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:19.129975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.849777+0000","last_change":"2024-09-11T23:56:57.350413+0000","last_active":"2024-09-11T23:57:07.849777+0000","last_peered":"2024-09-11T23:57:07.849777+0000","last_clean":"2024-09-11T23:57:07.849777+0000","last_became_active":"2024-09-11T23:56:57.350094+0000","last_became_peered":"2024-09-11T23:56:57.350094+0000","last_unstale":"2024-09-11T23:57:07.849777+0000","last_undegraded":"2024-09-11T23:57:07.849777+0000","last_fullsized":"2024-09-11T23:57:07.849777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:30.806452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.036409+0000","last_change":"2024-09-11T23:56:55.265370+0000","last_active":"2024-09-11T23:57:40.036409+0000","last_peered":"2024-09-11T23:57:40.036409+0000","last_clean":"2024-09-11T23:57:40.036409+0000","last_became_active":"2024-09-11T23:56:55.265025+0000","last_became_peered":"2024-09-11T23:56:55.265025+0000","last_unstale":"2024-09-11T23:57:40.036409+0000","last_undegraded":"2024-09-11T23:57:40.036409+0000","last_fullsized":"2024-09-11T23:57:40.036409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.583397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.051995+0000","last_change":"2024-09-11T23:56:55.276989+0000","last_active":"2024-09-11T23:57:41.051995+0000","last_peered":"2024-09-11T23:57:41.051995+0000","last_clean":"2024-09-11T23:57:41.051995+0000","last_became_active":"2024-09-11T23:56:55.276612+0000","last_became_peered":"2024-09-11T23:56:55.276612+0000","last_unstale":"2024-09-11T23:57:41.051995+0000","last_undegraded":"2024-09-11T23:57:41.051995+0000","last_fullsized":"2024-09-11T23:57:41.051995+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:28.708643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850830+0000","last_change":"2024-09-11T23:56:57.355005+0000","last_active":"2024-09-11T23:57:07.850830+0000","last_peered":"2024-09-11T23:57:07.850830+0000","last_clean":"2024-09-11T23:57:07.850830+0000","last_became_active":"2024-09-11T23:56:57.354690+0000","last_became_peered":"2024-09-11T23:56:57.354690+0000","last_unstale":"2024-09-11T23:57:07.850830+0000","last_undegraded":"2024-09-11T23:57:07.850830+0000","last_fullsized":"2024-09-11T23:57:07.850830+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:49.058770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022418+0000","last_change":"2024-09-11T23:57:04.415317+0000","last_active":"2024-09-11T23:57:08.022418+0000","last_peered":"2024-09-11T23:57:08.022418+0000","last_clean":"2024-09-11T23:57:08.022418+0000","last_became_active":"2024-09-11T23:57:04.413239+0000","last_became_peered":"2024-09-11T23:57:04.413239+0000","last_unstale":"2024-09-11T23:57:08.022418+0000","last_undegraded":"2024-09-11T23:57:08.022418+0000","last_fullsized":"2024-09-11T23:57:08.022418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:19.266871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:51.095329+0000","last_change":"2024-09-11T23:56:55.274372+0000","last_active":"2024-09-11T23:57:51.095329+0000","last_peered":"2024-09-11T23:57:51.095329+0000","last_clean":"2024-09-11T23:57:51.095329+0000","last_became_active":"2024-09-11T23:56:55.273984+0000","last_became_peered":"2024-09-11T23:56:55.273984+0000","last_unstale":"2024-09-11T23:57:51.095329+0000","last_undegraded":"2024-09-11T23:57:51.095329+0000","last_fullsized":"2024-09-11T23:57:51.095329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:15.853467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.519059+0000","last_change":"2024-09-11T23:56:57.344571+0000","last_active":"2024-09-11T23:57:08.519059+0000","last_peered":"2024-09-11T23:57:08.519059+0000","last_clean":"2024-09-11T23:57:08.519059+0000","last_became_active":"2024-09-11T23:56:57.344228+0000","last_became_peered":"2024-09-11T23:56:57.344228+0000","last_unstale":"2024-09-11T23:57:08.519059+0000","last_undegraded":"2024-09-11T23:57:08.519059+0000","last_fullsized":"2024-09-11T23:57:08.519059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:32.712464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022771+0000","last_change":"2024-09-11T23:57:04.418807+0000","last_active":"2024-09-11T23:57:08.022771+0000","last_peered":"2024-09-11T23:57:08.022771+0000","last_clean":"2024-09-11T23:57:08.022771+0000","last_became_active":"2024-09-11T23:57:04.418303+0000","last_became_peered":"2024-09-11T23:57:04.418303+0000","last_unstale":"2024-09-11T23:57:08.022771+0000","last_undegraded":"2024-09-11T23:57:08.022771+0000","last_fullsized":"2024-09-11T23:57:08.022771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:29.722073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021658+0000","last_change":"2024-09-11T23:56:57.351734+0000","last_active":"2024-09-11T23:57:08.021658+0000","last_peered":"2024-09-11T23:57:08.021658+0000","last_clean":"2024-09-11T23:57:08.021658+0000","last_became_active":"2024-09-11T23:56:57.351386+0000","last_became_peered":"2024-09-11T23:56:57.351386+0000","last_unstale":"2024-09-11T23:57:08.021658+0000","last_undegraded":"2024-09-11T23:57:08.021658+0000","last_fullsized":"2024-09-11T23:57:08.021658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.091137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022413+0000","last_change":"2024-09-11T23:56:57.354720+0000","last_active":"2024-09-11T23:57:08.022413+0000","last_peered":"2024-09-11T23:57:08.022413+0000","last_clean":"2024-09-11T23:57:08.022413+0000","last_became_active":"2024-09-11T23:56:57.353815+0000","last_became_peered":"2024-09-11T23:56:57.353815+0000","last_unstale":"2024-09-11T23:57:08.022413+0000","last_undegraded":"2024-09-11T23:57:08.022413+0000","last_fullsized":"2024-09-11T23:57:08.022413+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:30.516912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022267+0000","last_change":"2024-09-11T23:56:57.359290+0000","last_active":"2024-09-11T23:57:08.022267+0000","last_peered":"2024-09-11T23:57:08.022267+0000","last_clean":"2024-09-11T23:57:08.022267+0000","last_became_active":"2024-09-11T23:56:57.358953+0000","last_became_peered":"2024-09-11T23:56:57.358953+0000","last_unstale":"2024-09-11T23:57:08.022267+0000","last_undegraded":"2024-09-11T23:57:08.022267+0000","last_fullsized":"2024-09-11T23:57:08.022267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:24.894051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022253+0000","last_change":"2024-09-11T23:56:57.363571+0000","last_active":"2024-09-11T23:57:08.022253+0000","last_peered":"2024-09-11T23:57:08.022253+0000","last_clean":"2024-09-11T23:57:08.022253+0000","last_became_active":"2024-09-11T23:56:57.361844+0000","last_became_peered":"2024-09-11T23:56:57.361844+0000","last_unstale":"2024-09-11T23:57:08.022253+0000","last_undegraded":"2024-09-11T23:57:08.022253+0000","last_fullsized":"2024-09-11T23:57:08.022253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:22.693387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022730+0000","last_change":"2024-09-11T23:56:57.359850+0000","last_active":"2024-09-11T23:57:08.022730+0000","last_peered":"2024-09-11T23:57:08.022730+0000","last_clean":"2024-09-11T23:57:08.022730+0000","last_became_active":"2024-09-11T23:56:57.359560+0000","last_became_peered":"2024-09-11T23:56:57.359560+0000","last_unstale":"2024-09-11T23:57:08.022730+0000","last_undegraded":"2024-09-11T23:57:08.022730+0000","last_fullsized":"2024-09-11T23:57:08.022730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:33.015625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022300+0000","last_change":"2024-09-11T23:56:57.352870+0000","last_active":"2024-09-11T23:57:08.022300+0000","last_peered":"2024-09-11T23:57:08.022300+0000","last_clean":"2024-09-11T23:57:08.022300+0000","last_became_active":"2024-09-11T23:56:57.351427+0000","last_became_peered":"2024-09-11T23:56:57.351427+0000","last_unstale":"2024-09-11T23:57:08.022300+0000","last_undegraded":"2024-09-11T23:57:08.022300+0000","last_fullsized":"2024-09-11T23:57:08.022300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:11.895482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022810+0000","last_change":"2024-09-11T23:56:57.349609+0000","last_active":"2024-09-11T23:57:08.022810+0000","last_peered":"2024-09-11T23:57:08.022810+0000","last_clean":"2024-09-11T23:57:08.022810+0000","last_became_active":"2024-09-11T23:56:57.349307+0000","last_became_peered":"2024-09-11T23:56:57.349307+0000","last_unstale":"2024-09-11T23:57:08.022810+0000","last_undegraded":"2024-09-11T23:57:08.022810+0000","last_fullsized":"2024-09-11T23:57:08.022810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:49.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850450+0000","last_change":"2024-09-11T23:56:57.357093+0000","last_active":"2024-09-11T23:57:07.850450+0000","last_peered":"2024-09-11T23:57:07.850450+0000","last_clean":"2024-09-11T23:57:07.850450+0000","last_became_active":"2024-09-11T23:56:57.356313+0000","last_became_peered":"2024-09-11T23:56:57.356313+0000","last_unstale":"2024-09-11T23:57:07.850450+0000","last_undegraded":"2024-09-11T23:57:07.850450+0000","last_fullsized":"2024-09-11T23:57:07.850450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:00.861920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850385+0000","last_change":"2024-09-11T23:56:57.345499+0000","last_active":"2024-09-11T23:57:07.850385+0000","last_peered":"2024-09-11T23:57:07.850385+0000","last_clean":"2024-09-11T23:57:07.850385+0000","last_became_active":"2024-09-11T23:56:57.345186+0000","last_became_peered":"2024-09-11T23:56:57.345186+0000","last_unstale":"2024-09-11T23:57:07.850385+0000","last_undegraded":"2024-09-11T23:57:07.850385+0000","last_fullsized":"2024-09-11T23:57:07.850385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:27.680578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.849829+0000","last_change":"2024-09-11T23:56:57.351242+0000","last_active":"2024-09-11T23:57:07.849829+0000","last_peered":"2024-09-11T23:57:07.849829+0000","last_clean":"2024-09-11T23:57:07.849829+0000","last_became_active":"2024-09-11T23:56:57.350948+0000","last_became_peered":"2024-09-11T23:56:57.350948+0000","last_unstale":"2024-09-11T23:57:07.849829+0000","last_undegraded":"2024-09-11T23:57:07.849829+0000","last_fullsized":"2024-09-11T23:57:07.849829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:29.979795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022503+0000","last_change":"2024-09-11T23:56:57.355967+0000","last_active":"2024-09-11T23:57:08.022503+0000","last_peered":"2024-09-11T23:57:08.022503+0000","last_clean":"2024-09-11T23:57:08.022503+0000","last_became_active":"2024-09-11T23:56:57.355437+0000","last_became_peered":"2024-09-11T23:56:57.355437+0000","last_unstale":"2024-09-11T23:57:08.022503+0000","last_undegraded":"2024-09-11T23:57:08.022503+0000","last_fullsized":"2024-09-11T23:57:08.022503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:19.701339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022155+0000","last_change":"2024-09-11T23:56:57.361097+0000","last_active":"2024-09-11T23:57:08.022155+0000","last_peered":"2024-09-11T23:57:08.022155+0000","last_clean":"2024-09-11T23:57:08.022155+0000","last_became_active":"2024-09-11T23:56:57.360700+0000","last_became_peered":"2024-09-11T23:56:57.360700+0000","last_unstale":"2024-09-11T23:57:08.022155+0000","last_undegraded":"2024-09-11T23:57:08.022155+0000","last_fullsized":"2024-09-11T23:57:08.022155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:39.006911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021759+0000","last_change":"2024-09-11T23:56:57.356233+0000","last_active":"2024-09-11T23:57:08.021759+0000","last_peered":"2024-09-11T23:57:08.021759+0000","last_clean":"2024-09-11T23:57:08.021759+0000","last_became_active":"2024-09-11T23:56:57.354705+0000","last_became_peered":"2024-09-11T23:56:57.354705+0000","last_unstale":"2024-09-11T23:57:08.021759+0000","last_undegraded":"2024-09-11T23:57:08.021759+0000","last_fullsized":"2024-09-11T23:57:08.021759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:35.039827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022635+0000","last_change":"2024-09-11T23:56:57.357881+0000","last_active":"2024-09-11T23:57:08.022635+0000","last_peered":"2024-09-11T23:57:08.022635+0000","last_clean":"2024-09-11T23:57:08.022635+0000","last_became_active":"2024-09-11T23:56:57.357486+0000","last_became_peered":"2024-09-11T23:56:57.357486+0000","last_unstale":"2024-09-11T23:57:08.022635+0000","last_undegraded":"2024-09-11T23:57:08.022635+0000","last_fullsized":"2024-09-11T23:57:08.022635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:24.049072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023138+0000","last_change":"2024-09-11T23:56:57.355307+0000","last_active":"2024-09-11T23:57:08.023138+0000","last_peered":"2024-09-11T23:57:08.023138+0000","last_clean":"2024-09-11T23:57:08.023138+0000","last_became_active":"2024-09-11T23:56:57.354957+0000","last_became_peered":"2024-09-11T23:56:57.354957+0000","last_unstale":"2024-09-11T23:57:08.023138+0000","last_undegraded":"2024-09-11T23:57:08.023138+0000","last_fullsized":"2024-09-11T23:57:08.023138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:00.217654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022452+0000","last_change":"2024-09-11T23:56:57.361516+0000","last_active":"2024-09-11T23:57:08.022452+0000","last_peered":"2024-09-11T23:57:08.022452+0000","last_clean":"2024-09-11T23:57:08.022452+0000","last_became_active":"2024-09-11T23:56:57.361112+0000","last_became_peered":"2024-09-11T23:56:57.361112+0000","last_unstale":"2024-09-11T23:57:08.022452+0000","last_undegraded":"2024-09-11T23:57:08.022452+0000","last_fullsized":"2024-09-11T23:57:08.022452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:48.861534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023471+0000","last_change":"2024-09-11T23:56:57.357251+0000","last_active":"2024-09-11T23:57:08.023471+0000","last_peered":"2024-09-11T23:57:08.023471+0000","last_clean":"2024-09-11T23:57:08.023471+0000","last_became_active":"2024-09-11T23:56:57.356932+0000","last_became_peered":"2024-09-11T23:56:57.356932+0000","last_unstale":"2024-09-11T23:57:08.023471+0000","last_undegraded":"2024-09-11T23:57:08.023471+0000","last_fullsized":"2024-09-11T23:57:08.023471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:10.650294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021546+0000","last_change":"2024-09-11T23:56:57.360671+0000","last_active":"2024-09-11T23:57:08.021546+0000","last_peered":"2024-09-11T23:57:08.021546+0000","last_clean":"2024-09-11T23:57:08.021546+0000","last_became_active":"2024-09-11T23:56:57.360351+0000","last_became_peered":"2024-09-11T23:56:57.360351+0000","last_unstale":"2024-09-11T23:57:08.021546+0000","last_undegraded":"2024-09-11T23:57:08.021546+0000","last_fullsized":"2024-09-11T23:57:08.021546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:18.895549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021789+0000","last_change":"2024-09-11T23:56:57.363379+0000","last_active":"2024-09-11T23:57:08.021789+0000","last_peered":"2024-09-11T23:57:08.021789+0000","last_clean":"2024-09-11T23:57:08.021789+0000","last_became_active":"2024-09-11T23:56:57.362652+0000","last_became_peered":"2024-09-11T23:56:57.362652+0000","last_unstale":"2024-09-11T23:57:08.021789+0000","last_undegraded":"2024-09-11T23:57:08.021789+0000","last_fullsized":"2024-09-11T23:57:08.021789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:16.298532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022059+0000","last_change":"2024-09-11T23:56:57.347580+0000","last_active":"2024-09-11T23:57:08.022059+0000","last_peered":"2024-09-11T23:57:08.022059+0000","last_clean":"2024-09-11T23:57:08.022059+0000","last_became_active":"2024-09-11T23:56:57.347276+0000","last_became_peered":"2024-09-11T23:56:57.347276+0000","last_unstale":"2024-09-11T23:57:08.022059+0000","last_undegraded":"2024-09-11T23:57:08.022059+0000","last_fullsized":"2024-09-11T23:57:08.022059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:14.543167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.857895+0000","last_change":"2024-09-11T23:56:57.352544+0000","last_active":"2024-09-11T23:57:07.857895+0000","last_peered":"2024-09-11T23:57:07.857895+0000","last_clean":"2024-09-11T23:57:07.857895+0000","last_became_active":"2024-09-11T23:56:57.351672+0000","last_became_peered":"2024-09-11T23:56:57.351672+0000","last_unstale":"2024-09-11T23:57:07.857895+0000","last_undegraded":"2024-09-11T23:57:07.857895+0000","last_fullsized":"2024-09-11T23:57:07.857895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.097494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023360+0000","last_change":"2024-09-11T23:56:57.360698+0000","last_active":"2024-09-11T23:57:08.023360+0000","last_peered":"2024-09-11T23:57:08.023360+0000","last_clean":"2024-09-11T23:57:08.023360+0000","last_became_active":"2024-09-11T23:56:57.360257+0000","last_became_peered":"2024-09-11T23:56:57.360257+0000","last_unstale":"2024-09-11T23:57:08.023360+0000","last_undegraded":"2024-09-11T23:57:08.023360+0000","last_fullsized":"2024-09-11T23:57:08.023360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:23.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023335+0000","last_change":"2024-09-11T23:56:57.354301+0000","last_active":"2024-09-11T23:57:08.023335+0000","last_peered":"2024-09-11T23:57:08.023335+0000","last_clean":"2024-09-11T23:57:08.023335+0000","last_became_active":"2024-09-11T23:56:57.353936+0000","last_became_peered":"2024-09-11T23:56:57.353936+0000","last_unstale":"2024-09-11T23:57:08.023335+0000","last_undegraded":"2024-09-11T23:57:08.023335+0000","last_fullsized":"2024-09-11T23:57:08.023335+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:05.420546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023255+0000","last_change":"2024-09-11T23:56:57.352615+0000","last_active":"2024-09-11T23:57:08.023255+0000","last_peered":"2024-09-11T23:57:08.023255+0000","last_clean":"2024-09-11T23:57:08.023255+0000","last_became_active":"2024-09-11T23:56:57.352249+0000","last_became_peered":"2024-09-11T23:56:57.352249+0000","last_unstale":"2024-09-11T23:57:08.023255+0000","last_undegraded":"2024-09-11T23:57:08.023255+0000","last_fullsized":"2024-09-11T23:57:08.023255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:18.477555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.849742+0000","last_change":"2024-09-11T23:56:57.346309+0000","last_active":"2024-09-11T23:57:07.849742+0000","last_peered":"2024-09-11T23:57:07.849742+0000","last_clean":"2024-09-11T23:57:07.849742+0000","last_became_active":"2024-09-11T23:56:57.345943+0000","last_became_peered":"2024-09-11T23:56:57.345943+0000","last_unstale":"2024-09-11T23:57:07.849742+0000","last_undegraded":"2024-09-11T23:57:07.849742+0000","last_fullsized":"2024-09-11T23:57:07.849742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:20.142093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023065+0000","last_change":"2024-09-11T23:56:57.359749+0000","last_active":"2024-09-11T23:57:08.023065+0000","last_peered":"2024-09-11T23:57:08.023065+0000","last_clean":"2024-09-11T23:57:08.023065+0000","last_became_active":"2024-09-11T23:56:57.359343+0000","last_became_peered":"2024-09-11T23:56:57.359343+0000","last_unstale":"2024-09-11T23:57:08.023065+0000","last_undegraded":"2024-09-11T23:57:08.023065+0000","last_fullsized":"2024-09-11T23:57:08.023065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:59.132011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022298+0000","last_change":"2024-09-11T23:56:57.351843+0000","last_active":"2024-09-11T23:57:08.022298+0000","last_peered":"2024-09-11T23:57:08.022298+0000","last_clean":"2024-09-11T23:57:08.022298+0000","last_became_active":"2024-09-11T23:56:57.351501+0000","last_became_peered":"2024-09-11T23:56:57.351501+0000","last_unstale":"2024-09-11T23:57:08.022298+0000","last_undegraded":"2024-09-11T23:57:08.022298+0000","last_fullsized":"2024-09-11T23:57:08.022298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:51.612821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.519039+0000","last_change":"2024-09-11T23:56:57.344691+0000","last_active":"2024-09-11T23:57:08.519039+0000","last_peered":"2024-09-11T23:57:08.519039+0000","last_clean":"2024-09-11T23:57:08.519039+0000","last_became_active":"2024-09-11T23:56:57.344358+0000","last_became_peered":"2024-09-11T23:56:57.344358+0000","last_unstale":"2024-09-11T23:57:08.519039+0000","last_undegraded":"2024-09-11T23:57:08.519039+0000","last_fullsized":"2024-09-11T23:57:08.519039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:22.014079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.857828+0000","last_change":"2024-09-11T23:56:57.352838+0000","last_active":"2024-09-11T23:57:07.857828+0000","last_peered":"2024-09-11T23:57:07.857828+0000","last_clean":"2024-09-11T23:57:07.857828+0000","last_became_active":"2024-09-11T23:56:57.352043+0000","last_became_peered":"2024-09-11T23:56:57.352043+0000","last_unstale":"2024-09-11T23:57:07.857828+0000","last_undegraded":"2024-09-11T23:57:07.857828+0000","last_fullsized":"2024-09-11T23:57:07.857828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:01.897496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021410+0000","last_change":"2024-09-11T23:56:57.363300+0000","last_active":"2024-09-11T23:57:08.021410+0000","last_peered":"2024-09-11T23:57:08.021410+0000","last_clean":"2024-09-11T23:57:08.021410+0000","last_became_active":"2024-09-11T23:56:57.363001+0000","last_became_peered":"2024-09-11T23:56:57.363001+0000","last_unstale":"2024-09-11T23:57:08.021410+0000","last_undegraded":"2024-09-11T23:57:08.021410+0000","last_fullsized":"2024-09-11T23:57:08.021410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:36.585495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021770+0000","last_change":"2024-09-11T23:56:57.359008+0000","last_active":"2024-09-11T23:57:08.021770+0000","last_peered":"2024-09-11T23:57:08.021770+0000","last_clean":"2024-09-11T23:57:08.021770+0000","last_became_active":"2024-09-11T23:56:57.358701+0000","last_became_peered":"2024-09-11T23:56:57.358701+0000","last_unstale":"2024-09-11T23:57:08.021770+0000","last_undegraded":"2024-09-11T23:57:08.021770+0000","last_fullsized":"2024-09-11T23:57:08.021770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:24.287725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022175+0000","last_change":"2024-09-11T23:56:57.361104+0000","last_active":"2024-09-11T23:57:08.022175+0000","last_peered":"2024-09-11T23:57:08.022175+0000","last_clean":"2024-09-11T23:57:08.022175+0000","last_became_active":"2024-09-11T23:56:57.360095+0000","last_became_peered":"2024-09-11T23:56:57.360095+0000","last_unstale":"2024-09-11T23:57:08.022175+0000","last_undegraded":"2024-09-11T23:57:08.022175+0000","last_fullsized":"2024-09-11T23:57:08.022175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:29.577779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59228,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":160,"num_read_kb":148,"num_write":241,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":168616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":253517,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579929,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":477102,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808861,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":1116331,"data_compressed":54370,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":481128,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201319,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":477410,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430252,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":1073909,"data_compressed":54370,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":472929,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822710,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":1069098,"data_compressed":54370,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":476610,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":472244,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":526199,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":517304,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":473992,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35046,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35046,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":45490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":54149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:57:57.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:57:58.091 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.577+0000 7f6fa5baa640 1 -- 172.21.15.6:0/1241229511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fa0106f10 msgr2=0x7f6fa010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.577+0000 7f6fa5baa640 1 --2- 172.21.15.6:0/1241229511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fa0106f10 0x7f6fa010ea90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009ca0 tx=0x7f6f9802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.577+0000 7f6fa5baa640 1 -- 172.21.15.6:0/1241229511 shutdown_connections 2024-09-11T23:57:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.577+0000 7f6fa5baa640 1 --2- 172.21.15.6:0/1241229511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fa0106f10 0x7f6fa010ea90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.577+0000 7f6fa5baa640 1 --2- 172.21.15.6:0/1241229511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa0102790 0x7f6fa01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.577+0000 7f6fa5baa640 1 --2- 172.21.15.6:0/1241229511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa0101de0 0x7f6fa01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.577+0000 7f6fa5baa640 1 -- 172.21.15.6:0/1241229511 >> 172.21.15.6:0/1241229511 conn(0x7f6fa00fd8c0 msgr2=0x7f6fa00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.577+0000 7f6fa5baa640 1 -- 172.21.15.6:0/1241229511 shutdown_connections 2024-09-11T23:57:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.577+0000 7f6fa5baa640 1 -- 172.21.15.6:0/1241229511 wait complete. 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.578+0000 7f6fa5baa640 1 Processor -- start 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.578+0000 7f6fa5baa640 1 -- start start 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.578+0000 7f6fa5baa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa0101de0 0x7f6fa0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.578+0000 7f6fa5baa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fa0102790 0x7f6fa0198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.578+0000 7f6fa5baa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa0106f10 0x7f6fa019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.578+0000 7f6fa5baa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0111e40 con 0x7f6fa0102790 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.578+0000 7f6fa5baa640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0111cc0 con 0x7f6fa0106f10 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.578+0000 7f6fa5baa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0111fc0 con 0x7f6fa0101de0 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.578+0000 7f6f9effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fa0102790 0x7f6fa0198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.578+0000 7f6f9effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fa0102790 0x7f6fa0198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49978/0 (socket says 172.21.15.6:49978) 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.578+0000 7f6f9effd640 1 -- 172.21.15.6:0/2240913386 learned_addr learned my addr 172.21.15.6:0/2240913386 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6f9f7fe640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa0101de0 0x7f6fa0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6f9ffff640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa0106f10 0x7f6fa019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6f9effd640 1 -- 172.21.15.6:0/2240913386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa0101de0 msgr2=0x7f6fa0198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6f9effd640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa0101de0 0x7f6fa0198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6f9effd640 1 -- 172.21.15.6:0/2240913386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa0106f10 msgr2=0x7f6fa019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6f9effd640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa0106f10 0x7f6fa019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6f9effd640 1 -- 172.21.15.6:0/2240913386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa019d3b0 con 0x7f6fa0102790 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6f9ffff640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa0106f10 0x7f6fa019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6f9effd640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fa0102790 0x7f6fa0198940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c890 tx=0x7f6f9400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6f9cff9640 1 -- 172.21.15.6:0/2240913386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94004220 con 0x7f6fa0102790 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6fa5baa640 1 -- 172.21.15.6:0/2240913386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa019d6a0 con 0x7f6fa0102790 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6f9cff9640 1 -- 172.21.15.6:0/2240913386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f940043c0 con 0x7f6fa0102790 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6f9cff9640 1 -- 172.21.15.6:0/2240913386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94004a00 con 0x7f6fa0102790 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.579+0000 7f6fa5baa640 1 -- 172.21.15.6:0/2240913386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa01a4f80 con 0x7f6fa0102790 2024-09-11T23:57:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.580+0000 7f6fa5baa640 1 -- 172.21.15.6:0/2240913386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa01021c0 con 0x7f6fa0102790 2024-09-11T23:57:58.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.581+0000 7f6f9cff9640 1 -- 172.21.15.6:0/2240913386 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6f94004ba0 con 0x7f6fa0102790 2024-09-11T23:57:58.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.582+0000 7f6f9cff9640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6f880a2c10 0x7f6f880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:58.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.582+0000 7f6f9f7fe640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6f880a2c10 0x7f6f880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:58.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.582+0000 7f6f9cff9640 1 -- 172.21.15.6:0/2240913386 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f6f940cf1e0 con 0x7f6fa0102790 2024-09-11T23:57:58.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.583+0000 7f6f9f7fe640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6f880a2c10 0x7f6f880a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009890 tx=0x7f6f90008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:58.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.586+0000 7f6f9cff9640 1 -- 172.21.15.6:0/2240913386 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f94014030 con 0x7f6fa0102790 2024-09-11T23:57:58.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.757+0000 7f6fa5baa640 1 -- 172.21.15.6:0/2240913386 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6fa0062630 con 0x7f6f880a2c10 2024-09-11T23:57:58.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.766+0000 7f6f9cff9640 1 -- 172.21.15.6:0/2240913386 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340637 (secure 0 0 0) 0x7f6fa0062630 con 0x7f6f880a2c10 2024-09-11T23:57:58.769 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:57:58.770 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-11T23:57:58.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.769+0000 7f6fa5baa640 1 -- 172.21.15.6:0/2240913386 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6f880a2c10 msgr2=0x7f6f880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.769+0000 7f6fa5baa640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6f880a2c10 0x7f6f880a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009890 tx=0x7f6f90008040 comp rx=0 tx=0).stop 2024-09-11T23:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.769+0000 7f6fa5baa640 1 -- 172.21.15.6:0/2240913386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fa0102790 msgr2=0x7f6fa0198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.769+0000 7f6fa5baa640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fa0102790 0x7f6fa0198940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c890 tx=0x7f6f9400cd50 comp rx=0 tx=0).stop 2024-09-11T23:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.770+0000 7f6fa5baa640 1 -- 172.21.15.6:0/2240913386 shutdown_connections 2024-09-11T23:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.770+0000 7f6fa5baa640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6f880a2c10 0x7f6f880a50d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.770+0000 7f6fa5baa640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa0106f10 0x7f6fa019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.770+0000 7f6fa5baa640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fa0102790 0x7f6fa0198940 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.770+0000 7f6fa5baa640 1 --2- 172.21.15.6:0/2240913386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa0101de0 0x7f6fa0198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.770+0000 7f6fa5baa640 1 -- 172.21.15.6:0/2240913386 >> 172.21.15.6:0/2240913386 conn(0x7f6fa00fd8c0 msgr2=0x7f6fa00fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.770+0000 7f6fa5baa640 1 -- 172.21.15.6:0/2240913386 shutdown_connections 2024-09-11T23:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:57:58.770+0000 7f6fa5baa640 1 -- 172.21.15.6:0/2240913386 wait complete. 2024-09-11T23:57:59.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:58 smithi006 ceph-mon[30947]: pgmap v314: 129 pgs: 129 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 16 op/s 2024-09-11T23:57:59.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:58 smithi006 ceph-mon[30947]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:57:59.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:58 smithi134 ceph-mon[34893]: pgmap v314: 129 pgs: 129 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 16 op/s 2024-09-11T23:57:59.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:58 smithi134 ceph-mon[34893]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:57:59.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:58 smithi039 ceph-mon[34543]: pgmap v314: 129 pgs: 129 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 16 op/s 2024-09-11T23:57:59.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:58 smithi039 ceph-mon[34543]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:57:59.537 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-09-11T23:57:56.944785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649830,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":286,"num_read_kb":257,"num_write":424,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360888,"kb_used_data":11640,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580936,"statfs":{"total":1151940427776,"available":1151570878464,"internally_reserved":0,"allocated":11919360,"data_stored":7634256,"data_compressed":322275,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49376,"num_objects":14,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":139,"num_read_kb":129,"num_write":64,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003516"},"pg_stats":[{"pgid":"2.1f","version":"86'13","reported_seq":56,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:54.099855+0000","last_change":"2024-09-11T23:56:55.272753+0000","last_active":"2024-09-11T23:57:54.099855+0000","last_peered":"2024-09-11T23:57:54.099855+0000","last_clean":"2024-09-11T23:57:54.099855+0000","last_became_active":"2024-09-11T23:56:55.272342+0000","last_became_peered":"2024-09-11T23:56:55.272342+0000","last_unstale":"2024-09-11T23:57:54.099855+0000","last_undegraded":"2024-09-11T23:57:54.099855+0000","last_fullsized":"2024-09-11T23:57:54.099855+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:43.856651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850076+0000","last_change":"2024-09-11T23:56:57.349492+0000","last_active":"2024-09-11T23:57:07.850076+0000","last_peered":"2024-09-11T23:57:07.850076+0000","last_clean":"2024-09-11T23:57:07.850076+0000","last_became_active":"2024-09-11T23:56:57.349098+0000","last_became_peered":"2024-09-11T23:56:57.349098+0000","last_unstale":"2024-09-11T23:57:07.850076+0000","last_undegraded":"2024-09-11T23:57:07.850076+0000","last_fullsized":"2024-09-11T23:57:07.850076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:06.520492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022092+0000","last_change":"2024-09-11T23:57:04.417135+0000","last_active":"2024-09-11T23:57:08.022092+0000","last_peered":"2024-09-11T23:57:08.022092+0000","last_clean":"2024-09-11T23:57:08.022092+0000","last_became_active":"2024-09-11T23:57:04.416697+0000","last_became_peered":"2024-09-11T23:57:04.416697+0000","last_unstale":"2024-09-11T23:57:08.022092+0000","last_undegraded":"2024-09-11T23:57:08.022092+0000","last_fullsized":"2024-09-11T23:57:08.022092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:48.794840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850542+0000","last_change":"2024-09-11T23:56:55.593961+0000","last_active":"2024-09-11T23:57:07.850542+0000","last_peered":"2024-09-11T23:57:07.850542+0000","last_clean":"2024-09-11T23:57:07.850542+0000","last_became_active":"2024-09-11T23:56:55.593624+0000","last_became_peered":"2024-09-11T23:56:55.593624+0000","last_unstale":"2024-09-11T23:57:07.850542+0000","last_undegraded":"2024-09-11T23:57:07.850542+0000","last_fullsized":"2024-09-11T23:57:07.850542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:32.510264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022450+0000","last_change":"2024-09-11T23:56:57.364450+0000","last_active":"2024-09-11T23:57:08.022450+0000","last_peered":"2024-09-11T23:57:08.022450+0000","last_clean":"2024-09-11T23:57:08.022450+0000","last_became_active":"2024-09-11T23:56:57.363583+0000","last_became_peered":"2024-09-11T23:56:57.363583+0000","last_unstale":"2024-09-11T23:57:08.022450+0000","last_undegraded":"2024-09-11T23:57:08.022450+0000","last_fullsized":"2024-09-11T23:57:08.022450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:31.761036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.857536+0000","last_change":"2024-09-11T23:57:04.419305+0000","last_active":"2024-09-11T23:57:07.857536+0000","last_peered":"2024-09-11T23:57:07.857536+0000","last_clean":"2024-09-11T23:57:07.857536+0000","last_became_active":"2024-09-11T23:57:04.418774+0000","last_became_peered":"2024-09-11T23:57:04.418774+0000","last_unstale":"2024-09-11T23:57:07.857536+0000","last_undegraded":"2024-09-11T23:57:07.857536+0000","last_fullsized":"2024-09-11T23:57:07.857536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.910125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:43.080286+0000","last_change":"2024-09-11T23:56:55.275373+0000","last_active":"2024-09-11T23:57:43.080286+0000","last_peered":"2024-09-11T23:57:43.080286+0000","last_clean":"2024-09-11T23:57:43.080286+0000","last_became_active":"2024-09-11T23:56:55.274400+0000","last_became_peered":"2024-09-11T23:56:55.274400+0000","last_unstale":"2024-09-11T23:57:43.080286+0000","last_undegraded":"2024-09-11T23:57:43.080286+0000","last_fullsized":"2024-09-11T23:57:43.080286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:41.019225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022376+0000","last_change":"2024-09-11T23:56:57.346037+0000","last_active":"2024-09-11T23:57:08.022376+0000","last_peered":"2024-09-11T23:57:08.022376+0000","last_clean":"2024-09-11T23:57:08.022376+0000","last_became_active":"2024-09-11T23:56:57.345712+0000","last_became_peered":"2024-09-11T23:56:57.345712+0000","last_unstale":"2024-09-11T23:57:08.022376+0000","last_undegraded":"2024-09-11T23:57:08.022376+0000","last_fullsized":"2024-09-11T23:57:08.022376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:20.643812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.858153+0000","last_change":"2024-09-11T23:57:04.424212+0000","last_active":"2024-09-11T23:57:07.858153+0000","last_peered":"2024-09-11T23:57:07.858153+0000","last_clean":"2024-09-11T23:57:07.858153+0000","last_became_active":"2024-09-11T23:57:04.423501+0000","last_became_peered":"2024-09-11T23:57:04.423501+0000","last_unstale":"2024-09-11T23:57:07.858153+0000","last_undegraded":"2024-09-11T23:57:07.858153+0000","last_fullsized":"2024-09-11T23:57:07.858153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:52.680484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.069163+0000","last_change":"2024-09-11T23:56:55.275919+0000","last_active":"2024-09-11T23:57:42.069163+0000","last_peered":"2024-09-11T23:57:42.069163+0000","last_clean":"2024-09-11T23:57:42.069163+0000","last_became_active":"2024-09-11T23:56:55.275326+0000","last_became_peered":"2024-09-11T23:56:55.275326+0000","last_unstale":"2024-09-11T23:57:42.069163+0000","last_undegraded":"2024-09-11T23:57:42.069163+0000","last_fullsized":"2024-09-11T23:57:42.069163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:47.201282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850923+0000","last_change":"2024-09-11T23:56:57.360200+0000","last_active":"2024-09-11T23:57:07.850923+0000","last_peered":"2024-09-11T23:57:07.850923+0000","last_clean":"2024-09-11T23:57:07.850923+0000","last_became_active":"2024-09-11T23:56:57.359868+0000","last_became_peered":"2024-09-11T23:56:57.359868+0000","last_unstale":"2024-09-11T23:57:07.850923+0000","last_undegraded":"2024-09-11T23:57:07.850923+0000","last_fullsized":"2024-09-11T23:57:07.850923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:57.321711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.857626+0000","last_change":"2024-09-11T23:57:04.419886+0000","last_active":"2024-09-11T23:57:07.857626+0000","last_peered":"2024-09-11T23:57:07.857626+0000","last_clean":"2024-09-11T23:57:07.857626+0000","last_became_active":"2024-09-11T23:57:04.419419+0000","last_became_peered":"2024-09-11T23:57:04.419419+0000","last_unstale":"2024-09-11T23:57:07.857626+0000","last_undegraded":"2024-09-11T23:57:07.857626+0000","last_fullsized":"2024-09-11T23:57:07.857626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.768235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022759+0000","last_change":"2024-09-11T23:56:57.364619+0000","last_active":"2024-09-11T23:57:08.022759+0000","last_peered":"2024-09-11T23:57:08.022759+0000","last_clean":"2024-09-11T23:57:08.022759+0000","last_became_active":"2024-09-11T23:56:57.364279+0000","last_became_peered":"2024-09-11T23:56:57.364279+0000","last_unstale":"2024-09-11T23:57:08.022759+0000","last_undegraded":"2024-09-11T23:57:08.022759+0000","last_fullsized":"2024-09-11T23:57:08.022759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:13.540493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:39.030761+0000","last_change":"2024-09-11T23:56:55.274995+0000","last_active":"2024-09-11T23:57:39.030761+0000","last_peered":"2024-09-11T23:57:39.030761+0000","last_clean":"2024-09-11T23:57:39.030761+0000","last_became_active":"2024-09-11T23:56:55.274017+0000","last_became_peered":"2024-09-11T23:56:55.274017+0000","last_unstale":"2024-09-11T23:57:39.030761+0000","last_undegraded":"2024-09-11T23:57:39.030761+0000","last_fullsized":"2024-09-11T23:57:39.030761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:37.324085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.857776+0000","last_change":"2024-09-11T23:57:04.419999+0000","last_active":"2024-09-11T23:57:07.857776+0000","last_peered":"2024-09-11T23:57:07.857776+0000","last_clean":"2024-09-11T23:57:07.857776+0000","last_became_active":"2024-09-11T23:57:04.419579+0000","last_became_peered":"2024-09-11T23:57:04.419579+0000","last_unstale":"2024-09-11T23:57:07.857776+0000","last_undegraded":"2024-09-11T23:57:07.857776+0000","last_fullsized":"2024-09-11T23:57:07.857776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:08.830864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850136+0000","last_change":"2024-09-11T23:56:57.358959+0000","last_active":"2024-09-11T23:57:07.850136+0000","last_peered":"2024-09-11T23:57:07.850136+0000","last_clean":"2024-09-11T23:57:07.850136+0000","last_became_active":"2024-09-11T23:56:57.358676+0000","last_became_peered":"2024-09-11T23:56:57.358676+0000","last_unstale":"2024-09-11T23:57:07.850136+0000","last_undegraded":"2024-09-11T23:57:07.850136+0000","last_fullsized":"2024-09-11T23:57:07.850136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:03.243973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.052075+0000","last_change":"2024-09-11T23:56:55.274068+0000","last_active":"2024-09-11T23:57:41.052075+0000","last_peered":"2024-09-11T23:57:41.052075+0000","last_clean":"2024-09-11T23:57:41.052075+0000","last_became_active":"2024-09-11T23:56:55.273689+0000","last_became_peered":"2024-09-11T23:56:55.273689+0000","last_unstale":"2024-09-11T23:57:41.052075+0000","last_undegraded":"2024-09-11T23:57:41.052075+0000","last_fullsized":"2024-09-11T23:57:41.052075+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:36.315956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.858161+0000","last_change":"2024-09-11T23:57:04.424832+0000","last_active":"2024-09-11T23:57:07.858161+0000","last_peered":"2024-09-11T23:57:07.858161+0000","last_clean":"2024-09-11T23:57:07.858161+0000","last_became_active":"2024-09-11T23:57:04.424398+0000","last_became_peered":"2024-09-11T23:57:04.424398+0000","last_unstale":"2024-09-11T23:57:07.858161+0000","last_undegraded":"2024-09-11T23:57:07.858161+0000","last_fullsized":"2024-09-11T23:57:07.858161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:11.134123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021643+0000","last_change":"2024-09-11T23:56:57.349603+0000","last_active":"2024-09-11T23:57:08.021643+0000","last_peered":"2024-09-11T23:57:08.021643+0000","last_clean":"2024-09-11T23:57:08.021643+0000","last_became_active":"2024-09-11T23:56:57.349269+0000","last_became_peered":"2024-09-11T23:56:57.349269+0000","last_unstale":"2024-09-11T23:57:08.021643+0000","last_undegraded":"2024-09-11T23:57:08.021643+0000","last_fullsized":"2024-09-11T23:57:08.021643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:46.269274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.066202+0000","last_change":"2024-09-11T23:56:55.271033+0000","last_active":"2024-09-11T23:57:42.066202+0000","last_peered":"2024-09-11T23:57:42.066202+0000","last_clean":"2024-09-11T23:57:42.066202+0000","last_became_active":"2024-09-11T23:56:55.270704+0000","last_became_peered":"2024-09-11T23:56:55.270704+0000","last_unstale":"2024-09-11T23:57:42.066202+0000","last_undegraded":"2024-09-11T23:57:42.066202+0000","last_fullsized":"2024-09-11T23:57:42.066202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:36.751581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021774+0000","last_change":"2024-09-11T23:57:04.413809+0000","last_active":"2024-09-11T23:57:08.021774+0000","last_peered":"2024-09-11T23:57:08.021774+0000","last_clean":"2024-09-11T23:57:08.021774+0000","last_became_active":"2024-09-11T23:57:04.413338+0000","last_became_peered":"2024-09-11T23:57:04.413338+0000","last_unstale":"2024-09-11T23:57:08.021774+0000","last_undegraded":"2024-09-11T23:57:08.021774+0000","last_fullsized":"2024-09-11T23:57:08.021774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:24.112205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.518959+0000","last_change":"2024-09-11T23:56:57.348815+0000","last_active":"2024-09-11T23:57:08.518959+0000","last_peered":"2024-09-11T23:57:08.518959+0000","last_clean":"2024-09-11T23:57:08.518959+0000","last_became_active":"2024-09-11T23:56:57.348426+0000","last_became_peered":"2024-09-11T23:56:57.348426+0000","last_unstale":"2024-09-11T23:57:08.518959+0000","last_undegraded":"2024-09-11T23:57:08.518959+0000","last_fullsized":"2024-09-11T23:57:08.518959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:47.685615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:39.031699+0000","last_change":"2024-09-11T23:56:55.594325+0000","last_active":"2024-09-11T23:57:39.031699+0000","last_peered":"2024-09-11T23:57:39.031699+0000","last_clean":"2024-09-11T23:57:39.031699+0000","last_became_active":"2024-09-11T23:56:55.594044+0000","last_became_peered":"2024-09-11T23:56:55.594044+0000","last_unstale":"2024-09-11T23:57:39.031699+0000","last_undegraded":"2024-09-11T23:57:39.031699+0000","last_fullsized":"2024-09-11T23:57:39.031699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:05.124980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.857919+0000","last_change":"2024-09-11T23:57:04.425591+0000","last_active":"2024-09-11T23:57:07.857919+0000","last_peered":"2024-09-11T23:57:07.857919+0000","last_clean":"2024-09-11T23:57:07.857919+0000","last_became_active":"2024-09-11T23:57:04.424945+0000","last_became_peered":"2024-09-11T23:57:04.424945+0000","last_unstale":"2024-09-11T23:57:07.857919+0000","last_undegraded":"2024-09-11T23:57:07.857919+0000","last_fullsized":"2024-09-11T23:57:07.857919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:57.541426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021877+0000","last_change":"2024-09-11T23:56:57.363423+0000","last_active":"2024-09-11T23:57:08.021877+0000","last_peered":"2024-09-11T23:57:08.021877+0000","last_clean":"2024-09-11T23:57:08.021877+0000","last_became_active":"2024-09-11T23:56:57.361258+0000","last_became_peered":"2024-09-11T23:56:57.361258+0000","last_unstale":"2024-09-11T23:57:08.021877+0000","last_undegraded":"2024-09-11T23:57:08.021877+0000","last_fullsized":"2024-09-11T23:57:08.021877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:36.743240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.067825+0000","last_change":"2024-09-11T23:56:55.311774+0000","last_active":"2024-09-11T23:57:42.067825+0000","last_peered":"2024-09-11T23:57:42.067825+0000","last_clean":"2024-09-11T23:57:42.067825+0000","last_became_active":"2024-09-11T23:56:55.311409+0000","last_became_peered":"2024-09-11T23:56:55.311409+0000","last_unstale":"2024-09-11T23:57:42.067825+0000","last_undegraded":"2024-09-11T23:57:42.067825+0000","last_fullsized":"2024-09-11T23:57:42.067825+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:50.243993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022280+0000","last_change":"2024-09-11T23:57:04.416973+0000","last_active":"2024-09-11T23:57:08.022280+0000","last_peered":"2024-09-11T23:57:08.022280+0000","last_clean":"2024-09-11T23:57:08.022280+0000","last_became_active":"2024-09-11T23:57:04.416582+0000","last_became_peered":"2024-09-11T23:57:04.416582+0000","last_unstale":"2024-09-11T23:57:08.022280+0000","last_undegraded":"2024-09-11T23:57:08.022280+0000","last_fullsized":"2024-09-11T23:57:08.022280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:13.411939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850530+0000","last_change":"2024-09-11T23:56:57.354790+0000","last_active":"2024-09-11T23:57:07.850530+0000","last_peered":"2024-09-11T23:57:07.850530+0000","last_clean":"2024-09-11T23:57:07.850530+0000","last_became_active":"2024-09-11T23:56:57.354478+0000","last_became_peered":"2024-09-11T23:56:57.354478+0000","last_unstale":"2024-09-11T23:57:07.850530+0000","last_undegraded":"2024-09-11T23:57:07.850530+0000","last_fullsized":"2024-09-11T23:57:07.850530+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:01.109689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'14","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:53.377232+0000","last_change":"2024-09-11T23:56:55.265429+0000","last_active":"2024-09-11T23:57:53.377232+0000","last_peered":"2024-09-11T23:57:53.377232+0000","last_clean":"2024-09-11T23:57:53.377232+0000","last_became_active":"2024-09-11T23:56:55.265104+0000","last_became_peered":"2024-09-11T23:56:55.265104+0000","last_unstale":"2024-09-11T23:57:53.377232+0000","last_undegraded":"2024-09-11T23:57:53.377232+0000","last_fullsized":"2024-09-11T23:57:53.377232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:48.091192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.849619+0000","last_change":"2024-09-11T23:57:04.417058+0000","last_active":"2024-09-11T23:57:07.849619+0000","last_peered":"2024-09-11T23:57:07.849619+0000","last_clean":"2024-09-11T23:57:07.849619+0000","last_became_active":"2024-09-11T23:57:04.416237+0000","last_became_peered":"2024-09-11T23:57:04.416237+0000","last_unstale":"2024-09-11T23:57:07.849619+0000","last_undegraded":"2024-09-11T23:57:07.849619+0000","last_fullsized":"2024-09-11T23:57:07.849619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:47.959023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022832+0000","last_change":"2024-09-11T23:56:57.343131+0000","last_active":"2024-09-11T23:57:08.022832+0000","last_peered":"2024-09-11T23:57:08.022832+0000","last_clean":"2024-09-11T23:57:08.022832+0000","last_became_active":"2024-09-11T23:56:57.342823+0000","last_became_peered":"2024-09-11T23:56:57.342823+0000","last_unstale":"2024-09-11T23:57:08.022832+0000","last_undegraded":"2024-09-11T23:57:08.022832+0000","last_fullsized":"2024-09-11T23:57:08.022832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:00.685220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.068352+0000","last_change":"2024-09-11T23:56:55.594654+0000","last_active":"2024-09-11T23:57:42.068352+0000","last_peered":"2024-09-11T23:57:42.068352+0000","last_clean":"2024-09-11T23:57:42.068352+0000","last_became_active":"2024-09-11T23:56:55.594146+0000","last_became_peered":"2024-09-11T23:56:55.594146+0000","last_unstale":"2024-09-11T23:57:42.068352+0000","last_undegraded":"2024-09-11T23:57:42.068352+0000","last_fullsized":"2024-09-11T23:57:42.068352+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:41.770480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021647+0000","last_change":"2024-09-11T23:57:04.417873+0000","last_active":"2024-09-11T23:57:08.021647+0000","last_peered":"2024-09-11T23:57:08.021647+0000","last_clean":"2024-09-11T23:57:08.021647+0000","last_became_active":"2024-09-11T23:57:04.417477+0000","last_became_peered":"2024-09-11T23:57:04.417477+0000","last_unstale":"2024-09-11T23:57:08.021647+0000","last_undegraded":"2024-09-11T23:57:08.021647+0000","last_fullsized":"2024-09-11T23:57:08.021647+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:20.480850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022599+0000","last_change":"2024-09-11T23:56:57.360695+0000","last_active":"2024-09-11T23:57:08.022599+0000","last_peered":"2024-09-11T23:57:08.022599+0000","last_clean":"2024-09-11T23:57:08.022599+0000","last_became_active":"2024-09-11T23:56:57.357702+0000","last_became_peered":"2024-09-11T23:56:57.357702+0000","last_unstale":"2024-09-11T23:57:08.022599+0000","last_undegraded":"2024-09-11T23:57:08.022599+0000","last_fullsized":"2024-09-11T23:57:08.022599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:04.680682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023108+0000","last_change":"2024-09-11T23:56:55.594503+0000","last_active":"2024-09-11T23:57:08.023108+0000","last_peered":"2024-09-11T23:57:08.023108+0000","last_clean":"2024-09-11T23:57:08.023108+0000","last_became_active":"2024-09-11T23:56:55.594155+0000","last_became_peered":"2024-09-11T23:56:55.594155+0000","last_unstale":"2024-09-11T23:57:08.023108+0000","last_undegraded":"2024-09-11T23:57:08.023108+0000","last_fullsized":"2024-09-11T23:57:08.023108+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:15.181976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.519081+0000","last_change":"2024-09-11T23:57:04.410696+0000","last_active":"2024-09-11T23:57:08.519081+0000","last_peered":"2024-09-11T23:57:08.519081+0000","last_clean":"2024-09-11T23:57:08.519081+0000","last_became_active":"2024-09-11T23:57:04.410281+0000","last_became_peered":"2024-09-11T23:57:04.410281+0000","last_unstale":"2024-09-11T23:57:08.519081+0000","last_undegraded":"2024-09-11T23:57:08.519081+0000","last_fullsized":"2024-09-11T23:57:08.519081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:31.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022656+0000","last_change":"2024-09-11T23:56:57.361458+0000","last_active":"2024-09-11T23:57:08.022656+0000","last_peered":"2024-09-11T23:57:08.022656+0000","last_clean":"2024-09-11T23:57:08.022656+0000","last_became_active":"2024-09-11T23:56:57.361031+0000","last_became_peered":"2024-09-11T23:56:57.361031+0000","last_unstale":"2024-09-11T23:57:08.022656+0000","last_undegraded":"2024-09-11T23:57:08.022656+0000","last_fullsized":"2024-09-11T23:57:08.022656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:23.691469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.098218+0000","last_change":"2024-09-11T23:56:55.276558+0000","last_active":"2024-09-11T23:57:52.098218+0000","last_peered":"2024-09-11T23:57:52.098218+0000","last_clean":"2024-09-11T23:57:52.098218+0000","last_became_active":"2024-09-11T23:56:55.276053+0000","last_became_peered":"2024-09-11T23:56:55.276053+0000","last_unstale":"2024-09-11T23:57:52.098218+0000","last_undegraded":"2024-09-11T23:57:52.098218+0000","last_fullsized":"2024-09-11T23:57:52.098218+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:57.139383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022569+0000","last_change":"2024-09-11T23:57:04.414763+0000","last_active":"2024-09-11T23:57:08.022569+0000","last_peered":"2024-09-11T23:57:08.022569+0000","last_clean":"2024-09-11T23:57:08.022569+0000","last_became_active":"2024-09-11T23:57:04.414248+0000","last_became_peered":"2024-09-11T23:57:04.414248+0000","last_unstale":"2024-09-11T23:57:08.022569+0000","last_undegraded":"2024-09-11T23:57:08.022569+0000","last_fullsized":"2024-09-11T23:57:08.022569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.441399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850391+0000","last_change":"2024-09-11T23:56:57.351549+0000","last_active":"2024-09-11T23:57:07.850391+0000","last_peered":"2024-09-11T23:57:07.850391+0000","last_clean":"2024-09-11T23:57:07.850391+0000","last_became_active":"2024-09-11T23:56:57.351228+0000","last_became_peered":"2024-09-11T23:56:57.351228+0000","last_unstale":"2024-09-11T23:57:07.850391+0000","last_undegraded":"2024-09-11T23:57:07.850391+0000","last_fullsized":"2024-09-11T23:57:07.850391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:03.280698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.097686+0000","last_change":"2024-09-11T23:56:55.594392+0000","last_active":"2024-09-11T23:57:52.097686+0000","last_peered":"2024-09-11T23:57:52.097686+0000","last_clean":"2024-09-11T23:57:52.097686+0000","last_became_active":"2024-09-11T23:56:55.593620+0000","last_became_peered":"2024-09-11T23:56:55.593620+0000","last_unstale":"2024-09-11T23:57:52.097686+0000","last_undegraded":"2024-09-11T23:57:52.097686+0000","last_fullsized":"2024-09-11T23:57:52.097686+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:10.110283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021497+0000","last_change":"2024-09-11T23:57:04.408435+0000","last_active":"2024-09-11T23:57:08.021497+0000","last_peered":"2024-09-11T23:57:08.021497+0000","last_clean":"2024-09-11T23:57:08.021497+0000","last_became_active":"2024-09-11T23:57:04.408067+0000","last_became_peered":"2024-09-11T23:57:04.408067+0000","last_unstale":"2024-09-11T23:57:08.021497+0000","last_undegraded":"2024-09-11T23:57:08.021497+0000","last_fullsized":"2024-09-11T23:57:08.021497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:36.867039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021434+0000","last_change":"2024-09-11T23:56:57.352375+0000","last_active":"2024-09-11T23:57:08.021434+0000","last_peered":"2024-09-11T23:57:08.021434+0000","last_clean":"2024-09-11T23:57:08.021434+0000","last_became_active":"2024-09-11T23:56:57.352034+0000","last_became_peered":"2024-09-11T23:56:57.352034+0000","last_unstale":"2024-09-11T23:57:08.021434+0000","last_undegraded":"2024-09-11T23:57:08.021434+0000","last_fullsized":"2024-09-11T23:57:08.021434+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:02.707277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.035683+0000","last_change":"2024-09-11T23:56:55.279016+0000","last_active":"2024-09-11T23:57:40.035683+0000","last_peered":"2024-09-11T23:57:40.035683+0000","last_clean":"2024-09-11T23:57:40.035683+0000","last_became_active":"2024-09-11T23:56:55.278457+0000","last_became_peered":"2024-09-11T23:56:55.278457+0000","last_unstale":"2024-09-11T23:57:40.035683+0000","last_undegraded":"2024-09-11T23:57:40.035683+0000","last_fullsized":"2024-09-11T23:57:40.035683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:35.851946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.851052+0000","last_change":"2024-09-11T23:57:04.407941+0000","last_active":"2024-09-11T23:57:07.851052+0000","last_peered":"2024-09-11T23:57:07.851052+0000","last_clean":"2024-09-11T23:57:07.851052+0000","last_became_active":"2024-09-11T23:57:04.407517+0000","last_became_peered":"2024-09-11T23:57:04.407517+0000","last_unstale":"2024-09-11T23:57:07.851052+0000","last_undegraded":"2024-09-11T23:57:07.851052+0000","last_fullsized":"2024-09-11T23:57:07.851052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.781127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.849995+0000","last_change":"2024-09-11T23:56:57.344419+0000","last_active":"2024-09-11T23:57:07.849995+0000","last_peered":"2024-09-11T23:57:07.849995+0000","last_clean":"2024-09-11T23:57:07.849995+0000","last_became_active":"2024-09-11T23:56:57.343893+0000","last_became_peered":"2024-09-11T23:56:57.343893+0000","last_unstale":"2024-09-11T23:57:07.849995+0000","last_undegraded":"2024-09-11T23:57:07.849995+0000","last_fullsized":"2024-09-11T23:57:07.849995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:40.888240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:43.080657+0000","last_change":"2024-09-11T23:56:55.270056+0000","last_active":"2024-09-11T23:57:43.080657+0000","last_peered":"2024-09-11T23:57:43.080657+0000","last_clean":"2024-09-11T23:57:43.080657+0000","last_became_active":"2024-09-11T23:56:55.269689+0000","last_became_peered":"2024-09-11T23:56:55.269689+0000","last_unstale":"2024-09-11T23:57:43.080657+0000","last_undegraded":"2024-09-11T23:57:43.080657+0000","last_fullsized":"2024-09-11T23:57:43.080657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:21.085849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":343,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022698+0000","last_change":"2024-09-11T23:55:44.130655+0000","last_active":"2024-09-11T23:57:08.022698+0000","last_peered":"2024-09-11T23:57:08.022698+0000","last_clean":"2024-09-11T23:57:08.022698+0000","last_became_active":"2024-09-11T23:55:44.130263+0000","last_became_peered":"2024-09-11T23:55:44.130263+0000","last_unstale":"2024-09-11T23:57:08.022698+0000","last_undegraded":"2024-09-11T23:57:08.022698+0000","last_fullsized":"2024-09-11T23:57:08.022698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:17.476450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:17.476450+0000","last_clean_scrub_stamp":"2024-09-11T23:52:17.476450+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:38.754760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.126290+0000","last_change":"2024-09-11T23:57:04.417259+0000","last_active":"2024-09-11T23:57:08.126290+0000","last_peered":"2024-09-11T23:57:08.126290+0000","last_clean":"2024-09-11T23:57:08.126290+0000","last_became_active":"2024-09-11T23:57:04.416729+0000","last_became_peered":"2024-09-11T23:57:04.416729+0000","last_unstale":"2024-09-11T23:57:08.126290+0000","last_undegraded":"2024-09-11T23:57:08.126290+0000","last_fullsized":"2024-09-11T23:57:08.126290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:50.508736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023475+0000","last_change":"2024-09-11T23:56:57.362787+0000","last_active":"2024-09-11T23:57:08.023475+0000","last_peered":"2024-09-11T23:57:08.023475+0000","last_clean":"2024-09-11T23:57:08.023475+0000","last_became_active":"2024-09-11T23:56:57.362438+0000","last_became_peered":"2024-09-11T23:56:57.362438+0000","last_unstale":"2024-09-11T23:57:08.023475+0000","last_undegraded":"2024-09-11T23:57:08.023475+0000","last_fullsized":"2024-09-11T23:57:08.023475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:53.969983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:55.101260+0000","last_change":"2024-09-11T23:56:55.594525+0000","last_active":"2024-09-11T23:57:55.101260+0000","last_peered":"2024-09-11T23:57:55.101260+0000","last_clean":"2024-09-11T23:57:55.101260+0000","last_became_active":"2024-09-11T23:56:55.594187+0000","last_became_peered":"2024-09-11T23:56:55.594187+0000","last_unstale":"2024-09-11T23:57:55.101260+0000","last_undegraded":"2024-09-11T23:57:55.101260+0000","last_fullsized":"2024-09-11T23:57:55.101260+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.087663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022243+0000","last_change":"2024-09-11T23:57:04.421266+0000","last_active":"2024-09-11T23:57:08.022243+0000","last_peered":"2024-09-11T23:57:08.022243+0000","last_clean":"2024-09-11T23:57:08.022243+0000","last_became_active":"2024-09-11T23:57:04.420212+0000","last_became_peered":"2024-09-11T23:57:04.420212+0000","last_unstale":"2024-09-11T23:57:08.022243+0000","last_undegraded":"2024-09-11T23:57:08.022243+0000","last_fullsized":"2024-09-11T23:57:08.022243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:51.532509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022715+0000","last_change":"2024-09-11T23:56:57.360393+0000","last_active":"2024-09-11T23:57:08.022715+0000","last_peered":"2024-09-11T23:57:08.022715+0000","last_clean":"2024-09-11T23:57:08.022715+0000","last_became_active":"2024-09-11T23:56:57.359996+0000","last_became_peered":"2024-09-11T23:56:57.359996+0000","last_unstale":"2024-09-11T23:57:08.022715+0000","last_undegraded":"2024-09-11T23:57:08.022715+0000","last_fullsized":"2024-09-11T23:57:08.022715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:48.325137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.067227+0000","last_change":"2024-09-11T23:56:55.273929+0000","last_active":"2024-09-11T23:57:42.067227+0000","last_peered":"2024-09-11T23:57:42.067227+0000","last_clean":"2024-09-11T23:57:42.067227+0000","last_became_active":"2024-09-11T23:56:55.273581+0000","last_became_peered":"2024-09-11T23:56:55.273581+0000","last_unstale":"2024-09-11T23:57:42.067227+0000","last_undegraded":"2024-09-11T23:57:42.067227+0000","last_fullsized":"2024-09-11T23:57:42.067227+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:26.541787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022147+0000","last_change":"2024-09-11T23:57:04.422312+0000","last_active":"2024-09-11T23:57:08.022147+0000","last_peered":"2024-09-11T23:57:08.022147+0000","last_clean":"2024-09-11T23:57:08.022147+0000","last_became_active":"2024-09-11T23:57:04.420675+0000","last_became_peered":"2024-09-11T23:57:04.420675+0000","last_unstale":"2024-09-11T23:57:08.022147+0000","last_undegraded":"2024-09-11T23:57:08.022147+0000","last_fullsized":"2024-09-11T23:57:08.022147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:44.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022155+0000","last_change":"2024-09-11T23:56:57.359358+0000","last_active":"2024-09-11T23:57:08.022155+0000","last_peered":"2024-09-11T23:57:08.022155+0000","last_clean":"2024-09-11T23:57:08.022155+0000","last_became_active":"2024-09-11T23:56:57.358961+0000","last_became_peered":"2024-09-11T23:56:57.358961+0000","last_unstale":"2024-09-11T23:57:08.022155+0000","last_undegraded":"2024-09-11T23:57:08.022155+0000","last_fullsized":"2024-09-11T23:57:08.022155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:22.522047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.065912+0000","last_change":"2024-09-11T23:56:55.273958+0000","last_active":"2024-09-11T23:57:42.065912+0000","last_peered":"2024-09-11T23:57:42.065912+0000","last_clean":"2024-09-11T23:57:42.065912+0000","last_became_active":"2024-09-11T23:56:55.273656+0000","last_became_peered":"2024-09-11T23:56:55.273656+0000","last_unstale":"2024-09-11T23:57:42.065912+0000","last_undegraded":"2024-09-11T23:57:42.065912+0000","last_fullsized":"2024-09-11T23:57:42.065912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:34.357776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850244+0000","last_change":"2024-09-11T23:57:04.415966+0000","last_active":"2024-09-11T23:57:07.850244+0000","last_peered":"2024-09-11T23:57:07.850244+0000","last_clean":"2024-09-11T23:57:07.850244+0000","last_became_active":"2024-09-11T23:57:04.415601+0000","last_became_peered":"2024-09-11T23:57:04.415601+0000","last_unstale":"2024-09-11T23:57:07.850244+0000","last_undegraded":"2024-09-11T23:57:07.850244+0000","last_fullsized":"2024-09-11T23:57:07.850244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:46.244645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021927+0000","last_change":"2024-09-11T23:56:57.354350+0000","last_active":"2024-09-11T23:57:08.021927+0000","last_peered":"2024-09-11T23:57:08.021927+0000","last_clean":"2024-09-11T23:57:08.021927+0000","last_became_active":"2024-09-11T23:56:57.353900+0000","last_became_peered":"2024-09-11T23:56:57.353900+0000","last_unstale":"2024-09-11T23:57:08.021927+0000","last_undegraded":"2024-09-11T23:57:08.021927+0000","last_fullsized":"2024-09-11T23:57:08.021927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:40.559310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.031853+0000","last_change":"2024-09-11T23:56:55.271043+0000","last_active":"2024-09-11T23:57:42.031853+0000","last_peered":"2024-09-11T23:57:42.031853+0000","last_clean":"2024-09-11T23:57:42.031853+0000","last_became_active":"2024-09-11T23:56:55.270748+0000","last_became_peered":"2024-09-11T23:56:55.270748+0000","last_unstale":"2024-09-11T23:57:42.031853+0000","last_undegraded":"2024-09-11T23:57:42.031853+0000","last_fullsized":"2024-09-11T23:57:42.031853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:08.776139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850437+0000","last_change":"2024-09-11T23:57:04.421448+0000","last_active":"2024-09-11T23:57:07.850437+0000","last_peered":"2024-09-11T23:57:07.850437+0000","last_clean":"2024-09-11T23:57:07.850437+0000","last_became_active":"2024-09-11T23:57:04.421000+0000","last_became_peered":"2024-09-11T23:57:04.421000+0000","last_unstale":"2024-09-11T23:57:07.850437+0000","last_undegraded":"2024-09-11T23:57:07.850437+0000","last_fullsized":"2024-09-11T23:57:07.850437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:23.342301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850482+0000","last_change":"2024-09-11T23:56:57.360104+0000","last_active":"2024-09-11T23:57:07.850482+0000","last_peered":"2024-09-11T23:57:07.850482+0000","last_clean":"2024-09-11T23:57:07.850482+0000","last_became_active":"2024-09-11T23:56:57.359773+0000","last_became_peered":"2024-09-11T23:56:57.359773+0000","last_unstale":"2024-09-11T23:57:07.850482+0000","last_undegraded":"2024-09-11T23:57:07.850482+0000","last_fullsized":"2024-09-11T23:57:07.850482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:05.566675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.067963+0000","last_change":"2024-09-11T23:56:55.594731+0000","last_active":"2024-09-11T23:57:42.067963+0000","last_peered":"2024-09-11T23:57:42.067963+0000","last_clean":"2024-09-11T23:57:42.067963+0000","last_became_active":"2024-09-11T23:56:55.594095+0000","last_became_peered":"2024-09-11T23:56:55.594095+0000","last_unstale":"2024-09-11T23:57:42.067963+0000","last_undegraded":"2024-09-11T23:57:42.067963+0000","last_fullsized":"2024-09-11T23:57:42.067963+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:44.847662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022757+0000","last_change":"2024-09-11T23:57:04.413252+0000","last_active":"2024-09-11T23:57:08.022757+0000","last_peered":"2024-09-11T23:57:08.022757+0000","last_clean":"2024-09-11T23:57:08.022757+0000","last_became_active":"2024-09-11T23:57:04.412887+0000","last_became_peered":"2024-09-11T23:57:04.412887+0000","last_unstale":"2024-09-11T23:57:08.022757+0000","last_undegraded":"2024-09-11T23:57:08.022757+0000","last_fullsized":"2024-09-11T23:57:08.022757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:38.778093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022084+0000","last_change":"2024-09-11T23:56:57.354309+0000","last_active":"2024-09-11T23:57:08.022084+0000","last_peered":"2024-09-11T23:57:08.022084+0000","last_clean":"2024-09-11T23:57:08.022084+0000","last_became_active":"2024-09-11T23:56:57.353987+0000","last_became_peered":"2024-09-11T23:56:57.353987+0000","last_unstale":"2024-09-11T23:57:08.022084+0000","last_undegraded":"2024-09-11T23:57:08.022084+0000","last_fullsized":"2024-09-11T23:57:08.022084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:02.248741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.098284+0000","last_change":"2024-09-11T23:56:55.271531+0000","last_active":"2024-09-11T23:57:52.098284+0000","last_peered":"2024-09-11T23:57:52.098284+0000","last_clean":"2024-09-11T23:57:52.098284+0000","last_became_active":"2024-09-11T23:56:55.271150+0000","last_became_peered":"2024-09-11T23:56:55.271150+0000","last_unstale":"2024-09-11T23:57:52.098284+0000","last_undegraded":"2024-09-11T23:57:52.098284+0000","last_fullsized":"2024-09-11T23:57:52.098284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:31.885885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021940+0000","last_change":"2024-09-11T23:57:04.415610+0000","last_active":"2024-09-11T23:57:08.021940+0000","last_peered":"2024-09-11T23:57:08.021940+0000","last_clean":"2024-09-11T23:57:08.021940+0000","last_became_active":"2024-09-11T23:57:04.415168+0000","last_became_peered":"2024-09-11T23:57:04.415168+0000","last_unstale":"2024-09-11T23:57:08.021940+0000","last_undegraded":"2024-09-11T23:57:08.021940+0000","last_fullsized":"2024-09-11T23:57:08.021940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:34.688002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022194+0000","last_change":"2024-09-11T23:56:57.359960+0000","last_active":"2024-09-11T23:57:08.022194+0000","last_peered":"2024-09-11T23:57:08.022194+0000","last_clean":"2024-09-11T23:57:08.022194+0000","last_became_active":"2024-09-11T23:56:57.359417+0000","last_became_peered":"2024-09-11T23:56:57.359417+0000","last_unstale":"2024-09-11T23:57:08.022194+0000","last_undegraded":"2024-09-11T23:57:08.022194+0000","last_fullsized":"2024-09-11T23:57:08.022194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:18.741920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.067514+0000","last_change":"2024-09-11T23:56:55.272561+0000","last_active":"2024-09-11T23:57:42.067514+0000","last_peered":"2024-09-11T23:57:42.067514+0000","last_clean":"2024-09-11T23:57:42.067514+0000","last_became_active":"2024-09-11T23:56:55.272221+0000","last_became_peered":"2024-09-11T23:56:55.272221+0000","last_unstale":"2024-09-11T23:57:42.067514+0000","last_undegraded":"2024-09-11T23:57:42.067514+0000","last_fullsized":"2024-09-11T23:57:42.067514+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:22.151044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021664+0000","last_change":"2024-09-11T23:57:04.417299+0000","last_active":"2024-09-11T23:57:08.021664+0000","last_peered":"2024-09-11T23:57:08.021664+0000","last_clean":"2024-09-11T23:57:08.021664+0000","last_became_active":"2024-09-11T23:57:04.416864+0000","last_became_peered":"2024-09-11T23:57:04.416864+0000","last_unstale":"2024-09-11T23:57:08.021664+0000","last_undegraded":"2024-09-11T23:57:08.021664+0000","last_fullsized":"2024-09-11T23:57:08.021664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:12.582094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022002+0000","last_change":"2024-09-11T23:56:57.352008+0000","last_active":"2024-09-11T23:57:08.022002+0000","last_peered":"2024-09-11T23:57:08.022002+0000","last_clean":"2024-09-11T23:57:08.022002+0000","last_became_active":"2024-09-11T23:56:57.351708+0000","last_became_peered":"2024-09-11T23:56:57.351708+0000","last_unstale":"2024-09-11T23:57:08.022002+0000","last_undegraded":"2024-09-11T23:57:08.022002+0000","last_fullsized":"2024-09-11T23:57:08.022002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:50.908059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:43.080418+0000","last_change":"2024-09-11T23:56:55.275755+0000","last_active":"2024-09-11T23:57:43.080418+0000","last_peered":"2024-09-11T23:57:43.080418+0000","last_clean":"2024-09-11T23:57:43.080418+0000","last_became_active":"2024-09-11T23:56:55.275247+0000","last_became_peered":"2024-09-11T23:56:55.275247+0000","last_unstale":"2024-09-11T23:57:43.080418+0000","last_undegraded":"2024-09-11T23:57:43.080418+0000","last_fullsized":"2024-09-11T23:57:43.080418+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:43.698490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850912+0000","last_change":"2024-09-11T23:57:04.412237+0000","last_active":"2024-09-11T23:57:07.850912+0000","last_peered":"2024-09-11T23:57:07.850912+0000","last_clean":"2024-09-11T23:57:07.850912+0000","last_became_active":"2024-09-11T23:57:04.411799+0000","last_became_peered":"2024-09-11T23:57:04.411799+0000","last_unstale":"2024-09-11T23:57:07.850912+0000","last_undegraded":"2024-09-11T23:57:07.850912+0000","last_fullsized":"2024-09-11T23:57:07.850912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:19.311875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.519332+0000","last_change":"2024-09-11T23:56:57.357667+0000","last_active":"2024-09-11T23:57:08.519332+0000","last_peered":"2024-09-11T23:57:08.519332+0000","last_clean":"2024-09-11T23:57:08.519332+0000","last_became_active":"2024-09-11T23:56:57.356796+0000","last_became_peered":"2024-09-11T23:56:57.356796+0000","last_unstale":"2024-09-11T23:57:08.519332+0000","last_undegraded":"2024-09-11T23:57:08.519332+0000","last_fullsized":"2024-09-11T23:57:08.519332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:46.220102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":93,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:55.104771+0000","last_change":"2024-09-11T23:56:55.276168+0000","last_active":"2024-09-11T23:57:55.104771+0000","last_peered":"2024-09-11T23:57:55.104771+0000","last_clean":"2024-09-11T23:57:55.104771+0000","last_became_active":"2024-09-11T23:56:55.275719+0000","last_became_peered":"2024-09-11T23:56:55.275719+0000","last_unstale":"2024-09-11T23:57:55.104771+0000","last_undegraded":"2024-09-11T23:57:55.104771+0000","last_fullsized":"2024-09-11T23:57:55.104771+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:28.846711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52413,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":67,"num_write":33,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023053+0000","last_change":"2024-09-11T23:57:04.412804+0000","last_active":"2024-09-11T23:57:08.023053+0000","last_peered":"2024-09-11T23:57:08.023053+0000","last_clean":"2024-09-11T23:57:08.023053+0000","last_became_active":"2024-09-11T23:57:04.412366+0000","last_became_peered":"2024-09-11T23:57:04.412366+0000","last_unstale":"2024-09-11T23:57:08.023053+0000","last_undegraded":"2024-09-11T23:57:08.023053+0000","last_fullsized":"2024-09-11T23:57:08.023053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.924598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022488+0000","last_change":"2024-09-11T23:56:57.357530+0000","last_active":"2024-09-11T23:57:08.022488+0000","last_peered":"2024-09-11T23:57:08.022488+0000","last_clean":"2024-09-11T23:57:08.022488+0000","last_became_active":"2024-09-11T23:56:57.356306+0000","last_became_peered":"2024-09-11T23:56:57.356306+0000","last_unstale":"2024-09-11T23:57:08.022488+0000","last_undegraded":"2024-09-11T23:57:08.022488+0000","last_fullsized":"2024-09-11T23:57:08.022488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:10.919120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.052799+0000","last_change":"2024-09-11T23:56:55.594653+0000","last_active":"2024-09-11T23:57:41.052799+0000","last_peered":"2024-09-11T23:57:41.052799+0000","last_clean":"2024-09-11T23:57:41.052799+0000","last_became_active":"2024-09-11T23:56:55.594219+0000","last_became_peered":"2024-09-11T23:56:55.594219+0000","last_unstale":"2024-09-11T23:57:41.052799+0000","last_undegraded":"2024-09-11T23:57:41.052799+0000","last_fullsized":"2024-09-11T23:57:41.052799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:54.361656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.858439+0000","last_change":"2024-09-11T23:57:04.422049+0000","last_active":"2024-09-11T23:57:07.858439+0000","last_peered":"2024-09-11T23:57:07.858439+0000","last_clean":"2024-09-11T23:57:07.858439+0000","last_became_active":"2024-09-11T23:57:04.420845+0000","last_became_peered":"2024-09-11T23:57:04.420845+0000","last_unstale":"2024-09-11T23:57:07.858439+0000","last_undegraded":"2024-09-11T23:57:07.858439+0000","last_fullsized":"2024-09-11T23:57:07.858439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:49.854740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022547+0000","last_change":"2024-09-11T23:56:57.362523+0000","last_active":"2024-09-11T23:57:08.022547+0000","last_peered":"2024-09-11T23:57:08.022547+0000","last_clean":"2024-09-11T23:57:08.022547+0000","last_became_active":"2024-09-11T23:56:57.361361+0000","last_became_peered":"2024-09-11T23:56:57.361361+0000","last_unstale":"2024-09-11T23:57:08.022547+0000","last_undegraded":"2024-09-11T23:57:08.022547+0000","last_fullsized":"2024-09-11T23:57:08.022547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:57.341557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.068208+0000","last_change":"2024-09-11T23:56:55.278291+0000","last_active":"2024-09-11T23:57:42.068208+0000","last_peered":"2024-09-11T23:57:42.068208+0000","last_clean":"2024-09-11T23:57:42.068208+0000","last_became_active":"2024-09-11T23:56:55.277910+0000","last_became_peered":"2024-09-11T23:56:55.277910+0000","last_unstale":"2024-09-11T23:57:42.068208+0000","last_undegraded":"2024-09-11T23:57:42.068208+0000","last_fullsized":"2024-09-11T23:57:42.068208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:31.602177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021304+0000","last_change":"2024-09-11T23:57:04.419006+0000","last_active":"2024-09-11T23:57:08.021304+0000","last_peered":"2024-09-11T23:57:08.021304+0000","last_clean":"2024-09-11T23:57:08.021304+0000","last_became_active":"2024-09-11T23:57:04.418638+0000","last_became_peered":"2024-09-11T23:57:04.418638+0000","last_unstale":"2024-09-11T23:57:08.021304+0000","last_undegraded":"2024-09-11T23:57:08.021304+0000","last_fullsized":"2024-09-11T23:57:08.021304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:22.458414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023017+0000","last_change":"2024-09-11T23:56:57.354481+0000","last_active":"2024-09-11T23:57:08.023017+0000","last_peered":"2024-09-11T23:57:08.023017+0000","last_clean":"2024-09-11T23:57:08.023017+0000","last_became_active":"2024-09-11T23:56:57.354158+0000","last_became_peered":"2024-09-11T23:56:57.354158+0000","last_unstale":"2024-09-11T23:57:08.023017+0000","last_undegraded":"2024-09-11T23:57:08.023017+0000","last_fullsized":"2024-09-11T23:57:08.023017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:58.372231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":59,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:55.100312+0000","last_change":"2024-09-11T23:56:55.275767+0000","last_active":"2024-09-11T23:57:55.100312+0000","last_peered":"2024-09-11T23:57:55.100312+0000","last_clean":"2024-09-11T23:57:55.100312+0000","last_became_active":"2024-09-11T23:56:55.275284+0000","last_became_peered":"2024-09-11T23:56:55.275284+0000","last_unstale":"2024-09-11T23:57:55.100312+0000","last_undegraded":"2024-09-11T23:57:55.100312+0000","last_fullsized":"2024-09-11T23:57:55.100312+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:32.278786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.849875+0000","last_change":"2024-09-11T23:57:04.421329+0000","last_active":"2024-09-11T23:57:07.849875+0000","last_peered":"2024-09-11T23:57:07.849875+0000","last_clean":"2024-09-11T23:57:07.849875+0000","last_became_active":"2024-09-11T23:57:04.420982+0000","last_became_peered":"2024-09-11T23:57:04.420982+0000","last_unstale":"2024-09-11T23:57:07.849875+0000","last_undegraded":"2024-09-11T23:57:07.849875+0000","last_fullsized":"2024-09-11T23:57:07.849875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.580115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021666+0000","last_change":"2024-09-11T23:57:04.419497+0000","last_active":"2024-09-11T23:57:08.021666+0000","last_peered":"2024-09-11T23:57:08.021666+0000","last_clean":"2024-09-11T23:57:08.021666+0000","last_became_active":"2024-09-11T23:57:04.418877+0000","last_became_peered":"2024-09-11T23:57:04.418877+0000","last_unstale":"2024-09-11T23:57:08.021666+0000","last_undegraded":"2024-09-11T23:57:08.021666+0000","last_fullsized":"2024-09-11T23:57:08.021666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:30.895439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021625+0000","last_change":"2024-09-11T23:56:57.354086+0000","last_active":"2024-09-11T23:57:08.021625+0000","last_peered":"2024-09-11T23:57:08.021625+0000","last_clean":"2024-09-11T23:57:08.021625+0000","last_became_active":"2024-09-11T23:56:57.353733+0000","last_became_peered":"2024-09-11T23:56:57.353733+0000","last_unstale":"2024-09-11T23:57:08.021625+0000","last_undegraded":"2024-09-11T23:57:08.021625+0000","last_fullsized":"2024-09-11T23:57:08.021625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:55.169463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:42.068820+0000","last_change":"2024-09-11T23:56:55.275441+0000","last_active":"2024-09-11T23:57:42.068820+0000","last_peered":"2024-09-11T23:57:42.068820+0000","last_clean":"2024-09-11T23:57:42.068820+0000","last_became_active":"2024-09-11T23:56:55.275109+0000","last_became_peered":"2024-09-11T23:56:55.275109+0000","last_unstale":"2024-09-11T23:57:42.068820+0000","last_undegraded":"2024-09-11T23:57:42.068820+0000","last_fullsized":"2024-09-11T23:57:42.068820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:47.462579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021888+0000","last_change":"2024-09-11T23:57:04.419592+0000","last_active":"2024-09-11T23:57:08.021888+0000","last_peered":"2024-09-11T23:57:08.021888+0000","last_clean":"2024-09-11T23:57:08.021888+0000","last_became_active":"2024-09-11T23:57:04.419124+0000","last_became_peered":"2024-09-11T23:57:04.419124+0000","last_unstale":"2024-09-11T23:57:08.021888+0000","last_undegraded":"2024-09-11T23:57:08.021888+0000","last_fullsized":"2024-09-11T23:57:08.021888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:19.129975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.849777+0000","last_change":"2024-09-11T23:56:57.350413+0000","last_active":"2024-09-11T23:57:07.849777+0000","last_peered":"2024-09-11T23:57:07.849777+0000","last_clean":"2024-09-11T23:57:07.849777+0000","last_became_active":"2024-09-11T23:56:57.350094+0000","last_became_peered":"2024-09-11T23:56:57.350094+0000","last_unstale":"2024-09-11T23:57:07.849777+0000","last_undegraded":"2024-09-11T23:57:07.849777+0000","last_fullsized":"2024-09-11T23:57:07.849777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:30.806452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.036409+0000","last_change":"2024-09-11T23:56:55.265370+0000","last_active":"2024-09-11T23:57:40.036409+0000","last_peered":"2024-09-11T23:57:40.036409+0000","last_clean":"2024-09-11T23:57:40.036409+0000","last_became_active":"2024-09-11T23:56:55.265025+0000","last_became_peered":"2024-09-11T23:56:55.265025+0000","last_unstale":"2024-09-11T23:57:40.036409+0000","last_undegraded":"2024-09-11T23:57:40.036409+0000","last_fullsized":"2024-09-11T23:57:40.036409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.583397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.051995+0000","last_change":"2024-09-11T23:56:55.276989+0000","last_active":"2024-09-11T23:57:41.051995+0000","last_peered":"2024-09-11T23:57:41.051995+0000","last_clean":"2024-09-11T23:57:41.051995+0000","last_became_active":"2024-09-11T23:56:55.276612+0000","last_became_peered":"2024-09-11T23:56:55.276612+0000","last_unstale":"2024-09-11T23:57:41.051995+0000","last_undegraded":"2024-09-11T23:57:41.051995+0000","last_fullsized":"2024-09-11T23:57:41.051995+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:28.708643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850830+0000","last_change":"2024-09-11T23:56:57.355005+0000","last_active":"2024-09-11T23:57:07.850830+0000","last_peered":"2024-09-11T23:57:07.850830+0000","last_clean":"2024-09-11T23:57:07.850830+0000","last_became_active":"2024-09-11T23:56:57.354690+0000","last_became_peered":"2024-09-11T23:56:57.354690+0000","last_unstale":"2024-09-11T23:57:07.850830+0000","last_undegraded":"2024-09-11T23:57:07.850830+0000","last_fullsized":"2024-09-11T23:57:07.850830+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:49.058770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022418+0000","last_change":"2024-09-11T23:57:04.415317+0000","last_active":"2024-09-11T23:57:08.022418+0000","last_peered":"2024-09-11T23:57:08.022418+0000","last_clean":"2024-09-11T23:57:08.022418+0000","last_became_active":"2024-09-11T23:57:04.413239+0000","last_became_peered":"2024-09-11T23:57:04.413239+0000","last_unstale":"2024-09-11T23:57:08.022418+0000","last_undegraded":"2024-09-11T23:57:08.022418+0000","last_fullsized":"2024-09-11T23:57:08.022418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:19.266871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:51.095329+0000","last_change":"2024-09-11T23:56:55.274372+0000","last_active":"2024-09-11T23:57:51.095329+0000","last_peered":"2024-09-11T23:57:51.095329+0000","last_clean":"2024-09-11T23:57:51.095329+0000","last_became_active":"2024-09-11T23:56:55.273984+0000","last_became_peered":"2024-09-11T23:56:55.273984+0000","last_unstale":"2024-09-11T23:57:51.095329+0000","last_undegraded":"2024-09-11T23:57:51.095329+0000","last_fullsized":"2024-09-11T23:57:51.095329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:15.853467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.519059+0000","last_change":"2024-09-11T23:56:57.344571+0000","last_active":"2024-09-11T23:57:08.519059+0000","last_peered":"2024-09-11T23:57:08.519059+0000","last_clean":"2024-09-11T23:57:08.519059+0000","last_became_active":"2024-09-11T23:56:57.344228+0000","last_became_peered":"2024-09-11T23:56:57.344228+0000","last_unstale":"2024-09-11T23:57:08.519059+0000","last_undegraded":"2024-09-11T23:57:08.519059+0000","last_fullsized":"2024-09-11T23:57:08.519059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:32.712464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022771+0000","last_change":"2024-09-11T23:57:04.418807+0000","last_active":"2024-09-11T23:57:08.022771+0000","last_peered":"2024-09-11T23:57:08.022771+0000","last_clean":"2024-09-11T23:57:08.022771+0000","last_became_active":"2024-09-11T23:57:04.418303+0000","last_became_peered":"2024-09-11T23:57:04.418303+0000","last_unstale":"2024-09-11T23:57:08.022771+0000","last_undegraded":"2024-09-11T23:57:08.022771+0000","last_fullsized":"2024-09-11T23:57:08.022771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:29.722073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021658+0000","last_change":"2024-09-11T23:56:57.351734+0000","last_active":"2024-09-11T23:57:08.021658+0000","last_peered":"2024-09-11T23:57:08.021658+0000","last_clean":"2024-09-11T23:57:08.021658+0000","last_became_active":"2024-09-11T23:56:57.351386+0000","last_became_peered":"2024-09-11T23:56:57.351386+0000","last_unstale":"2024-09-11T23:57:08.021658+0000","last_undegraded":"2024-09-11T23:57:08.021658+0000","last_fullsized":"2024-09-11T23:57:08.021658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.091137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022413+0000","last_change":"2024-09-11T23:56:57.354720+0000","last_active":"2024-09-11T23:57:08.022413+0000","last_peered":"2024-09-11T23:57:08.022413+0000","last_clean":"2024-09-11T23:57:08.022413+0000","last_became_active":"2024-09-11T23:56:57.353815+0000","last_became_peered":"2024-09-11T23:56:57.353815+0000","last_unstale":"2024-09-11T23:57:08.022413+0000","last_undegraded":"2024-09-11T23:57:08.022413+0000","last_fullsized":"2024-09-11T23:57:08.022413+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:30.516912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022267+0000","last_change":"2024-09-11T23:56:57.359290+0000","last_active":"2024-09-11T23:57:08.022267+0000","last_peered":"2024-09-11T23:57:08.022267+0000","last_clean":"2024-09-11T23:57:08.022267+0000","last_became_active":"2024-09-11T23:56:57.358953+0000","last_became_peered":"2024-09-11T23:56:57.358953+0000","last_unstale":"2024-09-11T23:57:08.022267+0000","last_undegraded":"2024-09-11T23:57:08.022267+0000","last_fullsized":"2024-09-11T23:57:08.022267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:24.894051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022253+0000","last_change":"2024-09-11T23:56:57.363571+0000","last_active":"2024-09-11T23:57:08.022253+0000","last_peered":"2024-09-11T23:57:08.022253+0000","last_clean":"2024-09-11T23:57:08.022253+0000","last_became_active":"2024-09-11T23:56:57.361844+0000","last_became_peered":"2024-09-11T23:56:57.361844+0000","last_unstale":"2024-09-11T23:57:08.022253+0000","last_undegraded":"2024-09-11T23:57:08.022253+0000","last_fullsized":"2024-09-11T23:57:08.022253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:22.693387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022730+0000","last_change":"2024-09-11T23:56:57.359850+0000","last_active":"2024-09-11T23:57:08.022730+0000","last_peered":"2024-09-11T23:57:08.022730+0000","last_clean":"2024-09-11T23:57:08.022730+0000","last_became_active":"2024-09-11T23:56:57.359560+0000","last_became_peered":"2024-09-11T23:56:57.359560+0000","last_unstale":"2024-09-11T23:57:08.022730+0000","last_undegraded":"2024-09-11T23:57:08.022730+0000","last_fullsized":"2024-09-11T23:57:08.022730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:33.015625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022300+0000","last_change":"2024-09-11T23:56:57.352870+0000","last_active":"2024-09-11T23:57:08.022300+0000","last_peered":"2024-09-11T23:57:08.022300+0000","last_clean":"2024-09-11T23:57:08.022300+0000","last_became_active":"2024-09-11T23:56:57.351427+0000","last_became_peered":"2024-09-11T23:56:57.351427+0000","last_unstale":"2024-09-11T23:57:08.022300+0000","last_undegraded":"2024-09-11T23:57:08.022300+0000","last_fullsized":"2024-09-11T23:57:08.022300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:11.895482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022810+0000","last_change":"2024-09-11T23:56:57.349609+0000","last_active":"2024-09-11T23:57:08.022810+0000","last_peered":"2024-09-11T23:57:08.022810+0000","last_clean":"2024-09-11T23:57:08.022810+0000","last_became_active":"2024-09-11T23:56:57.349307+0000","last_became_peered":"2024-09-11T23:56:57.349307+0000","last_unstale":"2024-09-11T23:57:08.022810+0000","last_undegraded":"2024-09-11T23:57:08.022810+0000","last_fullsized":"2024-09-11T23:57:08.022810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:49.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850450+0000","last_change":"2024-09-11T23:56:57.357093+0000","last_active":"2024-09-11T23:57:07.850450+0000","last_peered":"2024-09-11T23:57:07.850450+0000","last_clean":"2024-09-11T23:57:07.850450+0000","last_became_active":"2024-09-11T23:56:57.356313+0000","last_became_peered":"2024-09-11T23:56:57.356313+0000","last_unstale":"2024-09-11T23:57:07.850450+0000","last_undegraded":"2024-09-11T23:57:07.850450+0000","last_fullsized":"2024-09-11T23:57:07.850450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:00.861920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.850385+0000","last_change":"2024-09-11T23:56:57.345499+0000","last_active":"2024-09-11T23:57:07.850385+0000","last_peered":"2024-09-11T23:57:07.850385+0000","last_clean":"2024-09-11T23:57:07.850385+0000","last_became_active":"2024-09-11T23:56:57.345186+0000","last_became_peered":"2024-09-11T23:56:57.345186+0000","last_unstale":"2024-09-11T23:57:07.850385+0000","last_undegraded":"2024-09-11T23:57:07.850385+0000","last_fullsized":"2024-09-11T23:57:07.850385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:27.680578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.849829+0000","last_change":"2024-09-11T23:56:57.351242+0000","last_active":"2024-09-11T23:57:07.849829+0000","last_peered":"2024-09-11T23:57:07.849829+0000","last_clean":"2024-09-11T23:57:07.849829+0000","last_became_active":"2024-09-11T23:56:57.350948+0000","last_became_peered":"2024-09-11T23:56:57.350948+0000","last_unstale":"2024-09-11T23:57:07.849829+0000","last_undegraded":"2024-09-11T23:57:07.849829+0000","last_fullsized":"2024-09-11T23:57:07.849829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:29.979795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022503+0000","last_change":"2024-09-11T23:56:57.355967+0000","last_active":"2024-09-11T23:57:08.022503+0000","last_peered":"2024-09-11T23:57:08.022503+0000","last_clean":"2024-09-11T23:57:08.022503+0000","last_became_active":"2024-09-11T23:56:57.355437+0000","last_became_peered":"2024-09-11T23:56:57.355437+0000","last_unstale":"2024-09-11T23:57:08.022503+0000","last_undegraded":"2024-09-11T23:57:08.022503+0000","last_fullsized":"2024-09-11T23:57:08.022503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:19.701339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022155+0000","last_change":"2024-09-11T23:56:57.361097+0000","last_active":"2024-09-11T23:57:08.022155+0000","last_peered":"2024-09-11T23:57:08.022155+0000","last_clean":"2024-09-11T23:57:08.022155+0000","last_became_active":"2024-09-11T23:56:57.360700+0000","last_became_peered":"2024-09-11T23:56:57.360700+0000","last_unstale":"2024-09-11T23:57:08.022155+0000","last_undegraded":"2024-09-11T23:57:08.022155+0000","last_fullsized":"2024-09-11T23:57:08.022155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:39.006911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021759+0000","last_change":"2024-09-11T23:56:57.356233+0000","last_active":"2024-09-11T23:57:08.021759+0000","last_peered":"2024-09-11T23:57:08.021759+0000","last_clean":"2024-09-11T23:57:08.021759+0000","last_became_active":"2024-09-11T23:56:57.354705+0000","last_became_peered":"2024-09-11T23:56:57.354705+0000","last_unstale":"2024-09-11T23:57:08.021759+0000","last_undegraded":"2024-09-11T23:57:08.021759+0000","last_fullsized":"2024-09-11T23:57:08.021759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:35.039827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022635+0000","last_change":"2024-09-11T23:56:57.357881+0000","last_active":"2024-09-11T23:57:08.022635+0000","last_peered":"2024-09-11T23:57:08.022635+0000","last_clean":"2024-09-11T23:57:08.022635+0000","last_became_active":"2024-09-11T23:56:57.357486+0000","last_became_peered":"2024-09-11T23:56:57.357486+0000","last_unstale":"2024-09-11T23:57:08.022635+0000","last_undegraded":"2024-09-11T23:57:08.022635+0000","last_fullsized":"2024-09-11T23:57:08.022635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:24.049072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023138+0000","last_change":"2024-09-11T23:56:57.355307+0000","last_active":"2024-09-11T23:57:08.023138+0000","last_peered":"2024-09-11T23:57:08.023138+0000","last_clean":"2024-09-11T23:57:08.023138+0000","last_became_active":"2024-09-11T23:56:57.354957+0000","last_became_peered":"2024-09-11T23:56:57.354957+0000","last_unstale":"2024-09-11T23:57:08.023138+0000","last_undegraded":"2024-09-11T23:57:08.023138+0000","last_fullsized":"2024-09-11T23:57:08.023138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:00.217654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022452+0000","last_change":"2024-09-11T23:56:57.361516+0000","last_active":"2024-09-11T23:57:08.022452+0000","last_peered":"2024-09-11T23:57:08.022452+0000","last_clean":"2024-09-11T23:57:08.022452+0000","last_became_active":"2024-09-11T23:56:57.361112+0000","last_became_peered":"2024-09-11T23:56:57.361112+0000","last_unstale":"2024-09-11T23:57:08.022452+0000","last_undegraded":"2024-09-11T23:57:08.022452+0000","last_fullsized":"2024-09-11T23:57:08.022452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:48.861534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023471+0000","last_change":"2024-09-11T23:56:57.357251+0000","last_active":"2024-09-11T23:57:08.023471+0000","last_peered":"2024-09-11T23:57:08.023471+0000","last_clean":"2024-09-11T23:57:08.023471+0000","last_became_active":"2024-09-11T23:56:57.356932+0000","last_became_peered":"2024-09-11T23:56:57.356932+0000","last_unstale":"2024-09-11T23:57:08.023471+0000","last_undegraded":"2024-09-11T23:57:08.023471+0000","last_fullsized":"2024-09-11T23:57:08.023471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:10.650294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021546+0000","last_change":"2024-09-11T23:56:57.360671+0000","last_active":"2024-09-11T23:57:08.021546+0000","last_peered":"2024-09-11T23:57:08.021546+0000","last_clean":"2024-09-11T23:57:08.021546+0000","last_became_active":"2024-09-11T23:56:57.360351+0000","last_became_peered":"2024-09-11T23:56:57.360351+0000","last_unstale":"2024-09-11T23:57:08.021546+0000","last_undegraded":"2024-09-11T23:57:08.021546+0000","last_fullsized":"2024-09-11T23:57:08.021546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:18.895549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021789+0000","last_change":"2024-09-11T23:56:57.363379+0000","last_active":"2024-09-11T23:57:08.021789+0000","last_peered":"2024-09-11T23:57:08.021789+0000","last_clean":"2024-09-11T23:57:08.021789+0000","last_became_active":"2024-09-11T23:56:57.362652+0000","last_became_peered":"2024-09-11T23:56:57.362652+0000","last_unstale":"2024-09-11T23:57:08.021789+0000","last_undegraded":"2024-09-11T23:57:08.021789+0000","last_fullsized":"2024-09-11T23:57:08.021789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:16.298532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022059+0000","last_change":"2024-09-11T23:56:57.347580+0000","last_active":"2024-09-11T23:57:08.022059+0000","last_peered":"2024-09-11T23:57:08.022059+0000","last_clean":"2024-09-11T23:57:08.022059+0000","last_became_active":"2024-09-11T23:56:57.347276+0000","last_became_peered":"2024-09-11T23:56:57.347276+0000","last_unstale":"2024-09-11T23:57:08.022059+0000","last_undegraded":"2024-09-11T23:57:08.022059+0000","last_fullsized":"2024-09-11T23:57:08.022059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:14.543167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.857895+0000","last_change":"2024-09-11T23:56:57.352544+0000","last_active":"2024-09-11T23:57:07.857895+0000","last_peered":"2024-09-11T23:57:07.857895+0000","last_clean":"2024-09-11T23:57:07.857895+0000","last_became_active":"2024-09-11T23:56:57.351672+0000","last_became_peered":"2024-09-11T23:56:57.351672+0000","last_unstale":"2024-09-11T23:57:07.857895+0000","last_undegraded":"2024-09-11T23:57:07.857895+0000","last_fullsized":"2024-09-11T23:57:07.857895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.097494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023360+0000","last_change":"2024-09-11T23:56:57.360698+0000","last_active":"2024-09-11T23:57:08.023360+0000","last_peered":"2024-09-11T23:57:08.023360+0000","last_clean":"2024-09-11T23:57:08.023360+0000","last_became_active":"2024-09-11T23:56:57.360257+0000","last_became_peered":"2024-09-11T23:56:57.360257+0000","last_unstale":"2024-09-11T23:57:08.023360+0000","last_undegraded":"2024-09-11T23:57:08.023360+0000","last_fullsized":"2024-09-11T23:57:08.023360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:23.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023335+0000","last_change":"2024-09-11T23:56:57.354301+0000","last_active":"2024-09-11T23:57:08.023335+0000","last_peered":"2024-09-11T23:57:08.023335+0000","last_clean":"2024-09-11T23:57:08.023335+0000","last_became_active":"2024-09-11T23:56:57.353936+0000","last_became_peered":"2024-09-11T23:56:57.353936+0000","last_unstale":"2024-09-11T23:57:08.023335+0000","last_undegraded":"2024-09-11T23:57:08.023335+0000","last_fullsized":"2024-09-11T23:57:08.023335+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:05.420546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023255+0000","last_change":"2024-09-11T23:56:57.352615+0000","last_active":"2024-09-11T23:57:08.023255+0000","last_peered":"2024-09-11T23:57:08.023255+0000","last_clean":"2024-09-11T23:57:08.023255+0000","last_became_active":"2024-09-11T23:56:57.352249+0000","last_became_peered":"2024-09-11T23:56:57.352249+0000","last_unstale":"2024-09-11T23:57:08.023255+0000","last_undegraded":"2024-09-11T23:57:08.023255+0000","last_fullsized":"2024-09-11T23:57:08.023255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:18.477555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.849742+0000","last_change":"2024-09-11T23:56:57.346309+0000","last_active":"2024-09-11T23:57:07.849742+0000","last_peered":"2024-09-11T23:57:07.849742+0000","last_clean":"2024-09-11T23:57:07.849742+0000","last_became_active":"2024-09-11T23:56:57.345943+0000","last_became_peered":"2024-09-11T23:56:57.345943+0000","last_unstale":"2024-09-11T23:57:07.849742+0000","last_undegraded":"2024-09-11T23:57:07.849742+0000","last_fullsized":"2024-09-11T23:57:07.849742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:20.142093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.023065+0000","last_change":"2024-09-11T23:56:57.359749+0000","last_active":"2024-09-11T23:57:08.023065+0000","last_peered":"2024-09-11T23:57:08.023065+0000","last_clean":"2024-09-11T23:57:08.023065+0000","last_became_active":"2024-09-11T23:56:57.359343+0000","last_became_peered":"2024-09-11T23:56:57.359343+0000","last_unstale":"2024-09-11T23:57:08.023065+0000","last_undegraded":"2024-09-11T23:57:08.023065+0000","last_fullsized":"2024-09-11T23:57:08.023065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:59.132011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022298+0000","last_change":"2024-09-11T23:56:57.351843+0000","last_active":"2024-09-11T23:57:08.022298+0000","last_peered":"2024-09-11T23:57:08.022298+0000","last_clean":"2024-09-11T23:57:08.022298+0000","last_became_active":"2024-09-11T23:56:57.351501+0000","last_became_peered":"2024-09-11T23:56:57.351501+0000","last_unstale":"2024-09-11T23:57:08.022298+0000","last_undegraded":"2024-09-11T23:57:08.022298+0000","last_fullsized":"2024-09-11T23:57:08.022298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:51.612821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.519039+0000","last_change":"2024-09-11T23:56:57.344691+0000","last_active":"2024-09-11T23:57:08.519039+0000","last_peered":"2024-09-11T23:57:08.519039+0000","last_clean":"2024-09-11T23:57:08.519039+0000","last_became_active":"2024-09-11T23:56:57.344358+0000","last_became_peered":"2024-09-11T23:56:57.344358+0000","last_unstale":"2024-09-11T23:57:08.519039+0000","last_undegraded":"2024-09-11T23:57:08.519039+0000","last_fullsized":"2024-09-11T23:57:08.519039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:22.014079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:07.857828+0000","last_change":"2024-09-11T23:56:57.352838+0000","last_active":"2024-09-11T23:57:07.857828+0000","last_peered":"2024-09-11T23:57:07.857828+0000","last_clean":"2024-09-11T23:57:07.857828+0000","last_became_active":"2024-09-11T23:56:57.352043+0000","last_became_peered":"2024-09-11T23:56:57.352043+0000","last_unstale":"2024-09-11T23:57:07.857828+0000","last_undegraded":"2024-09-11T23:57:07.857828+0000","last_fullsized":"2024-09-11T23:57:07.857828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:01.897496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021410+0000","last_change":"2024-09-11T23:56:57.363300+0000","last_active":"2024-09-11T23:57:08.021410+0000","last_peered":"2024-09-11T23:57:08.021410+0000","last_clean":"2024-09-11T23:57:08.021410+0000","last_became_active":"2024-09-11T23:56:57.363001+0000","last_became_peered":"2024-09-11T23:56:57.363001+0000","last_unstale":"2024-09-11T23:57:08.021410+0000","last_undegraded":"2024-09-11T23:57:08.021410+0000","last_fullsized":"2024-09-11T23:57:08.021410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:36.585495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.021770+0000","last_change":"2024-09-11T23:56:57.359008+0000","last_active":"2024-09-11T23:57:08.021770+0000","last_peered":"2024-09-11T23:57:08.021770+0000","last_clean":"2024-09-11T23:57:08.021770+0000","last_became_active":"2024-09-11T23:56:57.358701+0000","last_became_peered":"2024-09-11T23:56:57.358701+0000","last_unstale":"2024-09-11T23:57:08.021770+0000","last_undegraded":"2024-09-11T23:57:08.021770+0000","last_fullsized":"2024-09-11T23:57:08.021770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:24.287725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:57:08.022175+0000","last_change":"2024-09-11T23:56:57.361104+0000","last_active":"2024-09-11T23:57:08.022175+0000","last_peered":"2024-09-11T23:57:08.022175+0000","last_clean":"2024-09-11T23:57:08.022175+0000","last_became_active":"2024-09-11T23:56:57.360095+0000","last_became_peered":"2024-09-11T23:56:57.360095+0000","last_unstale":"2024-09-11T23:57:08.022175+0000","last_undegraded":"2024-09-11T23:57:08.022175+0000","last_fullsized":"2024-09-11T23:57:08.022175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:29.577779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59228,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":160,"num_read_kb":148,"num_write":241,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":168616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":253517,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579929,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":477102,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808861,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":1116331,"data_compressed":54370,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":481128,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201319,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":477410,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430252,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":1073909,"data_compressed":54370,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":472929,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822710,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":1069098,"data_compressed":54370,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":476610,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":472244,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":526199,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":517304,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":473992,"data_compressed":17685,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35046,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35046,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":45490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":54149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:57:59.543 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T23:57:59.543 INFO:tasks.cephadm:Setting up client nodes... 2024-09-11T23:57:59.544 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T23:57:59.806 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:00.065 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:57:59 smithi006 ceph-mon[30947]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:00.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:57:59 smithi134 ceph-mon[34893]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:00.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:57:59 smithi039 ceph-mon[34543]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:00.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.295+0000 7fec0982b640 1 -- 172.21.15.6:0/863821612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec04104fd0 msgr2=0x7fec041073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:00.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.295+0000 7fec0982b640 1 --2- 172.21.15.6:0/863821612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec04104fd0 0x7fec041073c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7febec009900 tx=0x7febec02a410 comp rx=0 tx=0).stop 2024-09-11T23:58:00.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.295+0000 7fec0982b640 1 -- 172.21.15.6:0/863821612 shutdown_connections 2024-09-11T23:58:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.295+0000 7fec0982b640 1 --2- 172.21.15.6:0/863821612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec04107900 0x7fec04109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.295+0000 7fec0982b640 1 --2- 172.21.15.6:0/863821612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec04104fd0 0x7fec041073c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.295+0000 7fec0982b640 1 --2- 172.21.15.6:0/863821612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec041026a0 0x7fec04104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.295+0000 7fec0982b640 1 -- 172.21.15.6:0/863821612 >> 172.21.15.6:0/863821612 conn(0x7fec040fc2a0 msgr2=0x7fec040fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.295+0000 7fec0982b640 1 -- 172.21.15.6:0/863821612 shutdown_connections 2024-09-11T23:58:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.296+0000 7fec0982b640 1 -- 172.21.15.6:0/863821612 wait complete. 2024-09-11T23:58:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.296+0000 7fec0982b640 1 Processor -- start 2024-09-11T23:58:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.296+0000 7fec0982b640 1 -- start start 2024-09-11T23:58:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.296+0000 7fec0982b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec041026a0 0x7fec04102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.296+0000 7fec0982b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec04104fd0 0x7fec04100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.296+0000 7fec0982b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec04107900 0x7fec04100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec0982b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fec0410d870 con 0x7fec04107900 2024-09-11T23:58:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec0982b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fec0410d6f0 con 0x7fec04104fd0 2024-09-11T23:58:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec0982b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fec0410d9f0 con 0x7fec041026a0 2024-09-11T23:58:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec037fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec04107900 0x7fec04100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec037fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec04107900 0x7fec04100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50000/0 (socket says 172.21.15.6:50000) 2024-09-11T23:58:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec037fe640 1 -- 172.21.15.6:0/3647903971 learned_addr learned my addr 172.21.15.6:0/3647903971 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec027fc640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec04104fd0 0x7fec04100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec02ffd640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec041026a0 0x7fec04102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec037fe640 1 -- 172.21.15.6:0/3647903971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec041026a0 msgr2=0x7fec04102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec037fe640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec041026a0 0x7fec04102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec037fe640 1 -- 172.21.15.6:0/3647903971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec04104fd0 msgr2=0x7fec04100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec037fe640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec04104fd0 0x7fec04100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec037fe640 1 -- 172.21.15.6:0/3647903971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec04101450 con 0x7fec04107900 2024-09-11T23:58:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec037fe640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec04107900 0x7fec04100b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7febfc00b970 tx=0x7febfc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec08829640 1 -- 172.21.15.6:0/3647903971 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc019070 con 0x7fec04107900 2024-09-11T23:58:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec0982b640 1 -- 172.21.15.6:0/3647903971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec041a2150 con 0x7fec04107900 2024-09-11T23:58:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.297+0000 7fec08829640 1 -- 172.21.15.6:0/3647903971 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7febfc014440 con 0x7fec04107900 2024-09-11T23:58:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.298+0000 7fec08829640 1 -- 172.21.15.6:0/3647903971 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc0075d0 con 0x7fec04107900 2024-09-11T23:58:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.298+0000 7fec0982b640 1 -- 172.21.15.6:0/3647903971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec041a2690 con 0x7fec04107900 2024-09-11T23:58:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.299+0000 7fec0982b640 1 -- 172.21.15.6:0/3647903971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec040fdd90 con 0x7fec04107900 2024-09-11T23:58:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.300+0000 7fec08829640 1 -- 172.21.15.6:0/3647903971 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7febfc01c070 con 0x7fec04107900 2024-09-11T23:58:00.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.301+0000 7fec08829640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7febf00a2c10 0x7febf00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:00.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.301+0000 7fec02ffd640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7febf00a2c10 0x7febf00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:00.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.301+0000 7fec08829640 1 -- 172.21.15.6:0/3647903971 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7febfc0ce810 con 0x7fec04107900 2024-09-11T23:58:00.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.301+0000 7fec02ffd640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7febf00a2c10 0x7febf00a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7febf4009990 tx=0x7febf4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:00.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.305+0000 7fec08829640 1 -- 172.21.15.6:0/3647903971 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7febfc09ae90 con 0x7fec04107900 2024-09-11T23:58:00.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.553+0000 7fec0982b640 1 -- 172.21.15.6:0/3647903971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fec04062df0 con 0x7fec04107900 2024-09-11T23:58:00.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.556+0000 7fec08829640 1 -- 172.21.15.6:0/3647903971 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7febfc09f190 con 0x7fec04107900 2024-09-11T23:58:00.555 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-09-11T23:58:00.556 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCILuJm/qIZIRAAY6IvuP5fl1WjF26uwREq2w== 2024-09-11T23:58:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.558+0000 7fec0982b640 1 -- 172.21.15.6:0/3647903971 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7febf00a2c10 msgr2=0x7febf00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.558+0000 7fec0982b640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7febf00a2c10 0x7febf00a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7febf4009990 tx=0x7febf4009110 comp rx=0 tx=0).stop 2024-09-11T23:58:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.558+0000 7fec0982b640 1 -- 172.21.15.6:0/3647903971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec04107900 msgr2=0x7fec04100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.558+0000 7fec0982b640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec04107900 0x7fec04100b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7febfc00b970 tx=0x7febfc00bd70 comp rx=0 tx=0).stop 2024-09-11T23:58:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.558+0000 7fec0982b640 1 -- 172.21.15.6:0/3647903971 shutdown_connections 2024-09-11T23:58:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.558+0000 7fec0982b640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7febf00a2c10 0x7febf00a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.558+0000 7fec0982b640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec04107900 0x7fec04100b90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.558+0000 7fec0982b640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec04104fd0 0x7fec04100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.558+0000 7fec0982b640 1 --2- 172.21.15.6:0/3647903971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec041026a0 0x7fec04102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.558+0000 7fec0982b640 1 -- 172.21.15.6:0/3647903971 >> 172.21.15.6:0/3647903971 conn(0x7fec040fc2a0 msgr2=0x7fec041030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.558+0000 7fec0982b640 1 -- 172.21.15.6:0/3647903971 shutdown_connections 2024-09-11T23:58:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:00.558+0000 7fec0982b640 1 -- 172.21.15.6:0/3647903971 wait complete. 2024-09-11T23:58:00.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:00 smithi006 ceph-mon[30947]: pgmap v315: 129 pgs: 129 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-11T23:58:00.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:00 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3647903971' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T23:58:00.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:00 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3647903971' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T23:58:01.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:00 smithi134 ceph-mon[34893]: pgmap v315: 129 pgs: 129 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-11T23:58:01.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:00 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3647903971' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T23:58:01.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:00 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3647903971' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T23:58:01.248 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-11T23:58:01.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-11T23:58:01.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T23:58:01.288 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T23:58:01.288 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-11T23:58:01.289 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-11T23:58:01.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:00 smithi039 ceph-mon[34543]: pgmap v315: 129 pgs: 129 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-11T23:58:01.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:00 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3647903971' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T23:58:01.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:00 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3647903971' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T23:58:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-11T23:58:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-11T23:58:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-09-11T23:58:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-11T23:58:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]: dispatch 2024-09-11T23:58:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-11T23:58:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]: dispatch 2024-09-11T23:58:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-09-11T23:58:02.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 10]}]: dispatch 2024-09-11T23:58:02.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-09-11T23:58:02.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.089+0000 7f214078b640 1 -- 172.21.15.6:0/1052103862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2138100a80 msgr2=0x7f2138100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:02.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.089+0000 7f214078b640 1 --2- 172.21.15.6:0/1052103862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2138100a80 0x7f2138100ee0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2128009930 tx=0x7f212802a420 comp rx=0 tx=0).stop 2024-09-11T23:58:02.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.089+0000 7f214078b640 1 -- 172.21.15.6:0/1052103862 shutdown_connections 2024-09-11T23:58:02.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.089+0000 7f214078b640 1 --2- 172.21.15.6:0/1052103862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2138101420 0x7f213810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.089+0000 7f214078b640 1 --2- 172.21.15.6:0/1052103862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2138100a80 0x7f2138100ee0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.089+0000 7f214078b640 1 --2- 172.21.15.6:0/1052103862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2138106a80 0x7f2138106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.089+0000 7f214078b640 1 -- 172.21.15.6:0/1052103862 >> 172.21.15.6:0/1052103862 conn(0x7f21380fc7a0 msgr2=0x7f21380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:02.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.089+0000 7f214078b640 1 -- 172.21.15.6:0/1052103862 shutdown_connections 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.089+0000 7f214078b640 1 -- 172.21.15.6:0/1052103862 wait complete. 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f214078b640 1 Processor -- start 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f214078b640 1 -- start start 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f214078b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2138100a80 0x7f213819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f214078b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2138101420 0x7f213819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f214078b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2138106a80 0x7f213819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f214078b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2138110d50 con 0x7f2138106a80 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f214078b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2138110bd0 con 0x7f2138100a80 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f214078b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2138110ed0 con 0x7f2138101420 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f213ed28640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2138106a80 0x7f213819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f213ed28640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2138106a80 0x7f213819eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51624/0 (socket says 172.21.15.6:51624) 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f213ed28640 1 -- 172.21.15.6:0/1875920287 learned_addr learned my addr 172.21.15.6:0/1875920287 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:02.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f213e527640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2138100a80 0x7f213819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f213dd26640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2138101420 0x7f213819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f213ed28640 1 -- 172.21.15.6:0/1875920287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2138101420 msgr2=0x7f213819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f213ed28640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2138101420 0x7f213819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f213ed28640 1 -- 172.21.15.6:0/1875920287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2138100a80 msgr2=0x7f213819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f213ed28640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2138100a80 0x7f213819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f213ed28640 1 -- 172.21.15.6:0/1875920287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213819f5b0 con 0x7f2138106a80 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f213e527640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2138100a80 0x7f213819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.090+0000 7f213ed28640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2138106a80 0x7f213819eed0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f213000b970 tx=0x7f213000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.091+0000 7f212f7fe640 1 -- 172.21.15.6:0/1875920287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2130019070 con 0x7f2138106a80 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.091+0000 7f214078b640 1 -- 172.21.15.6:0/1875920287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f213819f8a0 con 0x7f2138106a80 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.091+0000 7f212f7fe640 1 -- 172.21.15.6:0/1875920287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2130014440 con 0x7f2138106a80 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.091+0000 7f212f7fe640 1 -- 172.21.15.6:0/1875920287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21300075d0 con 0x7f2138106a80 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.091+0000 7f214078b640 1 -- 172.21.15.6:0/1875920287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21381a7180 con 0x7f2138106a80 2024-09-11T23:58:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.092+0000 7f214078b640 1 -- 172.21.15.6:0/1875920287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2138100ee0 con 0x7f2138106a80 2024-09-11T23:58:02.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.093+0000 7f212f7fe640 1 -- 172.21.15.6:0/1875920287 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f213001c070 con 0x7f2138106a80 2024-09-11T23:58:02.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.094+0000 7f212f7fe640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f21240a2c10 0x7f21240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:02.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.094+0000 7f213e527640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f21240a2c10 0x7f21240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:02.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.094+0000 7f212f7fe640 1 -- 172.21.15.6:0/1875920287 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f21300cea50 con 0x7f2138106a80 2024-09-11T23:58:02.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.094+0000 7f213e527640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f21240a2c10 0x7f21240a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f21340058c0 tx=0x7f2134005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:02.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.098+0000 7f212f7fe640 1 -- 172.21.15.6:0/1875920287 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f213009af50 con 0x7f2138106a80 2024-09-11T23:58:02.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-11T23:58:02.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-11T23:58:02.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-09-11T23:58:02.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-11T23:58:02.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]: dispatch 2024-09-11T23:58:02.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-11T23:58:02.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]: dispatch 2024-09-11T23:58:02.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-09-11T23:58:02.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 10]}]: dispatch 2024-09-11T23:58:02.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-09-11T23:58:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-11T23:58:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-11T23:58:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-09-11T23:58:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-11T23:58:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]: dispatch 2024-09-11T23:58:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-11T23:58:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]: dispatch 2024-09-11T23:58:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-09-11T23:58:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 10]}]: dispatch 2024-09-11T23:58:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-09-11T23:58:02.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.319+0000 7f214078b640 1 -- 172.21.15.6:0/1875920287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f21381a73e0 con 0x7f2138106a80 2024-09-11T23:58:02.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.324+0000 7f212f7fe640 1 -- 172.21.15.6:0/1875920287 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263185 (secure 0 0 0) 0x7f213009f250 con 0x7f2138106a80 2024-09-11T23:58:02.327 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:58:02.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.329+0000 7f214078b640 1 -- 172.21.15.6:0/1875920287 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f21240a2c10 msgr2=0x7f21240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.329+0000 7f214078b640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f21240a2c10 0x7f21240a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f21340058c0 tx=0x7f2134005ec0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.329+0000 7f214078b640 1 -- 172.21.15.6:0/1875920287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2138106a80 msgr2=0x7f213819eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.329+0000 7f214078b640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2138106a80 0x7f213819eed0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f213000b970 tx=0x7f213000be30 comp rx=0 tx=0).stop 2024-09-11T23:58:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.329+0000 7f214078b640 1 -- 172.21.15.6:0/1875920287 shutdown_connections 2024-09-11T23:58:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.329+0000 7f214078b640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f21240a2c10 0x7f21240a50d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.329+0000 7f214078b640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2138106a80 0x7f213819eed0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.329+0000 7f214078b640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2138101420 0x7f213819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.329+0000 7f214078b640 1 --2- 172.21.15.6:0/1875920287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2138100a80 0x7f213819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.329+0000 7f214078b640 1 -- 172.21.15.6:0/1875920287 >> 172.21.15.6:0/1875920287 conn(0x7f21380fc7a0 msgr2=0x7f213806a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.329+0000 7f214078b640 1 -- 172.21.15.6:0/1875920287 shutdown_connections 2024-09-11T23:58:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:02.329+0000 7f214078b640 1 -- 172.21.15.6:0/1875920287 wait complete. 2024-09-11T23:58:03.013 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: pgmap v316: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 KiB/s wr, 13 op/s 2024-09-11T23:58:03.013 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-11T23:58:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-11T23:58:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-09-11T23:58:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-11T23:58:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-09-11T23:58:03.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-11T23:58:03.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]': finished 2024-09-11T23:58:03.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-09-11T23:58:03.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 10]}]': finished 2024-09-11T23:58:03.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-11T23:58:03.016 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T23:58:03.016 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:02 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1875920287' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T23:58:03.041 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":306795778},{"type":"v1","addr":"172.21.15.6:6801","nonce":306795778}]},"active_addr":"172.21.15.6:6801/306795778","active_change":"2024-09-11T23:50:00.847130+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.6:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3044448245}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":107871561}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":74966729}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":395009638}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3587526458}]}]} 2024-09-11T23:58:03.048 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-11T23:58:03.048 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-11T23:58:03.048 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:58:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: pgmap v316: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 KiB/s wr, 13 op/s 2024-09-11T23:58:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-11T23:58:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-11T23:58:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-09-11T23:58:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-11T23:58:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-09-11T23:58:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-11T23:58:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]': finished 2024-09-11T23:58:03.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-09-11T23:58:03.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 10]}]': finished 2024-09-11T23:58:03.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-11T23:58:03.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T23:58:03.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:02 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1875920287' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T23:58:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: pgmap v316: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 KiB/s wr, 13 op/s 2024-09-11T23:58:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-11T23:58:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-11T23:58:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-09-11T23:58:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-11T23:58:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-09-11T23:58:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-11T23:58:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]': finished 2024-09-11T23:58:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-09-11T23:58:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 10]}]': finished 2024-09-11T23:58:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-11T23:58:03.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T23:58:03.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:02 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1875920287' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T23:58:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.866+0000 7f42580d1640 1 -- 172.21.15.6:0/3320556317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250102d40 msgr2=0x7f4250103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.866+0000 7f42580d1640 1 --2- 172.21.15.6:0/3320556317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250102d40 0x7f4250103120 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f424c009900 tx=0x7f424c02a480 comp rx=0 tx=0).stop 2024-09-11T23:58:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.866+0000 7f42580d1640 1 -- 172.21.15.6:0/3320556317 shutdown_connections 2024-09-11T23:58:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.866+0000 7f42580d1640 1 --2- 172.21.15.6:0/3320556317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f425010c170 0x7f425010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.866+0000 7f42580d1640 1 --2- 172.21.15.6:0/3320556317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4250103660 0x7f425010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.866+0000 7f42580d1640 1 --2- 172.21.15.6:0/3320556317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250102d40 0x7f4250103120 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.866+0000 7f42580d1640 1 -- 172.21.15.6:0/3320556317 >> 172.21.15.6:0/3320556317 conn(0x7f42500fc7a0 msgr2=0x7f42500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.866+0000 7f42580d1640 1 -- 172.21.15.6:0/3320556317 shutdown_connections 2024-09-11T23:58:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.866+0000 7f42580d1640 1 -- 172.21.15.6:0/3320556317 wait complete. 2024-09-11T23:58:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.866+0000 7f42580d1640 1 Processor -- start 2024-09-11T23:58:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.866+0000 7f42580d1640 1 -- start start 2024-09-11T23:58:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f42580d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250102d40 0x7f42501984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f42580d1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4250103660 0x7f4250198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f42580d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f425010c170 0x7f425019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f42580d1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4250111ee0 con 0x7f4250102d40 2024-09-11T23:58:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f42580d1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4250111d60 con 0x7f4250103660 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f42580d1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4250112060 con 0x7f425010c170 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f4255e6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250102d40 0x7f42501984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f4255e6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250102d40 0x7f42501984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51638/0 (socket says 172.21.15.6:51638) 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f4255e6d640 1 -- 172.21.15.6:0/3091212651 learned_addr learned my addr 172.21.15.6:0/3091212651 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f425566c640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4250103660 0x7f4250198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f425666e640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f425010c170 0x7f425019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f4255e6d640 1 -- 172.21.15.6:0/3091212651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f425010c170 msgr2=0x7f425019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f4255e6d640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f425010c170 0x7f425019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f4255e6d640 1 -- 172.21.15.6:0/3091212651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4250103660 msgr2=0x7f4250198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f4255e6d640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4250103660 0x7f4250198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f4255e6d640 1 -- 172.21.15.6:0/3091212651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425019d490 con 0x7f4250102d40 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.867+0000 7f4255e6d640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250102d40 0x7f42501984e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f424c006010 tx=0x7f424c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.868+0000 7f4242ffd640 1 -- 172.21.15.6:0/3091212651 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c03f030 con 0x7f4250102d40 2024-09-11T23:58:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.868+0000 7f4242ffd640 1 -- 172.21.15.6:0/3091212651 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f424c0035f0 con 0x7f4250102d40 2024-09-11T23:58:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.868+0000 7f42580d1640 1 -- 172.21.15.6:0/3091212651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425019d720 con 0x7f4250102d40 2024-09-11T23:58:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.868+0000 7f4242ffd640 1 -- 172.21.15.6:0/3091212651 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c035070 con 0x7f4250102d40 2024-09-11T23:58:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.868+0000 7f42580d1640 1 -- 172.21.15.6:0/3091212651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42501a5060 con 0x7f4250102d40 2024-09-11T23:58:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.869+0000 7f42580d1640 1 -- 172.21.15.6:0/3091212651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42501031a0 con 0x7f4250102d40 2024-09-11T23:58:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.870+0000 7f4242ffd640 1 -- 172.21.15.6:0/3091212651 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f424c003b10 con 0x7f4250102d40 2024-09-11T23:58:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.871+0000 7f4242ffd640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f423c0a2c90 0x7f423c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.871+0000 7f4242ffd640 1 -- 172.21.15.6:0/3091212651 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f424c0f0290 con 0x7f4250102d40 2024-09-11T23:58:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.871+0000 7f425566c640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f423c0a2c90 0x7f423c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.872+0000 7f425566c640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f423c0a2c90 0x7f423c0a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42500fee70 tx=0x7f4244009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:03.874+0000 7f4242ffd640 1 -- 172.21.15.6:0/3091212651 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f424c0bcd30 con 0x7f4250102d40 2024-09-11T23:58:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.051+0000 7f42580d1640 1 -- 172.21.15.6:0/3091212651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42501071e0 con 0x7f4250102d40 2024-09-11T23:58:04.052 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:03 smithi006 ceph-mon[30947]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T23:58:04.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.053+0000 7f4242ffd640 1 -- 172.21.15.6:0/3091212651 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24668 (secure 0 0 0) 0x7f424c0bc630 con 0x7f4250102d40 2024-09-11T23:58:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:58:04.053 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":88,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-11T23:58:02.808790+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:56:54.204314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:56:56.327143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:57:02.826677+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:58:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.055+0000 7f42580d1640 1 -- 172.21.15.6:0/3091212651 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f423c0a2c90 msgr2=0x7f423c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.055+0000 7f42580d1640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f423c0a2c90 0x7f423c0a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42500fee70 tx=0x7f4244009060 comp rx=0 tx=0).stop 2024-09-11T23:58:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.055+0000 7f42580d1640 1 -- 172.21.15.6:0/3091212651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250102d40 msgr2=0x7f42501984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.055+0000 7f42580d1640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250102d40 0x7f42501984e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f424c006010 tx=0x7f424c004270 comp rx=0 tx=0).stop 2024-09-11T23:58:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.055+0000 7f42580d1640 1 -- 172.21.15.6:0/3091212651 shutdown_connections 2024-09-11T23:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.055+0000 7f42580d1640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f423c0a2c90 0x7f423c0a5150 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.055+0000 7f42580d1640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f425010c170 0x7f425019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.055+0000 7f42580d1640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4250103660 0x7f4250198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.055+0000 7f42580d1640 1 --2- 172.21.15.6:0/3091212651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250102d40 0x7f42501984e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.055+0000 7f42580d1640 1 -- 172.21.15.6:0/3091212651 >> 172.21.15.6:0/3091212651 conn(0x7f42500fc7a0 msgr2=0x7f42500fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.055+0000 7f42580d1640 1 -- 172.21.15.6:0/3091212651 shutdown_connections 2024-09-11T23:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:04.055+0000 7f42580d1640 1 -- 172.21.15.6:0/3091212651 wait complete. 2024-09-11T23:58:04.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:03 smithi134 ceph-mon[34893]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T23:58:04.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:03 smithi039 ceph-mon[34543]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T23:58:04.736 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-11T23:58:04.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:58:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:05.116 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:04 smithi134 ceph-mon[34893]: pgmap v319: 129 pgs: 1 peering, 128 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2024-09-11T23:58:05.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:04 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3091212651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:05.117 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:04 smithi006 ceph-mon[30947]: pgmap v319: 129 pgs: 1 peering, 128 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2024-09-11T23:58:05.117 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:04 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3091212651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:05.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:04 smithi039 ceph-mon[34543]: pgmap v319: 129 pgs: 1 peering, 128 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2024-09-11T23:58:05.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:04 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3091212651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.524+0000 7fe67750d640 1 -- 172.21.15.6:0/3062496665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe670102570 msgr2=0x7fe6701029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.524+0000 7fe67750d640 1 --2- 172.21.15.6:0/3062496665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe670102570 0x7fe6701029b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe660009900 tx=0x7fe66002a480 comp rx=0 tx=0).stop 2024-09-11T23:58:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.524+0000 7fe67750d640 1 -- 172.21.15.6:0/3062496665 shutdown_connections 2024-09-11T23:58:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.524+0000 7fe67750d640 1 --2- 172.21.15.6:0/3062496665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe670102ef0 0x7fe67010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.524+0000 7fe67750d640 1 --2- 172.21.15.6:0/3062496665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe670102570 0x7fe6701029b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.524+0000 7fe67750d640 1 --2- 172.21.15.6:0/3062496665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe670100e20 0x7fe670101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.524+0000 7fe67750d640 1 -- 172.21.15.6:0/3062496665 >> 172.21.15.6:0/3062496665 conn(0x7fe6700fc7d0 msgr2=0x7fe6700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.524+0000 7fe67750d640 1 -- 172.21.15.6:0/3062496665 shutdown_connections 2024-09-11T23:58:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.524+0000 7fe67750d640 1 -- 172.21.15.6:0/3062496665 wait complete. 2024-09-11T23:58:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.525+0000 7fe67750d640 1 Processor -- start 2024-09-11T23:58:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.525+0000 7fe67750d640 1 -- start start 2024-09-11T23:58:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.525+0000 7fe67750d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe670100e20 0x7fe6701984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.525+0000 7fe67750d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe670102570 0x7fe670198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.525+0000 7fe67750d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe670102ef0 0x7fe67019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.525+0000 7fe67750d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe670110e30 con 0x7fe670100e20 2024-09-11T23:58:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.525+0000 7fe67750d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe670110cb0 con 0x7fe670102ef0 2024-09-11T23:58:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.525+0000 7fe67750d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe670110fb0 con 0x7fe670102570 2024-09-11T23:58:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.525+0000 7fe6752a9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe670100e20 0x7fe6701984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.525+0000 7fe6752a9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe670100e20 0x7fe6701984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51664/0 (socket says 172.21.15.6:51664) 2024-09-11T23:58:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.525+0000 7fe674aa8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe670102570 0x7fe670198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.525+0000 7fe6752a9640 1 -- 172.21.15.6:0/3747160991 learned_addr learned my addr 172.21.15.6:0/3747160991 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.526+0000 7fe675aaa640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe670102ef0 0x7fe67019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.526+0000 7fe6752a9640 1 -- 172.21.15.6:0/3747160991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe670102570 msgr2=0x7fe670198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.526+0000 7fe6752a9640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe670102570 0x7fe670198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.526+0000 7fe6752a9640 1 -- 172.21.15.6:0/3747160991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe670102ef0 msgr2=0x7fe67019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.526+0000 7fe6752a9640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe670102ef0 0x7fe67019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.526+0000 7fe6752a9640 1 -- 172.21.15.6:0/3747160991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67019d480 con 0x7fe670100e20 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.526+0000 7fe6752a9640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe670100e20 0x7fe6701984d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00d770 tx=0x7fe66c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.526+0000 7fe6667fc640 1 -- 172.21.15.6:0/3747160991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c017070 con 0x7fe670100e20 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.526+0000 7fe67750d640 1 -- 172.21.15.6:0/3747160991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67019d770 con 0x7fe670100e20 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.526+0000 7fe6667fc640 1 -- 172.21.15.6:0/3747160991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe66c0054d0 con 0x7fe670100e20 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.526+0000 7fe6667fc640 1 -- 172.21.15.6:0/3747160991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c004cf0 con 0x7fe670100e20 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.526+0000 7fe67750d640 1 -- 172.21.15.6:0/3747160991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6701a5050 con 0x7fe670100e20 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.527+0000 7fe67750d640 1 -- 172.21.15.6:0/3747160991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe670101200 con 0x7fe670100e20 2024-09-11T23:58:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.529+0000 7fe6667fc640 1 -- 172.21.15.6:0/3747160991 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe66c004e90 con 0x7fe670100e20 2024-09-11T23:58:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.529+0000 7fe6667fc640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe65c0a2c10 0x7fe65c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.529+0000 7fe674aa8640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe65c0a2c10 0x7fe65c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.529+0000 7fe6667fc640 1 -- 172.21.15.6:0/3747160991 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fe66c0cf350 con 0x7fe670100e20 2024-09-11T23:58:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.530+0000 7fe674aa8640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe65c0a2c10 0x7fe65c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe660009230 tx=0x7fe6600058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.533+0000 7fe6667fc640 1 -- 172.21.15.6:0/3747160991 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe66c09be90 con 0x7fe670100e20 2024-09-11T23:58:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.710+0000 7fe67750d640 1 -- 172.21.15.6:0/3747160991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe67010a0a0 con 0x7fe670100e20 2024-09-11T23:58:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.712+0000 7fe6667fc640 1 -- 172.21.15.6:0/3747160991 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24668 (secure 0 0 0) 0x7fe66c09b790 con 0x7fe670100e20 2024-09-11T23:58:05.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:58:05.720 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":88,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-11T23:58:02.808790+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:56:54.204314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:56:56.327143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:57:02.826677+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:58:05.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.714+0000 7fe67750d640 1 -- 172.21.15.6:0/3747160991 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe65c0a2c10 msgr2=0x7fe65c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:05.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.714+0000 7fe67750d640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe65c0a2c10 0x7fe65c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe660009230 tx=0x7fe6600058d0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.714+0000 7fe67750d640 1 -- 172.21.15.6:0/3747160991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe670100e20 msgr2=0x7fe6701984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:05.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.714+0000 7fe67750d640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe670100e20 0x7fe6701984d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00d770 tx=0x7fe66c00dc30 comp rx=0 tx=0).stop 2024-09-11T23:58:05.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.714+0000 7fe67750d640 1 -- 172.21.15.6:0/3747160991 shutdown_connections 2024-09-11T23:58:05.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.714+0000 7fe67750d640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe65c0a2c10 0x7fe65c0a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.714+0000 7fe67750d640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe670102ef0 0x7fe67019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.714+0000 7fe67750d640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe670102570 0x7fe670198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.714+0000 7fe67750d640 1 --2- 172.21.15.6:0/3747160991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe670100e20 0x7fe6701984d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.714+0000 7fe67750d640 1 -- 172.21.15.6:0/3747160991 >> 172.21.15.6:0/3747160991 conn(0x7fe6700fc7d0 msgr2=0x7fe67006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:05.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.714+0000 7fe67750d640 1 -- 172.21.15.6:0/3747160991 shutdown_connections 2024-09-11T23:58:05.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:05.714+0000 7fe67750d640 1 -- 172.21.15.6:0/3747160991 wait complete. 2024-09-11T23:58:06.060 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:05 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3747160991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:05 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3747160991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:06.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:05 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3747160991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:06.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-11T23:58:06.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-11T23:58:06.377 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-11T23:58:06.377 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-11T23:58:06.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-11T23:58:06.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-11T23:58:06.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-11T23:58:06.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-11T23:58:06.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-11T23:58:06.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-11T23:58:06.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-11T23:58:06.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-11T23:58:07.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:06 smithi006 ceph-mon[30947]: pgmap v320: 129 pgs: 1 peering, 128 active+clean; 643 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:58:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:06 smithi134 ceph-mon[34893]: pgmap v320: 129 pgs: 1 peering, 128 active+clean; 643 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:58:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:07.269 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:07.269 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:07.297 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:06 smithi039 ceph-mon[34543]: pgmap v320: 129 pgs: 1 peering, 128 active+clean; 643 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:58:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.407+0000 7f1816254640 1 -- 172.21.15.6:0/3483260352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810101470 msgr2=0x7f1810101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.407+0000 7f1816254640 1 --2- 172.21.15.6:0/3483260352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810101470 0x7f1810101850 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1800009900 tx=0x7f180002a410 comp rx=0 tx=0).stop 2024-09-11T23:58:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.407+0000 7f1816254640 1 -- 172.21.15.6:0/3483260352 shutdown_connections 2024-09-11T23:58:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.407+0000 7f1816254640 1 --2- 172.21.15.6:0/3483260352 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1810105de0 0x7f181010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.407+0000 7f1816254640 1 --2- 172.21.15.6:0/3483260352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1810101e20 0x7f18101056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.407+0000 7f1816254640 1 --2- 172.21.15.6:0/3483260352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810101470 0x7f1810101850 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.407+0000 7f1816254640 1 -- 172.21.15.6:0/3483260352 >> 172.21.15.6:0/3483260352 conn(0x7f1810077230 msgr2=0x7f18100fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.407+0000 7f1816254640 1 -- 172.21.15.6:0/3483260352 shutdown_connections 2024-09-11T23:58:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.407+0000 7f1816254640 1 -- 172.21.15.6:0/3483260352 wait complete. 2024-09-11T23:58:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.407+0000 7f1816254640 1 Processor -- start 2024-09-11T23:58:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.407+0000 7f1816254640 1 -- start start 2024-09-11T23:58:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f1816254640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1810101470 0x7f1810198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f1816254640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1810101e20 0x7f1810198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f1816254640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810105de0 0x7f181019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f1816254640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1810110cb0 con 0x7f1810105de0 2024-09-11T23:58:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f1816254640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1810110b30 con 0x7f1810101470 2024-09-11T23:58:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f1816254640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1810110e30 con 0x7f1810101e20 2024-09-11T23:58:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f180ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810105de0 0x7f181019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f180ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810105de0 0x7f181019cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51678/0 (socket says 172.21.15.6:51678) 2024-09-11T23:58:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f180ffff640 1 -- 172.21.15.6:0/1014599481 learned_addr learned my addr 172.21.15.6:0/1014599481 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f180f7fe640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1810101470 0x7f1810198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f180effd640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1810101e20 0x7f1810198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f180ffff640 1 -- 172.21.15.6:0/1014599481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1810101e20 msgr2=0x7f1810198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f180ffff640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1810101e20 0x7f1810198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f180ffff640 1 -- 172.21.15.6:0/1014599481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1810101470 msgr2=0x7f1810198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f180ffff640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1810101470 0x7f1810198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f180ffff640 1 -- 172.21.15.6:0/1014599481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181019d2b0 con 0x7f1810105de0 2024-09-11T23:58:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f180ffff640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810105de0 0x7f181019cbd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f180800eaa0 tx=0x7f180800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.408+0000 7f180cff9640 1 -- 172.21.15.6:0/1014599481 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808004d20 con 0x7f1810105de0 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.409+0000 7f1816254640 1 -- 172.21.15.6:0/1014599481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181019d5a0 con 0x7f1810105de0 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.409+0000 7f180cff9640 1 -- 172.21.15.6:0/1014599481 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1808005020 con 0x7f1810105de0 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.409+0000 7f180cff9640 1 -- 172.21.15.6:0/1014599481 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18080116b0 con 0x7f1810105de0 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.409+0000 7f1816254640 1 -- 172.21.15.6:0/1014599481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18101a4e80 con 0x7f1810105de0 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.409+0000 7f1816254640 1 -- 172.21.15.6:0/1014599481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1810100ca0 con 0x7f1810105de0 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.411+0000 7f180cff9640 1 -- 172.21.15.6:0/1014599481 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f18080051d0 con 0x7f1810105de0 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.411+0000 7f180cff9640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f17f80a2c10 0x7f17f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.412+0000 7f180f7fe640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f17f80a2c10 0x7f17f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.412+0000 7f180cff9640 1 -- 172.21.15.6:0/1014599481 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f18080cfa50 con 0x7f1810105de0 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.412+0000 7f180cff9640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335] conn(0x7f17f80adde0 0x7f17f80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.412+0000 7f180cff9640 1 -- 172.21.15.6:0/1014599481 --> [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1808014ec0 con 0x7f17f80adde0 2024-09-11T23:58:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.412+0000 7f180cff9640 1 -- 172.21.15.6:0/1014599481 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f18080cfea0 con 0x7f1810105de0 2024-09-11T23:58:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.412+0000 7f180f7fe640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f17f80a2c10 0x7f17f80a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1800031440 tx=0x7f1800005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.412+0000 7f180effd640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335] conn(0x7f17f80adde0 0x7f17f80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.413+0000 7f180effd640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335] conn(0x7f17f80adde0 0x7f17f80b0280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.413+0000 7f180cff9640 1 -- 172.21.15.6:0/1014599481 <== osd.4 v2:172.21.15.39:6808/1537139335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1808014ec0 con 0x7f17f80adde0 2024-09-11T23:58:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.427+0000 7f1816254640 1 -- 172.21.15.6:0/1014599481 --> [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1810102220 con 0x7f17f80adde0 2024-09-11T23:58:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.427+0000 7f180cff9640 1 -- 172.21.15.6:0/1014599481 <== osd.4 v2:172.21.15.39:6808/1537139335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1810102220 con 0x7f17f80adde0 2024-09-11T23:58:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.428+0000 7f1816254640 1 -- 172.21.15.6:0/1014599481 >> [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335] conn(0x7f17f80adde0 msgr2=0x7f17f80b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.428+0000 7f1816254640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335] conn(0x7f17f80adde0 0x7f17f80b0280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.428+0000 7f1816254640 1 -- 172.21.15.6:0/1014599481 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f17f80a2c10 msgr2=0x7f17f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.428+0000 7f1816254640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f17f80a2c10 0x7f17f80a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1800031440 tx=0x7f1800005b50 comp rx=0 tx=0).stop 2024-09-11T23:58:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.428+0000 7f1816254640 1 -- 172.21.15.6:0/1014599481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810105de0 msgr2=0x7f181019cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.428+0000 7f1816254640 1 --2- 172.21.15.6:0/1014599481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810105de0 0x7f181019cbd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f180800eaa0 tx=0x7f180800eea0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.428+0000 7f180ffff640 1 -- 172.21.15.6:0/1014599481 reap_dead start 2024-09-11T23:58:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.428+0000 7f1816254640 1 -- 172.21.15.6:0/1014599481 shutdown_connections 2024-09-11T23:58:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.428+0000 7f1816254640 1 -- 172.21.15.6:0/1014599481 >> 172.21.15.6:0/1014599481 conn(0x7f1810077230 msgr2=0x7f1810100240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.428+0000 7f1816254640 1 -- 172.21.15.6:0/1014599481 shutdown_connections 2024-09-11T23:58:08.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.428+0000 7f1816254640 1 -- 172.21.15.6:0/1014599481 wait complete. 2024-09-11T23:58:08.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.908+0000 7fe566e0e640 1 -- 172.21.15.6:0/612919095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe560101de0 msgr2=0x7fe5601021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.908+0000 7fe566e0e640 1 --2- 172.21.15.6:0/612919095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe560101de0 0x7fe5601021c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe554009900 tx=0x7fe55402a3f0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.908+0000 7fe566e0e640 1 -- 172.21.15.6:0/612919095 shutdown_connections 2024-09-11T23:58:08.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.908+0000 7fe566e0e640 1 --2- 172.21.15.6:0/612919095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe560106f10 0x7fe56010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.908+0000 7fe566e0e640 1 --2- 172.21.15.6:0/612919095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560102790 0x7fe5601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.908+0000 7fe566e0e640 1 --2- 172.21.15.6:0/612919095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe560101de0 0x7fe5601021c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.908+0000 7fe566e0e640 1 -- 172.21.15.6:0/612919095 >> 172.21.15.6:0/612919095 conn(0x7fe5600fd8c0 msgr2=0x7fe5600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:08.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.908+0000 7fe566e0e640 1 -- 172.21.15.6:0/612919095 shutdown_connections 2024-09-11T23:58:08.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.908+0000 7fe566e0e640 1 -- 172.21.15.6:0/612919095 wait complete. 2024-09-11T23:58:08.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe566e0e640 1 Processor -- start 2024-09-11T23:58:08.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe566e0e640 1 -- start start 2024-09-11T23:58:08.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe566e0e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe560101de0 0x7fe56019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe566e0e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe560102790 0x7fe56019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe566e0e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560106f10 0x7fe56019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe566e0e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe560111e20 con 0x7fe560102790 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe566e0e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe560111ca0 con 0x7fe560101de0 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe566e0e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe560111fa0 con 0x7fe560106f10 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe55ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe560102790 0x7fe56019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe55ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe560102790 0x7fe56019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51694/0 (socket says 172.21.15.6:51694) 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe564baa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe560101de0 0x7fe56019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe55ffff640 1 -- 172.21.15.6:0/3079693401 learned_addr learned my addr 172.21.15.6:0/3079693401 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe5653ab640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560106f10 0x7fe56019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe55ffff640 1 -- 172.21.15.6:0/3079693401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560106f10 msgr2=0x7fe56019ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe55ffff640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560106f10 0x7fe56019ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe55ffff640 1 -- 172.21.15.6:0/3079693401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe560101de0 msgr2=0x7fe56019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.909+0000 7fe55ffff640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe560101de0 0x7fe56019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.910+0000 7fe55ffff640 1 -- 172.21.15.6:0/3079693401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56019f4f0 con 0x7fe560102790 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.910+0000 7fe55ffff640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe560102790 0x7fe56019aa80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00d950 tx=0x7fe54c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.910+0000 7fe55dffb640 1 -- 172.21.15.6:0/3079693401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c017070 con 0x7fe560102790 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.910+0000 7fe55dffb640 1 -- 172.21.15.6:0/3079693401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe54c009c30 con 0x7fe560102790 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.910+0000 7fe566e0e640 1 -- 172.21.15.6:0/3079693401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe56019f7e0 con 0x7fe560102790 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.910+0000 7fe55dffb640 1 -- 172.21.15.6:0/3079693401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c00f620 con 0x7fe560102790 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.910+0000 7fe566e0e640 1 -- 172.21.15.6:0/3079693401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5601a70c0 con 0x7fe560102790 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.911+0000 7fe566e0e640 1 -- 172.21.15.6:0/3079693401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe56010e150 con 0x7fe560102790 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.912+0000 7fe55dffb640 1 -- 172.21.15.6:0/3079693401 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe54c0109a0 con 0x7fe560102790 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.913+0000 7fe55dffb640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe5500a2c10 0x7fe5500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.913+0000 7fe55dffb640 1 -- 172.21.15.6:0/3079693401 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fe54c0cf450 con 0x7fe560102790 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.913+0000 7fe564baa640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe5500a2c10 0x7fe5500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.913+0000 7fe55dffb640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235] conn(0x7fe5500adde0 0x7fe5500b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.913+0000 7fe55dffb640 1 -- 172.21.15.6:0/3079693401 --> [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5500b0950 con 0x7fe5500adde0 2024-09-11T23:58:08.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.913+0000 7fe55dffb640 1 -- 172.21.15.6:0/3079693401 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fe54c0cf8a0 con 0x7fe560102790 2024-09-11T23:58:08.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.913+0000 7fe5653ab640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235] conn(0x7fe5500adde0 0x7fe5500b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.914+0000 7fe564baa640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe5500a2c10 0x7fe5500a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe554031440 tx=0x7fe554005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:08.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.914+0000 7fe5653ab640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235] conn(0x7fe5500adde0 0x7fe5500b0280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:08.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.915+0000 7fe55dffb640 1 -- 172.21.15.6:0/3079693401 <== osd.2 v2:172.21.15.134:6800/3895287235 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe5500b0950 con 0x7fe5500adde0 2024-09-11T23:58:08.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.929+0000 7fe566e0e640 1 -- 172.21.15.6:0/3079693401 --> [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe5601032c0 con 0x7fe5500adde0 2024-09-11T23:58:08.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.929+0000 7fe55dffb640 1 -- 172.21.15.6:0/3079693401 <== osd.2 v2:172.21.15.134:6800/3895287235 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe5601032c0 con 0x7fe5500adde0 2024-09-11T23:58:08.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.930+0000 7fe566e0e640 1 -- 172.21.15.6:0/3079693401 >> [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235] conn(0x7fe5500adde0 msgr2=0x7fe5500b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.930+0000 7fe566e0e640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235] conn(0x7fe5500adde0 0x7fe5500b0280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.930+0000 7fe566e0e640 1 -- 172.21.15.6:0/3079693401 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe5500a2c10 msgr2=0x7fe5500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.930+0000 7fe566e0e640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe5500a2c10 0x7fe5500a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe554031440 tx=0x7fe554005b50 comp rx=0 tx=0).stop 2024-09-11T23:58:08.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.930+0000 7fe566e0e640 1 -- 172.21.15.6:0/3079693401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe560102790 msgr2=0x7fe56019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.930+0000 7fe566e0e640 1 --2- 172.21.15.6:0/3079693401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe560102790 0x7fe56019aa80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00d950 tx=0x7fe54c00de10 comp rx=0 tx=0).stop 2024-09-11T23:58:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.930+0000 7fe5653ab640 1 -- 172.21.15.6:0/3079693401 reap_dead start 2024-09-11T23:58:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.930+0000 7fe566e0e640 1 -- 172.21.15.6:0/3079693401 shutdown_connections 2024-09-11T23:58:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.930+0000 7fe566e0e640 1 -- 172.21.15.6:0/3079693401 >> 172.21.15.6:0/3079693401 conn(0x7fe5600fd8c0 msgr2=0x7fe5600fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.930+0000 7fe566e0e640 1 -- 172.21.15.6:0/3079693401 shutdown_connections 2024-09-11T23:58:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:08.930+0000 7fe566e0e640 1 -- 172.21.15.6:0/3079693401 wait complete. 2024-09-11T23:58:09.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:08 smithi006 ceph-mon[30947]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2024-09-11T23:58:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:08 smithi134 ceph-mon[34893]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2024-09-11T23:58:09.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:08 smithi039 ceph-mon[34543]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2024-09-11T23:58:09.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.590+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1660310169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4100e10 msgr2=0x7fdab4104e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.590+0000 7fdabb9a7640 1 --2- 172.21.15.6:0/1660310169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4100e10 0x7fdab4104e60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009900 tx=0x7fdaa802a410 comp rx=0 tx=0).stop 2024-09-11T23:58:09.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.590+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1660310169 shutdown_connections 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.590+0000 7fdabb9a7640 1 --2- 172.21.15.6:0/1660310169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdab4105590 0x7fdab410d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.590+0000 7fdabb9a7640 1 --2- 172.21.15.6:0/1660310169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4100e10 0x7fdab4104e60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.590+0000 7fdabb9a7640 1 --2- 172.21.15.6:0/1660310169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4100460 0x7fdab4100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.591+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1660310169 >> 172.21.15.6:0/1660310169 conn(0x7fdab40fbee0 msgr2=0x7fdab40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.591+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1660310169 shutdown_connections 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.591+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1660310169 wait complete. 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.591+0000 7fdabb9a7640 1 Processor -- start 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.591+0000 7fdabb9a7640 1 -- start start 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdabb9a7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdab4100460 0x7fdab41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdabb9a7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4100e10 0x7fdab41989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdabb9a7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4105590 0x7fdab419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdabb9a7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdab410fbf0 con 0x7fdab4105590 2024-09-11T23:58:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdabb9a7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdab410fa70 con 0x7fdab4100460 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdabb9a7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdab410fd70 con 0x7fdab4100e10 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab9f44640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4105590 0x7fdab419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab9f44640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4105590 0x7fdab419cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51702/0 (socket says 172.21.15.6:51702) 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab9f44640 1 -- 172.21.15.6:0/1936381323 learned_addr learned my addr 172.21.15.6:0/1936381323 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab9743640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdab4100460 0x7fdab41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab8f42640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4100e10 0x7fdab41989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab9f44640 1 -- 172.21.15.6:0/1936381323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4100e10 msgr2=0x7fdab41989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab9f44640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4100e10 0x7fdab41989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab9f44640 1 -- 172.21.15.6:0/1936381323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdab4100460 msgr2=0x7fdab41984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab9f44640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdab4100460 0x7fdab41984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab9f44640 1 -- 172.21.15.6:0/1936381323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab419d450 con 0x7fdab4105590 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab9f44640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4105590 0x7fdab419cd70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00d950 tx=0x7fdaac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab27fc640 1 -- 172.21.15.6:0/1936381323 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac017030 con 0x7fdab4105590 2024-09-11T23:58:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab27fc640 1 -- 172.21.15.6:0/1936381323 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdaac004020 con 0x7fdab4105590 2024-09-11T23:58:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1936381323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab419d740 con 0x7fdab4105590 2024-09-11T23:58:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.592+0000 7fdab27fc640 1 -- 172.21.15.6:0/1936381323 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac003b20 con 0x7fdab4105590 2024-09-11T23:58:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.593+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1936381323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab41a5020 con 0x7fdab4105590 2024-09-11T23:58:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.593+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1936381323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdab4062880 con 0x7fdab4105590 2024-09-11T23:58:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.595+0000 7fdab27fc640 1 -- 172.21.15.6:0/1936381323 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fdaac01a070 con 0x7fdab4105590 2024-09-11T23:58:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.595+0000 7fdab27fc640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fda9c0a2c90 0x7fda9c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.595+0000 7fdab27fc640 1 -- 172.21.15.6:0/1936381323 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fdaac0cf2e0 con 0x7fdab4105590 2024-09-11T23:58:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.595+0000 7fdab9743640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fda9c0a2c90 0x7fda9c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.596+0000 7fdab27fc640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609] conn(0x7fda9c0ade60 0x7fda9c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.596+0000 7fdab27fc640 1 -- 172.21.15.6:0/1936381323 --> [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdaac004370 con 0x7fda9c0ade60 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.596+0000 7fdab27fc640 1 -- 172.21.15.6:0/1936381323 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fdaac0cf730 con 0x7fdab4105590 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.596+0000 7fdab8f42640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609] conn(0x7fda9c0ade60 0x7fda9c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.596+0000 7fdab9743640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fda9c0a2c90 0x7fda9c0a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4005fd0 tx=0x7fdaa400a790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.596+0000 7fdab8f42640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609] conn(0x7fda9c0ade60 0x7fda9c0b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.597+0000 7fdab27fc640 1 -- 172.21.15.6:0/1936381323 <== osd.1 v2:172.21.15.39:6800/1024701609 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdaac004370 con 0x7fda9c0ade60 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.611+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1936381323 --> [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdab4062c80 con 0x7fda9c0ade60 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.611+0000 7fdab27fc640 1 -- 172.21.15.6:0/1936381323 <== osd.1 v2:172.21.15.39:6800/1024701609 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdab4062c80 con 0x7fda9c0ade60 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.612+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1936381323 >> [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609] conn(0x7fda9c0ade60 msgr2=0x7fda9c0b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.612+0000 7fdabb9a7640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609] conn(0x7fda9c0ade60 0x7fda9c0b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.612+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1936381323 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fda9c0a2c90 msgr2=0x7fda9c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.612+0000 7fdabb9a7640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fda9c0a2c90 0x7fda9c0a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4005fd0 tx=0x7fdaa400a790 comp rx=0 tx=0).stop 2024-09-11T23:58:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.612+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1936381323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4105590 msgr2=0x7fdab419cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.612+0000 7fdabb9a7640 1 --2- 172.21.15.6:0/1936381323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4105590 0x7fdab419cd70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00d950 tx=0x7fdaac00de10 comp rx=0 tx=0).stop 2024-09-11T23:58:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.612+0000 7fdab9f44640 1 -- 172.21.15.6:0/1936381323 reap_dead start 2024-09-11T23:58:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.612+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1936381323 shutdown_connections 2024-09-11T23:58:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.612+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1936381323 >> 172.21.15.6:0/1936381323 conn(0x7fdab40fbee0 msgr2=0x7fdab40fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.612+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1936381323 shutdown_connections 2024-09-11T23:58:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:09.612+0000 7fdabb9a7640 1 -- 172.21.15.6:0/1936381323 wait complete. 2024-09-11T23:58:10.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.486+0000 7fdab92af640 1 -- 172.21.15.6:0/1983184468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4102570 msgr2=0x7fdab41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.486+0000 7fdab92af640 1 --2- 172.21.15.6:0/1983184468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4102570 0x7fdab41029b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009900 tx=0x7fdaa802a480 comp rx=0 tx=0).stop 2024-09-11T23:58:10.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.486+0000 7fdab92af640 1 -- 172.21.15.6:0/1983184468 shutdown_connections 2024-09-11T23:58:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.486+0000 7fdab92af640 1 --2- 172.21.15.6:0/1983184468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdab4102ef0 0x7fdab410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.486+0000 7fdab92af640 1 --2- 172.21.15.6:0/1983184468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4102570 0x7fdab41029b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.486+0000 7fdab92af640 1 --2- 172.21.15.6:0/1983184468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4100e20 0x7fdab4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.486+0000 7fdab92af640 1 -- 172.21.15.6:0/1983184468 >> 172.21.15.6:0/1983184468 conn(0x7fdab40fc7d0 msgr2=0x7fdab40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.486+0000 7fdab92af640 1 -- 172.21.15.6:0/1983184468 shutdown_connections 2024-09-11T23:58:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.486+0000 7fdab92af640 1 -- 172.21.15.6:0/1983184468 wait complete. 2024-09-11T23:58:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.486+0000 7fdab92af640 1 Processor -- start 2024-09-11T23:58:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.487+0000 7fdab92af640 1 -- start start 2024-09-11T23:58:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.487+0000 7fdab92af640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdab4100e20 0x7fdab4198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.487+0000 7fdab92af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4102570 0x7fdab4198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.487+0000 7fdab92af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4102ef0 0x7fdab419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.487+0000 7fdab92af640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdab4111fd0 con 0x7fdab4102ef0 2024-09-11T23:58:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.487+0000 7fdab92af640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdab4111e50 con 0x7fdab4100e20 2024-09-11T23:58:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.487+0000 7fdab92af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdab4112150 con 0x7fdab4102570 2024-09-11T23:58:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.487+0000 7fdab37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4102ef0 0x7fdab419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.487+0000 7fdab37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4102ef0 0x7fdab419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39924/0 (socket says 172.21.15.6:39924) 2024-09-11T23:58:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.487+0000 7fdab37fe640 1 -- 172.21.15.6:0/1392663764 learned_addr learned my addr 172.21.15.6:0/1392663764 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.487+0000 7fdab27fc640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4102570 0x7fdab4198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.487+0000 7fdab2ffd640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdab4100e20 0x7fdab4198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.488+0000 7fdab37fe640 1 -- 172.21.15.6:0/1392663764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4102570 msgr2=0x7fdab4198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.488+0000 7fdab37fe640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4102570 0x7fdab4198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.488+0000 7fdab37fe640 1 -- 172.21.15.6:0/1392663764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdab4100e20 msgr2=0x7fdab4198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.488+0000 7fdab37fe640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdab4100e20 0x7fdab4198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.488+0000 7fdab37fe640 1 -- 172.21.15.6:0/1392663764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab419d4e0 con 0x7fdab4102ef0 2024-09-11T23:58:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.488+0000 7fdab37fe640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4102ef0 0x7fdab419ce00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009fd0 tx=0x7fdaac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.488+0000 7fda9bfff640 1 -- 172.21.15.6:0/1392663764 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac011830 con 0x7fdab4102ef0 2024-09-11T23:58:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.488+0000 7fdab92af640 1 -- 172.21.15.6:0/1392663764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab419d7d0 con 0x7fdab4102ef0 2024-09-11T23:58:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.488+0000 7fda9bfff640 1 -- 172.21.15.6:0/1392663764 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdaac016070 con 0x7fdab4102ef0 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.488+0000 7fda9bfff640 1 -- 172.21.15.6:0/1392663764 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac010de0 con 0x7fdab4102ef0 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.488+0000 7fdab92af640 1 -- 172.21.15.6:0/1392663764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab41a50b0 con 0x7fdab4102ef0 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.489+0000 7fdab92af640 1 -- 172.21.15.6:0/1392663764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdab4062980 con 0x7fdab4102ef0 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.491+0000 7fda9bfff640 1 -- 172.21.15.6:0/1392663764 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fdaac0119d0 con 0x7fdab4102ef0 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.491+0000 7fda9bfff640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fda9c0a2c10 0x7fda9c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.491+0000 7fdab2ffd640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fda9c0a2c10 0x7fda9c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.491+0000 7fda9bfff640 1 -- 172.21.15.6:0/1392663764 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fdaac0cf500 con 0x7fdab4102ef0 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.492+0000 7fda9bfff640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565] conn(0x7fda9c0adde0 0x7fda9c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.492+0000 7fda9bfff640 1 -- 172.21.15.6:0/1392663764 --> [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdaac004450 con 0x7fda9c0adde0 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.492+0000 7fda9bfff640 1 -- 172.21.15.6:0/1392663764 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fdaac0cf950 con 0x7fdab4102ef0 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.492+0000 7fdab2ffd640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fda9c0a2c10 0x7fda9c0a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400a400 tx=0x7fdaa400d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.492+0000 7fdab27fc640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565] conn(0x7fda9c0adde0 0x7fda9c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.492+0000 7fdab27fc640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565] conn(0x7fda9c0adde0 0x7fda9c0b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.493+0000 7fda9bfff640 1 -- 172.21.15.6:0/1392663764 <== osd.5 v2:172.21.15.134:6808/1350729565 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdaac004450 con 0x7fda9c0adde0 2024-09-11T23:58:10.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.508+0000 7fdab92af640 1 -- 172.21.15.6:0/1392663764 --> [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdab4062e00 con 0x7fda9c0adde0 2024-09-11T23:58:10.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.508+0000 7fda9bfff640 1 -- 172.21.15.6:0/1392663764 <== osd.5 v2:172.21.15.134:6808/1350729565 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdab4062e00 con 0x7fda9c0adde0 2024-09-11T23:58:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.508+0000 7fdab92af640 1 -- 172.21.15.6:0/1392663764 >> [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565] conn(0x7fda9c0adde0 msgr2=0x7fda9c0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.508+0000 7fdab92af640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565] conn(0x7fda9c0adde0 0x7fda9c0b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.509+0000 7fdab92af640 1 -- 172.21.15.6:0/1392663764 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fda9c0a2c10 msgr2=0x7fda9c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.509+0000 7fdab92af640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fda9c0a2c10 0x7fda9c0a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400a400 tx=0x7fdaa400d040 comp rx=0 tx=0).stop 2024-09-11T23:58:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.509+0000 7fdab92af640 1 -- 172.21.15.6:0/1392663764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4102ef0 msgr2=0x7fdab419ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.509+0000 7fdab92af640 1 --2- 172.21.15.6:0/1392663764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab4102ef0 0x7fdab419ce00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009fd0 tx=0x7fdaac00b8e0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.509+0000 7fdab37fe640 1 -- 172.21.15.6:0/1392663764 reap_dead start 2024-09-11T23:58:10.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.509+0000 7fdab92af640 1 -- 172.21.15.6:0/1392663764 shutdown_connections 2024-09-11T23:58:10.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.509+0000 7fdab92af640 1 -- 172.21.15.6:0/1392663764 >> 172.21.15.6:0/1392663764 conn(0x7fdab40fc7d0 msgr2=0x7fdab40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:10.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.509+0000 7fdab92af640 1 -- 172.21.15.6:0/1392663764 shutdown_connections 2024-09-11T23:58:10.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.509+0000 7fdab92af640 1 -- 172.21.15.6:0/1392663764 wait complete. 2024-09-11T23:58:10.514 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:10.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.690+0000 7fb2ae059640 1 -- 172.21.15.6:0/224920747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8102790 msgr2=0x7fb2a81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.690+0000 7fb2ae059640 1 --2- 172.21.15.6:0/224920747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8102790 0x7fb2a81067e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009900 tx=0x7fb29c02a410 comp rx=0 tx=0).stop 2024-09-11T23:58:10.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.691+0000 7fb2ae059640 1 -- 172.21.15.6:0/224920747 shutdown_connections 2024-09-11T23:58:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.691+0000 7fb2ae059640 1 --2- 172.21.15.6:0/224920747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a8106f10 0x7fb2a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.691+0000 7fb2ae059640 1 --2- 172.21.15.6:0/224920747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8102790 0x7fb2a81067e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.691+0000 7fb2ae059640 1 --2- 172.21.15.6:0/224920747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2a8101de0 0x7fb2a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.691+0000 7fb2ae059640 1 -- 172.21.15.6:0/224920747 >> 172.21.15.6:0/224920747 conn(0x7fb2a80fd8c0 msgr2=0x7fb2a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.691+0000 7fb2ae059640 1 -- 172.21.15.6:0/224920747 shutdown_connections 2024-09-11T23:58:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.691+0000 7fb2ae059640 1 -- 172.21.15.6:0/224920747 wait complete. 2024-09-11T23:58:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.691+0000 7fb2ae059640 1 Processor -- start 2024-09-11T23:58:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2ae059640 1 -- start start 2024-09-11T23:58:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2ae059640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a8101de0 0x7fb2a8198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2ae059640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2a8102790 0x7fb2a8198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2ae059640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8106f10 0x7fb2a819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2ae059640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a8111e20 con 0x7fb2a8106f10 2024-09-11T23:58:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2ae059640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a8111ca0 con 0x7fb2a8102790 2024-09-11T23:58:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2ae059640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a8111fa0 con 0x7fb2a8101de0 2024-09-11T23:58:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2a7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8106f10 0x7fb2a819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2a7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8106f10 0x7fb2a819cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39944/0 (socket says 172.21.15.6:39944) 2024-09-11T23:58:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2a7fff640 1 -- 172.21.15.6:0/3184942041 learned_addr learned my addr 172.21.15.6:0/3184942041 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2a6ffd640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2a8102790 0x7fb2a8198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2a77fe640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a8101de0 0x7fb2a8198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2a7fff640 1 -- 172.21.15.6:0/3184942041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a8101de0 msgr2=0x7fb2a8198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2a7fff640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a8101de0 0x7fb2a8198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2a7fff640 1 -- 172.21.15.6:0/3184942041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2a8102790 msgr2=0x7fb2a8198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2a7fff640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2a8102790 0x7fb2a8198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.692+0000 7fb2a7fff640 1 -- 172.21.15.6:0/3184942041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a819d2d0 con 0x7fb2a8106f10 2024-09-11T23:58:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.693+0000 7fb2a7fff640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8106f10 0x7fb2a819cbf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000cce0 tx=0x7fb2a000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.693+0000 7fb2a4ff9640 1 -- 172.21.15.6:0/3184942041 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000f450 con 0x7fb2a8106f10 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.693+0000 7fb2a4ff9640 1 -- 172.21.15.6:0/3184942041 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2a000faa0 con 0x7fb2a8106f10 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.693+0000 7fb2ae059640 1 -- 172.21.15.6:0/3184942041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a819d5c0 con 0x7fb2a8106f10 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.693+0000 7fb2a4ff9640 1 -- 172.21.15.6:0/3184942041 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0018b70 con 0x7fb2a8106f10 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.693+0000 7fb2ae059640 1 -- 172.21.15.6:0/3184942041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a81a4ea0 con 0x7fb2a8106f10 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.694+0000 7fb2ae059640 1 -- 172.21.15.6:0/3184942041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb2a8062980 con 0x7fb2a8106f10 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.695+0000 7fb2a4ff9640 1 -- 172.21.15.6:0/3184942041 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fb2a0018d10 con 0x7fb2a8106f10 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.696+0000 7fb2a4ff9640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb2900a2c10 0x7fb2900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.696+0000 7fb2a77fe640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb2900a2c10 0x7fb2900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.696+0000 7fb2a4ff9640 1 -- 172.21.15.6:0/3184942041 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fb2a00cfae0 con 0x7fb2a8106f10 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.696+0000 7fb2a4ff9640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012] conn(0x7fb2900adde0 0x7fb2900b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.696+0000 7fb2a4ff9640 1 -- 172.21.15.6:0/3184942041 --> [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2a0015e70 con 0x7fb2900adde0 2024-09-11T23:58:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.696+0000 7fb2a4ff9640 1 -- 172.21.15.6:0/3184942041 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fb2a00cff30 con 0x7fb2a8106f10 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.696+0000 7fb2a77fe640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb2900a2c10 0x7fb2900a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb298009bd0 tx=0x7fb298005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.697+0000 7fb2a6ffd640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012] conn(0x7fb2900adde0 0x7fb2900b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.697+0000 7fb2a6ffd640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012] conn(0x7fb2900adde0 0x7fb2900b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.698+0000 7fb2a4ff9640 1 -- 172.21.15.6:0/3184942041 <== osd.10 v2:172.21.15.39:6824/3939755012 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb2a0015e70 con 0x7fb2900adde0 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.712+0000 7fb2ae059640 1 -- 172.21.15.6:0/3184942041 --> [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb2a8062e00 con 0x7fb2900adde0 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.712+0000 7fb2a4ff9640 1 -- 172.21.15.6:0/3184942041 <== osd.10 v2:172.21.15.39:6824/3939755012 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb2a8062e00 con 0x7fb2900adde0 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.713+0000 7fb2ae059640 1 -- 172.21.15.6:0/3184942041 >> [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012] conn(0x7fb2900adde0 msgr2=0x7fb2900b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.713+0000 7fb2ae059640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012] conn(0x7fb2900adde0 0x7fb2900b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.713+0000 7fb2ae059640 1 -- 172.21.15.6:0/3184942041 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb2900a2c10 msgr2=0x7fb2900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.713+0000 7fb2ae059640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb2900a2c10 0x7fb2900a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb298009bd0 tx=0x7fb298005f90 comp rx=0 tx=0).stop 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.713+0000 7fb2ae059640 1 -- 172.21.15.6:0/3184942041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8106f10 msgr2=0x7fb2a819cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.713+0000 7fb2ae059640 1 --2- 172.21.15.6:0/3184942041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8106f10 0x7fb2a819cbf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000cce0 tx=0x7fb2a000a620 comp rx=0 tx=0).stop 2024-09-11T23:58:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.713+0000 7fb2a7fff640 1 -- 172.21.15.6:0/3184942041 reap_dead start 2024-09-11T23:58:10.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.713+0000 7fb2ae059640 1 -- 172.21.15.6:0/3184942041 shutdown_connections 2024-09-11T23:58:10.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.713+0000 7fb2ae059640 1 -- 172.21.15.6:0/3184942041 >> 172.21.15.6:0/3184942041 conn(0x7fb2a80fd8c0 msgr2=0x7fb2a80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:10.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.713+0000 7fb2ae059640 1 -- 172.21.15.6:0/3184942041 shutdown_connections 2024-09-11T23:58:10.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.713+0000 7fb2ae059640 1 -- 172.21.15.6:0/3184942041 wait complete. 2024-09-11T23:58:10.941 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:10 smithi006 ceph-mon[30947]: pgmap v322: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 383 B/s wr, 9 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2024-09-11T23:58:10.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.941+0000 7fb06b9e3640 1 -- 172.21.15.6:0/3807514814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb064102790 msgr2=0x7fb0641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.941+0000 7fb06b9e3640 1 --2- 172.21.15.6:0/3807514814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb064102790 0x7fb0641067e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb058009900 tx=0x7fb05802a3f0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.941+0000 7fb06b9e3640 1 -- 172.21.15.6:0/3807514814 shutdown_connections 2024-09-11T23:58:10.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.941+0000 7fb06b9e3640 1 --2- 172.21.15.6:0/3807514814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb064106f10 0x7fb06410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.941+0000 7fb06b9e3640 1 --2- 172.21.15.6:0/3807514814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb064102790 0x7fb0641067e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.941+0000 7fb06b9e3640 1 --2- 172.21.15.6:0/3807514814 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb064101de0 0x7fb0641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.941+0000 7fb06b9e3640 1 -- 172.21.15.6:0/3807514814 >> 172.21.15.6:0/3807514814 conn(0x7fb0640fd8c0 msgr2=0x7fb0640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.942+0000 7fb06b9e3640 1 -- 172.21.15.6:0/3807514814 shutdown_connections 2024-09-11T23:58:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.942+0000 7fb06b9e3640 1 -- 172.21.15.6:0/3807514814 wait complete. 2024-09-11T23:58:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.942+0000 7fb06b9e3640 1 Processor -- start 2024-09-11T23:58:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.942+0000 7fb06b9e3640 1 -- start start 2024-09-11T23:58:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.942+0000 7fb06b9e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb064101de0 0x7fb06419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.942+0000 7fb06b9e3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb064102790 0x7fb06419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.942+0000 7fb06b9e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb064106f10 0x7fb06419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb06b9e3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb064111e20 con 0x7fb064106f10 2024-09-11T23:58:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb06b9e3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb064111ca0 con 0x7fb064102790 2024-09-11T23:58:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb06b9e3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb064111fa0 con 0x7fb064101de0 2024-09-11T23:58:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb069f80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb064106f10 0x7fb06419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb069f80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb064106f10 0x7fb06419edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39958/0 (socket says 172.21.15.6:39958) 2024-09-11T23:58:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb069f80640 1 -- 172.21.15.6:0/1003910995 learned_addr learned my addr 172.21.15.6:0/1003910995 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb06977f640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb064101de0 0x7fb06419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb068f7e640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb064102790 0x7fb06419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb069f80640 1 -- 172.21.15.6:0/1003910995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb064101de0 msgr2=0x7fb06419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb069f80640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb064101de0 0x7fb06419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb069f80640 1 -- 172.21.15.6:0/1003910995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb064102790 msgr2=0x7fb06419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb069f80640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb064102790 0x7fb06419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb069f80640 1 -- 172.21.15.6:0/1003910995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06419f4b0 con 0x7fb064106f10 2024-09-11T23:58:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb069f80640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb064106f10 0x7fb06419edd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00eaa0 tx=0x7fb05c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb0567fc640 1 -- 172.21.15.6:0/1003910995 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c004d20 con 0x7fb064106f10 2024-09-11T23:58:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb06b9e3640 1 -- 172.21.15.6:0/1003910995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06419f7a0 con 0x7fb064106f10 2024-09-11T23:58:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb0567fc640 1 -- 172.21.15.6:0/1003910995 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb05c005020 con 0x7fb064106f10 2024-09-11T23:58:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.943+0000 7fb0567fc640 1 -- 172.21.15.6:0/1003910995 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c0116b0 con 0x7fb064106f10 2024-09-11T23:58:10.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.944+0000 7fb06b9e3640 1 -- 172.21.15.6:0/1003910995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0641a7080 con 0x7fb064106f10 2024-09-11T23:58:10.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.944+0000 7fb06b9e3640 1 -- 172.21.15.6:0/1003910995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb064075740 con 0x7fb064106f10 2024-09-11T23:58:10.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.946+0000 7fb0567fc640 1 -- 172.21.15.6:0/1003910995 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fb05c0051d0 con 0x7fb064106f10 2024-09-11T23:58:10.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.947+0000 7fb0567fc640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb0500a2c10 0x7fb0500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.947+0000 7fb06977f640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb0500a2c10 0x7fb0500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.947+0000 7fb0567fc640 1 -- 172.21.15.6:0/1003910995 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fb05c0cfa40 con 0x7fb064106f10 2024-09-11T23:58:10.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.947+0000 7fb0567fc640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536] conn(0x7fb0500adde0 0x7fb0500b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.947+0000 7fb0567fc640 1 -- 172.21.15.6:0/1003910995 --> [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb05c014ec0 con 0x7fb0500adde0 2024-09-11T23:58:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.947+0000 7fb0567fc640 1 -- 172.21.15.6:0/1003910995 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fb05c0cfe90 con 0x7fb064106f10 2024-09-11T23:58:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.947+0000 7fb06977f640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb0500a2c10 0x7fb0500a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb06000abe0 tx=0x7fb06000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.947+0000 7fb068f7e640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536] conn(0x7fb0500adde0 0x7fb0500b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.948+0000 7fb068f7e640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536] conn(0x7fb0500adde0 0x7fb0500b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.948+0000 7fb0567fc640 1 -- 172.21.15.6:0/1003910995 <== osd.9 v2:172.21.15.6:6826/4076879536 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb05c014ec0 con 0x7fb0500adde0 2024-09-11T23:58:10.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.962+0000 7fb06b9e3640 1 -- 172.21.15.6:0/1003910995 --> [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb0641032c0 con 0x7fb0500adde0 2024-09-11T23:58:10.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.962+0000 7fb0567fc640 1 -- 172.21.15.6:0/1003910995 <== osd.9 v2:172.21.15.6:6826/4076879536 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb0641032c0 con 0x7fb0500adde0 2024-09-11T23:58:10.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.963+0000 7fb06b9e3640 1 -- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536] conn(0x7fb0500adde0 msgr2=0x7fb0500b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.963+0000 7fb06b9e3640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536] conn(0x7fb0500adde0 0x7fb0500b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.963+0000 7fb06b9e3640 1 -- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb0500a2c10 msgr2=0x7fb0500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.963+0000 7fb06b9e3640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb0500a2c10 0x7fb0500a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb06000abe0 tx=0x7fb06000a2d0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.963+0000 7fb06b9e3640 1 -- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb064106f10 msgr2=0x7fb06419edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.963+0000 7fb06b9e3640 1 --2- 172.21.15.6:0/1003910995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb064106f10 0x7fb06419edd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00eaa0 tx=0x7fb05c00eea0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.963+0000 7fb069f80640 1 -- 172.21.15.6:0/1003910995 reap_dead start 2024-09-11T23:58:10.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.963+0000 7fb06b9e3640 1 -- 172.21.15.6:0/1003910995 shutdown_connections 2024-09-11T23:58:10.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.963+0000 7fb06b9e3640 1 -- 172.21.15.6:0/1003910995 >> 172.21.15.6:0/1003910995 conn(0x7fb0640fd8c0 msgr2=0x7fb0640fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:10.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.963+0000 7fb06b9e3640 1 -- 172.21.15.6:0/1003910995 shutdown_connections 2024-09-11T23:58:10.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:10.963+0000 7fb06b9e3640 1 -- 172.21.15.6:0/1003910995 wait complete. 2024-09-11T23:58:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:10 smithi134 ceph-mon[34893]: pgmap v322: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 383 B/s wr, 9 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2024-09-11T23:58:11.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:10 smithi039 ceph-mon[34543]: pgmap v322: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 383 B/s wr, 9 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2024-09-11T23:58:11.706 INFO:teuthology.orchestra.run.smithi006.stdout:77309411402 2024-09-11T23:58:11.706 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-11T23:58:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.901+0000 7fd62db0f640 1 -- 172.21.15.6:0/1261151599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd628100960 msgr2=0x7fd628100d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.901+0000 7fd62db0f640 1 --2- 172.21.15.6:0/1261151599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd628100960 0x7fd628100d40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd618009900 tx=0x7fd61802a410 comp rx=0 tx=0).stop 2024-09-11T23:58:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.901+0000 7fd62db0f640 1 -- 172.21.15.6:0/1261151599 shutdown_connections 2024-09-11T23:58:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.901+0000 7fd62db0f640 1 --2- 172.21.15.6:0/1261151599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd62810e510 0x7fd628110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.901+0000 7fd62db0f640 1 --2- 172.21.15.6:0/1261151599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd628101310 0x7fd62810dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.901+0000 7fd62db0f640 1 --2- 172.21.15.6:0/1261151599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd628100960 0x7fd628100d40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.901+0000 7fd62db0f640 1 -- 172.21.15.6:0/1261151599 >> 172.21.15.6:0/1261151599 conn(0x7fd6280fc7d0 msgr2=0x7fd6280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.901+0000 7fd62db0f640 1 -- 172.21.15.6:0/1261151599 shutdown_connections 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.901+0000 7fd62db0f640 1 -- 172.21.15.6:0/1261151599 wait complete. 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.902+0000 7fd62db0f640 1 Processor -- start 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd62db0f640 1 -- start start 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd62db0f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd628100960 0x7fd62819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd62db0f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd628101310 0x7fd62819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd62db0f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd62810e510 0x7fd62819ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd62db0f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd6281140a0 con 0x7fd62810e510 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd62db0f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd628113f20 con 0x7fd628101310 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd62db0f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd628114220 con 0x7fd628100960 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd627fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd62810e510 0x7fd62819ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd627fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd62810e510 0x7fd62819ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39986/0 (socket says 172.21.15.6:39986) 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd627fff640 1 -- 172.21.15.6:0/3743328406 learned_addr learned my addr 172.21.15.6:0/3743328406 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd6277fe640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd628100960 0x7fd62819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd626ffd640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd628101310 0x7fd62819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd627fff640 1 -- 172.21.15.6:0/3743328406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd628100960 msgr2=0x7fd62819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd627fff640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd628100960 0x7fd62819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd627fff640 1 -- 172.21.15.6:0/3743328406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd628101310 msgr2=0x7fd62819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd627fff640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd628101310 0x7fd62819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.903+0000 7fd627fff640 1 -- 172.21.15.6:0/3743328406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62819f550 con 0x7fd62810e510 2024-09-11T23:58:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.904+0000 7fd627fff640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd62810e510 0x7fd62819ee70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd620009fd0 tx=0x7fd62000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.904+0000 7fd624ff9640 1 -- 172.21.15.6:0/3743328406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620004d20 con 0x7fd62810e510 2024-09-11T23:58:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.904+0000 7fd624ff9640 1 -- 172.21.15.6:0/3743328406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd620005020 con 0x7fd62810e510 2024-09-11T23:58:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.904+0000 7fd62db0f640 1 -- 172.21.15.6:0/3743328406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62819f840 con 0x7fd62810e510 2024-09-11T23:58:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.904+0000 7fd624ff9640 1 -- 172.21.15.6:0/3743328406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200116b0 con 0x7fd62810e510 2024-09-11T23:58:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.904+0000 7fd62db0f640 1 -- 172.21.15.6:0/3743328406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6281a7120 con 0x7fd62810e510 2024-09-11T23:58:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.905+0000 7fd62db0f640 1 -- 172.21.15.6:0/3743328406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd628062980 con 0x7fd62810e510 2024-09-11T23:58:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.906+0000 7fd624ff9640 1 -- 172.21.15.6:0/3743328406 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd6200051d0 con 0x7fd62810e510 2024-09-11T23:58:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.907+0000 7fd624ff9640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd6100a2c90 0x7fd6100a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.907+0000 7fd624ff9640 1 -- 172.21.15.6:0/3743328406 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fd6200cfa00 con 0x7fd62810e510 2024-09-11T23:58:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.907+0000 7fd624ff9640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243] conn(0x7fd6100ade60 0x7fd6100b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.907+0000 7fd6277fe640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd6100a2c90 0x7fd6100a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.907+0000 7fd624ff9640 1 -- 172.21.15.6:0/3743328406 --> [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd620014ec0 con 0x7fd6100ade60 2024-09-11T23:58:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.907+0000 7fd624ff9640 1 -- 172.21.15.6:0/3743328406 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fd6200cfe50 con 0x7fd62810e510 2024-09-11T23:58:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.908+0000 7fd626ffd640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243] conn(0x7fd6100ade60 0x7fd6100b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.908+0000 7fd626ffd640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243] conn(0x7fd6100ade60 0x7fd6100b0300 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.908+0000 7fd6277fe640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd6100a2c90 0x7fd6100a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd618005ab0 tx=0x7fd618005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.909+0000 7fd624ff9640 1 -- 172.21.15.6:0/3743328406 <== osd.6 v2:172.21.15.6:6818/1313356243 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd620014ec0 con 0x7fd6100ade60 2024-09-11T23:58:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.922+0000 7fd62db0f640 1 -- 172.21.15.6:0/3743328406 --> [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd628062e00 con 0x7fd6100ade60 2024-09-11T23:58:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.923+0000 7fd624ff9640 1 -- 172.21.15.6:0/3743328406 <== osd.6 v2:172.21.15.6:6818/1313356243 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd628062e00 con 0x7fd6100ade60 2024-09-11T23:58:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.923+0000 7fd62db0f640 1 -- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243] conn(0x7fd6100ade60 msgr2=0x7fd6100b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.923+0000 7fd62db0f640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243] conn(0x7fd6100ade60 0x7fd6100b0300 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.923+0000 7fd62db0f640 1 -- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd6100a2c90 msgr2=0x7fd6100a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.923+0000 7fd62db0f640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd6100a2c90 0x7fd6100a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd618005ab0 tx=0x7fd618005a20 comp rx=0 tx=0).stop 2024-09-11T23:58:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.923+0000 7fd62db0f640 1 -- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd62810e510 msgr2=0x7fd62819ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.923+0000 7fd62db0f640 1 --2- 172.21.15.6:0/3743328406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd62810e510 0x7fd62819ee70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd620009fd0 tx=0x7fd62000ee60 comp rx=0 tx=0).stop 2024-09-11T23:58:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.923+0000 7fd627fff640 1 -- 172.21.15.6:0/3743328406 reap_dead start 2024-09-11T23:58:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.923+0000 7fd62db0f640 1 -- 172.21.15.6:0/3743328406 shutdown_connections 2024-09-11T23:58:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.923+0000 7fd62db0f640 1 -- 172.21.15.6:0/3743328406 >> 172.21.15.6:0/3743328406 conn(0x7fd6280fc7d0 msgr2=0x7fd6280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.924+0000 7fd62db0f640 1 -- 172.21.15.6:0/3743328406 shutdown_connections 2024-09-11T23:58:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:11.924+0000 7fd62db0f640 1 -- 172.21.15.6:0/3743328406 wait complete. 2024-09-11T23:58:12.379 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:12.828 INFO:teuthology.orchestra.run.smithi006.stdout:154618822714 2024-09-11T23:58:12.829 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-11T23:58:13.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:12 smithi006 ceph-mon[30947]: pgmap v323: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 336 B/s wr, 11 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2024-09-11T23:58:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:12 smithi134 ceph-mon[34893]: pgmap v323: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 336 B/s wr, 11 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2024-09-11T23:58:13.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:12 smithi039 ceph-mon[34543]: pgmap v323: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 336 B/s wr, 11 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2024-09-11T23:58:13.462 INFO:teuthology.orchestra.run.smithi006.stdout:266287972391 2024-09-11T23:58:13.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-11T23:58:14.598 INFO:teuthology.orchestra.run.smithi006.stdout:55834574926 2024-09-11T23:58:14.598 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-11T23:58:15.050 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:14 smithi006 ceph-mon[30947]: pgmap v324: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 303 B/s wr, 10 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2024-09-11T23:58:15.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:14 smithi134 ceph-mon[34893]: pgmap v324: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 303 B/s wr, 10 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2024-09-11T23:58:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.135+0000 7f6fe8677640 1 -- 172.21.15.6:0/3409543507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0103660 msgr2=0x7f6fe010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.135+0000 7f6fe8677640 1 --2- 172.21.15.6:0/3409543507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0103660 0x7f6fe010bb50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009900 tx=0x7f6fd002a480 comp rx=0 tx=0).stop 2024-09-11T23:58:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 -- 172.21.15.6:0/3409543507 shutdown_connections 2024-09-11T23:58:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 --2- 172.21.15.6:0/3409543507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe010c170 0x7f6fe010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 --2- 172.21.15.6:0/3409543507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0103660 0x7f6fe010bb50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 --2- 172.21.15.6:0/3409543507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe0102d40 0x7f6fe0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 -- 172.21.15.6:0/3409543507 >> 172.21.15.6:0/3409543507 conn(0x7f6fe00fc7a0 msgr2=0x7f6fe00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 -- 172.21.15.6:0/3409543507 shutdown_connections 2024-09-11T23:58:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 -- 172.21.15.6:0/3409543507 wait complete. 2024-09-11T23:58:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 Processor -- start 2024-09-11T23:58:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 -- start start 2024-09-11T23:58:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe0102d40 0x7f6fe01984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0103660 0x7f6fe0198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe010c170 0x7f6fe019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe0111e60 con 0x7f6fe0103660 2024-09-11T23:58:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.136+0000 7f6fe8677640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe0111ce0 con 0x7f6fe0102d40 2024-09-11T23:58:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe8677640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe0111fe0 con 0x7f6fe010c170 2024-09-11T23:58:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe5c12640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0103660 0x7f6fe0198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe5c12640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0103660 0x7f6fe0198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39994/0 (socket says 172.21.15.6:39994) 2024-09-11T23:58:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe5c12640 1 -- 172.21.15.6:0/1264149124 learned_addr learned my addr 172.21.15.6:0/1264149124 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe6c14640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe010c170 0x7f6fe019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe6413640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe0102d40 0x7f6fe01984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe5c12640 1 -- 172.21.15.6:0/1264149124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe010c170 msgr2=0x7f6fe019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe5c12640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe010c170 0x7f6fe019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe5c12640 1 -- 172.21.15.6:0/1264149124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe0102d40 msgr2=0x7f6fe01984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe5c12640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe0102d40 0x7f6fe01984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe5c12640 1 -- 172.21.15.6:0/1264149124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe019d470 con 0x7f6fe0103660 2024-09-11T23:58:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe6c14640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe010c170 0x7f6fe019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe5c12640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0103660 0x7f6fe0198a00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0006010 tx=0x7f6fd00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fd77fe640 1 -- 172.21.15.6:0/1264149124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd003f030 con 0x7f6fe0103660 2024-09-11T23:58:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fd77fe640 1 -- 172.21.15.6:0/1264149124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fd0003800 con 0x7f6fe0103660 2024-09-11T23:58:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe8677640 1 -- 172.21.15.6:0/1264149124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe019d700 con 0x7f6fe0103660 2024-09-11T23:58:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fd77fe640 1 -- 172.21.15.6:0/1264149124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0035070 con 0x7f6fe0103660 2024-09-11T23:58:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.137+0000 7f6fe8677640 1 -- 172.21.15.6:0/1264149124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe01a5040 con 0x7f6fe0103660 2024-09-11T23:58:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.138+0000 7f6fe8677640 1 -- 172.21.15.6:0/1264149124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fe0062900 con 0x7f6fe0103660 2024-09-11T23:58:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.140+0000 7f6fd77fe640 1 -- 172.21.15.6:0/1264149124 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6fd0031af0 con 0x7f6fe0103660 2024-09-11T23:58:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.140+0000 7f6fd77fe640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6fcc0a2c90 0x7f6fcc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.140+0000 7f6fe6413640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6fcc0a2c90 0x7f6fcc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.140+0000 7f6fd77fe640 1 -- 172.21.15.6:0/1264149124 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f6fd00f04c0 con 0x7f6fe0103660 2024-09-11T23:58:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.141+0000 7f6fd77fe640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681] conn(0x7f6fcc0adde0 0x7f6fcc0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.141+0000 7f6fd77fe640 1 -- 172.21.15.6:0/1264149124 --> [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fd0001d30 con 0x7f6fcc0adde0 2024-09-11T23:58:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.141+0000 7f6fd77fe640 1 -- 172.21.15.6:0/1264149124 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f6fd00f0910 con 0x7f6fe0103660 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.141+0000 7f6fe6c14640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681] conn(0x7f6fcc0adde0 0x7f6fcc0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.141+0000 7f6fe6413640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6fcc0a2c90 0x7f6fcc0a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009890 tx=0x7f6fdc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.141+0000 7f6fe6c14640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681] conn(0x7f6fcc0adde0 0x7f6fcc0b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.142+0000 7f6fd77fe640 1 -- 172.21.15.6:0/1264149124 <== osd.0 v2:172.21.15.6:6802/2698750681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6fd0001d30 con 0x7f6fcc0adde0 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.155+0000 7f6fe8677640 1 -- 172.21.15.6:0/1264149124 --> [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6fe0062d00 con 0x7f6fcc0adde0 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.156+0000 7f6fd77fe640 1 -- 172.21.15.6:0/1264149124 <== osd.0 v2:172.21.15.6:6802/2698750681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6fe0062d00 con 0x7f6fcc0adde0 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.156+0000 7f6fe8677640 1 -- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681] conn(0x7f6fcc0adde0 msgr2=0x7f6fcc0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.156+0000 7f6fe8677640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681] conn(0x7f6fcc0adde0 0x7f6fcc0b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.156+0000 7f6fe8677640 1 -- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6fcc0a2c90 msgr2=0x7f6fcc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.156+0000 7f6fe8677640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6fcc0a2c90 0x7f6fcc0a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009890 tx=0x7f6fdc008040 comp rx=0 tx=0).stop 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.156+0000 7f6fe8677640 1 -- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0103660 msgr2=0x7f6fe0198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.156+0000 7f6fe8677640 1 --2- 172.21.15.6:0/1264149124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0103660 0x7f6fe0198a00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0006010 tx=0x7f6fd00042f0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.156+0000 7f6fe6c14640 1 -- 172.21.15.6:0/1264149124 reap_dead start 2024-09-11T23:58:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.156+0000 7f6fe8677640 1 -- 172.21.15.6:0/1264149124 shutdown_connections 2024-09-11T23:58:15.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.156+0000 7f6fe8677640 1 -- 172.21.15.6:0/1264149124 >> 172.21.15.6:0/1264149124 conn(0x7f6fe00fc7a0 msgr2=0x7f6fe00fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:15.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.156+0000 7f6fe8677640 1 -- 172.21.15.6:0/1264149124 shutdown_connections 2024-09-11T23:58:15.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.156+0000 7f6fe8677640 1 -- 172.21.15.6:0/1264149124 wait complete. 2024-09-11T23:58:15.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:14 smithi039 ceph-mon[34543]: pgmap v324: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 303 B/s wr, 10 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2024-09-11T23:58:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.681+0000 7f73e517c640 1 -- 172.21.15.6:0/2514900169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73e0100a80 msgr2=0x7f73e0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.681+0000 7f73e517c640 1 --2- 172.21.15.6:0/2514900169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73e0100a80 0x7f73e0100ee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009930 tx=0x7f73c802a420 comp rx=0 tx=0).stop 2024-09-11T23:58:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.681+0000 7f73e517c640 1 -- 172.21.15.6:0/2514900169 shutdown_connections 2024-09-11T23:58:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.681+0000 7f73e517c640 1 --2- 172.21.15.6:0/2514900169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e0101420 0x7f73e010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.681+0000 7f73e517c640 1 --2- 172.21.15.6:0/2514900169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73e0100a80 0x7f73e0100ee0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.681+0000 7f73e517c640 1 --2- 172.21.15.6:0/2514900169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73e0106a80 0x7f73e0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.681+0000 7f73e517c640 1 -- 172.21.15.6:0/2514900169 >> 172.21.15.6:0/2514900169 conn(0x7f73e00fc7a0 msgr2=0x7f73e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.681+0000 7f73e517c640 1 -- 172.21.15.6:0/2514900169 shutdown_connections 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.681+0000 7f73e517c640 1 -- 172.21.15.6:0/2514900169 wait complete. 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73e517c640 1 Processor -- start 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73e517c640 1 -- start start 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73e517c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e0100a80 0x7f73e0102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73e517c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73e0101420 0x7f73e0102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73e517c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73e0106a80 0x7f73e01030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73e517c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f73e0110d30 con 0x7f73e0106a80 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73e517c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f73e0110bb0 con 0x7f73e0100a80 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73e517c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73e0110eb0 con 0x7f73e0101420 2024-09-11T23:58:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73df59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73e0106a80 0x7f73e01030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73df59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73e0106a80 0x7f73e01030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40008/0 (socket says 172.21.15.6:40008) 2024-09-11T23:58:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73df59e640 1 -- 172.21.15.6:0/2044311193 learned_addr learned my addr 172.21.15.6:0/2044311193 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73d7fff640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73e0101420 0x7f73e0102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73ded9d640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e0100a80 0x7f73e0102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73df59e640 1 -- 172.21.15.6:0/2044311193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73e0101420 msgr2=0x7f73e0102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73df59e640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73e0101420 0x7f73e0102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73df59e640 1 -- 172.21.15.6:0/2044311193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e0100a80 msgr2=0x7f73e0102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73df59e640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e0100a80 0x7f73e0102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73df59e640 1 -- 172.21.15.6:0/2044311193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e01a6860 con 0x7f73e0106a80 2024-09-11T23:58:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.682+0000 7f73ded9d640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e0100a80 0x7f73e0102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.683+0000 7f73df59e640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73e0106a80 0x7f73e01030d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f73d800eaa0 tx=0x7f73d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.683+0000 7f73dcd99640 1 -- 172.21.15.6:0/2044311193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d800cdb0 con 0x7f73e0106a80 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.683+0000 7f73e517c640 1 -- 172.21.15.6:0/2044311193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e01a6b50 con 0x7f73e0106a80 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.683+0000 7f73dcd99640 1 -- 172.21.15.6:0/2044311193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73d8005020 con 0x7f73e0106a80 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.683+0000 7f73dcd99640 1 -- 172.21.15.6:0/2044311193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d80116d0 con 0x7f73e0106a80 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.683+0000 7f73e517c640 1 -- 172.21.15.6:0/2044311193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e01a7060 con 0x7f73e0106a80 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.684+0000 7f73e517c640 1 -- 172.21.15.6:0/2044311193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73e00fd0a0 con 0x7f73e0106a80 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.685+0000 7f73dcd99640 1 -- 172.21.15.6:0/2044311193 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f73d80051d0 con 0x7f73e0106a80 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.686+0000 7f73dcd99640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73cc0a2c10 0x7f73cc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.686+0000 7f73dcd99640 1 -- 172.21.15.6:0/2044311193 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f73d80cfb00 con 0x7f73e0106a80 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.686+0000 7f73ded9d640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73cc0a2c10 0x7f73cc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.686+0000 7f73dcd99640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543] conn(0x7f73cc0adde0 0x7f73cc0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.686+0000 7f73dcd99640 1 -- 172.21.15.6:0/2044311193 --> [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73d8014ec0 con 0x7f73cc0adde0 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.686+0000 7f73dcd99640 1 -- 172.21.15.6:0/2044311193 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f73d80cff50 con 0x7f73e0106a80 2024-09-11T23:58:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.686+0000 7f73ded9d640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73cc0a2c10 0x7f73cc0a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73d0005fd0 tx=0x7f73d00094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.687+0000 7f73d7fff640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543] conn(0x7f73cc0adde0 0x7f73cc0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.687+0000 7f73d7fff640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543] conn(0x7f73cc0adde0 0x7f73cc0b0280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.688+0000 7f73dcd99640 1 -- 172.21.15.6:0/2044311193 <== osd.8 v2:172.21.15.134:6816/3894059543 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f73d8014ec0 con 0x7f73cc0adde0 2024-09-11T23:58:15.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.702+0000 7f73e517c640 1 -- 172.21.15.6:0/2044311193 --> [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f73e01021c0 con 0x7f73cc0adde0 2024-09-11T23:58:15.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.703+0000 7f73dcd99640 1 -- 172.21.15.6:0/2044311193 <== osd.8 v2:172.21.15.134:6816/3894059543 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f73e01021c0 con 0x7f73cc0adde0 2024-09-11T23:58:15.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.703+0000 7f73e517c640 1 -- 172.21.15.6:0/2044311193 >> [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543] conn(0x7f73cc0adde0 msgr2=0x7f73cc0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.703+0000 7f73e517c640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543] conn(0x7f73cc0adde0 0x7f73cc0b0280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.703+0000 7f73e517c640 1 -- 172.21.15.6:0/2044311193 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73cc0a2c10 msgr2=0x7f73cc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.703+0000 7f73e517c640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73cc0a2c10 0x7f73cc0a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73d0005fd0 tx=0x7f73d00094d0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.703+0000 7f73e517c640 1 -- 172.21.15.6:0/2044311193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73e0106a80 msgr2=0x7f73e01030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.703+0000 7f73e517c640 1 --2- 172.21.15.6:0/2044311193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73e0106a80 0x7f73e01030d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f73d800eaa0 tx=0x7f73d800ef60 comp rx=0 tx=0).stop 2024-09-11T23:58:15.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.703+0000 7f73df59e640 1 -- 172.21.15.6:0/2044311193 reap_dead start 2024-09-11T23:58:15.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.703+0000 7f73e517c640 1 -- 172.21.15.6:0/2044311193 shutdown_connections 2024-09-11T23:58:15.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.703+0000 7f73e517c640 1 -- 172.21.15.6:0/2044311193 >> 172.21.15.6:0/2044311193 conn(0x7f73e00fc7a0 msgr2=0x7f73e0104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:15.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.703+0000 7f73e517c640 1 -- 172.21.15.6:0/2044311193 shutdown_connections 2024-09-11T23:58:15.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:15.703+0000 7f73e517c640 1 -- 172.21.15.6:0/2044311193 wait complete. 2024-09-11T23:58:16.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.130+0000 7fd613e3a640 1 -- 172.21.15.6:0/1938502361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd60c102d30 msgr2=0x7fd60c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.130+0000 7fd613e3a640 1 --2- 172.21.15.6:0/1938502361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd60c102d30 0x7fd60c103110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd604009930 tx=0x7fd60402a420 comp rx=0 tx=0).stop 2024-09-11T23:58:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.130+0000 7fd613e3a640 1 -- 172.21.15.6:0/1938502361 shutdown_connections 2024-09-11T23:58:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.130+0000 7fd613e3a640 1 --2- 172.21.15.6:0/1938502361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd60c1082a0 0x7fd60c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.130+0000 7fd613e3a640 1 --2- 172.21.15.6:0/1938502361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd60c1036e0 0x7fd60c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.130+0000 7fd613e3a640 1 --2- 172.21.15.6:0/1938502361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd60c102d30 0x7fd60c103110 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.130+0000 7fd613e3a640 1 -- 172.21.15.6:0/1938502361 >> 172.21.15.6:0/1938502361 conn(0x7fd60c0fc7d0 msgr2=0x7fd60c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.130+0000 7fd613e3a640 1 -- 172.21.15.6:0/1938502361 shutdown_connections 2024-09-11T23:58:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.130+0000 7fd613e3a640 1 -- 172.21.15.6:0/1938502361 wait complete. 2024-09-11T23:58:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.130+0000 7fd613e3a640 1 Processor -- start 2024-09-11T23:58:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.130+0000 7fd613e3a640 1 -- start start 2024-09-11T23:58:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd613e3a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd60c102d30 0x7fd60c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd613e3a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd60c1036e0 0x7fd60c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd613e3a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd60c1082a0 0x7fd60c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd613e3a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c111f90 con 0x7fd60c1036e0 2024-09-11T23:58:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd613e3a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c111e10 con 0x7fd60c1082a0 2024-09-11T23:58:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd613e3a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c112110 con 0x7fd60c102d30 2024-09-11T23:58:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd6113d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd60c1036e0 0x7fd60c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd6113d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd60c1036e0 0x7fd60c198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40032/0 (socket says 172.21.15.6:40032) 2024-09-11T23:58:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd6113d5640 1 -- 172.21.15.6:0/1557264476 learned_addr learned my addr 172.21.15.6:0/1557264476 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd611bd6640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd60c102d30 0x7fd60c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd6123d7640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd60c1082a0 0x7fd60c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd6113d5640 1 -- 172.21.15.6:0/1557264476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd60c102d30 msgr2=0x7fd60c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd6113d5640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd60c102d30 0x7fd60c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd6113d5640 1 -- 172.21.15.6:0/1557264476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd60c1082a0 msgr2=0x7fd60c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd6113d5640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd60c1082a0 0x7fd60c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd6113d5640 1 -- 172.21.15.6:0/1557264476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c19d4e0 con 0x7fd60c1036e0 2024-09-11T23:58:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd6123d7640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd60c1082a0 0x7fd60c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd6113d5640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd60c1036e0 0x7fd60c198a70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd60000e9f0 tx=0x7fd60000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.131+0000 7fd60affd640 1 -- 172.21.15.6:0/1557264476 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60000ccc0 con 0x7fd60c1036e0 2024-09-11T23:58:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.132+0000 7fd613e3a640 1 -- 172.21.15.6:0/1557264476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c19d7d0 con 0x7fd60c1036e0 2024-09-11T23:58:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.132+0000 7fd60affd640 1 -- 172.21.15.6:0/1557264476 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6000108e0 con 0x7fd60c1036e0 2024-09-11T23:58:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.132+0000 7fd60affd640 1 -- 172.21.15.6:0/1557264476 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6000187e0 con 0x7fd60c1036e0 2024-09-11T23:58:16.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.132+0000 7fd613e3a640 1 -- 172.21.15.6:0/1557264476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c1a50b0 con 0x7fd60c1036e0 2024-09-11T23:58:16.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.132+0000 7fd613e3a640 1 -- 172.21.15.6:0/1557264476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd60c062980 con 0x7fd60c1036e0 2024-09-11T23:58:16.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.134+0000 7fd60affd640 1 -- 172.21.15.6:0/1557264476 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd600010a90 con 0x7fd60c1036e0 2024-09-11T23:58:16.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.134+0000 7fd60affd640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd5f40a2c10 0x7fd5f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:16.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.135+0000 7fd60affd640 1 -- 172.21.15.6:0/1557264476 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fd6000d0120 con 0x7fd60c1036e0 2024-09-11T23:58:16.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.135+0000 7fd611bd6640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd5f40a2c10 0x7fd5f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:16.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.135+0000 7fd60affd640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620] conn(0x7fd5f40adde0 0x7fd5f40b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.135+0000 7fd60affd640 1 -- 172.21.15.6:0/1557264476 --> [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd60001bec0 con 0x7fd5f40adde0 2024-09-11T23:58:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.135+0000 7fd60affd640 1 -- 172.21.15.6:0/1557264476 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fd6000d0570 con 0x7fd60c1036e0 2024-09-11T23:58:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.135+0000 7fd611bd6640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd5f40a2c10 0x7fd5f40a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd604031440 tx=0x7fd604005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.135+0000 7fd6123d7640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620] conn(0x7fd5f40adde0 0x7fd5f40b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.136+0000 7fd6123d7640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620] conn(0x7fd5f40adde0 0x7fd5f40b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.136+0000 7fd60affd640 1 -- 172.21.15.6:0/1557264476 <== osd.7 v2:172.21.15.39:6816/2076370620 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd60001bec0 con 0x7fd5f40adde0 2024-09-11T23:58:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.150+0000 7fd613e3a640 1 -- 172.21.15.6:0/1557264476 --> [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd60c062d80 con 0x7fd5f40adde0 2024-09-11T23:58:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.151+0000 7fd60affd640 1 -- 172.21.15.6:0/1557264476 <== osd.7 v2:172.21.15.39:6816/2076370620 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd60c062d80 con 0x7fd5f40adde0 2024-09-11T23:58:16.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.151+0000 7fd613e3a640 1 -- 172.21.15.6:0/1557264476 >> [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620] conn(0x7fd5f40adde0 msgr2=0x7fd5f40b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:16.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.151+0000 7fd613e3a640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620] conn(0x7fd5f40adde0 0x7fd5f40b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.151+0000 7fd613e3a640 1 -- 172.21.15.6:0/1557264476 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd5f40a2c10 msgr2=0x7fd5f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:16.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.151+0000 7fd613e3a640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd5f40a2c10 0x7fd5f40a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd604031440 tx=0x7fd604005a20 comp rx=0 tx=0).stop 2024-09-11T23:58:16.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.151+0000 7fd613e3a640 1 -- 172.21.15.6:0/1557264476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd60c1036e0 msgr2=0x7fd60c198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:16.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.151+0000 7fd613e3a640 1 --2- 172.21.15.6:0/1557264476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd60c1036e0 0x7fd60c198a70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd60000e9f0 tx=0x7fd60000eeb0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.151+0000 7fd6123d7640 1 -- 172.21.15.6:0/1557264476 reap_dead start 2024-09-11T23:58:16.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.151+0000 7fd613e3a640 1 -- 172.21.15.6:0/1557264476 shutdown_connections 2024-09-11T23:58:16.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.151+0000 7fd613e3a640 1 -- 172.21.15.6:0/1557264476 >> 172.21.15.6:0/1557264476 conn(0x7fd60c0fc7d0 msgr2=0x7fd60c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:16.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.151+0000 7fd613e3a640 1 -- 172.21.15.6:0/1557264476 shutdown_connections 2024-09-11T23:58:16.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.151+0000 7fd613e3a640 1 -- 172.21.15.6:0/1557264476 wait complete. 2024-09-11T23:58:16.665 INFO:teuthology.orchestra.run.smithi006.stdout:133143986239 2024-09-11T23:58:16.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-11T23:58:16.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.823+0000 7f28817b3640 1 -- 172.21.15.6:0/3230848919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f287c101de0 msgr2=0x7f287c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:16.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.823+0000 7f28817b3640 1 --2- 172.21.15.6:0/3230848919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f287c101de0 0x7f287c1021c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f286c009900 tx=0x7f286c02a410 comp rx=0 tx=0).stop 2024-09-11T23:58:16.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.823+0000 7f28817b3640 1 -- 172.21.15.6:0/3230848919 shutdown_connections 2024-09-11T23:58:16.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.823+0000 7f28817b3640 1 --2- 172.21.15.6:0/3230848919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f287c106f10 0x7f287c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.823+0000 7f28817b3640 1 --2- 172.21.15.6:0/3230848919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f287c102790 0x7f287c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.823+0000 7f28817b3640 1 --2- 172.21.15.6:0/3230848919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f287c101de0 0x7f287c1021c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.823+0000 7f28817b3640 1 -- 172.21.15.6:0/3230848919 >> 172.21.15.6:0/3230848919 conn(0x7f287c0fd8c0 msgr2=0x7f287c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:16.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.823+0000 7f28817b3640 1 -- 172.21.15.6:0/3230848919 shutdown_connections 2024-09-11T23:58:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.823+0000 7f28817b3640 1 -- 172.21.15.6:0/3230848919 wait complete. 2024-09-11T23:58:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.824+0000 7f28817b3640 1 Processor -- start 2024-09-11T23:58:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.824+0000 7f28817b3640 1 -- start start 2024-09-11T23:58:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.824+0000 7f28817b3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f287c101de0 0x7f287c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.824+0000 7f28817b3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f287c102790 0x7f287c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.824+0000 7f28817b3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f287c106f10 0x7f287c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.824+0000 7f28817b3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f287c111e60 con 0x7f287c101de0 2024-09-11T23:58:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.824+0000 7f28817b3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f287c111ce0 con 0x7f287c102790 2024-09-11T23:58:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.824+0000 7f28817b3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f287c111fe0 con 0x7f287c106f10 2024-09-11T23:58:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.824+0000 7f287affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f287c101de0 0x7f287c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.824+0000 7f287affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f287c101de0 0x7f287c198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40052/0 (socket says 172.21.15.6:40052) 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.824+0000 7f287affd640 1 -- 172.21.15.6:0/2443093038 learned_addr learned my addr 172.21.15.6:0/2443093038 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f287b7fe640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f287c106f10 0x7f287c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f287a7fc640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f287c102790 0x7f287c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f287affd640 1 -- 172.21.15.6:0/2443093038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f287c106f10 msgr2=0x7f287c19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f287affd640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f287c106f10 0x7f287c19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f287affd640 1 -- 172.21.15.6:0/2443093038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f287c102790 msgr2=0x7f287c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f287affd640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f287c102790 0x7f287c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f287affd640 1 -- 172.21.15.6:0/2443093038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287c19d3b0 con 0x7f287c101de0 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f287affd640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f287c101de0 0x7f287c198400 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f286c006010 tx=0x7f286c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f2863fff640 1 -- 172.21.15.6:0/2443093038 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c03f030 con 0x7f287c101de0 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f28817b3640 1 -- 172.21.15.6:0/2443093038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287c19d640 con 0x7f287c101de0 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f2863fff640 1 -- 172.21.15.6:0/2443093038 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f286c0035f0 con 0x7f287c101de0 2024-09-11T23:58:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f2863fff640 1 -- 172.21.15.6:0/2443093038 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c035070 con 0x7f287c101de0 2024-09-11T23:58:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.825+0000 7f28817b3640 1 -- 172.21.15.6:0/2443093038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f287c074420 con 0x7f287c101de0 2024-09-11T23:58:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.826+0000 7f28817b3640 1 -- 172.21.15.6:0/2443093038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f287c062980 con 0x7f287c101de0 2024-09-11T23:58:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.828+0000 7f2863fff640 1 -- 172.21.15.6:0/2443093038 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f286c003b10 con 0x7f287c101de0 2024-09-11T23:58:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.828+0000 7f2863fff640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f28640a2c10 0x7f28640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.828+0000 7f2863fff640 1 -- 172.21.15.6:0/2443093038 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f286c0f06c0 con 0x7f287c101de0 2024-09-11T23:58:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.829+0000 7f287a7fc640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f28640a2c10 0x7f28640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.829+0000 7f2863fff640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871] conn(0x7f28640adde0 0x7f28640b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.829+0000 7f2863fff640 1 -- 172.21.15.6:0/2443093038 --> [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f286c001d30 con 0x7f28640adde0 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.829+0000 7f2863fff640 1 -- 172.21.15.6:0/2443093038 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f286c0f0b10 con 0x7f287c101de0 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.829+0000 7f287b7fe640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871] conn(0x7f28640adde0 0x7f28640b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.829+0000 7f287a7fc640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f28640a2c10 0x7f28640a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f287c0fdd50 tx=0x7f287000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.829+0000 7f287b7fe640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871] conn(0x7f28640adde0 0x7f28640b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.830+0000 7f2863fff640 1 -- 172.21.15.6:0/2443093038 <== osd.3 v2:172.21.15.6:6810/2291614871 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f286c001d30 con 0x7f28640adde0 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.844+0000 7f28817b3640 1 -- 172.21.15.6:0/2443093038 --> [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f287c062e00 con 0x7f28640adde0 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.844+0000 7f2863fff640 1 -- 172.21.15.6:0/2443093038 <== osd.3 v2:172.21.15.6:6810/2291614871 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f287c062e00 con 0x7f28640adde0 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.844+0000 7f28817b3640 1 -- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871] conn(0x7f28640adde0 msgr2=0x7f28640b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.844+0000 7f28817b3640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871] conn(0x7f28640adde0 0x7f28640b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.844+0000 7f28817b3640 1 -- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f28640a2c10 msgr2=0x7f28640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.844+0000 7f28817b3640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f28640a2c10 0x7f28640a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f287c0fdd50 tx=0x7f287000a250 comp rx=0 tx=0).stop 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.844+0000 7f28817b3640 1 -- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f287c101de0 msgr2=0x7f287c198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.844+0000 7f28817b3640 1 --2- 172.21.15.6:0/2443093038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f287c101de0 0x7f287c198400 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f286c006010 tx=0x7f286c004270 comp rx=0 tx=0).stop 2024-09-11T23:58:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.844+0000 7f287b7fe640 1 -- 172.21.15.6:0/2443093038 reap_dead start 2024-09-11T23:58:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.845+0000 7f28817b3640 1 -- 172.21.15.6:0/2443093038 shutdown_connections 2024-09-11T23:58:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.845+0000 7f28817b3640 1 -- 172.21.15.6:0/2443093038 >> 172.21.15.6:0/2443093038 conn(0x7f287c0fd8c0 msgr2=0x7f287c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.845+0000 7f28817b3640 1 -- 172.21.15.6:0/2443093038 shutdown_connections 2024-09-11T23:58:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:16.845+0000 7f28817b3640 1 -- 172.21.15.6:0/2443093038 wait complete. 2024-09-11T23:58:17.091 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:16 smithi006 ceph-mon[30947]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-09-11T23:58:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:16 smithi134 ceph-mon[34893]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-09-11T23:58:17.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:16 smithi039 ceph-mon[34543]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-09-11T23:58:17.843 INFO:teuthology.orchestra.run.smithi006.stdout:287762808865 2024-09-11T23:58:17.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-11T23:58:18.280 INFO:teuthology.orchestra.run.smithi006.stdout:206158430257 2024-09-11T23:58:18.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-11T23:58:18.682 INFO:teuthology.orchestra.run.smithi006.stdout:184683593782 2024-09-11T23:58:18.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-11T23:58:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.844+0000 7fdae9cb4640 1 -- 172.21.15.6:0/415895331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdae40745a0 msgr2=0x7fdae4074980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.844+0000 7fdae9cb4640 1 --2- 172.21.15.6:0/415895331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdae40745a0 0x7fdae4074980 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009900 tx=0x7fdad402a410 comp rx=0 tx=0).stop 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.844+0000 7fdae9cb4640 1 -- 172.21.15.6:0/415895331 shutdown_connections 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.844+0000 7fdae9cb4640 1 --2- 172.21.15.6:0/415895331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdae410e470 0x7fdae41108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.844+0000 7fdae9cb4640 1 --2- 172.21.15.6:0/415895331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae4074f50 0x7fdae410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.844+0000 7fdae9cb4640 1 --2- 172.21.15.6:0/415895331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdae40745a0 0x7fdae4074980 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.844+0000 7fdae9cb4640 1 -- 172.21.15.6:0/415895331 >> 172.21.15.6:0/415895331 conn(0x7fdae40fd8d0 msgr2=0x7fdae40ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.844+0000 7fdae9cb4640 1 -- 172.21.15.6:0/415895331 shutdown_connections 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.844+0000 7fdae9cb4640 1 -- 172.21.15.6:0/415895331 wait complete. 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.845+0000 7fdae9cb4640 1 Processor -- start 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.845+0000 7fdae9cb4640 1 -- start start 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.845+0000 7fdae9cb4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae40745a0 0x7fdae419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.845+0000 7fdae9cb4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdae4074f50 0x7fdae419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.845+0000 7fdae9cb4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdae410e470 0x7fdae419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.845+0000 7fdae9cb4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdae4114090 con 0x7fdae4074f50 2024-09-11T23:58:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.845+0000 7fdae9cb4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdae4113f10 con 0x7fdae410e470 2024-09-11T23:58:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.845+0000 7fdae9cb4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdae4114210 con 0x7fdae40745a0 2024-09-11T23:58:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.845+0000 7fdadaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdae4074f50 0x7fdae419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdadaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdae4074f50 0x7fdae419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40074/0 (socket says 172.21.15.6:40074) 2024-09-11T23:58:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdadaffd640 1 -- 172.21.15.6:0/2294488250 learned_addr learned my addr 172.21.15.6:0/2294488250 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdae37fe640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae40745a0 0x7fdae419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdae3fff640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdae410e470 0x7fdae419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdadaffd640 1 -- 172.21.15.6:0/2294488250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae40745a0 msgr2=0x7fdae419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdadaffd640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae40745a0 0x7fdae419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdadaffd640 1 -- 172.21.15.6:0/2294488250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdae410e470 msgr2=0x7fdae419edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdadaffd640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdae410e470 0x7fdae419edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdadaffd640 1 -- 172.21.15.6:0/2294488250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae419f4b0 con 0x7fdae4074f50 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdadaffd640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdae4074f50 0x7fdae419aa40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00c920 tx=0x7fdacc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdae17fa640 1 -- 172.21.15.6:0/2294488250 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdacc007c70 con 0x7fdae4074f50 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdae17fa640 1 -- 172.21.15.6:0/2294488250 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdacc007e10 con 0x7fdae4074f50 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdae17fa640 1 -- 172.21.15.6:0/2294488250 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdacc018820 con 0x7fdae4074f50 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdae9cb4640 1 -- 172.21.15.6:0/2294488250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae419f7a0 con 0x7fdae4074f50 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.846+0000 7fdae9cb4640 1 -- 172.21.15.6:0/2294488250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae41a7080 con 0x7fdae4074f50 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.847+0000 7fdae9cb4640 1 -- 172.21.15.6:0/2294488250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdae4062900 con 0x7fdae4074f50 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.849+0000 7fdae17fa640 1 -- 172.21.15.6:0/2294488250 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fdacc0189c0 con 0x7fdae4074f50 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.849+0000 7fdae17fa640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdad00a2c10 0x7fdad00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.850+0000 7fdae37fe640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdad00a2c10 0x7fdad00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.850+0000 7fdae17fa640 1 -- 172.21.15.6:0/2294488250 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fdacc0cfa70 con 0x7fdae4074f50 2024-09-11T23:58:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.850+0000 7fdae17fa640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401] conn(0x7fdad00adde0 0x7fdad00b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.850+0000 7fdae17fa640 1 -- 172.21.15.6:0/2294488250 --> [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdacc015e70 con 0x7fdad00adde0 2024-09-11T23:58:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.850+0000 7fdae17fa640 1 -- 172.21.15.6:0/2294488250 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fdacc0cfec0 con 0x7fdae4074f50 2024-09-11T23:58:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.850+0000 7fdae37fe640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdad00a2c10 0x7fdad00a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdad4031440 tx=0x7fdad4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.850+0000 7fdae3fff640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401] conn(0x7fdad00adde0 0x7fdad00b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.851+0000 7fdae3fff640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401] conn(0x7fdad00adde0 0x7fdad00b0280 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.851+0000 7fdae17fa640 1 -- 172.21.15.6:0/2294488250 <== osd.11 v2:172.21.15.134:6824/932807401 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdacc015e70 con 0x7fdad00adde0 2024-09-11T23:58:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.866+0000 7fdae9cb4640 1 -- 172.21.15.6:0/2294488250 --> [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdae4062d00 con 0x7fdad00adde0 2024-09-11T23:58:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.866+0000 7fdae17fa640 1 -- 172.21.15.6:0/2294488250 <== osd.11 v2:172.21.15.134:6824/932807401 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdae4062d00 con 0x7fdad00adde0 2024-09-11T23:58:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.866+0000 7fdae9cb4640 1 -- 172.21.15.6:0/2294488250 >> [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401] conn(0x7fdad00adde0 msgr2=0x7fdad00b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.866+0000 7fdae9cb4640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401] conn(0x7fdad00adde0 0x7fdad00b0280 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.867+0000 7fdae9cb4640 1 -- 172.21.15.6:0/2294488250 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdad00a2c10 msgr2=0x7fdad00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.867+0000 7fdae9cb4640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdad00a2c10 0x7fdad00a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdad4031440 tx=0x7fdad4005b50 comp rx=0 tx=0).stop 2024-09-11T23:58:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.867+0000 7fdae9cb4640 1 -- 172.21.15.6:0/2294488250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdae4074f50 msgr2=0x7fdae419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.867+0000 7fdae9cb4640 1 --2- 172.21.15.6:0/2294488250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdae4074f50 0x7fdae419aa40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00c920 tx=0x7fdacc00cde0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.867+0000 7fdae3fff640 1 -- 172.21.15.6:0/2294488250 reap_dead start 2024-09-11T23:58:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.867+0000 7fdae9cb4640 1 -- 172.21.15.6:0/2294488250 shutdown_connections 2024-09-11T23:58:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.867+0000 7fdae9cb4640 1 -- 172.21.15.6:0/2294488250 >> 172.21.15.6:0/2294488250 conn(0x7fdae40fd8d0 msgr2=0x7fdae40fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.867+0000 7fdae9cb4640 1 -- 172.21.15.6:0/2294488250 shutdown_connections 2024-09-11T23:58:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:18.867+0000 7fdae9cb4640 1 -- 172.21.15.6:0/2294488250 wait complete. 2024-09-11T23:58:19.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:18 smithi006 ceph-mon[30947]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-09-11T23:58:19.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:18 smithi134 ceph-mon[34893]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-09-11T23:58:19.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:18 smithi039 ceph-mon[34543]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-09-11T23:58:19.542 INFO:teuthology.orchestra.run.smithi006.stdout:317827579934 2024-09-11T23:58:19.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-11T23:58:20.033 INFO:teuthology.orchestra.run.smithi006.stdout:34359738452 2024-09-11T23:58:20.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-11T23:58:20.060 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:20.474 INFO:teuthology.orchestra.run.smithi006.stdout:103079215174 2024-09-11T23:58:20.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-11T23:58:20.493 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:20.952 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:20.955 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:20.978 INFO:teuthology.orchestra.run.smithi006.stdout:236223201324 2024-09-11T23:58:20.979 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-11T23:58:21.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:20 smithi006 ceph-mon[30947]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:21.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:20 smithi134 ceph-mon[34893]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:21.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:20 smithi039 ceph-mon[34543]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:21.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.476+0000 7f6833a81640 1 -- 172.21.15.6:0/2544606033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c101280 msgr2=0x7f682c10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.476+0000 7f6833a81640 1 --2- 172.21.15.6:0/2544606033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c101280 0x7f682c10df40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6828009900 tx=0x7f682802a410 comp rx=0 tx=0).stop 2024-09-11T23:58:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.476+0000 7f6833a81640 1 -- 172.21.15.6:0/2544606033 shutdown_connections 2024-09-11T23:58:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.476+0000 7f6833a81640 1 --2- 172.21.15.6:0/2544606033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f682c10e480 0x7f682c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.476+0000 7f6833a81640 1 --2- 172.21.15.6:0/2544606033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c101280 0x7f682c10df40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.476+0000 7f6833a81640 1 --2- 172.21.15.6:0/2544606033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f682c1008d0 0x7f682c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.476+0000 7f6833a81640 1 -- 172.21.15.6:0/2544606033 >> 172.21.15.6:0/2544606033 conn(0x7f682c0fc7a0 msgr2=0x7f682c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.476+0000 7f6833a81640 1 -- 172.21.15.6:0/2544606033 shutdown_connections 2024-09-11T23:58:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.476+0000 7f6833a81640 1 -- 172.21.15.6:0/2544606033 wait complete. 2024-09-11T23:58:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.476+0000 7f6833a81640 1 Processor -- start 2024-09-11T23:58:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.476+0000 7f6833a81640 1 -- start start 2024-09-11T23:58:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f6833a81640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f682c1008d0 0x7f682c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:21.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f6833a81640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f682c101280 0x7f682c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:21.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f6833a81640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c10e480 0x7f682c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:21.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f6833a81640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f682c114040 con 0x7f682c10e480 2024-09-11T23:58:21.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f6833a81640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f682c113ec0 con 0x7f682c101280 2024-09-11T23:58:21.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f6833a81640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f682c1141c0 con 0x7f682c1008d0 2024-09-11T23:58:21.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f683201e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c10e480 0x7f682c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:21.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f683201e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c10e480 0x7f682c19eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37380/0 (socket says 172.21.15.6:37380) 2024-09-11T23:58:21.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f683201e640 1 -- 172.21.15.6:0/2914406940 learned_addr learned my addr 172.21.15.6:0/2914406940 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:21.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f683101c640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f682c101280 0x7f682c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:21.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f683181d640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f682c1008d0 0x7f682c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:21.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f683201e640 1 -- 172.21.15.6:0/2914406940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f682c1008d0 msgr2=0x7f682c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:21.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f683201e640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f682c1008d0 0x7f682c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:21.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f683201e640 1 -- 172.21.15.6:0/2914406940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f682c101280 msgr2=0x7f682c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:21.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f683201e640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f682c101280 0x7f682c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:21.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f683201e640 1 -- 172.21.15.6:0/2914406940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682c19f5b0 con 0x7f682c10e480 2024-09-11T23:58:21.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f683181d640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f682c1008d0 0x7f682c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:21.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f683201e640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c10e480 0x7f682c19eed0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6824009fd0 tx=0x7f682400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:21.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f681effd640 1 -- 172.21.15.6:0/2914406940 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824004d20 con 0x7f682c10e480 2024-09-11T23:58:21.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f681effd640 1 -- 172.21.15.6:0/2914406940 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6824005020 con 0x7f682c10e480 2024-09-11T23:58:21.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f6833a81640 1 -- 172.21.15.6:0/2914406940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682c19f8a0 con 0x7f682c10e480 2024-09-11T23:58:21.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.477+0000 7f681effd640 1 -- 172.21.15.6:0/2914406940 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68240116b0 con 0x7f682c10e480 2024-09-11T23:58:21.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.478+0000 7f6833a81640 1 -- 172.21.15.6:0/2914406940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f682c1a7180 con 0x7f682c10e480 2024-09-11T23:58:21.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.479+0000 7f6833a81640 1 -- 172.21.15.6:0/2914406940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f682c100cb0 con 0x7f682c10e480 2024-09-11T23:58:21.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.480+0000 7f681effd640 1 -- 172.21.15.6:0/2914406940 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f68240051d0 con 0x7f682c10e480 2024-09-11T23:58:21.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.480+0000 7f681effd640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f68180a2c10 0x7f68180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:21.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.481+0000 7f681effd640 1 -- 172.21.15.6:0/2914406940 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f68240cf730 con 0x7f682c10e480 2024-09-11T23:58:21.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.481+0000 7f683181d640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f68180a2c10 0x7f68180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:21.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.481+0000 7f683181d640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f68180a2c10 0x7f68180a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f68200058c0 tx=0x7f6820005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:21.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.485+0000 7f681effd640 1 -- 172.21.15.6:0/2914406940 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6824016030 con 0x7f682c10e480 2024-09-11T23:58:21.546 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:21.551 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:21.551 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:21.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.687+0000 7f6833a81640 1 -- 172.21.15.6:0/2914406940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f682c109610 con 0x7f682c10e480 2024-09-11T23:58:21.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.687+0000 7f681effd640 1 -- 172.21.15.6:0/2914406940 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f682409c1d0 con 0x7f682c10e480 2024-09-11T23:58:21.688 INFO:teuthology.orchestra.run.smithi006.stdout:154618822716 2024-09-11T23:58:21.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.689+0000 7f6833a81640 1 -- 172.21.15.6:0/2914406940 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f68180a2c10 msgr2=0x7f68180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:21.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.689+0000 7f6833a81640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f68180a2c10 0x7f68180a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f68200058c0 tx=0x7f6820005850 comp rx=0 tx=0).stop 2024-09-11T23:58:21.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.689+0000 7f6833a81640 1 -- 172.21.15.6:0/2914406940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c10e480 msgr2=0x7f682c19eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:21.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.689+0000 7f6833a81640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c10e480 0x7f682c19eed0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6824009fd0 tx=0x7f682400ee60 comp rx=0 tx=0).stop 2024-09-11T23:58:21.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.689+0000 7f6833a81640 1 -- 172.21.15.6:0/2914406940 shutdown_connections 2024-09-11T23:58:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.689+0000 7f6833a81640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f68180a2c10 0x7f68180a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.689+0000 7f6833a81640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c10e480 0x7f682c19eed0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.689+0000 7f6833a81640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f682c101280 0x7f682c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.689+0000 7f6833a81640 1 --2- 172.21.15.6:0/2914406940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f682c1008d0 0x7f682c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.689+0000 7f6833a81640 1 -- 172.21.15.6:0/2914406940 >> 172.21.15.6:0/2914406940 conn(0x7f682c0fc7a0 msgr2=0x7f682c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.690+0000 7f6833a81640 1 -- 172.21.15.6:0/2914406940 shutdown_connections 2024-09-11T23:58:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:21.690+0000 7f6833a81640 1 -- 172.21.15.6:0/2914406940 wait complete. 2024-09-11T23:58:22.101 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:21 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2914406940' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T23:58:22.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:21 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2914406940' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T23:58:22.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:21 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2914406940' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T23:58:22.428 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822714 got 154618822716 for osd.5 2024-09-11T23:58:22.428 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.838+0000 7fbda5b24640 1 -- 172.21.15.6:0/1873359270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0106f10 msgr2=0x7fbda010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.838+0000 7fbda5b24640 1 --2- 172.21.15.6:0/1873359270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0106f10 0x7fbda010ea90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009ca0 tx=0x7fbd9802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.839+0000 7fbda5b24640 1 -- 172.21.15.6:0/1873359270 shutdown_connections 2024-09-11T23:58:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.839+0000 7fbda5b24640 1 --2- 172.21.15.6:0/1873359270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0106f10 0x7fbda010ea90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.839+0000 7fbda5b24640 1 --2- 172.21.15.6:0/1873359270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbda0102790 0x7fbda01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.839+0000 7fbda5b24640 1 --2- 172.21.15.6:0/1873359270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda0101de0 0x7fbda01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.839+0000 7fbda5b24640 1 -- 172.21.15.6:0/1873359270 >> 172.21.15.6:0/1873359270 conn(0x7fbda00fd8c0 msgr2=0x7fbda00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.839+0000 7fbda5b24640 1 -- 172.21.15.6:0/1873359270 shutdown_connections 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.839+0000 7fbda5b24640 1 -- 172.21.15.6:0/1873359270 wait complete. 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.839+0000 7fbda5b24640 1 Processor -- start 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.839+0000 7fbda5b24640 1 -- start start 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbda5b24640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbda0101de0 0x7fbda0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbda5b24640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0102790 0x7fbda0198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbda5b24640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda0106f10 0x7fbda019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbda5b24640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbda0111e40 con 0x7fbda0102790 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbda5b24640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbda0111cc0 con 0x7fbda0101de0 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbda5b24640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbda0111fc0 con 0x7fbda0106f10 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0102790 0x7fbda0198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0102790 0x7fbda0198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37408/0 (socket says 172.21.15.6:37408) 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9effd640 1 -- 172.21.15.6:0/2920741644 learned_addr learned my addr 172.21.15.6:0/2920741644 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9f7fe640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbda0101de0 0x7fbda0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9ffff640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda0106f10 0x7fbda019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9effd640 1 -- 172.21.15.6:0/2920741644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda0106f10 msgr2=0x7fbda019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9effd640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda0106f10 0x7fbda019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9effd640 1 -- 172.21.15.6:0/2920741644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbda0101de0 msgr2=0x7fbda0198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9effd640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbda0101de0 0x7fbda0198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9effd640 1 -- 172.21.15.6:0/2920741644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda019d2d0 con 0x7fbda0102790 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9ffff640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda0106f10 0x7fbda019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9effd640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0102790 0x7fbda0198860 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400b4a0 tx=0x7fbd9400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.840+0000 7fbd9cff9640 1 -- 172.21.15.6:0/2920741644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94015020 con 0x7fbda0102790 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.841+0000 7fbda5b24640 1 -- 172.21.15.6:0/2920741644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda019d5c0 con 0x7fbda0102790 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.841+0000 7fbd9cff9640 1 -- 172.21.15.6:0/2920741644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd94011ce0 con 0x7fbda0102790 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.841+0000 7fbd9cff9640 1 -- 172.21.15.6:0/2920741644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94010dc0 con 0x7fbda0102790 2024-09-11T23:58:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.841+0000 7fbda5b24640 1 -- 172.21.15.6:0/2920741644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda01a4ea0 con 0x7fbda0102790 2024-09-11T23:58:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.842+0000 7fbda5b24640 1 -- 172.21.15.6:0/2920741644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda01021c0 con 0x7fbda0102790 2024-09-11T23:58:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.843+0000 7fbd9cff9640 1 -- 172.21.15.6:0/2920741644 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fbd94018020 con 0x7fbda0102790 2024-09-11T23:58:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.843+0000 7fbd9cff9640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbd880a2c10 0x7fbd880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.844+0000 7fbd9f7fe640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbd880a2c10 0x7fbd880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.844+0000 7fbd9cff9640 1 -- 172.21.15.6:0/2920741644 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fbd940ced50 con 0x7fbda0102790 2024-09-11T23:58:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.844+0000 7fbd9f7fe640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbd880a2c10 0x7fbd880a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000abe0 tx=0x7fbd9000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:22.848+0000 7fbd9cff9640 1 -- 172.21.15.6:0/2920741644 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd9401f020 con 0x7fbda0102790 2024-09-11T23:58:23.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:22 smithi006 ceph-mon[30947]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:58:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.029+0000 7fbda5b24640 1 -- 172.21.15.6:0/2920741644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbda002d7c0 con 0x7fbda0102790 2024-09-11T23:58:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.029+0000 7fbd9cff9640 1 -- 172.21.15.6:0/2920741644 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbd9409b900 con 0x7fbda0102790 2024-09-11T23:58:23.029 INFO:teuthology.orchestra.run.smithi006.stdout:184683593784 2024-09-11T23:58:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.031+0000 7fbda5b24640 1 -- 172.21.15.6:0/2920741644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbd880a2c10 msgr2=0x7fbd880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.031+0000 7fbda5b24640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbd880a2c10 0x7fbd880a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000abe0 tx=0x7fbd9000a2d0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.031+0000 7fbda5b24640 1 -- 172.21.15.6:0/2920741644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0102790 msgr2=0x7fbda0198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.031+0000 7fbda5b24640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0102790 0x7fbda0198860 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400b4a0 tx=0x7fbd9400b8a0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.032+0000 7fbda5b24640 1 -- 172.21.15.6:0/2920741644 shutdown_connections 2024-09-11T23:58:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.032+0000 7fbda5b24640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbd880a2c10 0x7fbd880a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.032+0000 7fbda5b24640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda0106f10 0x7fbda019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.032+0000 7fbda5b24640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0102790 0x7fbda0198860 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.032+0000 7fbda5b24640 1 --2- 172.21.15.6:0/2920741644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbda0101de0 0x7fbda0198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.032+0000 7fbda5b24640 1 -- 172.21.15.6:0/2920741644 >> 172.21.15.6:0/2920741644 conn(0x7fbda00fd8c0 msgr2=0x7fbda00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.032+0000 7fbda5b24640 1 -- 172.21.15.6:0/2920741644 shutdown_connections 2024-09-11T23:58:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.032+0000 7fbda5b24640 1 -- 172.21.15.6:0/2920741644 wait complete. 2024-09-11T23:58:23.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.093+0000 7f56305fc640 1 -- 172.21.15.6:0/3901814523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5628101420 msgr2=0x7f562810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.093+0000 7f56305fc640 1 --2- 172.21.15.6:0/3901814523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5628101420 0x7f562810d950 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5620009930 tx=0x7f562002a420 comp rx=0 tx=0).stop 2024-09-11T23:58:23.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.093+0000 7f56305fc640 1 -- 172.21.15.6:0/3901814523 shutdown_connections 2024-09-11T23:58:23.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.093+0000 7f56305fc640 1 --2- 172.21.15.6:0/3901814523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5628101420 0x7f562810d950 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.093+0000 7f56305fc640 1 --2- 172.21.15.6:0/3901814523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5628100a80 0x7f5628100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.093+0000 7f56305fc640 1 --2- 172.21.15.6:0/3901814523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5628106a80 0x7f5628106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.093+0000 7f56305fc640 1 -- 172.21.15.6:0/3901814523 >> 172.21.15.6:0/3901814523 conn(0x7f56280fc7a0 msgr2=0x7f56280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.093+0000 7f56305fc640 1 -- 172.21.15.6:0/3901814523 shutdown_connections 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.093+0000 7f56305fc640 1 -- 172.21.15.6:0/3901814523 wait complete. 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.093+0000 7f56305fc640 1 Processor -- start 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f56305fc640 1 -- start start 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f56305fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5628100a80 0x7f562810e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f56305fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5628101420 0x7f562810e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f56305fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5628106a80 0x7f562810ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f56305fc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5628111e50 con 0x7f5628106a80 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f56305fc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5628111cd0 con 0x7f5628101420 2024-09-11T23:58:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f56305fc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5628111fd0 con 0x7f5628100a80 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f562eb99640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5628106a80 0x7f562810ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f562eb99640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5628106a80 0x7f562810ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37428/0 (socket says 172.21.15.6:37428) 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f562eb99640 1 -- 172.21.15.6:0/2398282644 learned_addr learned my addr 172.21.15.6:0/2398282644 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f562db97640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5628101420 0x7f562810e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f562e398640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5628100a80 0x7f562810e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f562eb99640 1 -- 172.21.15.6:0/2398282644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5628100a80 msgr2=0x7f562810e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f562eb99640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5628100a80 0x7f562810e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f562eb99640 1 -- 172.21.15.6:0/2398282644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5628101420 msgr2=0x7f562810e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f562eb99640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5628101420 0x7f562810e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f562eb99640 1 -- 172.21.15.6:0/2398282644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56281a6830 con 0x7f5628106a80 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.094+0000 7f562e398640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5628100a80 0x7f562810e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.095+0000 7f562eb99640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5628106a80 0x7f562810ee60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5620005940 tx=0x7f56200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.095+0000 7f561f7fe640 1 -- 172.21.15.6:0/2398282644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562003f030 con 0x7f5628106a80 2024-09-11T23:58:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.095+0000 7f561f7fe640 1 -- 172.21.15.6:0/2398282644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5620003cb0 con 0x7f5628106a80 2024-09-11T23:58:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.095+0000 7f56305fc640 1 -- 172.21.15.6:0/2398282644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56281a6ac0 con 0x7f5628106a80 2024-09-11T23:58:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.095+0000 7f561f7fe640 1 -- 172.21.15.6:0/2398282644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620035070 con 0x7f5628106a80 2024-09-11T23:58:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.095+0000 7f56305fc640 1 -- 172.21.15.6:0/2398282644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56281a6fa0 con 0x7f5628106a80 2024-09-11T23:58:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.096+0000 7f56305fc640 1 -- 172.21.15.6:0/2398282644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5628100ee0 con 0x7f5628106a80 2024-09-11T23:58:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.098+0000 7f561f7fe640 1 -- 172.21.15.6:0/2398282644 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5620042030 con 0x7f5628106a80 2024-09-11T23:58:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.098+0000 7f561f7fe640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f56140a2c10 0x7f56140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.098+0000 7f561f7fe640 1 -- 172.21.15.6:0/2398282644 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f56200efd60 con 0x7f5628106a80 2024-09-11T23:58:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.098+0000 7f562e398640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f56140a2c10 0x7f56140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.099+0000 7f562e398640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f56140a2c10 0x7f56140a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5624005fd0 tx=0x7f5624009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.102+0000 7f561f7fe640 1 -- 172.21.15.6:0/2398282644 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56200bc800 con 0x7f5628106a80 2024-09-11T23:58:23.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:22 smithi134 ceph-mon[34893]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:58:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.280+0000 7f56305fc640 1 -- 172.21.15.6:0/2398282644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f5628108ff0 con 0x7f5628106a80 2024-09-11T23:58:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.280+0000 7f561f7fe640 1 -- 172.21.15.6:0/2398282644 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f56200bc100 con 0x7f5628106a80 2024-09-11T23:58:23.280 INFO:teuthology.orchestra.run.smithi006.stdout:317827579934 2024-09-11T23:58:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.282+0000 7f56305fc640 1 -- 172.21.15.6:0/2398282644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f56140a2c10 msgr2=0x7f56140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.282+0000 7f56305fc640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f56140a2c10 0x7f56140a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5624005fd0 tx=0x7f5624009500 comp rx=0 tx=0).stop 2024-09-11T23:58:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.282+0000 7f56305fc640 1 -- 172.21.15.6:0/2398282644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5628106a80 msgr2=0x7f562810ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.282+0000 7f56305fc640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5628106a80 0x7f562810ee60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5620005940 tx=0x7f56200042f0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.282+0000 7f56305fc640 1 -- 172.21.15.6:0/2398282644 shutdown_connections 2024-09-11T23:58:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.282+0000 7f56305fc640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f56140a2c10 0x7f56140a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.282+0000 7f56305fc640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5628106a80 0x7f562810ee60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.282+0000 7f56305fc640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5628101420 0x7f562810e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.282+0000 7f56305fc640 1 --2- 172.21.15.6:0/2398282644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5628100a80 0x7f562810e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.282+0000 7f56305fc640 1 -- 172.21.15.6:0/2398282644 >> 172.21.15.6:0/2398282644 conn(0x7f56280fc7a0 msgr2=0x7f56280fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.283+0000 7f56305fc640 1 -- 172.21.15.6:0/2398282644 shutdown_connections 2024-09-11T23:58:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:23.283+0000 7f56305fc640 1 -- 172.21.15.6:0/2398282644 wait complete. 2024-09-11T23:58:23.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:22 smithi039 ceph-mon[34543]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:58:23.905 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593782 got 184683593784 for osd.6 2024-09-11T23:58:23.905 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:24.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:23 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2920741644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T23:58:24.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:23 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2398282644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T23:58:24.222 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:23 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2920741644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T23:58:24.222 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:23 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2398282644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T23:58:24.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:23 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2920741644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T23:58:24.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:23 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2398282644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T23:58:24.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.916+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/108730572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0106a80 msgr2=0x7f6fe0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:24.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.916+0000 7f6fe5a3c640 1 --2- 172.21.15.6:0/108730572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0106a80 0x7f6fe0106e60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009930 tx=0x7f6fd002a420 comp rx=0 tx=0).stop 2024-09-11T23:58:24.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.916+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/108730572 shutdown_connections 2024-09-11T23:58:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.916+0000 7f6fe5a3c640 1 --2- 172.21.15.6:0/108730572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe0101420 0x7f6fe010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.916+0000 7f6fe5a3c640 1 --2- 172.21.15.6:0/108730572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe0100a80 0x7f6fe0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.916+0000 7f6fe5a3c640 1 --2- 172.21.15.6:0/108730572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0106a80 0x7f6fe0106e60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.916+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/108730572 >> 172.21.15.6:0/108730572 conn(0x7f6fe00fc7a0 msgr2=0x7f6fe00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.916+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/108730572 shutdown_connections 2024-09-11T23:58:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.916+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/108730572 wait complete. 2024-09-11T23:58:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.917+0000 7f6fe5a3c640 1 Processor -- start 2024-09-11T23:58:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.917+0000 7f6fe5a3c640 1 -- start start 2024-09-11T23:58:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.917+0000 7f6fe5a3c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe0100a80 0x7f6fe01961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.917+0000 7f6fe5a3c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0101420 0x7f6fe01966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.917+0000 7f6fe5a3c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe0106a80 0x7f6fe019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.917+0000 7f6fe5a3c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe010fc80 con 0x7f6fe0101420 2024-09-11T23:58:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.917+0000 7f6fe5a3c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe010fb00 con 0x7f6fe0100a80 2024-09-11T23:58:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.917+0000 7f6fe5a3c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe010fe00 con 0x7f6fe0106a80 2024-09-11T23:58:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.917+0000 7f6fde7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0101420 0x7f6fe01966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.917+0000 7f6fde7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0101420 0x7f6fe01966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37450/0 (socket says 172.21.15.6:37450) 2024-09-11T23:58:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.917+0000 7f6fde7fc640 1 -- 172.21.15.6:0/2336596136 learned_addr learned my addr 172.21.15.6:0/2336596136 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fdf7fe640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe0106a80 0x7f6fe019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fdeffd640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe0100a80 0x7f6fe01961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fde7fc640 1 -- 172.21.15.6:0/2336596136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe0106a80 msgr2=0x7f6fe019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fde7fc640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe0106a80 0x7f6fe019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fde7fc640 1 -- 172.21.15.6:0/2336596136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe0100a80 msgr2=0x7f6fe01961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fde7fc640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe0100a80 0x7f6fe01961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fde7fc640 1 -- 172.21.15.6:0/2336596136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe019b150 con 0x7f6fe0101420 2024-09-11T23:58:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fdeffd640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe0100a80 0x7f6fe01961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fde7fc640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0101420 0x7f6fe01966e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009db0 tx=0x7f6fd400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fe4a3a640 1 -- 172.21.15.6:0/2336596136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd400b030 con 0x7f6fe0101420 2024-09-11T23:58:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fe4a3a640 1 -- 172.21.15.6:0/2336596136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fd400b1d0 con 0x7f6fe0101420 2024-09-11T23:58:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/2336596136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe019b440 con 0x7f6fe0101420 2024-09-11T23:58:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fe4a3a640 1 -- 172.21.15.6:0/2336596136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4004a00 con 0x7f6fe0101420 2024-09-11T23:58:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.918+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/2336596136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe01a2d20 con 0x7f6fe0101420 2024-09-11T23:58:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.919+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/2336596136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe0100ee0 con 0x7f6fe0101420 2024-09-11T23:58:24.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.920+0000 7f6fe4a3a640 1 -- 172.21.15.6:0/2336596136 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6fd401e020 con 0x7f6fe0101420 2024-09-11T23:58:24.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.921+0000 7f6fe4a3a640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6fc80a2c10 0x7f6fc80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:24.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.921+0000 7f6fdeffd640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6fc80a2c10 0x7f6fc80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:24.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.921+0000 7f6fe4a3a640 1 -- 172.21.15.6:0/2336596136 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f6fd40d0f50 con 0x7f6fe0101420 2024-09-11T23:58:24.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.922+0000 7f6fdeffd640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6fc80a2c10 0x7f6fc80a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6fd002a940 tx=0x7f6fd0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:24.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:24.925+0000 7f6fe4a3a640 1 -- 172.21.15.6:0/2336596136 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6fd4012070 con 0x7f6fe0101420 2024-09-11T23:58:25.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.109+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/2336596136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6fe0108a60 con 0x7f6fe0101420 2024-09-11T23:58:25.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.109+0000 7f6fe4a3a640 1 -- 172.21.15.6:0/2336596136 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6fd409d9f0 con 0x7f6fe0101420 2024-09-11T23:58:25.109 INFO:teuthology.orchestra.run.smithi006.stdout:55834574929 2024-09-11T23:58:25.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.112+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/2336596136 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6fc80a2c10 msgr2=0x7f6fc80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:25.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.112+0000 7f6fe5a3c640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6fc80a2c10 0x7f6fc80a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6fd002a940 tx=0x7f6fd0005fd0 comp rx=0 tx=0).stop 2024-09-11T23:58:25.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.112+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/2336596136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0101420 msgr2=0x7f6fe01966e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:25.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.112+0000 7f6fe5a3c640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0101420 0x7f6fe01966e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009db0 tx=0x7f6fd400f4a0 comp rx=0 tx=0).stop 2024-09-11T23:58:25.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.112+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/2336596136 shutdown_connections 2024-09-11T23:58:25.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.112+0000 7f6fe5a3c640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f6fc80a2c10 0x7f6fc80a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:25.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.112+0000 7f6fe5a3c640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe0106a80 0x7f6fe019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:25.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.112+0000 7f6fe5a3c640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0101420 0x7f6fe01966e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:25.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.112+0000 7f6fe5a3c640 1 --2- 172.21.15.6:0/2336596136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe0100a80 0x7f6fe01961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:25.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.112+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/2336596136 >> 172.21.15.6:0/2336596136 conn(0x7f6fe00fc7a0 msgr2=0x7f6fe00fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:25.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.112+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/2336596136 shutdown_connections 2024-09-11T23:58:25.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:25.112+0000 7f6fe5a3c640 1 -- 172.21.15.6:0/2336596136 wait complete. 2024-09-11T23:58:25.142 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:24 smithi006 ceph-mon[30947]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:25.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:24 smithi134 ceph-mon[34893]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:25.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:24 smithi039 ceph-mon[34543]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:25.360 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579934 got 317827579934 for osd.11 2024-09-11T23:58:25.361 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:26.013 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:25 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2336596136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T23:58:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.013+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/2079182290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ac0102ef0 msgr2=0x7f1ac010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.013+0000 7f1ac6ca3640 1 --2- 172.21.15.6:0/2079182290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ac0102ef0 0x7f1ac010da40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009ca0 tx=0x7f1ab802a950 comp rx=0 tx=0).stop 2024-09-11T23:58:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.013+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/2079182290 shutdown_connections 2024-09-11T23:58:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.013+0000 7f1ac6ca3640 1 --2- 172.21.15.6:0/2079182290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ac0102ef0 0x7f1ac010da40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.013+0000 7f1ac6ca3640 1 --2- 172.21.15.6:0/2079182290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac0102570 0x7f1ac01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.013+0000 7f1ac6ca3640 1 --2- 172.21.15.6:0/2079182290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ac0100e20 0x7f1ac0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.013+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/2079182290 >> 172.21.15.6:0/2079182290 conn(0x7f1ac00fc7d0 msgr2=0x7f1ac00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.013+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/2079182290 shutdown_connections 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.013+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/2079182290 wait complete. 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac6ca3640 1 Processor -- start 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac6ca3640 1 -- start start 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac6ca3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ac0100e20 0x7f1ac019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac6ca3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ac0102570 0x7f1ac019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac6ca3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac0102ef0 0x7f1ac019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac6ca3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac0110e30 con 0x7f1ac0100e20 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac6ca3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac0110cb0 con 0x7f1ac0102ef0 2024-09-11T23:58:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac6ca3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac0110fb0 con 0x7f1ac0102570 2024-09-11T23:58:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac4a3f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ac0100e20 0x7f1ac019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac4a3f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ac0100e20 0x7f1ac019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37470/0 (socket says 172.21.15.6:37470) 2024-09-11T23:58:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac4a3f640 1 -- 172.21.15.6:0/4017600559 learned_addr learned my addr 172.21.15.6:0/4017600559 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1abffff640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ac0102570 0x7f1ac019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac5240640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac0102ef0 0x7f1ac019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac4a3f640 1 -- 172.21.15.6:0/4017600559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ac0102570 msgr2=0x7f1ac019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac4a3f640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ac0102570 0x7f1ac019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac4a3f640 1 -- 172.21.15.6:0/4017600559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac0102ef0 msgr2=0x7f1ac019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac4a3f640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac0102ef0 0x7f1ac019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.014+0000 7f1ac4a3f640 1 -- 172.21.15.6:0/4017600559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac019f540 con 0x7f1ac0100e20 2024-09-11T23:58:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.015+0000 7f1ac4a3f640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ac0100e20 0x7f1ac019a590 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000c970 tx=0x7f1ab000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.015+0000 7f1abdffb640 1 -- 172.21.15.6:0/4017600559 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0007bb0 con 0x7f1ac0100e20 2024-09-11T23:58:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.015+0000 7f1abdffb640 1 -- 172.21.15.6:0/4017600559 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1ab0007d50 con 0x7f1ac0100e20 2024-09-11T23:58:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.015+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/4017600559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac019f830 con 0x7f1ac0100e20 2024-09-11T23:58:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.015+0000 7f1abdffb640 1 -- 172.21.15.6:0/4017600559 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab000f450 con 0x7f1ac0100e20 2024-09-11T23:58:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.015+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/4017600559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac01a7110 con 0x7f1ac0100e20 2024-09-11T23:58:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.016+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/4017600559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac0101200 con 0x7f1ac0100e20 2024-09-11T23:58:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.017+0000 7f1abdffb640 1 -- 172.21.15.6:0/4017600559 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f1ab0004f20 con 0x7f1ac0100e20 2024-09-11T23:58:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.018+0000 7f1abdffb640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1aa80a2c10 0x7f1aa80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.018+0000 7f1abffff640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1aa80a2c10 0x7f1aa80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.018+0000 7f1abdffb640 1 -- 172.21.15.6:0/4017600559 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f1ab00cf200 con 0x7f1ac0100e20 2024-09-11T23:58:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.018+0000 7f1abffff640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1aa80a2c10 0x7f1aa80a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0104c00 tx=0x7f1ab400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:26.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.022+0000 7f1abdffb640 1 -- 172.21.15.6:0/4017600559 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ab0014030 con 0x7f1ac0100e20 2024-09-11T23:58:26.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.199+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/4017600559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1ac01a72e0 con 0x7f1ac0100e20 2024-09-11T23:58:26.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.200+0000 7f1abdffb640 1 -- 172.21.15.6:0/4017600559 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ab009b650 con 0x7f1ac0100e20 2024-09-11T23:58:26.201 INFO:teuthology.orchestra.run.smithi006.stdout:77309411405 2024-09-11T23:58:26.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.202+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/4017600559 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1aa80a2c10 msgr2=0x7f1aa80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.202+0000 7f1ac6ca3640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1aa80a2c10 0x7f1aa80a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0104c00 tx=0x7f1ab400b390 comp rx=0 tx=0).stop 2024-09-11T23:58:26.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.202+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/4017600559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ac0100e20 msgr2=0x7f1ac019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.202+0000 7f1ac6ca3640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ac0100e20 0x7f1ac019a590 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000c970 tx=0x7f1ab000ce30 comp rx=0 tx=0).stop 2024-09-11T23:58:26.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.202+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/4017600559 shutdown_connections 2024-09-11T23:58:26.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.202+0000 7f1ac6ca3640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1aa80a2c10 0x7f1aa80a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.202+0000 7f1ac6ca3640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac0102ef0 0x7f1ac019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.202+0000 7f1ac6ca3640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ac0102570 0x7f1ac019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.202+0000 7f1ac6ca3640 1 --2- 172.21.15.6:0/4017600559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ac0100e20 0x7f1ac019a590 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.202+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/4017600559 >> 172.21.15.6:0/4017600559 conn(0x7f1ac00fc7d0 msgr2=0x7f1ac006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.202+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/4017600559 shutdown_connections 2024-09-11T23:58:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.202+0000 7f1ac6ca3640 1 -- 172.21.15.6:0/4017600559 wait complete. 2024-09-11T23:58:26.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:25 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2336596136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T23:58:26.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:25 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2336596136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T23:58:26.485 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574926 got 55834574929 for osd.1 2024-09-11T23:58:26.485 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.642+0000 7f35db57a640 1 -- 172.21.15.6:0/1479968454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d41008d0 msgr2=0x7f35d4100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.642+0000 7f35db57a640 1 --2- 172.21.15.6:0/1479968454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d41008d0 0x7f35d4100cb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009900 tx=0x7f35d002a410 comp rx=0 tx=0).stop 2024-09-11T23:58:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.643+0000 7f35db57a640 1 -- 172.21.15.6:0/1479968454 shutdown_connections 2024-09-11T23:58:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.643+0000 7f35db57a640 1 --2- 172.21.15.6:0/1479968454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35d410e480 0x7f35d4110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.643+0000 7f35db57a640 1 --2- 172.21.15.6:0/1479968454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35d4101280 0x7f35d410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.643+0000 7f35db57a640 1 --2- 172.21.15.6:0/1479968454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d41008d0 0x7f35d4100cb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.643+0000 7f35db57a640 1 -- 172.21.15.6:0/1479968454 >> 172.21.15.6:0/1479968454 conn(0x7f35d40fc7a0 msgr2=0x7f35d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.643+0000 7f35db57a640 1 -- 172.21.15.6:0/1479968454 shutdown_connections 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.643+0000 7f35db57a640 1 -- 172.21.15.6:0/1479968454 wait complete. 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.643+0000 7f35db57a640 1 Processor -- start 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.643+0000 7f35db57a640 1 -- start start 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.643+0000 7f35db57a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35d41008d0 0x7f35d419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.643+0000 7f35db57a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d4101280 0x7f35d419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.643+0000 7f35db57a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35d410e480 0x7f35d419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35db57a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35d41140b0 con 0x7f35d4101280 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35db57a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f35d4113f30 con 0x7f35d410e480 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35db57a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35d4114230 con 0x7f35d41008d0 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35d8b15640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d4101280 0x7f35d419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35d8b15640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d4101280 0x7f35d419aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37492/0 (socket says 172.21.15.6:37492) 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35d8b15640 1 -- 172.21.15.6:0/2601669296 learned_addr learned my addr 172.21.15.6:0/2601669296 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35d9316640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35d41008d0 0x7f35d419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35d9b17640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35d410e480 0x7f35d419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35d8b15640 1 -- 172.21.15.6:0/2601669296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35d41008d0 msgr2=0x7f35d419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35d8b15640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35d41008d0 0x7f35d419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35d8b15640 1 -- 172.21.15.6:0/2601669296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35d410e480 msgr2=0x7f35d419ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35d8b15640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35d410e480 0x7f35d419ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35d8b15640 1 -- 172.21.15.6:0/2601669296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d419f560 con 0x7f35d4101280 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35d8b15640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d4101280 0x7f35d419aaf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f35c400e9f0 tx=0x7f35c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35ca7fc640 1 -- 172.21.15.6:0/2601669296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c400cd80 con 0x7f35d4101280 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35ca7fc640 1 -- 172.21.15.6:0/2601669296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35c40108e0 con 0x7f35d4101280 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35db57a640 1 -- 172.21.15.6:0/2601669296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d419f850 con 0x7f35d4101280 2024-09-11T23:58:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.644+0000 7f35ca7fc640 1 -- 172.21.15.6:0/2601669296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c4018920 con 0x7f35d4101280 2024-09-11T23:58:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.645+0000 7f35db57a640 1 -- 172.21.15.6:0/2601669296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d41a7130 con 0x7f35d4101280 2024-09-11T23:58:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.646+0000 7f35db57a640 1 -- 172.21.15.6:0/2601669296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d4100cb0 con 0x7f35d4101280 2024-09-11T23:58:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.647+0000 7f35ca7fc640 1 -- 172.21.15.6:0/2601669296 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f35c4010a90 con 0x7f35d4101280 2024-09-11T23:58:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.648+0000 7f35ca7fc640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f35c00a2c90 0x7f35c00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.648+0000 7f35d9316640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f35c00a2c90 0x7f35c00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.648+0000 7f35ca7fc640 1 -- 172.21.15.6:0/2601669296 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f35c40cfc20 con 0x7f35d4101280 2024-09-11T23:58:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.648+0000 7f35d9316640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f35c00a2c90 0x7f35c00a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f35d0005ab0 tx=0x7f35d0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.651+0000 7f35ca7fc640 1 -- 172.21.15.6:0/2601669296 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35c409c070 con 0x7f35d4101280 2024-09-11T23:58:26.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.831+0000 7f35db57a640 1 -- 172.21.15.6:0/2601669296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f35d402d7c0 con 0x7f35d4101280 2024-09-11T23:58:26.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.831+0000 7f35ca7fc640 1 -- 172.21.15.6:0/2601669296 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f35c40a0370 con 0x7f35d4101280 2024-09-11T23:58:26.831 INFO:teuthology.orchestra.run.smithi006.stdout:236223201326 2024-09-11T23:58:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.833+0000 7f35db57a640 1 -- 172.21.15.6:0/2601669296 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f35c00a2c90 msgr2=0x7f35c00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.833+0000 7f35db57a640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f35c00a2c90 0x7f35c00a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f35d0005ab0 tx=0x7f35d0005a20 comp rx=0 tx=0).stop 2024-09-11T23:58:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.833+0000 7f35db57a640 1 -- 172.21.15.6:0/2601669296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d4101280 msgr2=0x7f35d419aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.833+0000 7f35db57a640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d4101280 0x7f35d419aaf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f35c400e9f0 tx=0x7f35c400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.833+0000 7f35db57a640 1 -- 172.21.15.6:0/2601669296 shutdown_connections 2024-09-11T23:58:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.833+0000 7f35db57a640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f35c00a2c90 0x7f35c00a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.833+0000 7f35db57a640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35d410e480 0x7f35d419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.833+0000 7f35db57a640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d4101280 0x7f35d419aaf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.834+0000 7f35db57a640 1 --2- 172.21.15.6:0/2601669296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35d41008d0 0x7f35d419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.834+0000 7f35db57a640 1 -- 172.21.15.6:0/2601669296 >> 172.21.15.6:0/2601669296 conn(0x7f35d40fc7a0 msgr2=0x7f35d40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.834+0000 7f35db57a640 1 -- 172.21.15.6:0/2601669296 shutdown_connections 2024-09-11T23:58:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.834+0000 7f35db57a640 1 -- 172.21.15.6:0/2601669296 wait complete. 2024-09-11T23:58:26.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.880+0000 7f5a85dfb640 1 -- 172.21.15.6:0/2745227239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a80102ef0 msgr2=0x7f5a8010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.880+0000 7f5a85dfb640 1 --2- 172.21.15.6:0/2745227239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a80102ef0 0x7f5a8010da40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009ca0 tx=0x7f5a7802a950 comp rx=0 tx=0).stop 2024-09-11T23:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.880+0000 7f5a85dfb640 1 -- 172.21.15.6:0/2745227239 shutdown_connections 2024-09-11T23:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.880+0000 7f5a85dfb640 1 --2- 172.21.15.6:0/2745227239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a80102ef0 0x7f5a8010da40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.880+0000 7f5a85dfb640 1 --2- 172.21.15.6:0/2745227239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a80102570 0x7f5a801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.880+0000 7f5a85dfb640 1 --2- 172.21.15.6:0/2745227239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a80100e20 0x7f5a80101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.880+0000 7f5a85dfb640 1 -- 172.21.15.6:0/2745227239 >> 172.21.15.6:0/2745227239 conn(0x7f5a800fc7d0 msgr2=0x7f5a800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.880+0000 7f5a85dfb640 1 -- 172.21.15.6:0/2745227239 shutdown_connections 2024-09-11T23:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.880+0000 7f5a85dfb640 1 -- 172.21.15.6:0/2745227239 wait complete. 2024-09-11T23:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.881+0000 7f5a85dfb640 1 Processor -- start 2024-09-11T23:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.881+0000 7f5a85dfb640 1 -- start start 2024-09-11T23:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.881+0000 7f5a85dfb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a80100e20 0x7f5a80199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.881+0000 7f5a85dfb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a80102570 0x7f5a801997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.881+0000 7f5a85dfb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a80102ef0 0x7f5a801a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.881+0000 7f5a85dfb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5a80110e70 con 0x7f5a80100e20 2024-09-11T23:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.881+0000 7f5a85dfb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5a80110cf0 con 0x7f5a80102570 2024-09-11T23:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.881+0000 7f5a85dfb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a80110ff0 con 0x7f5a80102ef0 2024-09-11T23:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.881+0000 7f5a7f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a80100e20 0x7f5a80199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.881+0000 7f5a7f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a80100e20 0x7f5a80199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37500/0 (socket says 172.21.15.6:37500) 2024-09-11T23:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.881+0000 7f5a7f7fe640 1 -- 172.21.15.6:0/4000750102 learned_addr learned my addr 172.21.15.6:0/4000750102 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.881+0000 7f5a7ffff640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a80102ef0 0x7f5a801a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a7effd640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a80102570 0x7f5a801997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a7f7fe640 1 -- 172.21.15.6:0/4000750102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a80102ef0 msgr2=0x7f5a801a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a7f7fe640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a80102ef0 0x7f5a801a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a7f7fe640 1 -- 172.21.15.6:0/4000750102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a80102570 msgr2=0x7f5a801997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a7f7fe640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a80102570 0x7f5a801997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a7f7fe640 1 -- 172.21.15.6:0/4000750102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a801a4840 con 0x7f5a80100e20 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a7ffff640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a80102ef0 0x7f5a801a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a7f7fe640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a80100e20 0x7f5a80199280 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b4a0 tx=0x7f5a7000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a7cff9640 1 -- 172.21.15.6:0/4000750102 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70014070 con 0x7f5a80100e20 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a85dfb640 1 -- 172.21.15.6:0/4000750102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a801a4a10 con 0x7f5a80100e20 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a7cff9640 1 -- 172.21.15.6:0/4000750102 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5a70010ac0 con 0x7f5a80100e20 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a7cff9640 1 -- 172.21.15.6:0/4000750102 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70017c30 con 0x7f5a80100e20 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.882+0000 7f5a85dfb640 1 -- 172.21.15.6:0/4000750102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a801a4f00 con 0x7f5a80100e20 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.883+0000 7f5a85dfb640 1 -- 172.21.15.6:0/4000750102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a80101200 con 0x7f5a80100e20 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.885+0000 7f5a7cff9640 1 -- 172.21.15.6:0/4000750102 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5a70017070 con 0x7f5a80100e20 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.885+0000 7f5a7cff9640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5a680a2c90 0x7f5a680a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.885+0000 7f5a7cff9640 1 -- 172.21.15.6:0/4000750102 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f5a700ceb90 con 0x7f5a80100e20 2024-09-11T23:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.885+0000 7f5a7effd640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5a680a2c90 0x7f5a680a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.886+0000 7f5a7effd640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5a680a2c90 0x7f5a680a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5a8006aac0 tx=0x7f5a74005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:26.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:26.889+0000 7f5a7cff9640 1 -- 172.21.15.6:0/4000750102 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a7009b6e0 con 0x7f5a80100e20 2024-09-11T23:58:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.069+0000 7f5a85dfb640 1 -- 172.21.15.6:0/4000750102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5a8006a560 con 0x7f5a80100e20 2024-09-11T23:58:27.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:26 smithi006 ceph-mon[30947]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-11T23:58:27.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:26 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/4017600559' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T23:58:27.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:26 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2601669296' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T23:58:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.070+0000 7f5a7cff9640 1 -- 172.21.15.6:0/4000750102 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5a8006a560 con 0x7f5a80100e20 2024-09-11T23:58:27.071 INFO:teuthology.orchestra.run.smithi006.stdout:34359738454 2024-09-11T23:58:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.072+0000 7f5a85dfb640 1 -- 172.21.15.6:0/4000750102 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5a680a2c90 msgr2=0x7f5a680a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.072+0000 7f5a85dfb640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5a680a2c90 0x7f5a680a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5a8006aac0 tx=0x7f5a74005f90 comp rx=0 tx=0).stop 2024-09-11T23:58:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.072+0000 7f5a85dfb640 1 -- 172.21.15.6:0/4000750102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a80100e20 msgr2=0x7f5a80199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.072+0000 7f5a85dfb640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a80100e20 0x7f5a80199280 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b4a0 tx=0x7f5a7000b960 comp rx=0 tx=0).stop 2024-09-11T23:58:27.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.072+0000 7f5a85dfb640 1 -- 172.21.15.6:0/4000750102 shutdown_connections 2024-09-11T23:58:27.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.072+0000 7f5a85dfb640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5a680a2c90 0x7f5a680a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.072+0000 7f5a85dfb640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a80102ef0 0x7f5a801a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.072+0000 7f5a85dfb640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a80102570 0x7f5a801997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.072+0000 7f5a85dfb640 1 --2- 172.21.15.6:0/4000750102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a80100e20 0x7f5a80199280 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.072+0000 7f5a85dfb640 1 -- 172.21.15.6:0/4000750102 >> 172.21.15.6:0/4000750102 conn(0x7f5a800fc7d0 msgr2=0x7f5a800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:27.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.073+0000 7f5a85dfb640 1 -- 172.21.15.6:0/4000750102 shutdown_connections 2024-09-11T23:58:27.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:27.073+0000 7f5a85dfb640 1 -- 172.21.15.6:0/4000750102 wait complete. 2024-09-11T23:58:27.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:26 smithi134 ceph-mon[34893]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-11T23:58:27.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:26 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/4017600559' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T23:58:27.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:26 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2601669296' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T23:58:27.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:26 smithi039 ceph-mon[34543]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-11T23:58:27.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:26 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/4017600559' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T23:58:27.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:26 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2601669296' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T23:58:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:27.334 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:27.335 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:27.336 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:27.342 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:27.970 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:27 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/4000750102' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T23:58:27.998 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411402 got 77309411405 for osd.2 2024-09-11T23:58:27.998 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:28.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:27 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/4000750102' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T23:58:28.316 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:27 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/4000750102' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T23:58:28.433 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201324 got 236223201326 for osd.8 2024-09-11T23:58:28.434 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:29.091 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:28 smithi006 ceph-mon[30947]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:58:29.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.090+0000 7f1d82cdb640 1 -- 172.21.15.6:0/139782264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c102790 msgr2=0x7f1d7c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.090+0000 7f1d82cdb640 1 --2- 172.21.15.6:0/139782264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c102790 0x7f1d7c1067e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009ca0 tx=0x7f1d7002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.090+0000 7f1d82cdb640 1 -- 172.21.15.6:0/139782264 shutdown_connections 2024-09-11T23:58:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.090+0000 7f1d82cdb640 1 --2- 172.21.15.6:0/139782264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d7c106f10 0x7f1d7c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.090+0000 7f1d82cdb640 1 --2- 172.21.15.6:0/139782264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c102790 0x7f1d7c1067e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.090+0000 7f1d82cdb640 1 --2- 172.21.15.6:0/139782264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d7c101de0 0x7f1d7c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.090+0000 7f1d82cdb640 1 -- 172.21.15.6:0/139782264 >> 172.21.15.6:0/139782264 conn(0x7f1d7c0fd8c0 msgr2=0x7f1d7c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.091+0000 7f1d82cdb640 1 -- 172.21.15.6:0/139782264 shutdown_connections 2024-09-11T23:58:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.091+0000 7f1d82cdb640 1 -- 172.21.15.6:0/139782264 wait complete. 2024-09-11T23:58:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.091+0000 7f1d82cdb640 1 Processor -- start 2024-09-11T23:58:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.091+0000 7f1d82cdb640 1 -- start start 2024-09-11T23:58:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d82cdb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c101de0 0x7f1d7c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d82cdb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d7c102790 0x7f1d7c1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d82cdb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d7c106f10 0x7f1d7c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d82cdb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c111e20 con 0x7f1d7c101de0 2024-09-11T23:58:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d82cdb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c111ca0 con 0x7f1d7c102790 2024-09-11T23:58:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d82cdb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c111fa0 con 0x7f1d7c106f10 2024-09-11T23:58:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d80a77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c101de0 0x7f1d7c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d80a77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c101de0 0x7f1d7c198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37514/0 (socket says 172.21.15.6:37514) 2024-09-11T23:58:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d80a77640 1 -- 172.21.15.6:0/248379152 learned_addr learned my addr 172.21.15.6:0/248379152 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d7bfff640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d7c102790 0x7f1d7c1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d81278640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d7c106f10 0x7f1d7c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d80a77640 1 -- 172.21.15.6:0/248379152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d7c106f10 msgr2=0x7f1d7c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d80a77640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d7c106f10 0x7f1d7c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d80a77640 1 -- 172.21.15.6:0/248379152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d7c102790 msgr2=0x7f1d7c1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d80a77640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d7c102790 0x7f1d7c1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d80a77640 1 -- 172.21.15.6:0/248379152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7c19d310 con 0x7f1d7c101de0 2024-09-11T23:58:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d7bfff640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d7c102790 0x7f1d7c1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d81278640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d7c106f10 0x7f1d7c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.092+0000 7f1d80a77640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c101de0 0x7f1d7c198360 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00e9f0 tx=0x7f1d6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.093+0000 7f1d79ffb640 1 -- 172.21.15.6:0/248379152 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00cd80 con 0x7f1d7c101de0 2024-09-11T23:58:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.093+0000 7f1d79ffb640 1 -- 172.21.15.6:0/248379152 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1d6c0108e0 con 0x7f1d7c101de0 2024-09-11T23:58:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.093+0000 7f1d82cdb640 1 -- 172.21.15.6:0/248379152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7c19d600 con 0x7f1d7c101de0 2024-09-11T23:58:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.093+0000 7f1d79ffb640 1 -- 172.21.15.6:0/248379152 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c018920 con 0x7f1d7c101de0 2024-09-11T23:58:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.093+0000 7f1d82cdb640 1 -- 172.21.15.6:0/248379152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d7c1a4ee0 con 0x7f1d7c101de0 2024-09-11T23:58:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.094+0000 7f1d82cdb640 1 -- 172.21.15.6:0/248379152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d7c1021c0 con 0x7f1d7c101de0 2024-09-11T23:58:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.095+0000 7f1d79ffb640 1 -- 172.21.15.6:0/248379152 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f1d6c010a90 con 0x7f1d7c101de0 2024-09-11T23:58:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.096+0000 7f1d79ffb640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1d640a2c90 0x7f1d640a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.096+0000 7f1d7bfff640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1d640a2c90 0x7f1d640a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.096+0000 7f1d79ffb640 1 -- 172.21.15.6:0/248379152 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f1d6c0cf910 con 0x7f1d7c101de0 2024-09-11T23:58:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.096+0000 7f1d7bfff640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1d640a2c90 0x7f1d640a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0fdce0 tx=0x7f1d70005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.100+0000 7f1d79ffb640 1 -- 172.21.15.6:0/248379152 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d6c09c3b0 con 0x7f1d7c101de0 2024-09-11T23:58:29.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:28 smithi134 ceph-mon[34893]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:58:29.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.279+0000 7f1d82cdb640 1 -- 172.21.15.6:0/248379152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f1d7c10a150 con 0x7f1d7c101de0 2024-09-11T23:58:29.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.279+0000 7f1d79ffb640 1 -- 172.21.15.6:0/248379152 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1d6c09bcb0 con 0x7f1d7c101de0 2024-09-11T23:58:29.280 INFO:teuthology.orchestra.run.smithi006.stdout:266287972394 2024-09-11T23:58:29.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.282+0000 7f1d82cdb640 1 -- 172.21.15.6:0/248379152 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1d640a2c90 msgr2=0x7f1d640a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.282+0000 7f1d82cdb640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1d640a2c90 0x7f1d640a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0fdce0 tx=0x7f1d70005ef0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.282+0000 7f1d82cdb640 1 -- 172.21.15.6:0/248379152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c101de0 msgr2=0x7f1d7c198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.282+0000 7f1d82cdb640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c101de0 0x7f1d7c198360 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00e9f0 tx=0x7f1d6c00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.282+0000 7f1d82cdb640 1 -- 172.21.15.6:0/248379152 shutdown_connections 2024-09-11T23:58:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.282+0000 7f1d82cdb640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1d640a2c90 0x7f1d640a5150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.282+0000 7f1d82cdb640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d7c106f10 0x7f1d7c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.282+0000 7f1d82cdb640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d7c102790 0x7f1d7c1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.282+0000 7f1d82cdb640 1 --2- 172.21.15.6:0/248379152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c101de0 0x7f1d7c198360 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.282+0000 7f1d82cdb640 1 -- 172.21.15.6:0/248379152 >> 172.21.15.6:0/248379152 conn(0x7f1d7c0fd8c0 msgr2=0x7f1d7c0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.282+0000 7f1d82cdb640 1 -- 172.21.15.6:0/248379152 shutdown_connections 2024-09-11T23:58:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.282+0000 7f1d82cdb640 1 -- 172.21.15.6:0/248379152 wait complete. 2024-09-11T23:58:29.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:28 smithi039 ceph-mon[34543]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:58:29.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.337+0000 7f424363d640 1 -- 172.21.15.6:0/3125212618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c1037a0 msgr2=0x7f423c10bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.337+0000 7f424363d640 1 --2- 172.21.15.6:0/3125212618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c1037a0 0x7f423c10bc00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4230009900 tx=0x7f423002a410 comp rx=0 tx=0).stop 2024-09-11T23:58:29.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.338+0000 7f424363d640 1 -- 172.21.15.6:0/3125212618 shutdown_connections 2024-09-11T23:58:29.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.338+0000 7f424363d640 1 --2- 172.21.15.6:0/3125212618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c10c2f0 0x7f423c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.338+0000 7f424363d640 1 --2- 172.21.15.6:0/3125212618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c1037a0 0x7f423c10bc00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.338+0000 7f424363d640 1 --2- 172.21.15.6:0/3125212618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f423c102df0 0x7f423c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.338+0000 7f424363d640 1 -- 172.21.15.6:0/3125212618 >> 172.21.15.6:0/3125212618 conn(0x7f423c0fc7d0 msgr2=0x7f423c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:29.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.338+0000 7f424363d640 1 -- 172.21.15.6:0/3125212618 shutdown_connections 2024-09-11T23:58:29.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.338+0000 7f424363d640 1 -- 172.21.15.6:0/3125212618 wait complete. 2024-09-11T23:58:29.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.338+0000 7f424363d640 1 Processor -- start 2024-09-11T23:58:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.338+0000 7f424363d640 1 -- start start 2024-09-11T23:58:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.338+0000 7f424363d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f423c102df0 0x7f423c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.338+0000 7f424363d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c1037a0 0x7f423c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f424363d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c10c2f0 0x7f423c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f424363d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f423c111fd0 con 0x7f423c1037a0 2024-09-11T23:58:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f424363d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f423c111e50 con 0x7f423c10c2f0 2024-09-11T23:58:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f424363d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f423c112150 con 0x7f423c102df0 2024-09-11T23:58:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f4240bd8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c1037a0 0x7f423c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f4240bd8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c1037a0 0x7f423c198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37526/0 (socket says 172.21.15.6:37526) 2024-09-11T23:58:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f4240bd8640 1 -- 172.21.15.6:0/1375812587 learned_addr learned my addr 172.21.15.6:0/1375812587 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f42413d9640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f423c102df0 0x7f423c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f4241bda640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c10c2f0 0x7f423c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f4240bd8640 1 -- 172.21.15.6:0/1375812587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f423c102df0 msgr2=0x7f423c198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f4240bd8640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f423c102df0 0x7f423c198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f4240bd8640 1 -- 172.21.15.6:0/1375812587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c10c2f0 msgr2=0x7f423c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f4240bd8640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c10c2f0 0x7f423c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f4240bd8640 1 -- 172.21.15.6:0/1375812587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423c19d530 con 0x7f423c1037a0 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f4241bda640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c10c2f0 0x7f423c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f4240bd8640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c1037a0 0x7f423c198ac0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4230005ab0 tx=0x7f4230003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f422e7fc640 1 -- 172.21.15.6:0/1375812587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423003f070 con 0x7f423c1037a0 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f422e7fc640 1 -- 172.21.15.6:0/1375812587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4230031d60 con 0x7f423c1037a0 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f422e7fc640 1 -- 172.21.15.6:0/1375812587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230035030 con 0x7f423c1037a0 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.339+0000 7f424363d640 1 -- 172.21.15.6:0/1375812587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f423c19d7c0 con 0x7f423c1037a0 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.340+0000 7f424363d640 1 -- 172.21.15.6:0/1375812587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f423c1a5100 con 0x7f423c1037a0 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.341+0000 7f424363d640 1 -- 172.21.15.6:0/1375812587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f423c06a790 con 0x7f423c1037a0 2024-09-11T23:58:29.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.342+0000 7f422e7fc640 1 -- 172.21.15.6:0/1375812587 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4230042070 con 0x7f423c1037a0 2024-09-11T23:58:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.343+0000 7f422e7fc640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f42280a2c90 0x7f42280a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.343+0000 7f42413d9640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f42280a2c90 0x7f42280a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.343+0000 7f422e7fc640 1 -- 172.21.15.6:0/1375812587 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f42300efc80 con 0x7f423c1037a0 2024-09-11T23:58:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.343+0000 7f42413d9640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f42280a2c90 0x7f42280a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4238005fd0 tx=0x7f423800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.347+0000 7f422e7fc640 1 -- 172.21.15.6:0/1375812587 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42300bc6c0 con 0x7f423c1037a0 2024-09-11T23:58:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.524+0000 7f424363d640 1 -- 172.21.15.6:0/1375812587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f423c199910 con 0x7f423c1037a0 2024-09-11T23:58:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.524+0000 7f422e7fc640 1 -- 172.21.15.6:0/1375812587 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f423c199910 con 0x7f423c1037a0 2024-09-11T23:58:29.524 INFO:teuthology.orchestra.run.smithi006.stdout:206158430259 2024-09-11T23:58:29.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.526+0000 7f424363d640 1 -- 172.21.15.6:0/1375812587 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f42280a2c90 msgr2=0x7f42280a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.526+0000 7f424363d640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f42280a2c90 0x7f42280a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4238005fd0 tx=0x7f423800b390 comp rx=0 tx=0).stop 2024-09-11T23:58:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.526+0000 7f424363d640 1 -- 172.21.15.6:0/1375812587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c1037a0 msgr2=0x7f423c198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.526+0000 7f424363d640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c1037a0 0x7f423c198ac0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4230005ab0 tx=0x7f4230003cd0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.527+0000 7f424363d640 1 -- 172.21.15.6:0/1375812587 shutdown_connections 2024-09-11T23:58:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.527+0000 7f424363d640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f42280a2c90 0x7f42280a5150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.527+0000 7f424363d640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c10c2f0 0x7f423c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.527+0000 7f424363d640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c1037a0 0x7f423c198ac0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.527+0000 7f424363d640 1 --2- 172.21.15.6:0/1375812587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f423c102df0 0x7f423c198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.527+0000 7f424363d640 1 -- 172.21.15.6:0/1375812587 >> 172.21.15.6:0/1375812587 conn(0x7f423c0fc7d0 msgr2=0x7f423c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.527+0000 7f424363d640 1 -- 172.21.15.6:0/1375812587 shutdown_connections 2024-09-11T23:58:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:29.527+0000 7f424363d640 1 -- 172.21.15.6:0/1375812587 wait complete. 2024-09-11T23:58:30.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:29 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/248379152' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T23:58:30.192 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:29 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1375812587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T23:58:30.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:29 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/248379152' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T23:58:30.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:29 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1375812587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T23:58:30.226 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738452 got 34359738454 for osd.0 2024-09-11T23:58:30.226 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:30.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:29 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/248379152' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T23:58:30.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:29 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1375812587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T23:58:30.917 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972391 got 266287972394 for osd.9 2024-09-11T23:58:30.918 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:31.151 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:30 smithi006 ceph-mon[30947]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:31.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:30 smithi134 ceph-mon[34893]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:31.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:30 smithi039 ceph-mon[34543]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:31.872 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430257 got 206158430259 for osd.7 2024-09-11T23:58:31.873 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:32.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.079+0000 7f0687a71640 1 -- 172.21.15.6:0/3854149069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0680102da0 msgr2=0x7f0680103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:32.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.079+0000 7f0687a71640 1 --2- 172.21.15.6:0/3854149069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0680102da0 0x7f0680103180 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f067c009900 tx=0x7f067c02a480 comp rx=0 tx=0).stop 2024-09-11T23:58:32.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.079+0000 7f0687a71640 1 -- 172.21.15.6:0/3854149069 shutdown_connections 2024-09-11T23:58:32.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.079+0000 7f0687a71640 1 --2- 172.21.15.6:0/3854149069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f068010c180 0x7f068010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:32.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.079+0000 7f0687a71640 1 --2- 172.21.15.6:0/3854149069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06801036c0 0x7f068010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:32.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.079+0000 7f0687a71640 1 --2- 172.21.15.6:0/3854149069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0680102da0 0x7f0680103180 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:32.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.079+0000 7f0687a71640 1 -- 172.21.15.6:0/3854149069 >> 172.21.15.6:0/3854149069 conn(0x7f06800fc7a0 msgr2=0x7f06800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:32.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.079+0000 7f0687a71640 1 -- 172.21.15.6:0/3854149069 shutdown_connections 2024-09-11T23:58:32.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.079+0000 7f0687a71640 1 -- 172.21.15.6:0/3854149069 wait complete. 2024-09-11T23:58:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.080+0000 7f0687a71640 1 Processor -- start 2024-09-11T23:58:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.080+0000 7f0687a71640 1 -- start start 2024-09-11T23:58:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.080+0000 7f0687a71640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0680102da0 0x7f0680100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.080+0000 7f0687a71640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06801036c0 0x7f0680100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.080+0000 7f0687a71640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068010c180 0x7f0680101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.080+0000 7f0687a71640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0680111e50 con 0x7f06801036c0 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.080+0000 7f0687a71640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0680111cd0 con 0x7f068010c180 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.080+0000 7f0687a71640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0680111fd0 con 0x7f0680102da0 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.080+0000 7f068500c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06801036c0 0x7f0680100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.080+0000 7f068500c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06801036c0 0x7f0680100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44700/0 (socket says 172.21.15.6:44700) 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.080+0000 7f068500c640 1 -- 172.21.15.6:0/2103991091 learned_addr learned my addr 172.21.15.6:0/2103991091 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.080+0000 7f068580d640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0680102da0 0x7f0680100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f068600e640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068010c180 0x7f0680101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f068500c640 1 -- 172.21.15.6:0/2103991091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0680102da0 msgr2=0x7f0680100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f068500c640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0680102da0 0x7f0680100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f068500c640 1 -- 172.21.15.6:0/2103991091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068010c180 msgr2=0x7f0680101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f068500c640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068010c180 0x7f0680101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f068500c640 1 -- 172.21.15.6:0/2103991091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06801a67f0 con 0x7f06801036c0 2024-09-11T23:58:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f068600e640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068010c180 0x7f0680101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f068500c640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06801036c0 0x7f0680100f40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f067000c920 tx=0x7f067000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f0676ffd640 1 -- 172.21.15.6:0/2103991091 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670007c70 con 0x7f06801036c0 2024-09-11T23:58:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f0687a71640 1 -- 172.21.15.6:0/2103991091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06801a6ae0 con 0x7f06801036c0 2024-09-11T23:58:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f0676ffd640 1 -- 172.21.15.6:0/2103991091 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0670007e10 con 0x7f06801036c0 2024-09-11T23:58:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f0676ffd640 1 -- 172.21.15.6:0/2103991091 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670018820 con 0x7f06801036c0 2024-09-11T23:58:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.081+0000 7f0687a71640 1 -- 172.21.15.6:0/2103991091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06801a7020 con 0x7f06801036c0 2024-09-11T23:58:32.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.082+0000 7f0687a71640 1 -- 172.21.15.6:0/2103991091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0680103180 con 0x7f06801036c0 2024-09-11T23:58:32.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.083+0000 7f0676ffd640 1 -- 172.21.15.6:0/2103991091 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f06700189c0 con 0x7f06801036c0 2024-09-11T23:58:32.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.084+0000 7f0676ffd640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f066c0a2c10 0x7f066c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:32.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.084+0000 7f068580d640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f066c0a2c10 0x7f066c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:32.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.084+0000 7f0676ffd640 1 -- 172.21.15.6:0/2103991091 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f06700cf6c0 con 0x7f06801036c0 2024-09-11T23:58:32.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.085+0000 7f068580d640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f066c0a2c10 0x7f066c0a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f067c031440 tx=0x7f067c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:32.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.088+0000 7f0676ffd640 1 -- 172.21.15.6:0/2103991091 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0670014030 con 0x7f06801036c0 2024-09-11T23:58:32.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.270+0000 7f0687a71640 1 -- 172.21.15.6:0/2103991091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0680106c70 con 0x7f06801036c0 2024-09-11T23:58:32.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.270+0000 7f0676ffd640 1 -- 172.21.15.6:0/2103991091 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f067009c100 con 0x7f06801036c0 2024-09-11T23:58:32.270 INFO:teuthology.orchestra.run.smithi006.stdout:103079215177 2024-09-11T23:58:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.272+0000 7f0687a71640 1 -- 172.21.15.6:0/2103991091 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f066c0a2c10 msgr2=0x7f066c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.272+0000 7f0687a71640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f066c0a2c10 0x7f066c0a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f067c031440 tx=0x7f067c005e80 comp rx=0 tx=0).stop 2024-09-11T23:58:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.273+0000 7f0687a71640 1 -- 172.21.15.6:0/2103991091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06801036c0 msgr2=0x7f0680100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.273+0000 7f0687a71640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06801036c0 0x7f0680100f40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f067000c920 tx=0x7f067000cde0 comp rx=0 tx=0).stop 2024-09-11T23:58:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.273+0000 7f0687a71640 1 -- 172.21.15.6:0/2103991091 shutdown_connections 2024-09-11T23:58:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.273+0000 7f0687a71640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f066c0a2c10 0x7f066c0a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.273+0000 7f0687a71640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068010c180 0x7f0680101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.273+0000 7f0687a71640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06801036c0 0x7f0680100f40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.273+0000 7f0687a71640 1 --2- 172.21.15.6:0/2103991091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0680102da0 0x7f0680100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.273+0000 7f0687a71640 1 -- 172.21.15.6:0/2103991091 >> 172.21.15.6:0/2103991091 conn(0x7f06800fc7a0 msgr2=0x7f06800fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.273+0000 7f0687a71640 1 -- 172.21.15.6:0/2103991091 shutdown_connections 2024-09-11T23:58:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:32.273+0000 7f0687a71640 1 -- 172.21.15.6:0/2103991091 wait complete. 2024-09-11T23:58:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.060+0000 7f856645b640 1 -- 172.21.15.6:0/344571994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8560106f20 msgr2=0x7f856010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.060+0000 7f856645b640 1 --2- 172.21.15.6:0/344571994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8560106f20 0x7f856010eaa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8558009ca0 tx=0x7f855802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.060+0000 7f856645b640 1 -- 172.21.15.6:0/344571994 shutdown_connections 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.060+0000 7f856645b640 1 --2- 172.21.15.6:0/344571994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8560106f20 0x7f856010eaa0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.060+0000 7f856645b640 1 --2- 172.21.15.6:0/344571994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85601027a0 0x7f85601067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.060+0000 7f856645b640 1 --2- 172.21.15.6:0/344571994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8560101df0 0x7f85601021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.060+0000 7f856645b640 1 -- 172.21.15.6:0/344571994 >> 172.21.15.6:0/344571994 conn(0x7f85600fd8b0 msgr2=0x7f85600ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.060+0000 7f856645b640 1 -- 172.21.15.6:0/344571994 shutdown_connections 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.060+0000 7f856645b640 1 -- 172.21.15.6:0/344571994 wait complete. 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.060+0000 7f856645b640 1 Processor -- start 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f856645b640 1 -- start start 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f856645b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8560101df0 0x7f8560198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f856645b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85601027a0 0x7f8560198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f856645b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8560106f20 0x7f856019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f856645b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8560111e80 con 0x7f8560101df0 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f856645b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8560111d00 con 0x7f8560106f20 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f856645b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8560112000 con 0x7f85601027a0 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f855ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8560101df0 0x7f8560198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f855ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8560101df0 0x7f8560198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44714/0 (socket says 172.21.15.6:44714) 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f855ffff640 1 -- 172.21.15.6:0/2308236479 learned_addr learned my addr 172.21.15.6:0/2308236479 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f855f7fe640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85601027a0 0x7f8560198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f85649f8640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8560106f20 0x7f856019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f855ffff640 1 -- 172.21.15.6:0/2308236479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85601027a0 msgr2=0x7f8560198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f855ffff640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85601027a0 0x7f8560198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f855ffff640 1 -- 172.21.15.6:0/2308236479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8560106f20 msgr2=0x7f856019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f855ffff640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8560106f20 0x7f856019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f855ffff640 1 -- 172.21.15.6:0/2308236479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856019d2b0 con 0x7f8560101df0 2024-09-11T23:58:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.061+0000 7f85649f8640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8560106f20 0x7f856019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.062+0000 7f855ffff640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8560101df0 0x7f8560198300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f855000d770 tx=0x7f855000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.062+0000 7f855d7fa640 1 -- 172.21.15.6:0/2308236479 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550017070 con 0x7f8560101df0 2024-09-11T23:58:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.062+0000 7f855d7fa640 1 -- 172.21.15.6:0/2308236479 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85500054d0 con 0x7f8560101df0 2024-09-11T23:58:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.062+0000 7f856645b640 1 -- 172.21.15.6:0/2308236479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856019d5a0 con 0x7f8560101df0 2024-09-11T23:58:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.062+0000 7f855d7fa640 1 -- 172.21.15.6:0/2308236479 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550004cf0 con 0x7f8560101df0 2024-09-11T23:58:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.062+0000 7f856645b640 1 -- 172.21.15.6:0/2308236479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85601a4e80 con 0x7f8560101df0 2024-09-11T23:58:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.063+0000 7f856645b640 1 -- 172.21.15.6:0/2308236479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85601021d0 con 0x7f8560101df0 2024-09-11T23:58:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.064+0000 7f855d7fa640 1 -- 172.21.15.6:0/2308236479 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f8550004e90 con 0x7f8560101df0 2024-09-11T23:58:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.065+0000 7f855d7fa640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f85480a2c10 0x7f85480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.065+0000 7f855f7fe640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f85480a2c10 0x7f85480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.065+0000 7f855d7fa640 1 -- 172.21.15.6:0/2308236479 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f85500cf3e0 con 0x7f8560101df0 2024-09-11T23:58:33.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.066+0000 7f855f7fe640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f85480a2c10 0x7f85480a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f85600fdcd0 tx=0x7f855400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:33.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.068+0000 7f855d7fa640 1 -- 172.21.15.6:0/2308236479 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f855009be20 con 0x7f8560101df0 2024-09-11T23:58:33.199 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:32 smithi006 ceph-mon[30947]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:58:33.200 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:32 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2103991091' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T23:58:33.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:32 smithi134 ceph-mon[34893]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:58:33.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:32 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2103991091' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T23:58:33.227 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215174 got 103079215177 for osd.3 2024-09-11T23:58:33.227 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.247+0000 7f856645b640 1 -- 172.21.15.6:0/2308236479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f856010a160 con 0x7f8560101df0 2024-09-11T23:58:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.248+0000 7f855d7fa640 1 -- 172.21.15.6:0/2308236479 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f855009b720 con 0x7f8560101df0 2024-09-11T23:58:33.248 INFO:teuthology.orchestra.run.smithi006.stdout:287762808869 2024-09-11T23:58:33.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.250+0000 7f856645b640 1 -- 172.21.15.6:0/2308236479 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f85480a2c10 msgr2=0x7f85480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.250+0000 7f856645b640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f85480a2c10 0x7f85480a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f85600fdcd0 tx=0x7f855400b410 comp rx=0 tx=0).stop 2024-09-11T23:58:33.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.250+0000 7f856645b640 1 -- 172.21.15.6:0/2308236479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8560101df0 msgr2=0x7f8560198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.250+0000 7f856645b640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8560101df0 0x7f8560198300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f855000d770 tx=0x7f855000dc30 comp rx=0 tx=0).stop 2024-09-11T23:58:33.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.250+0000 7f856645b640 1 -- 172.21.15.6:0/2308236479 shutdown_connections 2024-09-11T23:58:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.250+0000 7f856645b640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f85480a2c10 0x7f85480a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.250+0000 7f856645b640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8560106f20 0x7f856019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.250+0000 7f856645b640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85601027a0 0x7f8560198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.250+0000 7f856645b640 1 --2- 172.21.15.6:0/2308236479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8560101df0 0x7f8560198300 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.250+0000 7f856645b640 1 -- 172.21.15.6:0/2308236479 >> 172.21.15.6:0/2308236479 conn(0x7f85600fd8b0 msgr2=0x7f85600feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.250+0000 7f856645b640 1 -- 172.21.15.6:0/2308236479 shutdown_connections 2024-09-11T23:58:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.250+0000 7f856645b640 1 -- 172.21.15.6:0/2308236479 wait complete. 2024-09-11T23:58:33.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:32 smithi039 ceph-mon[34543]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:58:33.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:32 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2103991091' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T23:58:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.419+0000 7fb132d17640 1 -- 172.21.15.6:0/239891463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12c101240 msgr2=0x7fb12c101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.419+0000 7fb132d17640 1 --2- 172.21.15.6:0/239891463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12c101240 0x7fb12c101680 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb120009900 tx=0x7fb12002a410 comp rx=0 tx=0).stop 2024-09-11T23:58:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.419+0000 7fb132d17640 1 -- 172.21.15.6:0/239891463 shutdown_connections 2024-09-11T23:58:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.419+0000 7fb132d17640 1 --2- 172.21.15.6:0/239891463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb12c101bc0 0x7fb12c10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.419+0000 7fb132d17640 1 --2- 172.21.15.6:0/239891463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12c101240 0x7fb12c101680 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.419+0000 7fb132d17640 1 --2- 172.21.15.6:0/239891463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb12c105a90 0x7fb12c105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.419+0000 7fb132d17640 1 -- 172.21.15.6:0/239891463 >> 172.21.15.6:0/239891463 conn(0x7fb12c077210 msgr2=0x7fb12c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.420+0000 7fb132d17640 1 -- 172.21.15.6:0/239891463 shutdown_connections 2024-09-11T23:58:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.420+0000 7fb132d17640 1 -- 172.21.15.6:0/239891463 wait complete. 2024-09-11T23:58:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.420+0000 7fb132d17640 1 Processor -- start 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.420+0000 7fb132d17640 1 -- start start 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.420+0000 7fb132d17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12c101240 0x7fb12c0fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.420+0000 7fb132d17640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb12c101bc0 0x7fb12c0fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.420+0000 7fb132d17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb12c105a90 0x7fb12c0fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.420+0000 7fb132d17640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c110e20 con 0x7fb12c101240 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.420+0000 7fb132d17640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c110ca0 con 0x7fb12c101bc0 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.420+0000 7fb132d17640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c110fa0 con 0x7fb12c105a90 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb130ab3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12c101240 0x7fb12c0fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb130ab3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12c101240 0x7fb12c0fc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44742/0 (socket says 172.21.15.6:44742) 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb130ab3640 1 -- 172.21.15.6:0/486122605 learned_addr learned my addr 172.21.15.6:0/486122605 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb1312b4640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb12c105a90 0x7fb12c0fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb12bfff640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb12c101bc0 0x7fb12c0fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb130ab3640 1 -- 172.21.15.6:0/486122605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb12c105a90 msgr2=0x7fb12c0fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb130ab3640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb12c105a90 0x7fb12c0fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb130ab3640 1 -- 172.21.15.6:0/486122605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb12c101bc0 msgr2=0x7fb12c0fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb130ab3640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb12c101bc0 0x7fb12c0fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb130ab3640 1 -- 172.21.15.6:0/486122605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12c1a6920 con 0x7fb12c101240 2024-09-11T23:58:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb12bfff640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb12c101bc0 0x7fb12c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb1312b4640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb12c105a90 0x7fb12c0fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb130ab3640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12c101240 0x7fb12c0fc690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00d770 tx=0x7fb11c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb129ffb640 1 -- 172.21.15.6:0/486122605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c017070 con 0x7fb12c101240 2024-09-11T23:58:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb129ffb640 1 -- 172.21.15.6:0/486122605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb11c0054d0 con 0x7fb12c101240 2024-09-11T23:58:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb132d17640 1 -- 172.21.15.6:0/486122605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12c1a6c10 con 0x7fb12c101240 2024-09-11T23:58:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb129ffb640 1 -- 172.21.15.6:0/486122605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c004cf0 con 0x7fb12c101240 2024-09-11T23:58:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.421+0000 7fb132d17640 1 -- 172.21.15.6:0/486122605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb12c1a7150 con 0x7fb12c101240 2024-09-11T23:58:33.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.423+0000 7fb132d17640 1 -- 172.21.15.6:0/486122605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb12c101680 con 0x7fb12c101240 2024-09-11T23:58:33.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.424+0000 7fb129ffb640 1 -- 172.21.15.6:0/486122605 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fb11c004e90 con 0x7fb12c101240 2024-09-11T23:58:33.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.424+0000 7fb129ffb640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb1140a2c90 0x7fb1140a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:33.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.424+0000 7fb129ffb640 1 -- 172.21.15.6:0/486122605 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fb11c0cef30 con 0x7fb12c101240 2024-09-11T23:58:33.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.424+0000 7fb12bfff640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb1140a2c90 0x7fb1140a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:33.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.425+0000 7fb12bfff640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb1140a2c90 0x7fb1140a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb120000c00 tx=0x7fb120032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:33.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.429+0000 7fb129ffb640 1 -- 172.21.15.6:0/486122605 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb11c09b9d0 con 0x7fb12c101240 2024-09-11T23:58:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.605+0000 7fb132d17640 1 -- 172.21.15.6:0/486122605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb12c1a7410 con 0x7fb12c101240 2024-09-11T23:58:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.606+0000 7fb129ffb640 1 -- 172.21.15.6:0/486122605 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb11c09b2d0 con 0x7fb12c101240 2024-09-11T23:58:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:133143986244 2024-09-11T23:58:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.608+0000 7fb132d17640 1 -- 172.21.15.6:0/486122605 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb1140a2c90 msgr2=0x7fb1140a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.608+0000 7fb132d17640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb1140a2c90 0x7fb1140a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb120000c00 tx=0x7fb120032c70 comp rx=0 tx=0).stop 2024-09-11T23:58:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.608+0000 7fb132d17640 1 -- 172.21.15.6:0/486122605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12c101240 msgr2=0x7fb12c0fc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.608+0000 7fb132d17640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12c101240 0x7fb12c0fc690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00d770 tx=0x7fb11c00dc30 comp rx=0 tx=0).stop 2024-09-11T23:58:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.608+0000 7fb132d17640 1 -- 172.21.15.6:0/486122605 shutdown_connections 2024-09-11T23:58:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.608+0000 7fb132d17640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb1140a2c90 0x7fb1140a5150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.608+0000 7fb132d17640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb12c105a90 0x7fb12c0fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.608+0000 7fb132d17640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb12c101bc0 0x7fb12c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.608+0000 7fb132d17640 1 --2- 172.21.15.6:0/486122605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12c101240 0x7fb12c0fc690 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.608+0000 7fb132d17640 1 -- 172.21.15.6:0/486122605 >> 172.21.15.6:0/486122605 conn(0x7fb12c077210 msgr2=0x7fb12c1002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.608+0000 7fb132d17640 1 -- 172.21.15.6:0/486122605 shutdown_connections 2024-09-11T23:58:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:33.608+0000 7fb132d17640 1 -- 172.21.15.6:0/486122605 wait complete. 2024-09-11T23:58:34.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:33 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2308236479' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T23:58:34.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:33 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/486122605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T23:58:34.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:33 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2308236479' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T23:58:34.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:33 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/486122605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T23:58:34.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:33 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2308236479' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T23:58:34.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:33 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/486122605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T23:58:34.485 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986239 got 133143986244 for osd.4 2024-09-11T23:58:34.485 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:34.950 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808865 got 287762808869 for osd.10 2024-09-11T23:58:34.950 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:34.951 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T23:58:34.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:58:35.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:34 smithi134 ceph-mon[34893]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:35.220 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:35.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:34 smithi039 ceph-mon[34543]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:35.342 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:34 smithi006 ceph-mon[30947]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.699+0000 7fc865897640 1 -- 172.21.15.6:0/2362359385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8601027a0 msgr2=0x7fc8601067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.699+0000 7fc865897640 1 --2- 172.21.15.6:0/2362359385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8601027a0 0x7fc8601067f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc848009900 tx=0x7fc84802a410 comp rx=0 tx=0).stop 2024-09-11T23:58:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.700+0000 7fc865897640 1 -- 172.21.15.6:0/2362359385 shutdown_connections 2024-09-11T23:58:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.700+0000 7fc865897640 1 --2- 172.21.15.6:0/2362359385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc860106f20 0x7fc86010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.700+0000 7fc865897640 1 --2- 172.21.15.6:0/2362359385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8601027a0 0x7fc8601067f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.700+0000 7fc865897640 1 --2- 172.21.15.6:0/2362359385 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc860101df0 0x7fc8601021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.700+0000 7fc865897640 1 -- 172.21.15.6:0/2362359385 >> 172.21.15.6:0/2362359385 conn(0x7fc8600fd8f0 msgr2=0x7fc8600ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.700+0000 7fc865897640 1 -- 172.21.15.6:0/2362359385 shutdown_connections 2024-09-11T23:58:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.700+0000 7fc865897640 1 -- 172.21.15.6:0/2362359385 wait complete. 2024-09-11T23:58:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.700+0000 7fc865897640 1 Processor -- start 2024-09-11T23:58:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.700+0000 7fc865897640 1 -- start start 2024-09-11T23:58:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc865897640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc860101df0 0x7fc8601983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc865897640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8601027a0 0x7fc860198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc865897640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc860106f20 0x7fc86019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc865897640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc860111e50 con 0x7fc8601027a0 2024-09-11T23:58:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc865897640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc860111cd0 con 0x7fc860101df0 2024-09-11T23:58:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc865897640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc860111fd0 con 0x7fc860106f20 2024-09-11T23:58:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc85e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8601027a0 0x7fc860198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc85e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8601027a0 0x7fc860198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44764/0 (socket says 172.21.15.6:44764) 2024-09-11T23:58:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc85e7fc640 1 -- 172.21.15.6:0/2097167201 learned_addr learned my addr 172.21.15.6:0/2097167201 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc85effd640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc860101df0 0x7fc8601983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc85f7fe640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc860106f20 0x7fc86019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc85e7fc640 1 -- 172.21.15.6:0/2097167201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc860106f20 msgr2=0x7fc86019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc85e7fc640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc860106f20 0x7fc86019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc85e7fc640 1 -- 172.21.15.6:0/2097167201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc860101df0 msgr2=0x7fc8601983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc85e7fc640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc860101df0 0x7fc8601983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc85e7fc640 1 -- 172.21.15.6:0/2097167201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86019d3a0 con 0x7fc8601027a0 2024-09-11T23:58:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc85effd640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc860101df0 0x7fc8601983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:58:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.701+0000 7fc85e7fc640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8601027a0 0x7fc860198930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc848005940 tx=0x7fc848004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.702+0000 7fc864895640 1 -- 172.21.15.6:0/2097167201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84803f030 con 0x7fc8601027a0 2024-09-11T23:58:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.702+0000 7fc864895640 1 -- 172.21.15.6:0/2097167201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc848003aa0 con 0x7fc8601027a0 2024-09-11T23:58:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.702+0000 7fc865897640 1 -- 172.21.15.6:0/2097167201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc86019d630 con 0x7fc8601027a0 2024-09-11T23:58:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.702+0000 7fc864895640 1 -- 172.21.15.6:0/2097167201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc848035070 con 0x7fc8601027a0 2024-09-11T23:58:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.702+0000 7fc865897640 1 -- 172.21.15.6:0/2097167201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8601a4f70 con 0x7fc8601027a0 2024-09-11T23:58:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.703+0000 7fc865897640 1 -- 172.21.15.6:0/2097167201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8601032d0 con 0x7fc8601027a0 2024-09-11T23:58:35.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.704+0000 7fc864895640 1 -- 172.21.15.6:0/2097167201 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fc848042030 con 0x7fc8601027a0 2024-09-11T23:58:35.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.705+0000 7fc864895640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc84c0a2c90 0x7fc84c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:35.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.705+0000 7fc85effd640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc84c0a2c90 0x7fc84c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:35.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.705+0000 7fc864895640 1 -- 172.21.15.6:0/2097167201 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fc8480efc60 con 0x7fc8601027a0 2024-09-11T23:58:35.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.705+0000 7fc85effd640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc84c0a2c90 0x7fc84c0a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc85800bfd0 tx=0x7fc85800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:35.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.710+0000 7fc864895640 1 -- 172.21.15.6:0/2097167201 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc8480bc700 con 0x7fc8601027a0 2024-09-11T23:58:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.881+0000 7fc865897640 1 -- 172.21.15.6:0/2097167201 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc86010a130 con 0x7fc84c0a2c90 2024-09-11T23:58:35.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.890+0000 7fc864895640 1 -- 172.21.15.6:0/2097167201 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340648 (secure 0 0 0) 0x7fc86010a130 con 0x7fc84c0a2c90 2024-09-11T23:58:35.893 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:58:35.895 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-11T23:58:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.894+0000 7fc865897640 1 -- 172.21.15.6:0/2097167201 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc84c0a2c90 msgr2=0x7fc84c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.894+0000 7fc865897640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc84c0a2c90 0x7fc84c0a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc85800bfd0 tx=0x7fc85800b390 comp rx=0 tx=0).stop 2024-09-11T23:58:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.894+0000 7fc865897640 1 -- 172.21.15.6:0/2097167201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8601027a0 msgr2=0x7fc860198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.894+0000 7fc865897640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8601027a0 0x7fc860198930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc848005940 tx=0x7fc848004270 comp rx=0 tx=0).stop 2024-09-11T23:58:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.894+0000 7fc865897640 1 -- 172.21.15.6:0/2097167201 shutdown_connections 2024-09-11T23:58:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.894+0000 7fc865897640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc84c0a2c90 0x7fc84c0a5150 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.894+0000 7fc865897640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc860106f20 0x7fc86019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.894+0000 7fc865897640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8601027a0 0x7fc860198930 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.894+0000 7fc865897640 1 --2- 172.21.15.6:0/2097167201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc860101df0 0x7fc8601983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.894+0000 7fc865897640 1 -- 172.21.15.6:0/2097167201 >> 172.21.15.6:0/2097167201 conn(0x7fc8600fd8f0 msgr2=0x7fc8600fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.894+0000 7fc865897640 1 -- 172.21.15.6:0/2097167201 shutdown_connections 2024-09-11T23:58:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:35.894+0000 7fc865897640 1 -- 172.21.15.6:0/2097167201 wait complete. 2024-09-11T23:58:36.561 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-11T23:58:34.955434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660348,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":656,"num_read_kb":447,"num_write":431,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180848,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361296,"kb_used_data":11972,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580528,"statfs":{"total":1151940427776,"available":1151570460672,"internally_reserved":0,"allocated":12259328,"data_stored":7902038,"data_compressed":394023,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003287"},"pg_stats":[{"pgid":"2.1f","version":"86'13","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:29.142806+0000","last_change":"2024-09-11T23:56:55.272753+0000","last_active":"2024-09-11T23:58:29.142806+0000","last_peered":"2024-09-11T23:58:29.142806+0000","last_clean":"2024-09-11T23:58:29.142806+0000","last_became_active":"2024-09-11T23:56:55.272342+0000","last_became_peered":"2024-09-11T23:56:55.272342+0000","last_unstale":"2024-09-11T23:58:29.142806+0000","last_undegraded":"2024-09-11T23:58:29.142806+0000","last_fullsized":"2024-09-11T23:58:29.142806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:43.856651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815580+0000","last_change":"2024-09-11T23:56:57.349492+0000","last_active":"2024-09-11T23:58:02.815580+0000","last_peered":"2024-09-11T23:58:02.815580+0000","last_clean":"2024-09-11T23:58:02.815580+0000","last_became_active":"2024-09-11T23:56:57.349098+0000","last_became_peered":"2024-09-11T23:56:57.349098+0000","last_unstale":"2024-09-11T23:58:02.815580+0000","last_undegraded":"2024-09-11T23:58:02.815580+0000","last_fullsized":"2024-09-11T23:58:02.815580+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:06.520492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821378+0000","last_change":"2024-09-11T23:57:04.417135+0000","last_active":"2024-09-11T23:58:02.821378+0000","last_peered":"2024-09-11T23:58:02.821378+0000","last_clean":"2024-09-11T23:58:02.821378+0000","last_became_active":"2024-09-11T23:57:04.416697+0000","last_became_peered":"2024-09-11T23:57:04.416697+0000","last_unstale":"2024-09-11T23:58:02.821378+0000","last_undegraded":"2024-09-11T23:58:02.821378+0000","last_fullsized":"2024-09-11T23:58:02.821378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:48.794840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815898+0000","last_change":"2024-09-11T23:56:55.593961+0000","last_active":"2024-09-11T23:58:02.815898+0000","last_peered":"2024-09-11T23:58:02.815898+0000","last_clean":"2024-09-11T23:58:02.815898+0000","last_became_active":"2024-09-11T23:56:55.593624+0000","last_became_peered":"2024-09-11T23:56:55.593624+0000","last_unstale":"2024-09-11T23:58:02.815898+0000","last_undegraded":"2024-09-11T23:58:02.815898+0000","last_fullsized":"2024-09-11T23:58:02.815898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:32.510264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816796+0000","last_change":"2024-09-11T23:56:57.364450+0000","last_active":"2024-09-11T23:58:02.816796+0000","last_peered":"2024-09-11T23:58:02.816796+0000","last_clean":"2024-09-11T23:58:02.816796+0000","last_became_active":"2024-09-11T23:56:57.363583+0000","last_became_peered":"2024-09-11T23:56:57.363583+0000","last_unstale":"2024-09-11T23:58:02.816796+0000","last_undegraded":"2024-09-11T23:58:02.816796+0000","last_fullsized":"2024-09-11T23:58:02.816796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:31.761036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813908+0000","last_change":"2024-09-11T23:57:04.419305+0000","last_active":"2024-09-11T23:58:02.813908+0000","last_peered":"2024-09-11T23:58:02.813908+0000","last_clean":"2024-09-11T23:58:02.813908+0000","last_became_active":"2024-09-11T23:57:04.418774+0000","last_became_peered":"2024-09-11T23:57:04.418774+0000","last_unstale":"2024-09-11T23:58:02.813908+0000","last_undegraded":"2024-09-11T23:58:02.813908+0000","last_fullsized":"2024-09-11T23:58:02.813908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.910125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816228+0000","last_change":"2024-09-11T23:56:55.275373+0000","last_active":"2024-09-11T23:58:02.816228+0000","last_peered":"2024-09-11T23:58:02.816228+0000","last_clean":"2024-09-11T23:58:02.816228+0000","last_became_active":"2024-09-11T23:56:55.274400+0000","last_became_peered":"2024-09-11T23:56:55.274400+0000","last_unstale":"2024-09-11T23:58:02.816228+0000","last_undegraded":"2024-09-11T23:58:02.816228+0000","last_fullsized":"2024-09-11T23:58:02.816228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:41.019225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.820054+0000","last_change":"2024-09-11T23:56:57.346037+0000","last_active":"2024-09-11T23:58:02.820054+0000","last_peered":"2024-09-11T23:58:02.820054+0000","last_clean":"2024-09-11T23:58:02.820054+0000","last_became_active":"2024-09-11T23:56:57.345712+0000","last_became_peered":"2024-09-11T23:56:57.345712+0000","last_unstale":"2024-09-11T23:58:02.820054+0000","last_undegraded":"2024-09-11T23:58:02.820054+0000","last_fullsized":"2024-09-11T23:58:02.820054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:20.643812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.820521+0000","last_change":"2024-09-11T23:58:02.820521+0000","last_active":"2024-09-11T23:58:02.820521+0000","last_peered":"2024-09-11T23:58:02.820521+0000","last_clean":"2024-09-11T23:58:02.820521+0000","last_became_active":"2024-09-11T23:58:02.820081+0000","last_became_peered":"2024-09-11T23:58:02.820081+0000","last_unstale":"2024-09-11T23:58:02.820521+0000","last_undegraded":"2024-09-11T23:58:02.820521+0000","last_fullsized":"2024-09-11T23:58:02.820521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:27.818237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815495+0000","last_change":"2024-09-11T23:56:55.275919+0000","last_active":"2024-09-11T23:58:02.815495+0000","last_peered":"2024-09-11T23:58:02.815495+0000","last_clean":"2024-09-11T23:58:02.815495+0000","last_became_active":"2024-09-11T23:56:55.275326+0000","last_became_peered":"2024-09-11T23:56:55.275326+0000","last_unstale":"2024-09-11T23:58:02.815495+0000","last_undegraded":"2024-09-11T23:58:02.815495+0000","last_fullsized":"2024-09-11T23:58:02.815495+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:47.201282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.823611+0000","last_change":"2024-09-11T23:58:02.823611+0000","last_active":"2024-09-11T23:58:02.823611+0000","last_peered":"2024-09-11T23:58:02.823611+0000","last_clean":"2024-09-11T23:58:02.823611+0000","last_became_active":"2024-09-11T23:58:02.823207+0000","last_became_peered":"2024-09-11T23:58:02.823207+0000","last_unstale":"2024-09-11T23:58:02.823611+0000","last_undegraded":"2024-09-11T23:58:02.823611+0000","last_fullsized":"2024-09-11T23:58:02.823611+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:49.640712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814389+0000","last_change":"2024-09-11T23:57:04.419886+0000","last_active":"2024-09-11T23:58:02.814389+0000","last_peered":"2024-09-11T23:58:02.814389+0000","last_clean":"2024-09-11T23:58:02.814389+0000","last_became_active":"2024-09-11T23:57:04.419419+0000","last_became_peered":"2024-09-11T23:57:04.419419+0000","last_unstale":"2024-09-11T23:58:02.814389+0000","last_undegraded":"2024-09-11T23:58:02.814389+0000","last_fullsized":"2024-09-11T23:58:02.814389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.768235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816698+0000","last_change":"2024-09-11T23:56:57.364619+0000","last_active":"2024-09-11T23:58:02.816698+0000","last_peered":"2024-09-11T23:58:02.816698+0000","last_clean":"2024-09-11T23:58:02.816698+0000","last_became_active":"2024-09-11T23:56:57.364279+0000","last_became_peered":"2024-09-11T23:56:57.364279+0000","last_unstale":"2024-09-11T23:58:02.816698+0000","last_undegraded":"2024-09-11T23:58:02.816698+0000","last_fullsized":"2024-09-11T23:58:02.816698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:13.540493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816358+0000","last_change":"2024-09-11T23:56:55.274995+0000","last_active":"2024-09-11T23:58:02.816358+0000","last_peered":"2024-09-11T23:58:02.816358+0000","last_clean":"2024-09-11T23:58:02.816358+0000","last_became_active":"2024-09-11T23:56:55.274017+0000","last_became_peered":"2024-09-11T23:56:55.274017+0000","last_unstale":"2024-09-11T23:58:02.816358+0000","last_undegraded":"2024-09-11T23:58:02.816358+0000","last_fullsized":"2024-09-11T23:58:02.816358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:37.324085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814296+0000","last_change":"2024-09-11T23:57:04.419999+0000","last_active":"2024-09-11T23:58:02.814296+0000","last_peered":"2024-09-11T23:58:02.814296+0000","last_clean":"2024-09-11T23:58:02.814296+0000","last_became_active":"2024-09-11T23:57:04.419579+0000","last_became_peered":"2024-09-11T23:57:04.419579+0000","last_unstale":"2024-09-11T23:58:02.814296+0000","last_undegraded":"2024-09-11T23:58:02.814296+0000","last_fullsized":"2024-09-11T23:58:02.814296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:08.830864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814708+0000","last_change":"2024-09-11T23:56:57.358959+0000","last_active":"2024-09-11T23:58:02.814708+0000","last_peered":"2024-09-11T23:58:02.814708+0000","last_clean":"2024-09-11T23:58:02.814708+0000","last_became_active":"2024-09-11T23:56:57.358676+0000","last_became_peered":"2024-09-11T23:56:57.358676+0000","last_unstale":"2024-09-11T23:58:02.814708+0000","last_undegraded":"2024-09-11T23:58:02.814708+0000","last_fullsized":"2024-09-11T23:58:02.814708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:03.243973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821774+0000","last_change":"2024-09-11T23:56:55.274068+0000","last_active":"2024-09-11T23:58:02.821774+0000","last_peered":"2024-09-11T23:58:02.821774+0000","last_clean":"2024-09-11T23:58:02.821774+0000","last_became_active":"2024-09-11T23:56:55.273689+0000","last_became_peered":"2024-09-11T23:56:55.273689+0000","last_unstale":"2024-09-11T23:58:02.821774+0000","last_undegraded":"2024-09-11T23:58:02.821774+0000","last_fullsized":"2024-09-11T23:58:02.821774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:36.315956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814847+0000","last_change":"2024-09-11T23:57:04.424832+0000","last_active":"2024-09-11T23:58:02.814847+0000","last_peered":"2024-09-11T23:58:02.814847+0000","last_clean":"2024-09-11T23:58:02.814847+0000","last_became_active":"2024-09-11T23:57:04.424398+0000","last_became_peered":"2024-09-11T23:57:04.424398+0000","last_unstale":"2024-09-11T23:58:02.814847+0000","last_undegraded":"2024-09-11T23:58:02.814847+0000","last_fullsized":"2024-09-11T23:58:02.814847+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:11.134123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813068+0000","last_change":"2024-09-11T23:56:57.349603+0000","last_active":"2024-09-11T23:58:02.813068+0000","last_peered":"2024-09-11T23:58:02.813068+0000","last_clean":"2024-09-11T23:58:02.813068+0000","last_became_active":"2024-09-11T23:56:57.349269+0000","last_became_peered":"2024-09-11T23:56:57.349269+0000","last_unstale":"2024-09-11T23:58:02.813068+0000","last_undegraded":"2024-09-11T23:58:02.813068+0000","last_fullsized":"2024-09-11T23:58:02.813068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:46.269274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814956+0000","last_change":"2024-09-11T23:56:55.271033+0000","last_active":"2024-09-11T23:58:02.814956+0000","last_peered":"2024-09-11T23:58:02.814956+0000","last_clean":"2024-09-11T23:58:02.814956+0000","last_became_active":"2024-09-11T23:56:55.270704+0000","last_became_peered":"2024-09-11T23:56:55.270704+0000","last_unstale":"2024-09-11T23:58:02.814956+0000","last_undegraded":"2024-09-11T23:58:02.814956+0000","last_fullsized":"2024-09-11T23:58:02.814956+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:36.751581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.825269+0000","last_change":"2024-09-11T23:58:02.823979+0000","last_active":"2024-09-11T23:58:02.825269+0000","last_peered":"2024-09-11T23:58:02.825269+0000","last_clean":"2024-09-11T23:58:02.825269+0000","last_became_active":"2024-09-11T23:58:02.823513+0000","last_became_peered":"2024-09-11T23:58:02.823513+0000","last_unstale":"2024-09-11T23:58:02.825269+0000","last_undegraded":"2024-09-11T23:58:02.825269+0000","last_fullsized":"2024-09-11T23:58:02.825269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:03.783479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815159+0000","last_change":"2024-09-11T23:56:57.348815+0000","last_active":"2024-09-11T23:58:02.815159+0000","last_peered":"2024-09-11T23:58:02.815159+0000","last_clean":"2024-09-11T23:58:02.815159+0000","last_became_active":"2024-09-11T23:56:57.348426+0000","last_became_peered":"2024-09-11T23:56:57.348426+0000","last_unstale":"2024-09-11T23:58:02.815159+0000","last_undegraded":"2024-09-11T23:58:02.815159+0000","last_fullsized":"2024-09-11T23:58:02.815159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:47.685615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.819881+0000","last_change":"2024-09-11T23:56:55.594325+0000","last_active":"2024-09-11T23:58:02.819881+0000","last_peered":"2024-09-11T23:58:02.819881+0000","last_clean":"2024-09-11T23:58:02.819881+0000","last_became_active":"2024-09-11T23:56:55.594044+0000","last_became_peered":"2024-09-11T23:56:55.594044+0000","last_unstale":"2024-09-11T23:58:02.819881+0000","last_undegraded":"2024-09-11T23:58:02.819881+0000","last_fullsized":"2024-09-11T23:58:02.819881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:05.124980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814331+0000","last_change":"2024-09-11T23:57:04.425591+0000","last_active":"2024-09-11T23:58:02.814331+0000","last_peered":"2024-09-11T23:58:02.814331+0000","last_clean":"2024-09-11T23:58:02.814331+0000","last_became_active":"2024-09-11T23:57:04.424945+0000","last_became_peered":"2024-09-11T23:57:04.424945+0000","last_unstale":"2024-09-11T23:58:02.814331+0000","last_undegraded":"2024-09-11T23:58:02.814331+0000","last_fullsized":"2024-09-11T23:58:02.814331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:57.541426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816231+0000","last_change":"2024-09-11T23:56:57.363423+0000","last_active":"2024-09-11T23:58:02.816231+0000","last_peered":"2024-09-11T23:58:02.816231+0000","last_clean":"2024-09-11T23:58:02.816231+0000","last_became_active":"2024-09-11T23:56:57.361258+0000","last_became_peered":"2024-09-11T23:56:57.361258+0000","last_unstale":"2024-09-11T23:58:02.816231+0000","last_undegraded":"2024-09-11T23:58:02.816231+0000","last_fullsized":"2024-09-11T23:58:02.816231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:36.743240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814711+0000","last_change":"2024-09-11T23:56:55.311774+0000","last_active":"2024-09-11T23:58:02.814711+0000","last_peered":"2024-09-11T23:58:02.814711+0000","last_clean":"2024-09-11T23:58:02.814711+0000","last_became_active":"2024-09-11T23:56:55.311409+0000","last_became_peered":"2024-09-11T23:56:55.311409+0000","last_unstale":"2024-09-11T23:58:02.814711+0000","last_undegraded":"2024-09-11T23:58:02.814711+0000","last_fullsized":"2024-09-11T23:58:02.814711+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:50.243993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821542+0000","last_change":"2024-09-11T23:57:04.416973+0000","last_active":"2024-09-11T23:58:02.821542+0000","last_peered":"2024-09-11T23:58:02.821542+0000","last_clean":"2024-09-11T23:58:02.821542+0000","last_became_active":"2024-09-11T23:57:04.416582+0000","last_became_peered":"2024-09-11T23:57:04.416582+0000","last_unstale":"2024-09-11T23:58:02.821542+0000","last_undegraded":"2024-09-11T23:58:02.821542+0000","last_fullsized":"2024-09-11T23:58:02.821542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:13.411939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815759+0000","last_change":"2024-09-11T23:56:57.354790+0000","last_active":"2024-09-11T23:58:02.815759+0000","last_peered":"2024-09-11T23:58:02.815759+0000","last_clean":"2024-09-11T23:58:02.815759+0000","last_became_active":"2024-09-11T23:56:57.354478+0000","last_became_peered":"2024-09-11T23:56:57.354478+0000","last_unstale":"2024-09-11T23:58:02.815759+0000","last_undegraded":"2024-09-11T23:58:02.815759+0000","last_fullsized":"2024-09-11T23:58:02.815759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:01.109689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'16","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.826957+0000","last_change":"2024-09-11T23:58:02.826957+0000","last_active":"2024-09-11T23:58:02.826957+0000","last_peered":"2024-09-11T23:58:02.826957+0000","last_clean":"2024-09-11T23:58:02.826957+0000","last_became_active":"2024-09-11T23:58:02.817510+0000","last_became_peered":"2024-09-11T23:58:02.817510+0000","last_unstale":"2024-09-11T23:58:02.826957+0000","last_undegraded":"2024-09-11T23:58:02.826957+0000","last_fullsized":"2024-09-11T23:58:02.826957+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:09.269065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814351+0000","last_change":"2024-09-11T23:57:04.417058+0000","last_active":"2024-09-11T23:58:02.814351+0000","last_peered":"2024-09-11T23:58:02.814351+0000","last_clean":"2024-09-11T23:58:02.814351+0000","last_became_active":"2024-09-11T23:57:04.416237+0000","last_became_peered":"2024-09-11T23:57:04.416237+0000","last_unstale":"2024-09-11T23:58:02.814351+0000","last_undegraded":"2024-09-11T23:58:02.814351+0000","last_fullsized":"2024-09-11T23:58:02.814351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:47.959023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816264+0000","last_change":"2024-09-11T23:56:57.343131+0000","last_active":"2024-09-11T23:58:02.816264+0000","last_peered":"2024-09-11T23:58:02.816264+0000","last_clean":"2024-09-11T23:58:02.816264+0000","last_became_active":"2024-09-11T23:56:57.342823+0000","last_became_peered":"2024-09-11T23:56:57.342823+0000","last_unstale":"2024-09-11T23:58:02.816264+0000","last_undegraded":"2024-09-11T23:58:02.816264+0000","last_fullsized":"2024-09-11T23:58:02.816264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:00.685220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.827972+0000","last_change":"2024-09-11T23:58:02.827572+0000","last_active":"2024-09-11T23:58:02.827972+0000","last_peered":"2024-09-11T23:58:02.827972+0000","last_clean":"2024-09-11T23:58:02.827972+0000","last_became_active":"2024-09-11T23:58:02.817674+0000","last_became_peered":"2024-09-11T23:58:02.817674+0000","last_unstale":"2024-09-11T23:58:02.827972+0000","last_undegraded":"2024-09-11T23:58:02.827972+0000","last_fullsized":"2024-09-11T23:58:02.827972+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:52.173564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813078+0000","last_change":"2024-09-11T23:57:04.417873+0000","last_active":"2024-09-11T23:58:02.813078+0000","last_peered":"2024-09-11T23:58:02.813078+0000","last_clean":"2024-09-11T23:58:02.813078+0000","last_became_active":"2024-09-11T23:57:04.417477+0000","last_became_peered":"2024-09-11T23:57:04.417477+0000","last_unstale":"2024-09-11T23:58:02.813078+0000","last_undegraded":"2024-09-11T23:58:02.813078+0000","last_fullsized":"2024-09-11T23:58:02.813078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:20.480850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813186+0000","last_change":"2024-09-11T23:56:57.360695+0000","last_active":"2024-09-11T23:58:02.813186+0000","last_peered":"2024-09-11T23:58:02.813186+0000","last_clean":"2024-09-11T23:58:02.813186+0000","last_became_active":"2024-09-11T23:56:57.357702+0000","last_became_peered":"2024-09-11T23:56:57.357702+0000","last_unstale":"2024-09-11T23:58:02.813186+0000","last_undegraded":"2024-09-11T23:58:02.813186+0000","last_fullsized":"2024-09-11T23:58:02.813186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:04.680682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.812341+0000","last_change":"2024-09-11T23:56:55.594503+0000","last_active":"2024-09-11T23:58:02.812341+0000","last_peered":"2024-09-11T23:58:02.812341+0000","last_clean":"2024-09-11T23:58:02.812341+0000","last_became_active":"2024-09-11T23:56:55.594155+0000","last_became_peered":"2024-09-11T23:56:55.594155+0000","last_unstale":"2024-09-11T23:58:02.812341+0000","last_undegraded":"2024-09-11T23:58:02.812341+0000","last_fullsized":"2024-09-11T23:58:02.812341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:15.181976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815830+0000","last_change":"2024-09-11T23:57:04.410696+0000","last_active":"2024-09-11T23:58:02.815830+0000","last_peered":"2024-09-11T23:58:02.815830+0000","last_clean":"2024-09-11T23:58:02.815830+0000","last_became_active":"2024-09-11T23:57:04.410281+0000","last_became_peered":"2024-09-11T23:57:04.410281+0000","last_unstale":"2024-09-11T23:58:02.815830+0000","last_undegraded":"2024-09-11T23:58:02.815830+0000","last_fullsized":"2024-09-11T23:58:02.815830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:31.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813116+0000","last_change":"2024-09-11T23:56:57.361458+0000","last_active":"2024-09-11T23:58:02.813116+0000","last_peered":"2024-09-11T23:58:02.813116+0000","last_clean":"2024-09-11T23:58:02.813116+0000","last_became_active":"2024-09-11T23:56:57.361031+0000","last_became_peered":"2024-09-11T23:56:57.361031+0000","last_unstale":"2024-09-11T23:58:02.813116+0000","last_undegraded":"2024-09-11T23:58:02.813116+0000","last_fullsized":"2024-09-11T23:58:02.813116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:23.691469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:31.146009+0000","last_change":"2024-09-11T23:56:55.276558+0000","last_active":"2024-09-11T23:58:31.146009+0000","last_peered":"2024-09-11T23:58:31.146009+0000","last_clean":"2024-09-11T23:58:31.146009+0000","last_became_active":"2024-09-11T23:56:55.276053+0000","last_became_peered":"2024-09-11T23:56:55.276053+0000","last_unstale":"2024-09-11T23:58:31.146009+0000","last_undegraded":"2024-09-11T23:58:31.146009+0000","last_fullsized":"2024-09-11T23:58:31.146009+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:57.139383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815986+0000","last_change":"2024-09-11T23:57:04.414763+0000","last_active":"2024-09-11T23:58:02.815986+0000","last_peered":"2024-09-11T23:58:02.815986+0000","last_clean":"2024-09-11T23:58:02.815986+0000","last_became_active":"2024-09-11T23:57:04.414248+0000","last_became_peered":"2024-09-11T23:57:04.414248+0000","last_unstale":"2024-09-11T23:58:02.815986+0000","last_undegraded":"2024-09-11T23:58:02.815986+0000","last_fullsized":"2024-09-11T23:58:02.815986+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.441399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817029+0000","last_change":"2024-09-11T23:56:57.351549+0000","last_active":"2024-09-11T23:58:02.817029+0000","last_peered":"2024-09-11T23:58:02.817029+0000","last_clean":"2024-09-11T23:58:02.817029+0000","last_became_active":"2024-09-11T23:56:57.351228+0000","last_became_peered":"2024-09-11T23:56:57.351228+0000","last_unstale":"2024-09-11T23:58:02.817029+0000","last_undegraded":"2024-09-11T23:58:02.817029+0000","last_fullsized":"2024-09-11T23:58:02.817029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:03.280698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":91,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:32.146986+0000","last_change":"2024-09-11T23:56:55.594392+0000","last_active":"2024-09-11T23:58:32.146986+0000","last_peered":"2024-09-11T23:58:32.146986+0000","last_clean":"2024-09-11T23:58:32.146986+0000","last_became_active":"2024-09-11T23:56:55.593620+0000","last_became_peered":"2024-09-11T23:56:55.593620+0000","last_unstale":"2024-09-11T23:58:32.146986+0000","last_undegraded":"2024-09-11T23:58:32.146986+0000","last_fullsized":"2024-09-11T23:58:32.146986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:10.110283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.823977+0000","last_change":"2024-09-11T23:58:02.823977+0000","last_active":"2024-09-11T23:58:02.823977+0000","last_peered":"2024-09-11T23:58:02.823977+0000","last_clean":"2024-09-11T23:58:02.823977+0000","last_became_active":"2024-09-11T23:58:02.823498+0000","last_became_peered":"2024-09-11T23:58:02.823498+0000","last_unstale":"2024-09-11T23:58:02.823977+0000","last_undegraded":"2024-09-11T23:58:02.823977+0000","last_fullsized":"2024-09-11T23:58:02.823977+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:02.322181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815395+0000","last_change":"2024-09-11T23:56:57.352375+0000","last_active":"2024-09-11T23:58:02.815395+0000","last_peered":"2024-09-11T23:58:02.815395+0000","last_clean":"2024-09-11T23:58:02.815395+0000","last_became_active":"2024-09-11T23:56:57.352034+0000","last_became_peered":"2024-09-11T23:56:57.352034+0000","last_unstale":"2024-09-11T23:58:02.815395+0000","last_undegraded":"2024-09-11T23:58:02.815395+0000","last_fullsized":"2024-09-11T23:58:02.815395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:02.707277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816793+0000","last_change":"2024-09-11T23:56:55.279016+0000","last_active":"2024-09-11T23:58:02.816793+0000","last_peered":"2024-09-11T23:58:02.816793+0000","last_clean":"2024-09-11T23:58:02.816793+0000","last_became_active":"2024-09-11T23:56:55.278457+0000","last_became_peered":"2024-09-11T23:56:55.278457+0000","last_unstale":"2024-09-11T23:58:02.816793+0000","last_undegraded":"2024-09-11T23:58:02.816793+0000","last_fullsized":"2024-09-11T23:58:02.816793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:35.851946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817877+0000","last_change":"2024-09-11T23:57:04.407941+0000","last_active":"2024-09-11T23:58:02.817877+0000","last_peered":"2024-09-11T23:58:02.817877+0000","last_clean":"2024-09-11T23:58:02.817877+0000","last_became_active":"2024-09-11T23:57:04.407517+0000","last_became_peered":"2024-09-11T23:57:04.407517+0000","last_unstale":"2024-09-11T23:58:02.817877+0000","last_undegraded":"2024-09-11T23:58:02.817877+0000","last_fullsized":"2024-09-11T23:58:02.817877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.781127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814774+0000","last_change":"2024-09-11T23:56:57.344419+0000","last_active":"2024-09-11T23:58:02.814774+0000","last_peered":"2024-09-11T23:58:02.814774+0000","last_clean":"2024-09-11T23:58:02.814774+0000","last_became_active":"2024-09-11T23:56:57.343893+0000","last_became_peered":"2024-09-11T23:56:57.343893+0000","last_unstale":"2024-09-11T23:58:02.814774+0000","last_undegraded":"2024-09-11T23:58:02.814774+0000","last_fullsized":"2024-09-11T23:58:02.814774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:40.888240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815417+0000","last_change":"2024-09-11T23:56:55.270056+0000","last_active":"2024-09-11T23:58:02.815417+0000","last_peered":"2024-09-11T23:58:02.815417+0000","last_clean":"2024-09-11T23:58:02.815417+0000","last_became_active":"2024-09-11T23:56:55.269689+0000","last_became_peered":"2024-09-11T23:56:55.269689+0000","last_unstale":"2024-09-11T23:58:02.815417+0000","last_undegraded":"2024-09-11T23:58:02.815417+0000","last_fullsized":"2024-09-11T23:58:02.815417+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:21.085849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":348,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817044+0000","last_change":"2024-09-11T23:55:44.130655+0000","last_active":"2024-09-11T23:58:02.817044+0000","last_peered":"2024-09-11T23:58:02.817044+0000","last_clean":"2024-09-11T23:58:02.817044+0000","last_became_active":"2024-09-11T23:55:44.130263+0000","last_became_peered":"2024-09-11T23:55:44.130263+0000","last_unstale":"2024-09-11T23:58:02.817044+0000","last_undegraded":"2024-09-11T23:58:02.817044+0000","last_fullsized":"2024-09-11T23:58:02.817044+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:17.476450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:17.476450+0000","last_clean_scrub_stamp":"2024-09-11T23:52:17.476450+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:38.754760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817234+0000","last_change":"2024-09-11T23:57:04.417259+0000","last_active":"2024-09-11T23:58:02.817234+0000","last_peered":"2024-09-11T23:58:02.817234+0000","last_clean":"2024-09-11T23:58:02.817234+0000","last_became_active":"2024-09-11T23:57:04.416729+0000","last_became_peered":"2024-09-11T23:57:04.416729+0000","last_unstale":"2024-09-11T23:58:02.817234+0000","last_undegraded":"2024-09-11T23:58:02.817234+0000","last_fullsized":"2024-09-11T23:58:02.817234+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:50.508736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817560+0000","last_change":"2024-09-11T23:56:57.362787+0000","last_active":"2024-09-11T23:58:02.817560+0000","last_peered":"2024-09-11T23:58:02.817560+0000","last_clean":"2024-09-11T23:58:02.817560+0000","last_became_active":"2024-09-11T23:56:57.362438+0000","last_became_peered":"2024-09-11T23:56:57.362438+0000","last_unstale":"2024-09-11T23:58:02.817560+0000","last_undegraded":"2024-09-11T23:58:02.817560+0000","last_fullsized":"2024-09-11T23:58:02.817560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:53.969983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":90,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:30.160784+0000","last_change":"2024-09-11T23:56:55.594525+0000","last_active":"2024-09-11T23:58:30.160784+0000","last_peered":"2024-09-11T23:58:30.160784+0000","last_clean":"2024-09-11T23:58:30.160784+0000","last_became_active":"2024-09-11T23:56:55.594187+0000","last_became_peered":"2024-09-11T23:56:55.594187+0000","last_unstale":"2024-09-11T23:58:30.160784+0000","last_undegraded":"2024-09-11T23:58:30.160784+0000","last_fullsized":"2024-09-11T23:58:30.160784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.087663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.820058+0000","last_change":"2024-09-11T23:57:04.421266+0000","last_active":"2024-09-11T23:58:02.820058+0000","last_peered":"2024-09-11T23:58:02.820058+0000","last_clean":"2024-09-11T23:58:02.820058+0000","last_became_active":"2024-09-11T23:57:04.420212+0000","last_became_peered":"2024-09-11T23:57:04.420212+0000","last_unstale":"2024-09-11T23:58:02.820058+0000","last_undegraded":"2024-09-11T23:58:02.820058+0000","last_fullsized":"2024-09-11T23:58:02.820058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:51.532509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817200+0000","last_change":"2024-09-11T23:56:57.360393+0000","last_active":"2024-09-11T23:58:02.817200+0000","last_peered":"2024-09-11T23:58:02.817200+0000","last_clean":"2024-09-11T23:58:02.817200+0000","last_became_active":"2024-09-11T23:56:57.359996+0000","last_became_peered":"2024-09-11T23:56:57.359996+0000","last_unstale":"2024-09-11T23:58:02.817200+0000","last_undegraded":"2024-09-11T23:58:02.817200+0000","last_fullsized":"2024-09-11T23:58:02.817200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:48.325137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.818347+0000","last_change":"2024-09-11T23:56:55.273929+0000","last_active":"2024-09-11T23:58:02.818347+0000","last_peered":"2024-09-11T23:58:02.818347+0000","last_clean":"2024-09-11T23:58:02.818347+0000","last_became_active":"2024-09-11T23:56:55.273581+0000","last_became_peered":"2024-09-11T23:56:55.273581+0000","last_unstale":"2024-09-11T23:58:02.818347+0000","last_undegraded":"2024-09-11T23:58:02.818347+0000","last_fullsized":"2024-09-11T23:58:02.818347+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:26.541787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816294+0000","last_change":"2024-09-11T23:57:04.422312+0000","last_active":"2024-09-11T23:58:02.816294+0000","last_peered":"2024-09-11T23:58:02.816294+0000","last_clean":"2024-09-11T23:58:02.816294+0000","last_became_active":"2024-09-11T23:57:04.420675+0000","last_became_peered":"2024-09-11T23:57:04.420675+0000","last_unstale":"2024-09-11T23:58:02.816294+0000","last_undegraded":"2024-09-11T23:58:02.816294+0000","last_fullsized":"2024-09-11T23:58:02.816294+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:44.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817495+0000","last_change":"2024-09-11T23:56:57.359358+0000","last_active":"2024-09-11T23:58:02.817495+0000","last_peered":"2024-09-11T23:58:02.817495+0000","last_clean":"2024-09-11T23:58:02.817495+0000","last_became_active":"2024-09-11T23:56:57.358961+0000","last_became_peered":"2024-09-11T23:56:57.358961+0000","last_unstale":"2024-09-11T23:58:02.817495+0000","last_undegraded":"2024-09-11T23:58:02.817495+0000","last_fullsized":"2024-09-11T23:58:02.817495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:22.522047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.829931+0000","last_change":"2024-09-11T23:58:02.829931+0000","last_active":"2024-09-11T23:58:02.829931+0000","last_peered":"2024-09-11T23:58:02.829931+0000","last_clean":"2024-09-11T23:58:02.829931+0000","last_became_active":"2024-09-11T23:58:02.822017+0000","last_became_peered":"2024-09-11T23:58:02.822017+0000","last_unstale":"2024-09-11T23:58:02.829931+0000","last_undegraded":"2024-09-11T23:58:02.829931+0000","last_fullsized":"2024-09-11T23:58:02.829931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:44.775965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816802+0000","last_change":"2024-09-11T23:57:04.415966+0000","last_active":"2024-09-11T23:58:02.816802+0000","last_peered":"2024-09-11T23:58:02.816802+0000","last_clean":"2024-09-11T23:58:02.816802+0000","last_became_active":"2024-09-11T23:57:04.415601+0000","last_became_peered":"2024-09-11T23:57:04.415601+0000","last_unstale":"2024-09-11T23:58:02.816802+0000","last_undegraded":"2024-09-11T23:58:02.816802+0000","last_fullsized":"2024-09-11T23:58:02.816802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:46.244645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821922+0000","last_change":"2024-09-11T23:58:02.821922+0000","last_active":"2024-09-11T23:58:02.821922+0000","last_peered":"2024-09-11T23:58:02.821922+0000","last_clean":"2024-09-11T23:58:02.821922+0000","last_became_active":"2024-09-11T23:58:02.821509+0000","last_became_peered":"2024-09-11T23:58:02.821509+0000","last_unstale":"2024-09-11T23:58:02.821922+0000","last_undegraded":"2024-09-11T23:58:02.821922+0000","last_fullsized":"2024-09-11T23:58:02.821922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:43.955746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817371+0000","last_change":"2024-09-11T23:56:55.271043+0000","last_active":"2024-09-11T23:58:02.817371+0000","last_peered":"2024-09-11T23:58:02.817371+0000","last_clean":"2024-09-11T23:58:02.817371+0000","last_became_active":"2024-09-11T23:56:55.270748+0000","last_became_peered":"2024-09-11T23:56:55.270748+0000","last_unstale":"2024-09-11T23:58:02.817371+0000","last_undegraded":"2024-09-11T23:58:02.817371+0000","last_fullsized":"2024-09-11T23:58:02.817371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:08.776139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817264+0000","last_change":"2024-09-11T23:57:04.421448+0000","last_active":"2024-09-11T23:58:02.817264+0000","last_peered":"2024-09-11T23:58:02.817264+0000","last_clean":"2024-09-11T23:58:02.817264+0000","last_became_active":"2024-09-11T23:57:04.421000+0000","last_became_peered":"2024-09-11T23:57:04.421000+0000","last_unstale":"2024-09-11T23:58:02.817264+0000","last_undegraded":"2024-09-11T23:58:02.817264+0000","last_fullsized":"2024-09-11T23:58:02.817264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:23.342301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817425+0000","last_change":"2024-09-11T23:56:57.360104+0000","last_active":"2024-09-11T23:58:02.817425+0000","last_peered":"2024-09-11T23:58:02.817425+0000","last_clean":"2024-09-11T23:58:02.817425+0000","last_became_active":"2024-09-11T23:56:57.359773+0000","last_became_peered":"2024-09-11T23:56:57.359773+0000","last_unstale":"2024-09-11T23:58:02.817425+0000","last_undegraded":"2024-09-11T23:58:02.817425+0000","last_fullsized":"2024-09-11T23:58:02.817425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:05.566675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815686+0000","last_change":"2024-09-11T23:56:55.594731+0000","last_active":"2024-09-11T23:58:02.815686+0000","last_peered":"2024-09-11T23:58:02.815686+0000","last_clean":"2024-09-11T23:58:02.815686+0000","last_became_active":"2024-09-11T23:56:55.594095+0000","last_became_peered":"2024-09-11T23:56:55.594095+0000","last_unstale":"2024-09-11T23:58:02.815686+0000","last_undegraded":"2024-09-11T23:58:02.815686+0000","last_fullsized":"2024-09-11T23:58:02.815686+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:44.847662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817125+0000","last_change":"2024-09-11T23:57:04.413252+0000","last_active":"2024-09-11T23:58:02.817125+0000","last_peered":"2024-09-11T23:58:02.817125+0000","last_clean":"2024-09-11T23:58:02.817125+0000","last_became_active":"2024-09-11T23:57:04.412887+0000","last_became_peered":"2024-09-11T23:57:04.412887+0000","last_unstale":"2024-09-11T23:58:02.817125+0000","last_undegraded":"2024-09-11T23:58:02.817125+0000","last_fullsized":"2024-09-11T23:58:02.817125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:38.778093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816585+0000","last_change":"2024-09-11T23:56:57.354309+0000","last_active":"2024-09-11T23:58:02.816585+0000","last_peered":"2024-09-11T23:58:02.816585+0000","last_clean":"2024-09-11T23:58:02.816585+0000","last_became_active":"2024-09-11T23:56:57.353987+0000","last_became_peered":"2024-09-11T23:56:57.353987+0000","last_unstale":"2024-09-11T23:58:02.816585+0000","last_undegraded":"2024-09-11T23:58:02.816585+0000","last_fullsized":"2024-09-11T23:58:02.816585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:02.248741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:32.147549+0000","last_change":"2024-09-11T23:56:55.271531+0000","last_active":"2024-09-11T23:58:32.147549+0000","last_peered":"2024-09-11T23:58:32.147549+0000","last_clean":"2024-09-11T23:58:32.147549+0000","last_became_active":"2024-09-11T23:56:55.271150+0000","last_became_peered":"2024-09-11T23:56:55.271150+0000","last_unstale":"2024-09-11T23:58:32.147549+0000","last_undegraded":"2024-09-11T23:58:32.147549+0000","last_fullsized":"2024-09-11T23:58:32.147549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:31.885885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.812643+0000","last_change":"2024-09-11T23:57:04.415610+0000","last_active":"2024-09-11T23:58:02.812643+0000","last_peered":"2024-09-11T23:58:02.812643+0000","last_clean":"2024-09-11T23:58:02.812643+0000","last_became_active":"2024-09-11T23:57:04.415168+0000","last_became_peered":"2024-09-11T23:57:04.415168+0000","last_unstale":"2024-09-11T23:58:02.812643+0000","last_undegraded":"2024-09-11T23:58:02.812643+0000","last_fullsized":"2024-09-11T23:58:02.812643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:34.688002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817081+0000","last_change":"2024-09-11T23:56:57.359960+0000","last_active":"2024-09-11T23:58:02.817081+0000","last_peered":"2024-09-11T23:58:02.817081+0000","last_clean":"2024-09-11T23:58:02.817081+0000","last_became_active":"2024-09-11T23:56:57.359417+0000","last_became_peered":"2024-09-11T23:56:57.359417+0000","last_unstale":"2024-09-11T23:58:02.817081+0000","last_undegraded":"2024-09-11T23:58:02.817081+0000","last_fullsized":"2024-09-11T23:58:02.817081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:18.741920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817801+0000","last_change":"2024-09-11T23:56:55.272561+0000","last_active":"2024-09-11T23:58:02.817801+0000","last_peered":"2024-09-11T23:58:02.817801+0000","last_clean":"2024-09-11T23:58:02.817801+0000","last_became_active":"2024-09-11T23:56:55.272221+0000","last_became_peered":"2024-09-11T23:56:55.272221+0000","last_unstale":"2024-09-11T23:58:02.817801+0000","last_undegraded":"2024-09-11T23:58:02.817801+0000","last_fullsized":"2024-09-11T23:58:02.817801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:22.151044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.819543+0000","last_change":"2024-09-11T23:58:02.819543+0000","last_active":"2024-09-11T23:58:02.819543+0000","last_peered":"2024-09-11T23:58:02.819543+0000","last_clean":"2024-09-11T23:58:02.819543+0000","last_became_active":"2024-09-11T23:58:02.819058+0000","last_became_peered":"2024-09-11T23:58:02.819058+0000","last_unstale":"2024-09-11T23:58:02.819543+0000","last_undegraded":"2024-09-11T23:58:02.819543+0000","last_fullsized":"2024-09-11T23:58:02.819543+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:58.852592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,7,6],"acting":[11,10,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815919+0000","last_change":"2024-09-11T23:56:57.352008+0000","last_active":"2024-09-11T23:58:02.815919+0000","last_peered":"2024-09-11T23:58:02.815919+0000","last_clean":"2024-09-11T23:58:02.815919+0000","last_became_active":"2024-09-11T23:56:57.351708+0000","last_became_peered":"2024-09-11T23:56:57.351708+0000","last_unstale":"2024-09-11T23:58:02.815919+0000","last_undegraded":"2024-09-11T23:58:02.815919+0000","last_fullsized":"2024-09-11T23:58:02.815919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:50.908059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.822084+0000","last_change":"2024-09-11T23:56:55.275755+0000","last_active":"2024-09-11T23:58:02.822084+0000","last_peered":"2024-09-11T23:58:02.822084+0000","last_clean":"2024-09-11T23:58:02.822084+0000","last_became_active":"2024-09-11T23:56:55.275247+0000","last_became_peered":"2024-09-11T23:56:55.275247+0000","last_unstale":"2024-09-11T23:58:02.822084+0000","last_undegraded":"2024-09-11T23:58:02.822084+0000","last_fullsized":"2024-09-11T23:58:02.822084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:43.698490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817941+0000","last_change":"2024-09-11T23:57:04.412237+0000","last_active":"2024-09-11T23:58:02.817941+0000","last_peered":"2024-09-11T23:58:02.817941+0000","last_clean":"2024-09-11T23:58:02.817941+0000","last_became_active":"2024-09-11T23:57:04.411799+0000","last_became_peered":"2024-09-11T23:57:04.411799+0000","last_unstale":"2024-09-11T23:58:02.817941+0000","last_undegraded":"2024-09-11T23:58:02.817941+0000","last_fullsized":"2024-09-11T23:58:02.817941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:19.311875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815973+0000","last_change":"2024-09-11T23:56:57.357667+0000","last_active":"2024-09-11T23:58:02.815973+0000","last_peered":"2024-09-11T23:58:02.815973+0000","last_clean":"2024-09-11T23:58:02.815973+0000","last_became_active":"2024-09-11T23:56:57.356796+0000","last_became_peered":"2024-09-11T23:56:57.356796+0000","last_unstale":"2024-09-11T23:58:02.815973+0000","last_undegraded":"2024-09-11T23:58:02.815973+0000","last_fullsized":"2024-09-11T23:58:02.815973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:46.220102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'34","reported_seq":172,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:30.148195+0000","last_change":"2024-09-11T23:56:55.276168+0000","last_active":"2024-09-11T23:58:30.148195+0000","last_peered":"2024-09-11T23:58:30.148195+0000","last_clean":"2024-09-11T23:58:30.148195+0000","last_became_active":"2024-09-11T23:56:55.275719+0000","last_became_peered":"2024-09-11T23:56:55.275719+0000","last_unstale":"2024-09-11T23:58:30.148195+0000","last_undegraded":"2024-09-11T23:58:30.148195+0000","last_fullsized":"2024-09-11T23:58:30.148195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:28.846711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62931,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":113,"num_write":36,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.812085+0000","last_change":"2024-09-11T23:57:04.412804+0000","last_active":"2024-09-11T23:58:02.812085+0000","last_peered":"2024-09-11T23:58:02.812085+0000","last_clean":"2024-09-11T23:58:02.812085+0000","last_became_active":"2024-09-11T23:57:04.412366+0000","last_became_peered":"2024-09-11T23:57:04.412366+0000","last_unstale":"2024-09-11T23:58:02.812085+0000","last_undegraded":"2024-09-11T23:58:02.812085+0000","last_fullsized":"2024-09-11T23:58:02.812085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.924598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.820237+0000","last_change":"2024-09-11T23:56:57.357530+0000","last_active":"2024-09-11T23:58:02.820237+0000","last_peered":"2024-09-11T23:58:02.820237+0000","last_clean":"2024-09-11T23:58:02.820237+0000","last_became_active":"2024-09-11T23:56:57.356306+0000","last_became_peered":"2024-09-11T23:56:57.356306+0000","last_unstale":"2024-09-11T23:58:02.820237+0000","last_undegraded":"2024-09-11T23:58:02.820237+0000","last_fullsized":"2024-09-11T23:58:02.820237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:10.919120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.818235+0000","last_change":"2024-09-11T23:56:55.594653+0000","last_active":"2024-09-11T23:58:02.818235+0000","last_peered":"2024-09-11T23:58:02.818235+0000","last_clean":"2024-09-11T23:58:02.818235+0000","last_became_active":"2024-09-11T23:56:55.594219+0000","last_became_peered":"2024-09-11T23:56:55.594219+0000","last_unstale":"2024-09-11T23:58:02.818235+0000","last_undegraded":"2024-09-11T23:58:02.818235+0000","last_fullsized":"2024-09-11T23:58:02.818235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:54.361656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815293+0000","last_change":"2024-09-11T23:57:04.422049+0000","last_active":"2024-09-11T23:58:02.815293+0000","last_peered":"2024-09-11T23:58:02.815293+0000","last_clean":"2024-09-11T23:58:02.815293+0000","last_became_active":"2024-09-11T23:57:04.420845+0000","last_became_peered":"2024-09-11T23:57:04.420845+0000","last_unstale":"2024-09-11T23:58:02.815293+0000","last_undegraded":"2024-09-11T23:58:02.815293+0000","last_fullsized":"2024-09-11T23:58:02.815293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:49.854740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816885+0000","last_change":"2024-09-11T23:56:57.362523+0000","last_active":"2024-09-11T23:58:02.816885+0000","last_peered":"2024-09-11T23:58:02.816885+0000","last_clean":"2024-09-11T23:58:02.816885+0000","last_became_active":"2024-09-11T23:56:57.361361+0000","last_became_peered":"2024-09-11T23:56:57.361361+0000","last_unstale":"2024-09-11T23:58:02.816885+0000","last_undegraded":"2024-09-11T23:58:02.816885+0000","last_fullsized":"2024-09-11T23:58:02.816885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:57.341557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.833430+0000","last_change":"2024-09-11T23:58:02.833430+0000","last_active":"2024-09-11T23:58:02.833430+0000","last_peered":"2024-09-11T23:58:02.833430+0000","last_clean":"2024-09-11T23:58:02.833430+0000","last_became_active":"2024-09-11T23:58:02.822558+0000","last_became_peered":"2024-09-11T23:58:02.822558+0000","last_unstale":"2024-09-11T23:58:02.833430+0000","last_undegraded":"2024-09-11T23:58:02.833430+0000","last_fullsized":"2024-09-11T23:58:02.833430+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:45.815627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.811877+0000","last_change":"2024-09-11T23:57:04.419006+0000","last_active":"2024-09-11T23:58:02.811877+0000","last_peered":"2024-09-11T23:58:02.811877+0000","last_clean":"2024-09-11T23:58:02.811877+0000","last_became_active":"2024-09-11T23:57:04.418638+0000","last_became_peered":"2024-09-11T23:57:04.418638+0000","last_unstale":"2024-09-11T23:58:02.811877+0000","last_undegraded":"2024-09-11T23:58:02.811877+0000","last_fullsized":"2024-09-11T23:58:02.811877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:22.458414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821439+0000","last_change":"2024-09-11T23:56:57.354481+0000","last_active":"2024-09-11T23:58:02.821439+0000","last_peered":"2024-09-11T23:58:02.821439+0000","last_clean":"2024-09-11T23:58:02.821439+0000","last_became_active":"2024-09-11T23:56:57.354158+0000","last_became_peered":"2024-09-11T23:56:57.354158+0000","last_unstale":"2024-09-11T23:58:02.821439+0000","last_undegraded":"2024-09-11T23:58:02.821439+0000","last_fullsized":"2024-09-11T23:58:02.821439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:58.372231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":133,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:30.148096+0000","last_change":"2024-09-11T23:56:55.275767+0000","last_active":"2024-09-11T23:58:30.148096+0000","last_peered":"2024-09-11T23:58:30.148096+0000","last_clean":"2024-09-11T23:58:30.148096+0000","last_became_active":"2024-09-11T23:56:55.275284+0000","last_became_peered":"2024-09-11T23:56:55.275284+0000","last_unstale":"2024-09-11T23:58:30.148096+0000","last_undegraded":"2024-09-11T23:58:30.148096+0000","last_fullsized":"2024-09-11T23:58:30.148096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:32.278786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815127+0000","last_change":"2024-09-11T23:57:04.421329+0000","last_active":"2024-09-11T23:58:02.815127+0000","last_peered":"2024-09-11T23:58:02.815127+0000","last_clean":"2024-09-11T23:58:02.815127+0000","last_became_active":"2024-09-11T23:57:04.420982+0000","last_became_peered":"2024-09-11T23:57:04.420982+0000","last_unstale":"2024-09-11T23:58:02.815127+0000","last_undegraded":"2024-09-11T23:58:02.815127+0000","last_fullsized":"2024-09-11T23:58:02.815127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.580115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816047+0000","last_change":"2024-09-11T23:57:04.419497+0000","last_active":"2024-09-11T23:58:02.816047+0000","last_peered":"2024-09-11T23:58:02.816047+0000","last_clean":"2024-09-11T23:58:02.816047+0000","last_became_active":"2024-09-11T23:57:04.418877+0000","last_became_peered":"2024-09-11T23:57:04.418877+0000","last_unstale":"2024-09-11T23:58:02.816047+0000","last_undegraded":"2024-09-11T23:58:02.816047+0000","last_fullsized":"2024-09-11T23:58:02.816047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:30.895439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.811991+0000","last_change":"2024-09-11T23:56:57.354086+0000","last_active":"2024-09-11T23:58:02.811991+0000","last_peered":"2024-09-11T23:58:02.811991+0000","last_clean":"2024-09-11T23:58:02.811991+0000","last_became_active":"2024-09-11T23:56:57.353733+0000","last_became_peered":"2024-09-11T23:56:57.353733+0000","last_unstale":"2024-09-11T23:58:02.811991+0000","last_undegraded":"2024-09-11T23:58:02.811991+0000","last_fullsized":"2024-09-11T23:58:02.811991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:55.169463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817179+0000","last_change":"2024-09-11T23:56:55.275441+0000","last_active":"2024-09-11T23:58:02.817179+0000","last_peered":"2024-09-11T23:58:02.817179+0000","last_clean":"2024-09-11T23:58:02.817179+0000","last_became_active":"2024-09-11T23:56:55.275109+0000","last_became_peered":"2024-09-11T23:56:55.275109+0000","last_unstale":"2024-09-11T23:58:02.817179+0000","last_undegraded":"2024-09-11T23:58:02.817179+0000","last_fullsized":"2024-09-11T23:58:02.817179+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:47.462579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813303+0000","last_change":"2024-09-11T23:57:04.419592+0000","last_active":"2024-09-11T23:58:02.813303+0000","last_peered":"2024-09-11T23:58:02.813303+0000","last_clean":"2024-09-11T23:58:02.813303+0000","last_became_active":"2024-09-11T23:57:04.419124+0000","last_became_peered":"2024-09-11T23:57:04.419124+0000","last_unstale":"2024-09-11T23:58:02.813303+0000","last_undegraded":"2024-09-11T23:58:02.813303+0000","last_fullsized":"2024-09-11T23:58:02.813303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:19.129975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814619+0000","last_change":"2024-09-11T23:56:57.350413+0000","last_active":"2024-09-11T23:58:02.814619+0000","last_peered":"2024-09-11T23:58:02.814619+0000","last_clean":"2024-09-11T23:58:02.814619+0000","last_became_active":"2024-09-11T23:56:57.350094+0000","last_became_peered":"2024-09-11T23:56:57.350094+0000","last_unstale":"2024-09-11T23:58:02.814619+0000","last_undegraded":"2024-09-11T23:58:02.814619+0000","last_fullsized":"2024-09-11T23:58:02.814619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:30.806452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815503+0000","last_change":"2024-09-11T23:56:55.265370+0000","last_active":"2024-09-11T23:58:02.815503+0000","last_peered":"2024-09-11T23:58:02.815503+0000","last_clean":"2024-09-11T23:58:02.815503+0000","last_became_active":"2024-09-11T23:56:55.265025+0000","last_became_peered":"2024-09-11T23:56:55.265025+0000","last_unstale":"2024-09-11T23:58:02.815503+0000","last_undegraded":"2024-09-11T23:58:02.815503+0000","last_fullsized":"2024-09-11T23:58:02.815503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.583397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813127+0000","last_change":"2024-09-11T23:56:55.276989+0000","last_active":"2024-09-11T23:58:02.813127+0000","last_peered":"2024-09-11T23:58:02.813127+0000","last_clean":"2024-09-11T23:58:02.813127+0000","last_became_active":"2024-09-11T23:56:55.276612+0000","last_became_peered":"2024-09-11T23:56:55.276612+0000","last_unstale":"2024-09-11T23:58:02.813127+0000","last_undegraded":"2024-09-11T23:58:02.813127+0000","last_fullsized":"2024-09-11T23:58:02.813127+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:28.708643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.818635+0000","last_change":"2024-09-11T23:56:57.355005+0000","last_active":"2024-09-11T23:58:02.818635+0000","last_peered":"2024-09-11T23:58:02.818635+0000","last_clean":"2024-09-11T23:58:02.818635+0000","last_became_active":"2024-09-11T23:56:57.354690+0000","last_became_peered":"2024-09-11T23:56:57.354690+0000","last_unstale":"2024-09-11T23:58:02.818635+0000","last_undegraded":"2024-09-11T23:58:02.818635+0000","last_fullsized":"2024-09-11T23:58:02.818635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:49.058770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.822225+0000","last_change":"2024-09-11T23:57:04.415317+0000","last_active":"2024-09-11T23:58:02.822225+0000","last_peered":"2024-09-11T23:58:02.822225+0000","last_clean":"2024-09-11T23:58:02.822225+0000","last_became_active":"2024-09-11T23:57:04.413239+0000","last_became_peered":"2024-09-11T23:57:04.413239+0000","last_unstale":"2024-09-11T23:58:02.822225+0000","last_undegraded":"2024-09-11T23:58:02.822225+0000","last_fullsized":"2024-09-11T23:58:02.822225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:19.266871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":90,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:31.150388+0000","last_change":"2024-09-11T23:56:55.274372+0000","last_active":"2024-09-11T23:58:31.150388+0000","last_peered":"2024-09-11T23:58:31.150388+0000","last_clean":"2024-09-11T23:58:31.150388+0000","last_became_active":"2024-09-11T23:56:55.273984+0000","last_became_peered":"2024-09-11T23:56:55.273984+0000","last_unstale":"2024-09-11T23:58:31.150388+0000","last_undegraded":"2024-09-11T23:58:31.150388+0000","last_fullsized":"2024-09-11T23:58:31.150388+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:15.853467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816032+0000","last_change":"2024-09-11T23:56:57.344571+0000","last_active":"2024-09-11T23:58:02.816032+0000","last_peered":"2024-09-11T23:58:02.816032+0000","last_clean":"2024-09-11T23:58:02.816032+0000","last_became_active":"2024-09-11T23:56:57.344228+0000","last_became_peered":"2024-09-11T23:56:57.344228+0000","last_unstale":"2024-09-11T23:58:02.816032+0000","last_undegraded":"2024-09-11T23:58:02.816032+0000","last_fullsized":"2024-09-11T23:58:02.816032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:32.712464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821974+0000","last_change":"2024-09-11T23:57:04.418807+0000","last_active":"2024-09-11T23:58:02.821974+0000","last_peered":"2024-09-11T23:58:02.821974+0000","last_clean":"2024-09-11T23:58:02.821974+0000","last_became_active":"2024-09-11T23:57:04.418303+0000","last_became_peered":"2024-09-11T23:57:04.418303+0000","last_unstale":"2024-09-11T23:58:02.821974+0000","last_undegraded":"2024-09-11T23:58:02.821974+0000","last_fullsized":"2024-09-11T23:58:02.821974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:29.722073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813000+0000","last_change":"2024-09-11T23:56:57.351734+0000","last_active":"2024-09-11T23:58:02.813000+0000","last_peered":"2024-09-11T23:58:02.813000+0000","last_clean":"2024-09-11T23:58:02.813000+0000","last_became_active":"2024-09-11T23:56:57.351386+0000","last_became_peered":"2024-09-11T23:56:57.351386+0000","last_unstale":"2024-09-11T23:58:02.813000+0000","last_undegraded":"2024-09-11T23:58:02.813000+0000","last_fullsized":"2024-09-11T23:58:02.813000+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.091137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821724+0000","last_change":"2024-09-11T23:56:57.354720+0000","last_active":"2024-09-11T23:58:02.821724+0000","last_peered":"2024-09-11T23:58:02.821724+0000","last_clean":"2024-09-11T23:58:02.821724+0000","last_became_active":"2024-09-11T23:56:57.353815+0000","last_became_peered":"2024-09-11T23:56:57.353815+0000","last_unstale":"2024-09-11T23:58:02.821724+0000","last_undegraded":"2024-09-11T23:58:02.821724+0000","last_fullsized":"2024-09-11T23:58:02.821724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:30.516912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821725+0000","last_change":"2024-09-11T23:56:57.359290+0000","last_active":"2024-09-11T23:58:02.821725+0000","last_peered":"2024-09-11T23:58:02.821725+0000","last_clean":"2024-09-11T23:58:02.821725+0000","last_became_active":"2024-09-11T23:56:57.358953+0000","last_became_peered":"2024-09-11T23:56:57.358953+0000","last_unstale":"2024-09-11T23:58:02.821725+0000","last_undegraded":"2024-09-11T23:58:02.821725+0000","last_fullsized":"2024-09-11T23:58:02.821725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:24.894051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816318+0000","last_change":"2024-09-11T23:56:57.363571+0000","last_active":"2024-09-11T23:58:02.816318+0000","last_peered":"2024-09-11T23:58:02.816318+0000","last_clean":"2024-09-11T23:58:02.816318+0000","last_became_active":"2024-09-11T23:56:57.361844+0000","last_became_peered":"2024-09-11T23:56:57.361844+0000","last_unstale":"2024-09-11T23:58:02.816318+0000","last_undegraded":"2024-09-11T23:58:02.816318+0000","last_fullsized":"2024-09-11T23:58:02.816318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:22.693387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816168+0000","last_change":"2024-09-11T23:56:57.359850+0000","last_active":"2024-09-11T23:58:02.816168+0000","last_peered":"2024-09-11T23:58:02.816168+0000","last_clean":"2024-09-11T23:58:02.816168+0000","last_became_active":"2024-09-11T23:56:57.359560+0000","last_became_peered":"2024-09-11T23:56:57.359560+0000","last_unstale":"2024-09-11T23:58:02.816168+0000","last_undegraded":"2024-09-11T23:58:02.816168+0000","last_fullsized":"2024-09-11T23:58:02.816168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:33.015625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813958+0000","last_change":"2024-09-11T23:56:57.352870+0000","last_active":"2024-09-11T23:58:02.813958+0000","last_peered":"2024-09-11T23:58:02.813958+0000","last_clean":"2024-09-11T23:58:02.813958+0000","last_became_active":"2024-09-11T23:56:57.351427+0000","last_became_peered":"2024-09-11T23:56:57.351427+0000","last_unstale":"2024-09-11T23:58:02.813958+0000","last_undegraded":"2024-09-11T23:58:02.813958+0000","last_fullsized":"2024-09-11T23:58:02.813958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:11.895482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.820335+0000","last_change":"2024-09-11T23:56:57.349609+0000","last_active":"2024-09-11T23:58:02.820335+0000","last_peered":"2024-09-11T23:58:02.820335+0000","last_clean":"2024-09-11T23:58:02.820335+0000","last_became_active":"2024-09-11T23:56:57.349307+0000","last_became_peered":"2024-09-11T23:56:57.349307+0000","last_unstale":"2024-09-11T23:58:02.820335+0000","last_undegraded":"2024-09-11T23:58:02.820335+0000","last_fullsized":"2024-09-11T23:58:02.820335+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:49.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815659+0000","last_change":"2024-09-11T23:56:57.357093+0000","last_active":"2024-09-11T23:58:02.815659+0000","last_peered":"2024-09-11T23:58:02.815659+0000","last_clean":"2024-09-11T23:58:02.815659+0000","last_became_active":"2024-09-11T23:56:57.356313+0000","last_became_peered":"2024-09-11T23:56:57.356313+0000","last_unstale":"2024-09-11T23:58:02.815659+0000","last_undegraded":"2024-09-11T23:58:02.815659+0000","last_fullsized":"2024-09-11T23:58:02.815659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:00.861920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816991+0000","last_change":"2024-09-11T23:56:57.345499+0000","last_active":"2024-09-11T23:58:02.816991+0000","last_peered":"2024-09-11T23:58:02.816991+0000","last_clean":"2024-09-11T23:58:02.816991+0000","last_became_active":"2024-09-11T23:56:57.345186+0000","last_became_peered":"2024-09-11T23:56:57.345186+0000","last_unstale":"2024-09-11T23:58:02.816991+0000","last_undegraded":"2024-09-11T23:58:02.816991+0000","last_fullsized":"2024-09-11T23:58:02.816991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:27.680578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814777+0000","last_change":"2024-09-11T23:56:57.351242+0000","last_active":"2024-09-11T23:58:02.814777+0000","last_peered":"2024-09-11T23:58:02.814777+0000","last_clean":"2024-09-11T23:58:02.814777+0000","last_became_active":"2024-09-11T23:56:57.350948+0000","last_became_peered":"2024-09-11T23:56:57.350948+0000","last_unstale":"2024-09-11T23:58:02.814777+0000","last_undegraded":"2024-09-11T23:58:02.814777+0000","last_fullsized":"2024-09-11T23:58:02.814777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:29.979795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.820320+0000","last_change":"2024-09-11T23:56:57.355967+0000","last_active":"2024-09-11T23:58:02.820320+0000","last_peered":"2024-09-11T23:58:02.820320+0000","last_clean":"2024-09-11T23:58:02.820320+0000","last_became_active":"2024-09-11T23:56:57.355437+0000","last_became_peered":"2024-09-11T23:56:57.355437+0000","last_unstale":"2024-09-11T23:58:02.820320+0000","last_undegraded":"2024-09-11T23:58:02.820320+0000","last_fullsized":"2024-09-11T23:58:02.820320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:19.701339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816919+0000","last_change":"2024-09-11T23:56:57.361097+0000","last_active":"2024-09-11T23:58:02.816919+0000","last_peered":"2024-09-11T23:58:02.816919+0000","last_clean":"2024-09-11T23:58:02.816919+0000","last_became_active":"2024-09-11T23:56:57.360700+0000","last_became_peered":"2024-09-11T23:56:57.360700+0000","last_unstale":"2024-09-11T23:58:02.816919+0000","last_undegraded":"2024-09-11T23:58:02.816919+0000","last_fullsized":"2024-09-11T23:58:02.816919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:39.006911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814192+0000","last_change":"2024-09-11T23:56:57.356233+0000","last_active":"2024-09-11T23:58:02.814192+0000","last_peered":"2024-09-11T23:58:02.814192+0000","last_clean":"2024-09-11T23:58:02.814192+0000","last_became_active":"2024-09-11T23:56:57.354705+0000","last_became_peered":"2024-09-11T23:56:57.354705+0000","last_unstale":"2024-09-11T23:58:02.814192+0000","last_undegraded":"2024-09-11T23:58:02.814192+0000","last_fullsized":"2024-09-11T23:58:02.814192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:35.039827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.822155+0000","last_change":"2024-09-11T23:56:57.357881+0000","last_active":"2024-09-11T23:58:02.822155+0000","last_peered":"2024-09-11T23:58:02.822155+0000","last_clean":"2024-09-11T23:58:02.822155+0000","last_became_active":"2024-09-11T23:56:57.357486+0000","last_became_peered":"2024-09-11T23:56:57.357486+0000","last_unstale":"2024-09-11T23:58:02.822155+0000","last_undegraded":"2024-09-11T23:58:02.822155+0000","last_fullsized":"2024-09-11T23:58:02.822155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:24.049072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.812522+0000","last_change":"2024-09-11T23:56:57.355307+0000","last_active":"2024-09-11T23:58:02.812522+0000","last_peered":"2024-09-11T23:58:02.812522+0000","last_clean":"2024-09-11T23:58:02.812522+0000","last_became_active":"2024-09-11T23:56:57.354957+0000","last_became_peered":"2024-09-11T23:56:57.354957+0000","last_unstale":"2024-09-11T23:58:02.812522+0000","last_undegraded":"2024-09-11T23:58:02.812522+0000","last_fullsized":"2024-09-11T23:58:02.812522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:00.217654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813698+0000","last_change":"2024-09-11T23:56:57.361516+0000","last_active":"2024-09-11T23:58:02.813698+0000","last_peered":"2024-09-11T23:58:02.813698+0000","last_clean":"2024-09-11T23:58:02.813698+0000","last_became_active":"2024-09-11T23:56:57.361112+0000","last_became_peered":"2024-09-11T23:56:57.361112+0000","last_unstale":"2024-09-11T23:58:02.813698+0000","last_undegraded":"2024-09-11T23:58:02.813698+0000","last_fullsized":"2024-09-11T23:58:02.813698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:48.861534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.819718+0000","last_change":"2024-09-11T23:56:57.357251+0000","last_active":"2024-09-11T23:58:02.819718+0000","last_peered":"2024-09-11T23:58:02.819718+0000","last_clean":"2024-09-11T23:58:02.819718+0000","last_became_active":"2024-09-11T23:56:57.356932+0000","last_became_peered":"2024-09-11T23:56:57.356932+0000","last_unstale":"2024-09-11T23:58:02.819718+0000","last_undegraded":"2024-09-11T23:58:02.819718+0000","last_fullsized":"2024-09-11T23:58:02.819718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:10.650294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816550+0000","last_change":"2024-09-11T23:56:57.360671+0000","last_active":"2024-09-11T23:58:02.816550+0000","last_peered":"2024-09-11T23:58:02.816550+0000","last_clean":"2024-09-11T23:58:02.816550+0000","last_became_active":"2024-09-11T23:56:57.360351+0000","last_became_peered":"2024-09-11T23:56:57.360351+0000","last_unstale":"2024-09-11T23:58:02.816550+0000","last_undegraded":"2024-09-11T23:58:02.816550+0000","last_fullsized":"2024-09-11T23:58:02.816550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:18.895549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816132+0000","last_change":"2024-09-11T23:56:57.363379+0000","last_active":"2024-09-11T23:58:02.816132+0000","last_peered":"2024-09-11T23:58:02.816132+0000","last_clean":"2024-09-11T23:58:02.816132+0000","last_became_active":"2024-09-11T23:56:57.362652+0000","last_became_peered":"2024-09-11T23:56:57.362652+0000","last_unstale":"2024-09-11T23:58:02.816132+0000","last_undegraded":"2024-09-11T23:58:02.816132+0000","last_fullsized":"2024-09-11T23:58:02.816132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:16.298532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816832+0000","last_change":"2024-09-11T23:56:57.347580+0000","last_active":"2024-09-11T23:58:02.816832+0000","last_peered":"2024-09-11T23:58:02.816832+0000","last_clean":"2024-09-11T23:58:02.816832+0000","last_became_active":"2024-09-11T23:56:57.347276+0000","last_became_peered":"2024-09-11T23:56:57.347276+0000","last_unstale":"2024-09-11T23:58:02.816832+0000","last_undegraded":"2024-09-11T23:58:02.816832+0000","last_fullsized":"2024-09-11T23:58:02.816832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:14.543167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814758+0000","last_change":"2024-09-11T23:56:57.352544+0000","last_active":"2024-09-11T23:58:02.814758+0000","last_peered":"2024-09-11T23:58:02.814758+0000","last_clean":"2024-09-11T23:58:02.814758+0000","last_became_active":"2024-09-11T23:56:57.351672+0000","last_became_peered":"2024-09-11T23:56:57.351672+0000","last_unstale":"2024-09-11T23:58:02.814758+0000","last_undegraded":"2024-09-11T23:58:02.814758+0000","last_fullsized":"2024-09-11T23:58:02.814758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.097494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817491+0000","last_change":"2024-09-11T23:56:57.360698+0000","last_active":"2024-09-11T23:58:02.817491+0000","last_peered":"2024-09-11T23:58:02.817491+0000","last_clean":"2024-09-11T23:58:02.817491+0000","last_became_active":"2024-09-11T23:56:57.360257+0000","last_became_peered":"2024-09-11T23:56:57.360257+0000","last_unstale":"2024-09-11T23:58:02.817491+0000","last_undegraded":"2024-09-11T23:58:02.817491+0000","last_fullsized":"2024-09-11T23:58:02.817491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:23.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813632+0000","last_change":"2024-09-11T23:56:57.354301+0000","last_active":"2024-09-11T23:58:02.813632+0000","last_peered":"2024-09-11T23:58:02.813632+0000","last_clean":"2024-09-11T23:58:02.813632+0000","last_became_active":"2024-09-11T23:56:57.353936+0000","last_became_peered":"2024-09-11T23:56:57.353936+0000","last_unstale":"2024-09-11T23:58:02.813632+0000","last_undegraded":"2024-09-11T23:58:02.813632+0000","last_fullsized":"2024-09-11T23:58:02.813632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:05.420546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821582+0000","last_change":"2024-09-11T23:56:57.352615+0000","last_active":"2024-09-11T23:58:02.821582+0000","last_peered":"2024-09-11T23:58:02.821582+0000","last_clean":"2024-09-11T23:58:02.821582+0000","last_became_active":"2024-09-11T23:56:57.352249+0000","last_became_peered":"2024-09-11T23:56:57.352249+0000","last_unstale":"2024-09-11T23:58:02.821582+0000","last_undegraded":"2024-09-11T23:58:02.821582+0000","last_fullsized":"2024-09-11T23:58:02.821582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:18.477555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814504+0000","last_change":"2024-09-11T23:56:57.346309+0000","last_active":"2024-09-11T23:58:02.814504+0000","last_peered":"2024-09-11T23:58:02.814504+0000","last_clean":"2024-09-11T23:58:02.814504+0000","last_became_active":"2024-09-11T23:56:57.345943+0000","last_became_peered":"2024-09-11T23:56:57.345943+0000","last_unstale":"2024-09-11T23:58:02.814504+0000","last_undegraded":"2024-09-11T23:58:02.814504+0000","last_fullsized":"2024-09-11T23:58:02.814504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:20.142093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816859+0000","last_change":"2024-09-11T23:56:57.359749+0000","last_active":"2024-09-11T23:58:02.816859+0000","last_peered":"2024-09-11T23:58:02.816859+0000","last_clean":"2024-09-11T23:58:02.816859+0000","last_became_active":"2024-09-11T23:56:57.359343+0000","last_became_peered":"2024-09-11T23:56:57.359343+0000","last_unstale":"2024-09-11T23:58:02.816859+0000","last_undegraded":"2024-09-11T23:58:02.816859+0000","last_fullsized":"2024-09-11T23:58:02.816859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:59.132011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813115+0000","last_change":"2024-09-11T23:56:57.351843+0000","last_active":"2024-09-11T23:58:02.813115+0000","last_peered":"2024-09-11T23:58:02.813115+0000","last_clean":"2024-09-11T23:58:02.813115+0000","last_became_active":"2024-09-11T23:56:57.351501+0000","last_became_peered":"2024-09-11T23:56:57.351501+0000","last_unstale":"2024-09-11T23:58:02.813115+0000","last_undegraded":"2024-09-11T23:58:02.813115+0000","last_fullsized":"2024-09-11T23:58:02.813115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:51.612821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816219+0000","last_change":"2024-09-11T23:56:57.344691+0000","last_active":"2024-09-11T23:58:02.816219+0000","last_peered":"2024-09-11T23:58:02.816219+0000","last_clean":"2024-09-11T23:58:02.816219+0000","last_became_active":"2024-09-11T23:56:57.344358+0000","last_became_peered":"2024-09-11T23:56:57.344358+0000","last_unstale":"2024-09-11T23:58:02.816219+0000","last_undegraded":"2024-09-11T23:58:02.816219+0000","last_fullsized":"2024-09-11T23:58:02.816219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:22.014079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814501+0000","last_change":"2024-09-11T23:56:57.352838+0000","last_active":"2024-09-11T23:58:02.814501+0000","last_peered":"2024-09-11T23:58:02.814501+0000","last_clean":"2024-09-11T23:58:02.814501+0000","last_became_active":"2024-09-11T23:56:57.352043+0000","last_became_peered":"2024-09-11T23:56:57.352043+0000","last_unstale":"2024-09-11T23:58:02.814501+0000","last_undegraded":"2024-09-11T23:58:02.814501+0000","last_fullsized":"2024-09-11T23:58:02.814501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:01.897496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815528+0000","last_change":"2024-09-11T23:56:57.363300+0000","last_active":"2024-09-11T23:58:02.815528+0000","last_peered":"2024-09-11T23:58:02.815528+0000","last_clean":"2024-09-11T23:58:02.815528+0000","last_became_active":"2024-09-11T23:56:57.363001+0000","last_became_peered":"2024-09-11T23:56:57.363001+0000","last_unstale":"2024-09-11T23:58:02.815528+0000","last_undegraded":"2024-09-11T23:58:02.815528+0000","last_fullsized":"2024-09-11T23:58:02.815528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:36.585495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816145+0000","last_change":"2024-09-11T23:56:57.359008+0000","last_active":"2024-09-11T23:58:02.816145+0000","last_peered":"2024-09-11T23:58:02.816145+0000","last_clean":"2024-09-11T23:58:02.816145+0000","last_became_active":"2024-09-11T23:56:57.358701+0000","last_became_peered":"2024-09-11T23:56:57.358701+0000","last_unstale":"2024-09-11T23:58:02.816145+0000","last_undegraded":"2024-09-11T23:58:02.816145+0000","last_fullsized":"2024-09-11T23:58:02.816145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:24.287725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813588+0000","last_change":"2024-09-11T23:56:57.361104+0000","last_active":"2024-09-11T23:58:02.813588+0000","last_peered":"2024-09-11T23:58:02.813588+0000","last_clean":"2024-09-11T23:58:02.813588+0000","last_became_active":"2024-09-11T23:56:57.360095+0000","last_became_peered":"2024-09-11T23:56:57.360095+0000","last_unstale":"2024-09-11T23:58:02.813588+0000","last_undegraded":"2024-09-11T23:58:02.813588+0000","last_fullsized":"2024-09-11T23:58:02.813588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:29.577779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69746,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":530,"num_read_kb":338,"num_write":248,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":253517,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579937,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":496144,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1126400,"data_stored":1145779,"data_compressed":60349,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972395,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1003520,"data_stored":500058,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201328,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":987136,"data_stored":496228,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430261,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1048576,"data_stored":1092839,"data_compressed":60349,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":974848,"data_stored":491859,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1056768,"data_stored":1088028,"data_compressed":60349,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":495540,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":491174,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1064960,"data_stored":555647,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1044480,"data_stored":555820,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":999424,"data_stored":492922,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35046,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35046,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:58:36.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:58:36.830 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:37.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:36 smithi134 ceph-mon[34893]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-11T23:58:37.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:36 smithi134 ceph-mon[34893]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:37.250 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:36 smithi006 ceph-mon[30947]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-11T23:58:37.251 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:36 smithi006 ceph-mon[30947]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:37.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:36 smithi039 ceph-mon[34543]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-11T23:58:37.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:36 smithi039 ceph-mon[34543]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.334+0000 7fec71736640 1 -- 172.21.15.6:0/3743811795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6c101de0 msgr2=0x7fec6c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.334+0000 7fec71736640 1 --2- 172.21.15.6:0/3743811795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6c101de0 0x7fec6c1021c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec64009900 tx=0x7fec6402a3f0 comp rx=0 tx=0).stop 2024-09-11T23:58:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.334+0000 7fec71736640 1 -- 172.21.15.6:0/3743811795 shutdown_connections 2024-09-11T23:58:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.334+0000 7fec71736640 1 --2- 172.21.15.6:0/3743811795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec6c106f10 0x7fec6c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.334+0000 7fec71736640 1 --2- 172.21.15.6:0/3743811795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c102790 0x7fec6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.334+0000 7fec71736640 1 --2- 172.21.15.6:0/3743811795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6c101de0 0x7fec6c1021c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.334+0000 7fec71736640 1 -- 172.21.15.6:0/3743811795 >> 172.21.15.6:0/3743811795 conn(0x7fec6c0fd8c0 msgr2=0x7fec6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.334+0000 7fec71736640 1 -- 172.21.15.6:0/3743811795 shutdown_connections 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.334+0000 7fec71736640 1 -- 172.21.15.6:0/3743811795 wait complete. 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.334+0000 7fec71736640 1 Processor -- start 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec71736640 1 -- start start 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec71736640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c101de0 0x7fec6c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec71736640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6c102790 0x7fec6c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec71736640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec6c106f10 0x7fec6c19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec71736640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c111de0 con 0x7fec6c102790 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec71736640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c111c60 con 0x7fec6c106f10 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec71736640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c111f60 con 0x7fec6c101de0 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec6a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6c102790 0x7fec6c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec6a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6c102790 0x7fec6c19aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44776/0 (socket says 172.21.15.6:44776) 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec6a7fc640 1 -- 172.21.15.6:0/664224070 learned_addr learned my addr 172.21.15.6:0/664224070 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec6affd640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c101de0 0x7fec6c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec6b7fe640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec6c106f10 0x7fec6c19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec6a7fc640 1 -- 172.21.15.6:0/664224070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c101de0 msgr2=0x7fec6c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec6a7fc640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c101de0 0x7fec6c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec6a7fc640 1 -- 172.21.15.6:0/664224070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec6c106f10 msgr2=0x7fec6c19ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec6a7fc640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec6c106f10 0x7fec6c19ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec6a7fc640 1 -- 172.21.15.6:0/664224070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6c19f510 con 0x7fec6c102790 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec6b7fe640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec6c106f10 0x7fec6c19ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.335+0000 7fec6a7fc640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6c102790 0x7fec6c19aaa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fec5400c920 tx=0x7fec5400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.336+0000 7fec63fff640 1 -- 172.21.15.6:0/664224070 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54007c70 con 0x7fec6c102790 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.336+0000 7fec63fff640 1 -- 172.21.15.6:0/664224070 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec54007e10 con 0x7fec6c102790 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.336+0000 7fec71736640 1 -- 172.21.15.6:0/664224070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6c19f800 con 0x7fec6c102790 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.336+0000 7fec63fff640 1 -- 172.21.15.6:0/664224070 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54018820 con 0x7fec6c102790 2024-09-11T23:58:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.336+0000 7fec71736640 1 -- 172.21.15.6:0/664224070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec6c1a70e0 con 0x7fec6c102790 2024-09-11T23:58:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.337+0000 7fec71736640 1 -- 172.21.15.6:0/664224070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec6c1021c0 con 0x7fec6c102790 2024-09-11T23:58:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.338+0000 7fec63fff640 1 -- 172.21.15.6:0/664224070 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fec540189c0 con 0x7fec6c102790 2024-09-11T23:58:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.339+0000 7fec63fff640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fec580a2c90 0x7fec580a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.339+0000 7fec6affd640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fec580a2c90 0x7fec580a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.339+0000 7fec63fff640 1 -- 172.21.15.6:0/664224070 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fec540cf600 con 0x7fec6c102790 2024-09-11T23:58:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.340+0000 7fec6affd640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fec580a2c90 0x7fec580a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fec64031440 tx=0x7fec64005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.343+0000 7fec63fff640 1 -- 172.21.15.6:0/664224070 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec54014030 con 0x7fec6c102790 2024-09-11T23:58:37.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.515+0000 7fec71736640 1 -- 172.21.15.6:0/664224070 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec6c075430 con 0x7fec580a2c90 2024-09-11T23:58:37.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.524+0000 7fec63fff640 1 -- 172.21.15.6:0/664224070 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340651 (secure 0 0 0) 0x7fec6c075430 con 0x7fec580a2c90 2024-09-11T23:58:37.525 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:58:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-11T23:58:37.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.528+0000 7fec71736640 1 -- 172.21.15.6:0/664224070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fec580a2c90 msgr2=0x7fec580a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:37.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.528+0000 7fec71736640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fec580a2c90 0x7fec580a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fec64031440 tx=0x7fec64005b50 comp rx=0 tx=0).stop 2024-09-11T23:58:37.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.528+0000 7fec71736640 1 -- 172.21.15.6:0/664224070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6c102790 msgr2=0x7fec6c19aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:37.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.528+0000 7fec71736640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6c102790 0x7fec6c19aaa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fec5400c920 tx=0x7fec5400cde0 comp rx=0 tx=0).stop 2024-09-11T23:58:37.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.528+0000 7fec71736640 1 -- 172.21.15.6:0/664224070 shutdown_connections 2024-09-11T23:58:37.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.528+0000 7fec71736640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fec580a2c90 0x7fec580a5150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:37.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.528+0000 7fec71736640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec6c106f10 0x7fec6c19ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:37.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.528+0000 7fec71736640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6c102790 0x7fec6c19aaa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:37.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.528+0000 7fec71736640 1 --2- 172.21.15.6:0/664224070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c101de0 0x7fec6c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:37.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.528+0000 7fec71736640 1 -- 172.21.15.6:0/664224070 >> 172.21.15.6:0/664224070 conn(0x7fec6c0fd8c0 msgr2=0x7fec6c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:37.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.529+0000 7fec71736640 1 -- 172.21.15.6:0/664224070 shutdown_connections 2024-09-11T23:58:37.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:37.529+0000 7fec71736640 1 -- 172.21.15.6:0/664224070 wait complete. 2024-09-11T23:58:38.195 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-09-11T23:58:36.956019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660348,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":686,"num_read_kb":467,"num_write":431,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180848,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361296,"kb_used_data":11972,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580528,"statfs":{"total":1151940427776,"available":1151570460672,"internally_reserved":0,"allocated":12259328,"data_stored":7902038,"data_compressed":394023,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003413"},"pg_stats":[{"pgid":"2.1f","version":"86'13","reported_seq":100,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:34.149073+0000","last_change":"2024-09-11T23:56:55.272753+0000","last_active":"2024-09-11T23:58:34.149073+0000","last_peered":"2024-09-11T23:58:34.149073+0000","last_clean":"2024-09-11T23:58:34.149073+0000","last_became_active":"2024-09-11T23:56:55.272342+0000","last_became_peered":"2024-09-11T23:56:55.272342+0000","last_unstale":"2024-09-11T23:58:34.149073+0000","last_undegraded":"2024-09-11T23:58:34.149073+0000","last_fullsized":"2024-09-11T23:58:34.149073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:43.856651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815580+0000","last_change":"2024-09-11T23:56:57.349492+0000","last_active":"2024-09-11T23:58:02.815580+0000","last_peered":"2024-09-11T23:58:02.815580+0000","last_clean":"2024-09-11T23:58:02.815580+0000","last_became_active":"2024-09-11T23:56:57.349098+0000","last_became_peered":"2024-09-11T23:56:57.349098+0000","last_unstale":"2024-09-11T23:58:02.815580+0000","last_undegraded":"2024-09-11T23:58:02.815580+0000","last_fullsized":"2024-09-11T23:58:02.815580+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:06.520492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821378+0000","last_change":"2024-09-11T23:57:04.417135+0000","last_active":"2024-09-11T23:58:02.821378+0000","last_peered":"2024-09-11T23:58:02.821378+0000","last_clean":"2024-09-11T23:58:02.821378+0000","last_became_active":"2024-09-11T23:57:04.416697+0000","last_became_peered":"2024-09-11T23:57:04.416697+0000","last_unstale":"2024-09-11T23:58:02.821378+0000","last_undegraded":"2024-09-11T23:58:02.821378+0000","last_fullsized":"2024-09-11T23:58:02.821378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:48.794840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815898+0000","last_change":"2024-09-11T23:56:55.593961+0000","last_active":"2024-09-11T23:58:02.815898+0000","last_peered":"2024-09-11T23:58:02.815898+0000","last_clean":"2024-09-11T23:58:02.815898+0000","last_became_active":"2024-09-11T23:56:55.593624+0000","last_became_peered":"2024-09-11T23:56:55.593624+0000","last_unstale":"2024-09-11T23:58:02.815898+0000","last_undegraded":"2024-09-11T23:58:02.815898+0000","last_fullsized":"2024-09-11T23:58:02.815898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:32.510264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816796+0000","last_change":"2024-09-11T23:56:57.364450+0000","last_active":"2024-09-11T23:58:02.816796+0000","last_peered":"2024-09-11T23:58:02.816796+0000","last_clean":"2024-09-11T23:58:02.816796+0000","last_became_active":"2024-09-11T23:56:57.363583+0000","last_became_peered":"2024-09-11T23:56:57.363583+0000","last_unstale":"2024-09-11T23:58:02.816796+0000","last_undegraded":"2024-09-11T23:58:02.816796+0000","last_fullsized":"2024-09-11T23:58:02.816796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:31.761036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813908+0000","last_change":"2024-09-11T23:57:04.419305+0000","last_active":"2024-09-11T23:58:02.813908+0000","last_peered":"2024-09-11T23:58:02.813908+0000","last_clean":"2024-09-11T23:58:02.813908+0000","last_became_active":"2024-09-11T23:57:04.418774+0000","last_became_peered":"2024-09-11T23:57:04.418774+0000","last_unstale":"2024-09-11T23:58:02.813908+0000","last_undegraded":"2024-09-11T23:58:02.813908+0000","last_fullsized":"2024-09-11T23:58:02.813908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.910125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816228+0000","last_change":"2024-09-11T23:56:55.275373+0000","last_active":"2024-09-11T23:58:02.816228+0000","last_peered":"2024-09-11T23:58:02.816228+0000","last_clean":"2024-09-11T23:58:02.816228+0000","last_became_active":"2024-09-11T23:56:55.274400+0000","last_became_peered":"2024-09-11T23:56:55.274400+0000","last_unstale":"2024-09-11T23:58:02.816228+0000","last_undegraded":"2024-09-11T23:58:02.816228+0000","last_fullsized":"2024-09-11T23:58:02.816228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:41.019225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.820054+0000","last_change":"2024-09-11T23:56:57.346037+0000","last_active":"2024-09-11T23:58:02.820054+0000","last_peered":"2024-09-11T23:58:02.820054+0000","last_clean":"2024-09-11T23:58:02.820054+0000","last_became_active":"2024-09-11T23:56:57.345712+0000","last_became_peered":"2024-09-11T23:56:57.345712+0000","last_unstale":"2024-09-11T23:58:02.820054+0000","last_undegraded":"2024-09-11T23:58:02.820054+0000","last_fullsized":"2024-09-11T23:58:02.820054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:20.643812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.820521+0000","last_change":"2024-09-11T23:58:02.820521+0000","last_active":"2024-09-11T23:58:02.820521+0000","last_peered":"2024-09-11T23:58:02.820521+0000","last_clean":"2024-09-11T23:58:02.820521+0000","last_became_active":"2024-09-11T23:58:02.820081+0000","last_became_peered":"2024-09-11T23:58:02.820081+0000","last_unstale":"2024-09-11T23:58:02.820521+0000","last_undegraded":"2024-09-11T23:58:02.820521+0000","last_fullsized":"2024-09-11T23:58:02.820521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:27.818237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815495+0000","last_change":"2024-09-11T23:56:55.275919+0000","last_active":"2024-09-11T23:58:02.815495+0000","last_peered":"2024-09-11T23:58:02.815495+0000","last_clean":"2024-09-11T23:58:02.815495+0000","last_became_active":"2024-09-11T23:56:55.275326+0000","last_became_peered":"2024-09-11T23:56:55.275326+0000","last_unstale":"2024-09-11T23:58:02.815495+0000","last_undegraded":"2024-09-11T23:58:02.815495+0000","last_fullsized":"2024-09-11T23:58:02.815495+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:47.201282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.823611+0000","last_change":"2024-09-11T23:58:02.823611+0000","last_active":"2024-09-11T23:58:02.823611+0000","last_peered":"2024-09-11T23:58:02.823611+0000","last_clean":"2024-09-11T23:58:02.823611+0000","last_became_active":"2024-09-11T23:58:02.823207+0000","last_became_peered":"2024-09-11T23:58:02.823207+0000","last_unstale":"2024-09-11T23:58:02.823611+0000","last_undegraded":"2024-09-11T23:58:02.823611+0000","last_fullsized":"2024-09-11T23:58:02.823611+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:49.640712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814389+0000","last_change":"2024-09-11T23:57:04.419886+0000","last_active":"2024-09-11T23:58:02.814389+0000","last_peered":"2024-09-11T23:58:02.814389+0000","last_clean":"2024-09-11T23:58:02.814389+0000","last_became_active":"2024-09-11T23:57:04.419419+0000","last_became_peered":"2024-09-11T23:57:04.419419+0000","last_unstale":"2024-09-11T23:58:02.814389+0000","last_undegraded":"2024-09-11T23:58:02.814389+0000","last_fullsized":"2024-09-11T23:58:02.814389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.768235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816698+0000","last_change":"2024-09-11T23:56:57.364619+0000","last_active":"2024-09-11T23:58:02.816698+0000","last_peered":"2024-09-11T23:58:02.816698+0000","last_clean":"2024-09-11T23:58:02.816698+0000","last_became_active":"2024-09-11T23:56:57.364279+0000","last_became_peered":"2024-09-11T23:56:57.364279+0000","last_unstale":"2024-09-11T23:58:02.816698+0000","last_undegraded":"2024-09-11T23:58:02.816698+0000","last_fullsized":"2024-09-11T23:58:02.816698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:13.540493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816358+0000","last_change":"2024-09-11T23:56:55.274995+0000","last_active":"2024-09-11T23:58:02.816358+0000","last_peered":"2024-09-11T23:58:02.816358+0000","last_clean":"2024-09-11T23:58:02.816358+0000","last_became_active":"2024-09-11T23:56:55.274017+0000","last_became_peered":"2024-09-11T23:56:55.274017+0000","last_unstale":"2024-09-11T23:58:02.816358+0000","last_undegraded":"2024-09-11T23:58:02.816358+0000","last_fullsized":"2024-09-11T23:58:02.816358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:37.324085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814296+0000","last_change":"2024-09-11T23:57:04.419999+0000","last_active":"2024-09-11T23:58:02.814296+0000","last_peered":"2024-09-11T23:58:02.814296+0000","last_clean":"2024-09-11T23:58:02.814296+0000","last_became_active":"2024-09-11T23:57:04.419579+0000","last_became_peered":"2024-09-11T23:57:04.419579+0000","last_unstale":"2024-09-11T23:58:02.814296+0000","last_undegraded":"2024-09-11T23:58:02.814296+0000","last_fullsized":"2024-09-11T23:58:02.814296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:08.830864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814708+0000","last_change":"2024-09-11T23:56:57.358959+0000","last_active":"2024-09-11T23:58:02.814708+0000","last_peered":"2024-09-11T23:58:02.814708+0000","last_clean":"2024-09-11T23:58:02.814708+0000","last_became_active":"2024-09-11T23:56:57.358676+0000","last_became_peered":"2024-09-11T23:56:57.358676+0000","last_unstale":"2024-09-11T23:58:02.814708+0000","last_undegraded":"2024-09-11T23:58:02.814708+0000","last_fullsized":"2024-09-11T23:58:02.814708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:03.243973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821774+0000","last_change":"2024-09-11T23:56:55.274068+0000","last_active":"2024-09-11T23:58:02.821774+0000","last_peered":"2024-09-11T23:58:02.821774+0000","last_clean":"2024-09-11T23:58:02.821774+0000","last_became_active":"2024-09-11T23:56:55.273689+0000","last_became_peered":"2024-09-11T23:56:55.273689+0000","last_unstale":"2024-09-11T23:58:02.821774+0000","last_undegraded":"2024-09-11T23:58:02.821774+0000","last_fullsized":"2024-09-11T23:58:02.821774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:36.315956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814847+0000","last_change":"2024-09-11T23:57:04.424832+0000","last_active":"2024-09-11T23:58:02.814847+0000","last_peered":"2024-09-11T23:58:02.814847+0000","last_clean":"2024-09-11T23:58:02.814847+0000","last_became_active":"2024-09-11T23:57:04.424398+0000","last_became_peered":"2024-09-11T23:57:04.424398+0000","last_unstale":"2024-09-11T23:58:02.814847+0000","last_undegraded":"2024-09-11T23:58:02.814847+0000","last_fullsized":"2024-09-11T23:58:02.814847+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:11.134123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813068+0000","last_change":"2024-09-11T23:56:57.349603+0000","last_active":"2024-09-11T23:58:02.813068+0000","last_peered":"2024-09-11T23:58:02.813068+0000","last_clean":"2024-09-11T23:58:02.813068+0000","last_became_active":"2024-09-11T23:56:57.349269+0000","last_became_peered":"2024-09-11T23:56:57.349269+0000","last_unstale":"2024-09-11T23:58:02.813068+0000","last_undegraded":"2024-09-11T23:58:02.813068+0000","last_fullsized":"2024-09-11T23:58:02.813068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:46.269274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814956+0000","last_change":"2024-09-11T23:56:55.271033+0000","last_active":"2024-09-11T23:58:02.814956+0000","last_peered":"2024-09-11T23:58:02.814956+0000","last_clean":"2024-09-11T23:58:02.814956+0000","last_became_active":"2024-09-11T23:56:55.270704+0000","last_became_peered":"2024-09-11T23:56:55.270704+0000","last_unstale":"2024-09-11T23:58:02.814956+0000","last_undegraded":"2024-09-11T23:58:02.814956+0000","last_fullsized":"2024-09-11T23:58:02.814956+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:36.751581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.825269+0000","last_change":"2024-09-11T23:58:02.823979+0000","last_active":"2024-09-11T23:58:02.825269+0000","last_peered":"2024-09-11T23:58:02.825269+0000","last_clean":"2024-09-11T23:58:02.825269+0000","last_became_active":"2024-09-11T23:58:02.823513+0000","last_became_peered":"2024-09-11T23:58:02.823513+0000","last_unstale":"2024-09-11T23:58:02.825269+0000","last_undegraded":"2024-09-11T23:58:02.825269+0000","last_fullsized":"2024-09-11T23:58:02.825269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:03.783479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815159+0000","last_change":"2024-09-11T23:56:57.348815+0000","last_active":"2024-09-11T23:58:02.815159+0000","last_peered":"2024-09-11T23:58:02.815159+0000","last_clean":"2024-09-11T23:58:02.815159+0000","last_became_active":"2024-09-11T23:56:57.348426+0000","last_became_peered":"2024-09-11T23:56:57.348426+0000","last_unstale":"2024-09-11T23:58:02.815159+0000","last_undegraded":"2024-09-11T23:58:02.815159+0000","last_fullsized":"2024-09-11T23:58:02.815159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:47.685615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.819881+0000","last_change":"2024-09-11T23:56:55.594325+0000","last_active":"2024-09-11T23:58:02.819881+0000","last_peered":"2024-09-11T23:58:02.819881+0000","last_clean":"2024-09-11T23:58:02.819881+0000","last_became_active":"2024-09-11T23:56:55.594044+0000","last_became_peered":"2024-09-11T23:56:55.594044+0000","last_unstale":"2024-09-11T23:58:02.819881+0000","last_undegraded":"2024-09-11T23:58:02.819881+0000","last_fullsized":"2024-09-11T23:58:02.819881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:05.124980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814331+0000","last_change":"2024-09-11T23:57:04.425591+0000","last_active":"2024-09-11T23:58:02.814331+0000","last_peered":"2024-09-11T23:58:02.814331+0000","last_clean":"2024-09-11T23:58:02.814331+0000","last_became_active":"2024-09-11T23:57:04.424945+0000","last_became_peered":"2024-09-11T23:57:04.424945+0000","last_unstale":"2024-09-11T23:58:02.814331+0000","last_undegraded":"2024-09-11T23:58:02.814331+0000","last_fullsized":"2024-09-11T23:58:02.814331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:57.541426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816231+0000","last_change":"2024-09-11T23:56:57.363423+0000","last_active":"2024-09-11T23:58:02.816231+0000","last_peered":"2024-09-11T23:58:02.816231+0000","last_clean":"2024-09-11T23:58:02.816231+0000","last_became_active":"2024-09-11T23:56:57.361258+0000","last_became_peered":"2024-09-11T23:56:57.361258+0000","last_unstale":"2024-09-11T23:58:02.816231+0000","last_undegraded":"2024-09-11T23:58:02.816231+0000","last_fullsized":"2024-09-11T23:58:02.816231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:36.743240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814711+0000","last_change":"2024-09-11T23:56:55.311774+0000","last_active":"2024-09-11T23:58:02.814711+0000","last_peered":"2024-09-11T23:58:02.814711+0000","last_clean":"2024-09-11T23:58:02.814711+0000","last_became_active":"2024-09-11T23:56:55.311409+0000","last_became_peered":"2024-09-11T23:56:55.311409+0000","last_unstale":"2024-09-11T23:58:02.814711+0000","last_undegraded":"2024-09-11T23:58:02.814711+0000","last_fullsized":"2024-09-11T23:58:02.814711+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:50.243993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821542+0000","last_change":"2024-09-11T23:57:04.416973+0000","last_active":"2024-09-11T23:58:02.821542+0000","last_peered":"2024-09-11T23:58:02.821542+0000","last_clean":"2024-09-11T23:58:02.821542+0000","last_became_active":"2024-09-11T23:57:04.416582+0000","last_became_peered":"2024-09-11T23:57:04.416582+0000","last_unstale":"2024-09-11T23:58:02.821542+0000","last_undegraded":"2024-09-11T23:58:02.821542+0000","last_fullsized":"2024-09-11T23:58:02.821542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:13.411939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815759+0000","last_change":"2024-09-11T23:56:57.354790+0000","last_active":"2024-09-11T23:58:02.815759+0000","last_peered":"2024-09-11T23:58:02.815759+0000","last_clean":"2024-09-11T23:58:02.815759+0000","last_became_active":"2024-09-11T23:56:57.354478+0000","last_became_peered":"2024-09-11T23:56:57.354478+0000","last_unstale":"2024-09-11T23:58:02.815759+0000","last_undegraded":"2024-09-11T23:58:02.815759+0000","last_fullsized":"2024-09-11T23:58:02.815759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:01.109689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'16","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.826957+0000","last_change":"2024-09-11T23:58:02.826957+0000","last_active":"2024-09-11T23:58:02.826957+0000","last_peered":"2024-09-11T23:58:02.826957+0000","last_clean":"2024-09-11T23:58:02.826957+0000","last_became_active":"2024-09-11T23:58:02.817510+0000","last_became_peered":"2024-09-11T23:58:02.817510+0000","last_unstale":"2024-09-11T23:58:02.826957+0000","last_undegraded":"2024-09-11T23:58:02.826957+0000","last_fullsized":"2024-09-11T23:58:02.826957+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:09.269065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814351+0000","last_change":"2024-09-11T23:57:04.417058+0000","last_active":"2024-09-11T23:58:02.814351+0000","last_peered":"2024-09-11T23:58:02.814351+0000","last_clean":"2024-09-11T23:58:02.814351+0000","last_became_active":"2024-09-11T23:57:04.416237+0000","last_became_peered":"2024-09-11T23:57:04.416237+0000","last_unstale":"2024-09-11T23:58:02.814351+0000","last_undegraded":"2024-09-11T23:58:02.814351+0000","last_fullsized":"2024-09-11T23:58:02.814351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:47.959023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816264+0000","last_change":"2024-09-11T23:56:57.343131+0000","last_active":"2024-09-11T23:58:02.816264+0000","last_peered":"2024-09-11T23:58:02.816264+0000","last_clean":"2024-09-11T23:58:02.816264+0000","last_became_active":"2024-09-11T23:56:57.342823+0000","last_became_peered":"2024-09-11T23:56:57.342823+0000","last_unstale":"2024-09-11T23:58:02.816264+0000","last_undegraded":"2024-09-11T23:58:02.816264+0000","last_fullsized":"2024-09-11T23:58:02.816264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:00.685220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.827972+0000","last_change":"2024-09-11T23:58:02.827572+0000","last_active":"2024-09-11T23:58:02.827972+0000","last_peered":"2024-09-11T23:58:02.827972+0000","last_clean":"2024-09-11T23:58:02.827972+0000","last_became_active":"2024-09-11T23:58:02.817674+0000","last_became_peered":"2024-09-11T23:58:02.817674+0000","last_unstale":"2024-09-11T23:58:02.827972+0000","last_undegraded":"2024-09-11T23:58:02.827972+0000","last_fullsized":"2024-09-11T23:58:02.827972+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:52.173564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813078+0000","last_change":"2024-09-11T23:57:04.417873+0000","last_active":"2024-09-11T23:58:02.813078+0000","last_peered":"2024-09-11T23:58:02.813078+0000","last_clean":"2024-09-11T23:58:02.813078+0000","last_became_active":"2024-09-11T23:57:04.417477+0000","last_became_peered":"2024-09-11T23:57:04.417477+0000","last_unstale":"2024-09-11T23:58:02.813078+0000","last_undegraded":"2024-09-11T23:58:02.813078+0000","last_fullsized":"2024-09-11T23:58:02.813078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:20.480850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813186+0000","last_change":"2024-09-11T23:56:57.360695+0000","last_active":"2024-09-11T23:58:02.813186+0000","last_peered":"2024-09-11T23:58:02.813186+0000","last_clean":"2024-09-11T23:58:02.813186+0000","last_became_active":"2024-09-11T23:56:57.357702+0000","last_became_peered":"2024-09-11T23:56:57.357702+0000","last_unstale":"2024-09-11T23:58:02.813186+0000","last_undegraded":"2024-09-11T23:58:02.813186+0000","last_fullsized":"2024-09-11T23:58:02.813186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:04.680682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.812341+0000","last_change":"2024-09-11T23:56:55.594503+0000","last_active":"2024-09-11T23:58:02.812341+0000","last_peered":"2024-09-11T23:58:02.812341+0000","last_clean":"2024-09-11T23:58:02.812341+0000","last_became_active":"2024-09-11T23:56:55.594155+0000","last_became_peered":"2024-09-11T23:56:55.594155+0000","last_unstale":"2024-09-11T23:58:02.812341+0000","last_undegraded":"2024-09-11T23:58:02.812341+0000","last_fullsized":"2024-09-11T23:58:02.812341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:15.181976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815830+0000","last_change":"2024-09-11T23:57:04.410696+0000","last_active":"2024-09-11T23:58:02.815830+0000","last_peered":"2024-09-11T23:58:02.815830+0000","last_clean":"2024-09-11T23:58:02.815830+0000","last_became_active":"2024-09-11T23:57:04.410281+0000","last_became_peered":"2024-09-11T23:57:04.410281+0000","last_unstale":"2024-09-11T23:58:02.815830+0000","last_undegraded":"2024-09-11T23:58:02.815830+0000","last_fullsized":"2024-09-11T23:58:02.815830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:31.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813116+0000","last_change":"2024-09-11T23:56:57.361458+0000","last_active":"2024-09-11T23:58:02.813116+0000","last_peered":"2024-09-11T23:58:02.813116+0000","last_clean":"2024-09-11T23:58:02.813116+0000","last_became_active":"2024-09-11T23:56:57.361031+0000","last_became_peered":"2024-09-11T23:56:57.361031+0000","last_unstale":"2024-09-11T23:58:02.813116+0000","last_undegraded":"2024-09-11T23:58:02.813116+0000","last_fullsized":"2024-09-11T23:58:02.813116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:23.691469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:31.146009+0000","last_change":"2024-09-11T23:56:55.276558+0000","last_active":"2024-09-11T23:58:31.146009+0000","last_peered":"2024-09-11T23:58:31.146009+0000","last_clean":"2024-09-11T23:58:31.146009+0000","last_became_active":"2024-09-11T23:56:55.276053+0000","last_became_peered":"2024-09-11T23:56:55.276053+0000","last_unstale":"2024-09-11T23:58:31.146009+0000","last_undegraded":"2024-09-11T23:58:31.146009+0000","last_fullsized":"2024-09-11T23:58:31.146009+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:57.139383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815986+0000","last_change":"2024-09-11T23:57:04.414763+0000","last_active":"2024-09-11T23:58:02.815986+0000","last_peered":"2024-09-11T23:58:02.815986+0000","last_clean":"2024-09-11T23:58:02.815986+0000","last_became_active":"2024-09-11T23:57:04.414248+0000","last_became_peered":"2024-09-11T23:57:04.414248+0000","last_unstale":"2024-09-11T23:58:02.815986+0000","last_undegraded":"2024-09-11T23:58:02.815986+0000","last_fullsized":"2024-09-11T23:58:02.815986+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.441399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817029+0000","last_change":"2024-09-11T23:56:57.351549+0000","last_active":"2024-09-11T23:58:02.817029+0000","last_peered":"2024-09-11T23:58:02.817029+0000","last_clean":"2024-09-11T23:58:02.817029+0000","last_became_active":"2024-09-11T23:56:57.351228+0000","last_became_peered":"2024-09-11T23:56:57.351228+0000","last_unstale":"2024-09-11T23:58:02.817029+0000","last_undegraded":"2024-09-11T23:58:02.817029+0000","last_fullsized":"2024-09-11T23:58:02.817029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:03.280698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":91,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:32.146986+0000","last_change":"2024-09-11T23:56:55.594392+0000","last_active":"2024-09-11T23:58:32.146986+0000","last_peered":"2024-09-11T23:58:32.146986+0000","last_clean":"2024-09-11T23:58:32.146986+0000","last_became_active":"2024-09-11T23:56:55.593620+0000","last_became_peered":"2024-09-11T23:56:55.593620+0000","last_unstale":"2024-09-11T23:58:32.146986+0000","last_undegraded":"2024-09-11T23:58:32.146986+0000","last_fullsized":"2024-09-11T23:58:32.146986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:10.110283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.823977+0000","last_change":"2024-09-11T23:58:02.823977+0000","last_active":"2024-09-11T23:58:02.823977+0000","last_peered":"2024-09-11T23:58:02.823977+0000","last_clean":"2024-09-11T23:58:02.823977+0000","last_became_active":"2024-09-11T23:58:02.823498+0000","last_became_peered":"2024-09-11T23:58:02.823498+0000","last_unstale":"2024-09-11T23:58:02.823977+0000","last_undegraded":"2024-09-11T23:58:02.823977+0000","last_fullsized":"2024-09-11T23:58:02.823977+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:02.322181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815395+0000","last_change":"2024-09-11T23:56:57.352375+0000","last_active":"2024-09-11T23:58:02.815395+0000","last_peered":"2024-09-11T23:58:02.815395+0000","last_clean":"2024-09-11T23:58:02.815395+0000","last_became_active":"2024-09-11T23:56:57.352034+0000","last_became_peered":"2024-09-11T23:56:57.352034+0000","last_unstale":"2024-09-11T23:58:02.815395+0000","last_undegraded":"2024-09-11T23:58:02.815395+0000","last_fullsized":"2024-09-11T23:58:02.815395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:02.707277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816793+0000","last_change":"2024-09-11T23:56:55.279016+0000","last_active":"2024-09-11T23:58:02.816793+0000","last_peered":"2024-09-11T23:58:02.816793+0000","last_clean":"2024-09-11T23:58:02.816793+0000","last_became_active":"2024-09-11T23:56:55.278457+0000","last_became_peered":"2024-09-11T23:56:55.278457+0000","last_unstale":"2024-09-11T23:58:02.816793+0000","last_undegraded":"2024-09-11T23:58:02.816793+0000","last_fullsized":"2024-09-11T23:58:02.816793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:35.851946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817877+0000","last_change":"2024-09-11T23:57:04.407941+0000","last_active":"2024-09-11T23:58:02.817877+0000","last_peered":"2024-09-11T23:58:02.817877+0000","last_clean":"2024-09-11T23:58:02.817877+0000","last_became_active":"2024-09-11T23:57:04.407517+0000","last_became_peered":"2024-09-11T23:57:04.407517+0000","last_unstale":"2024-09-11T23:58:02.817877+0000","last_undegraded":"2024-09-11T23:58:02.817877+0000","last_fullsized":"2024-09-11T23:58:02.817877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.781127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814774+0000","last_change":"2024-09-11T23:56:57.344419+0000","last_active":"2024-09-11T23:58:02.814774+0000","last_peered":"2024-09-11T23:58:02.814774+0000","last_clean":"2024-09-11T23:58:02.814774+0000","last_became_active":"2024-09-11T23:56:57.343893+0000","last_became_peered":"2024-09-11T23:56:57.343893+0000","last_unstale":"2024-09-11T23:58:02.814774+0000","last_undegraded":"2024-09-11T23:58:02.814774+0000","last_fullsized":"2024-09-11T23:58:02.814774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:40.888240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815417+0000","last_change":"2024-09-11T23:56:55.270056+0000","last_active":"2024-09-11T23:58:02.815417+0000","last_peered":"2024-09-11T23:58:02.815417+0000","last_clean":"2024-09-11T23:58:02.815417+0000","last_became_active":"2024-09-11T23:56:55.269689+0000","last_became_peered":"2024-09-11T23:56:55.269689+0000","last_unstale":"2024-09-11T23:58:02.815417+0000","last_undegraded":"2024-09-11T23:58:02.815417+0000","last_fullsized":"2024-09-11T23:58:02.815417+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:21.085849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":348,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817044+0000","last_change":"2024-09-11T23:55:44.130655+0000","last_active":"2024-09-11T23:58:02.817044+0000","last_peered":"2024-09-11T23:58:02.817044+0000","last_clean":"2024-09-11T23:58:02.817044+0000","last_became_active":"2024-09-11T23:55:44.130263+0000","last_became_peered":"2024-09-11T23:55:44.130263+0000","last_unstale":"2024-09-11T23:58:02.817044+0000","last_undegraded":"2024-09-11T23:58:02.817044+0000","last_fullsized":"2024-09-11T23:58:02.817044+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:17.476450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:17.476450+0000","last_clean_scrub_stamp":"2024-09-11T23:52:17.476450+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:38.754760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817234+0000","last_change":"2024-09-11T23:57:04.417259+0000","last_active":"2024-09-11T23:58:02.817234+0000","last_peered":"2024-09-11T23:58:02.817234+0000","last_clean":"2024-09-11T23:58:02.817234+0000","last_became_active":"2024-09-11T23:57:04.416729+0000","last_became_peered":"2024-09-11T23:57:04.416729+0000","last_unstale":"2024-09-11T23:58:02.817234+0000","last_undegraded":"2024-09-11T23:58:02.817234+0000","last_fullsized":"2024-09-11T23:58:02.817234+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:50.508736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817560+0000","last_change":"2024-09-11T23:56:57.362787+0000","last_active":"2024-09-11T23:58:02.817560+0000","last_peered":"2024-09-11T23:58:02.817560+0000","last_clean":"2024-09-11T23:58:02.817560+0000","last_became_active":"2024-09-11T23:56:57.362438+0000","last_became_peered":"2024-09-11T23:56:57.362438+0000","last_unstale":"2024-09-11T23:58:02.817560+0000","last_undegraded":"2024-09-11T23:58:02.817560+0000","last_fullsized":"2024-09-11T23:58:02.817560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:53.969983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:35.168693+0000","last_change":"2024-09-11T23:56:55.594525+0000","last_active":"2024-09-11T23:58:35.168693+0000","last_peered":"2024-09-11T23:58:35.168693+0000","last_clean":"2024-09-11T23:58:35.168693+0000","last_became_active":"2024-09-11T23:56:55.594187+0000","last_became_peered":"2024-09-11T23:56:55.594187+0000","last_unstale":"2024-09-11T23:58:35.168693+0000","last_undegraded":"2024-09-11T23:58:35.168693+0000","last_fullsized":"2024-09-11T23:58:35.168693+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.087663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.820058+0000","last_change":"2024-09-11T23:57:04.421266+0000","last_active":"2024-09-11T23:58:02.820058+0000","last_peered":"2024-09-11T23:58:02.820058+0000","last_clean":"2024-09-11T23:58:02.820058+0000","last_became_active":"2024-09-11T23:57:04.420212+0000","last_became_peered":"2024-09-11T23:57:04.420212+0000","last_unstale":"2024-09-11T23:58:02.820058+0000","last_undegraded":"2024-09-11T23:58:02.820058+0000","last_fullsized":"2024-09-11T23:58:02.820058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:51.532509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817200+0000","last_change":"2024-09-11T23:56:57.360393+0000","last_active":"2024-09-11T23:58:02.817200+0000","last_peered":"2024-09-11T23:58:02.817200+0000","last_clean":"2024-09-11T23:58:02.817200+0000","last_became_active":"2024-09-11T23:56:57.359996+0000","last_became_peered":"2024-09-11T23:56:57.359996+0000","last_unstale":"2024-09-11T23:58:02.817200+0000","last_undegraded":"2024-09-11T23:58:02.817200+0000","last_fullsized":"2024-09-11T23:58:02.817200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:48.325137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.818347+0000","last_change":"2024-09-11T23:56:55.273929+0000","last_active":"2024-09-11T23:58:02.818347+0000","last_peered":"2024-09-11T23:58:02.818347+0000","last_clean":"2024-09-11T23:58:02.818347+0000","last_became_active":"2024-09-11T23:56:55.273581+0000","last_became_peered":"2024-09-11T23:56:55.273581+0000","last_unstale":"2024-09-11T23:58:02.818347+0000","last_undegraded":"2024-09-11T23:58:02.818347+0000","last_fullsized":"2024-09-11T23:58:02.818347+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:26.541787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816294+0000","last_change":"2024-09-11T23:57:04.422312+0000","last_active":"2024-09-11T23:58:02.816294+0000","last_peered":"2024-09-11T23:58:02.816294+0000","last_clean":"2024-09-11T23:58:02.816294+0000","last_became_active":"2024-09-11T23:57:04.420675+0000","last_became_peered":"2024-09-11T23:57:04.420675+0000","last_unstale":"2024-09-11T23:58:02.816294+0000","last_undegraded":"2024-09-11T23:58:02.816294+0000","last_fullsized":"2024-09-11T23:58:02.816294+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:44.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817495+0000","last_change":"2024-09-11T23:56:57.359358+0000","last_active":"2024-09-11T23:58:02.817495+0000","last_peered":"2024-09-11T23:58:02.817495+0000","last_clean":"2024-09-11T23:58:02.817495+0000","last_became_active":"2024-09-11T23:56:57.358961+0000","last_became_peered":"2024-09-11T23:56:57.358961+0000","last_unstale":"2024-09-11T23:58:02.817495+0000","last_undegraded":"2024-09-11T23:58:02.817495+0000","last_fullsized":"2024-09-11T23:58:02.817495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:22.522047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.829931+0000","last_change":"2024-09-11T23:58:02.829931+0000","last_active":"2024-09-11T23:58:02.829931+0000","last_peered":"2024-09-11T23:58:02.829931+0000","last_clean":"2024-09-11T23:58:02.829931+0000","last_became_active":"2024-09-11T23:58:02.822017+0000","last_became_peered":"2024-09-11T23:58:02.822017+0000","last_unstale":"2024-09-11T23:58:02.829931+0000","last_undegraded":"2024-09-11T23:58:02.829931+0000","last_fullsized":"2024-09-11T23:58:02.829931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:44.775965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816802+0000","last_change":"2024-09-11T23:57:04.415966+0000","last_active":"2024-09-11T23:58:02.816802+0000","last_peered":"2024-09-11T23:58:02.816802+0000","last_clean":"2024-09-11T23:58:02.816802+0000","last_became_active":"2024-09-11T23:57:04.415601+0000","last_became_peered":"2024-09-11T23:57:04.415601+0000","last_unstale":"2024-09-11T23:58:02.816802+0000","last_undegraded":"2024-09-11T23:58:02.816802+0000","last_fullsized":"2024-09-11T23:58:02.816802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:46.244645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821922+0000","last_change":"2024-09-11T23:58:02.821922+0000","last_active":"2024-09-11T23:58:02.821922+0000","last_peered":"2024-09-11T23:58:02.821922+0000","last_clean":"2024-09-11T23:58:02.821922+0000","last_became_active":"2024-09-11T23:58:02.821509+0000","last_became_peered":"2024-09-11T23:58:02.821509+0000","last_unstale":"2024-09-11T23:58:02.821922+0000","last_undegraded":"2024-09-11T23:58:02.821922+0000","last_fullsized":"2024-09-11T23:58:02.821922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:43.955746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817371+0000","last_change":"2024-09-11T23:56:55.271043+0000","last_active":"2024-09-11T23:58:02.817371+0000","last_peered":"2024-09-11T23:58:02.817371+0000","last_clean":"2024-09-11T23:58:02.817371+0000","last_became_active":"2024-09-11T23:56:55.270748+0000","last_became_peered":"2024-09-11T23:56:55.270748+0000","last_unstale":"2024-09-11T23:58:02.817371+0000","last_undegraded":"2024-09-11T23:58:02.817371+0000","last_fullsized":"2024-09-11T23:58:02.817371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:08.776139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817264+0000","last_change":"2024-09-11T23:57:04.421448+0000","last_active":"2024-09-11T23:58:02.817264+0000","last_peered":"2024-09-11T23:58:02.817264+0000","last_clean":"2024-09-11T23:58:02.817264+0000","last_became_active":"2024-09-11T23:57:04.421000+0000","last_became_peered":"2024-09-11T23:57:04.421000+0000","last_unstale":"2024-09-11T23:58:02.817264+0000","last_undegraded":"2024-09-11T23:58:02.817264+0000","last_fullsized":"2024-09-11T23:58:02.817264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:23.342301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817425+0000","last_change":"2024-09-11T23:56:57.360104+0000","last_active":"2024-09-11T23:58:02.817425+0000","last_peered":"2024-09-11T23:58:02.817425+0000","last_clean":"2024-09-11T23:58:02.817425+0000","last_became_active":"2024-09-11T23:56:57.359773+0000","last_became_peered":"2024-09-11T23:56:57.359773+0000","last_unstale":"2024-09-11T23:58:02.817425+0000","last_undegraded":"2024-09-11T23:58:02.817425+0000","last_fullsized":"2024-09-11T23:58:02.817425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:05.566675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815686+0000","last_change":"2024-09-11T23:56:55.594731+0000","last_active":"2024-09-11T23:58:02.815686+0000","last_peered":"2024-09-11T23:58:02.815686+0000","last_clean":"2024-09-11T23:58:02.815686+0000","last_became_active":"2024-09-11T23:56:55.594095+0000","last_became_peered":"2024-09-11T23:56:55.594095+0000","last_unstale":"2024-09-11T23:58:02.815686+0000","last_undegraded":"2024-09-11T23:58:02.815686+0000","last_fullsized":"2024-09-11T23:58:02.815686+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:44.847662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817125+0000","last_change":"2024-09-11T23:57:04.413252+0000","last_active":"2024-09-11T23:58:02.817125+0000","last_peered":"2024-09-11T23:58:02.817125+0000","last_clean":"2024-09-11T23:58:02.817125+0000","last_became_active":"2024-09-11T23:57:04.412887+0000","last_became_peered":"2024-09-11T23:57:04.412887+0000","last_unstale":"2024-09-11T23:58:02.817125+0000","last_undegraded":"2024-09-11T23:58:02.817125+0000","last_fullsized":"2024-09-11T23:58:02.817125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:38.778093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816585+0000","last_change":"2024-09-11T23:56:57.354309+0000","last_active":"2024-09-11T23:58:02.816585+0000","last_peered":"2024-09-11T23:58:02.816585+0000","last_clean":"2024-09-11T23:58:02.816585+0000","last_became_active":"2024-09-11T23:56:57.353987+0000","last_became_peered":"2024-09-11T23:56:57.353987+0000","last_unstale":"2024-09-11T23:58:02.816585+0000","last_undegraded":"2024-09-11T23:58:02.816585+0000","last_fullsized":"2024-09-11T23:58:02.816585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:02.248741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:32.147549+0000","last_change":"2024-09-11T23:56:55.271531+0000","last_active":"2024-09-11T23:58:32.147549+0000","last_peered":"2024-09-11T23:58:32.147549+0000","last_clean":"2024-09-11T23:58:32.147549+0000","last_became_active":"2024-09-11T23:56:55.271150+0000","last_became_peered":"2024-09-11T23:56:55.271150+0000","last_unstale":"2024-09-11T23:58:32.147549+0000","last_undegraded":"2024-09-11T23:58:32.147549+0000","last_fullsized":"2024-09-11T23:58:32.147549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:31.885885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.812643+0000","last_change":"2024-09-11T23:57:04.415610+0000","last_active":"2024-09-11T23:58:02.812643+0000","last_peered":"2024-09-11T23:58:02.812643+0000","last_clean":"2024-09-11T23:58:02.812643+0000","last_became_active":"2024-09-11T23:57:04.415168+0000","last_became_peered":"2024-09-11T23:57:04.415168+0000","last_unstale":"2024-09-11T23:58:02.812643+0000","last_undegraded":"2024-09-11T23:58:02.812643+0000","last_fullsized":"2024-09-11T23:58:02.812643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:34.688002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817081+0000","last_change":"2024-09-11T23:56:57.359960+0000","last_active":"2024-09-11T23:58:02.817081+0000","last_peered":"2024-09-11T23:58:02.817081+0000","last_clean":"2024-09-11T23:58:02.817081+0000","last_became_active":"2024-09-11T23:56:57.359417+0000","last_became_peered":"2024-09-11T23:56:57.359417+0000","last_unstale":"2024-09-11T23:58:02.817081+0000","last_undegraded":"2024-09-11T23:58:02.817081+0000","last_fullsized":"2024-09-11T23:58:02.817081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:18.741920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817801+0000","last_change":"2024-09-11T23:56:55.272561+0000","last_active":"2024-09-11T23:58:02.817801+0000","last_peered":"2024-09-11T23:58:02.817801+0000","last_clean":"2024-09-11T23:58:02.817801+0000","last_became_active":"2024-09-11T23:56:55.272221+0000","last_became_peered":"2024-09-11T23:56:55.272221+0000","last_unstale":"2024-09-11T23:58:02.817801+0000","last_undegraded":"2024-09-11T23:58:02.817801+0000","last_fullsized":"2024-09-11T23:58:02.817801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:22.151044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.819543+0000","last_change":"2024-09-11T23:58:02.819543+0000","last_active":"2024-09-11T23:58:02.819543+0000","last_peered":"2024-09-11T23:58:02.819543+0000","last_clean":"2024-09-11T23:58:02.819543+0000","last_became_active":"2024-09-11T23:58:02.819058+0000","last_became_peered":"2024-09-11T23:58:02.819058+0000","last_unstale":"2024-09-11T23:58:02.819543+0000","last_undegraded":"2024-09-11T23:58:02.819543+0000","last_fullsized":"2024-09-11T23:58:02.819543+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:58.852592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,7,6],"acting":[11,10,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815919+0000","last_change":"2024-09-11T23:56:57.352008+0000","last_active":"2024-09-11T23:58:02.815919+0000","last_peered":"2024-09-11T23:58:02.815919+0000","last_clean":"2024-09-11T23:58:02.815919+0000","last_became_active":"2024-09-11T23:56:57.351708+0000","last_became_peered":"2024-09-11T23:56:57.351708+0000","last_unstale":"2024-09-11T23:58:02.815919+0000","last_undegraded":"2024-09-11T23:58:02.815919+0000","last_fullsized":"2024-09-11T23:58:02.815919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:50.908059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.822084+0000","last_change":"2024-09-11T23:56:55.275755+0000","last_active":"2024-09-11T23:58:02.822084+0000","last_peered":"2024-09-11T23:58:02.822084+0000","last_clean":"2024-09-11T23:58:02.822084+0000","last_became_active":"2024-09-11T23:56:55.275247+0000","last_became_peered":"2024-09-11T23:56:55.275247+0000","last_unstale":"2024-09-11T23:58:02.822084+0000","last_undegraded":"2024-09-11T23:58:02.822084+0000","last_fullsized":"2024-09-11T23:58:02.822084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:43.698490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817941+0000","last_change":"2024-09-11T23:57:04.412237+0000","last_active":"2024-09-11T23:58:02.817941+0000","last_peered":"2024-09-11T23:58:02.817941+0000","last_clean":"2024-09-11T23:58:02.817941+0000","last_became_active":"2024-09-11T23:57:04.411799+0000","last_became_peered":"2024-09-11T23:57:04.411799+0000","last_unstale":"2024-09-11T23:58:02.817941+0000","last_undegraded":"2024-09-11T23:58:02.817941+0000","last_fullsized":"2024-09-11T23:58:02.817941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:19.311875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815973+0000","last_change":"2024-09-11T23:56:57.357667+0000","last_active":"2024-09-11T23:58:02.815973+0000","last_peered":"2024-09-11T23:58:02.815973+0000","last_clean":"2024-09-11T23:58:02.815973+0000","last_became_active":"2024-09-11T23:56:57.356796+0000","last_became_peered":"2024-09-11T23:56:57.356796+0000","last_unstale":"2024-09-11T23:58:02.815973+0000","last_undegraded":"2024-09-11T23:58:02.815973+0000","last_fullsized":"2024-09-11T23:58:02.815973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:46.220102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'34","reported_seq":182,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:35.155058+0000","last_change":"2024-09-11T23:56:55.276168+0000","last_active":"2024-09-11T23:58:35.155058+0000","last_peered":"2024-09-11T23:58:35.155058+0000","last_clean":"2024-09-11T23:58:35.155058+0000","last_became_active":"2024-09-11T23:56:55.275719+0000","last_became_peered":"2024-09-11T23:56:55.275719+0000","last_unstale":"2024-09-11T23:58:35.155058+0000","last_undegraded":"2024-09-11T23:58:35.155058+0000","last_fullsized":"2024-09-11T23:58:35.155058+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:28.846711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62931,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":115,"num_read_kb":118,"num_write":36,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.812085+0000","last_change":"2024-09-11T23:57:04.412804+0000","last_active":"2024-09-11T23:58:02.812085+0000","last_peered":"2024-09-11T23:58:02.812085+0000","last_clean":"2024-09-11T23:58:02.812085+0000","last_became_active":"2024-09-11T23:57:04.412366+0000","last_became_peered":"2024-09-11T23:57:04.412366+0000","last_unstale":"2024-09-11T23:58:02.812085+0000","last_undegraded":"2024-09-11T23:58:02.812085+0000","last_fullsized":"2024-09-11T23:58:02.812085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.924598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.820237+0000","last_change":"2024-09-11T23:56:57.357530+0000","last_active":"2024-09-11T23:58:02.820237+0000","last_peered":"2024-09-11T23:58:02.820237+0000","last_clean":"2024-09-11T23:58:02.820237+0000","last_became_active":"2024-09-11T23:56:57.356306+0000","last_became_peered":"2024-09-11T23:56:57.356306+0000","last_unstale":"2024-09-11T23:58:02.820237+0000","last_undegraded":"2024-09-11T23:58:02.820237+0000","last_fullsized":"2024-09-11T23:58:02.820237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:10.919120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.818235+0000","last_change":"2024-09-11T23:56:55.594653+0000","last_active":"2024-09-11T23:58:02.818235+0000","last_peered":"2024-09-11T23:58:02.818235+0000","last_clean":"2024-09-11T23:58:02.818235+0000","last_became_active":"2024-09-11T23:56:55.594219+0000","last_became_peered":"2024-09-11T23:56:55.594219+0000","last_unstale":"2024-09-11T23:58:02.818235+0000","last_undegraded":"2024-09-11T23:58:02.818235+0000","last_fullsized":"2024-09-11T23:58:02.818235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:54.361656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815293+0000","last_change":"2024-09-11T23:57:04.422049+0000","last_active":"2024-09-11T23:58:02.815293+0000","last_peered":"2024-09-11T23:58:02.815293+0000","last_clean":"2024-09-11T23:58:02.815293+0000","last_became_active":"2024-09-11T23:57:04.420845+0000","last_became_peered":"2024-09-11T23:57:04.420845+0000","last_unstale":"2024-09-11T23:58:02.815293+0000","last_undegraded":"2024-09-11T23:58:02.815293+0000","last_fullsized":"2024-09-11T23:58:02.815293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:49.854740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816885+0000","last_change":"2024-09-11T23:56:57.362523+0000","last_active":"2024-09-11T23:58:02.816885+0000","last_peered":"2024-09-11T23:58:02.816885+0000","last_clean":"2024-09-11T23:58:02.816885+0000","last_became_active":"2024-09-11T23:56:57.361361+0000","last_became_peered":"2024-09-11T23:56:57.361361+0000","last_unstale":"2024-09-11T23:58:02.816885+0000","last_undegraded":"2024-09-11T23:58:02.816885+0000","last_fullsized":"2024-09-11T23:58:02.816885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:57.341557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.833430+0000","last_change":"2024-09-11T23:58:02.833430+0000","last_active":"2024-09-11T23:58:02.833430+0000","last_peered":"2024-09-11T23:58:02.833430+0000","last_clean":"2024-09-11T23:58:02.833430+0000","last_became_active":"2024-09-11T23:58:02.822558+0000","last_became_peered":"2024-09-11T23:58:02.822558+0000","last_unstale":"2024-09-11T23:58:02.833430+0000","last_undegraded":"2024-09-11T23:58:02.833430+0000","last_fullsized":"2024-09-11T23:58:02.833430+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:45.815627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.811877+0000","last_change":"2024-09-11T23:57:04.419006+0000","last_active":"2024-09-11T23:58:02.811877+0000","last_peered":"2024-09-11T23:58:02.811877+0000","last_clean":"2024-09-11T23:58:02.811877+0000","last_became_active":"2024-09-11T23:57:04.418638+0000","last_became_peered":"2024-09-11T23:57:04.418638+0000","last_unstale":"2024-09-11T23:58:02.811877+0000","last_undegraded":"2024-09-11T23:58:02.811877+0000","last_fullsized":"2024-09-11T23:58:02.811877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:22.458414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821439+0000","last_change":"2024-09-11T23:56:57.354481+0000","last_active":"2024-09-11T23:58:02.821439+0000","last_peered":"2024-09-11T23:58:02.821439+0000","last_clean":"2024-09-11T23:58:02.821439+0000","last_became_active":"2024-09-11T23:56:57.354158+0000","last_became_peered":"2024-09-11T23:56:57.354158+0000","last_unstale":"2024-09-11T23:58:02.821439+0000","last_undegraded":"2024-09-11T23:58:02.821439+0000","last_fullsized":"2024-09-11T23:58:02.821439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:58.372231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:35.155157+0000","last_change":"2024-09-11T23:56:55.275767+0000","last_active":"2024-09-11T23:58:35.155157+0000","last_peered":"2024-09-11T23:58:35.155157+0000","last_clean":"2024-09-11T23:58:35.155157+0000","last_became_active":"2024-09-11T23:56:55.275284+0000","last_became_peered":"2024-09-11T23:56:55.275284+0000","last_unstale":"2024-09-11T23:58:35.155157+0000","last_undegraded":"2024-09-11T23:58:35.155157+0000","last_fullsized":"2024-09-11T23:58:35.155157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:32.278786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815127+0000","last_change":"2024-09-11T23:57:04.421329+0000","last_active":"2024-09-11T23:58:02.815127+0000","last_peered":"2024-09-11T23:58:02.815127+0000","last_clean":"2024-09-11T23:58:02.815127+0000","last_became_active":"2024-09-11T23:57:04.420982+0000","last_became_peered":"2024-09-11T23:57:04.420982+0000","last_unstale":"2024-09-11T23:58:02.815127+0000","last_undegraded":"2024-09-11T23:58:02.815127+0000","last_fullsized":"2024-09-11T23:58:02.815127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.580115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816047+0000","last_change":"2024-09-11T23:57:04.419497+0000","last_active":"2024-09-11T23:58:02.816047+0000","last_peered":"2024-09-11T23:58:02.816047+0000","last_clean":"2024-09-11T23:58:02.816047+0000","last_became_active":"2024-09-11T23:57:04.418877+0000","last_became_peered":"2024-09-11T23:57:04.418877+0000","last_unstale":"2024-09-11T23:58:02.816047+0000","last_undegraded":"2024-09-11T23:58:02.816047+0000","last_fullsized":"2024-09-11T23:58:02.816047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:30.895439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.811991+0000","last_change":"2024-09-11T23:56:57.354086+0000","last_active":"2024-09-11T23:58:02.811991+0000","last_peered":"2024-09-11T23:58:02.811991+0000","last_clean":"2024-09-11T23:58:02.811991+0000","last_became_active":"2024-09-11T23:56:57.353733+0000","last_became_peered":"2024-09-11T23:56:57.353733+0000","last_unstale":"2024-09-11T23:58:02.811991+0000","last_undegraded":"2024-09-11T23:58:02.811991+0000","last_fullsized":"2024-09-11T23:58:02.811991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:55.169463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817179+0000","last_change":"2024-09-11T23:56:55.275441+0000","last_active":"2024-09-11T23:58:02.817179+0000","last_peered":"2024-09-11T23:58:02.817179+0000","last_clean":"2024-09-11T23:58:02.817179+0000","last_became_active":"2024-09-11T23:56:55.275109+0000","last_became_peered":"2024-09-11T23:56:55.275109+0000","last_unstale":"2024-09-11T23:58:02.817179+0000","last_undegraded":"2024-09-11T23:58:02.817179+0000","last_fullsized":"2024-09-11T23:58:02.817179+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:47.462579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813303+0000","last_change":"2024-09-11T23:57:04.419592+0000","last_active":"2024-09-11T23:58:02.813303+0000","last_peered":"2024-09-11T23:58:02.813303+0000","last_clean":"2024-09-11T23:58:02.813303+0000","last_became_active":"2024-09-11T23:57:04.419124+0000","last_became_peered":"2024-09-11T23:57:04.419124+0000","last_unstale":"2024-09-11T23:58:02.813303+0000","last_undegraded":"2024-09-11T23:58:02.813303+0000","last_fullsized":"2024-09-11T23:58:02.813303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:19.129975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814619+0000","last_change":"2024-09-11T23:56:57.350413+0000","last_active":"2024-09-11T23:58:02.814619+0000","last_peered":"2024-09-11T23:58:02.814619+0000","last_clean":"2024-09-11T23:58:02.814619+0000","last_became_active":"2024-09-11T23:56:57.350094+0000","last_became_peered":"2024-09-11T23:56:57.350094+0000","last_unstale":"2024-09-11T23:58:02.814619+0000","last_undegraded":"2024-09-11T23:58:02.814619+0000","last_fullsized":"2024-09-11T23:58:02.814619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:30.806452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815503+0000","last_change":"2024-09-11T23:56:55.265370+0000","last_active":"2024-09-11T23:58:02.815503+0000","last_peered":"2024-09-11T23:58:02.815503+0000","last_clean":"2024-09-11T23:58:02.815503+0000","last_became_active":"2024-09-11T23:56:55.265025+0000","last_became_peered":"2024-09-11T23:56:55.265025+0000","last_unstale":"2024-09-11T23:58:02.815503+0000","last_undegraded":"2024-09-11T23:58:02.815503+0000","last_fullsized":"2024-09-11T23:58:02.815503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.583397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813127+0000","last_change":"2024-09-11T23:56:55.276989+0000","last_active":"2024-09-11T23:58:02.813127+0000","last_peered":"2024-09-11T23:58:02.813127+0000","last_clean":"2024-09-11T23:58:02.813127+0000","last_became_active":"2024-09-11T23:56:55.276612+0000","last_became_peered":"2024-09-11T23:56:55.276612+0000","last_unstale":"2024-09-11T23:58:02.813127+0000","last_undegraded":"2024-09-11T23:58:02.813127+0000","last_fullsized":"2024-09-11T23:58:02.813127+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:28.708643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.818635+0000","last_change":"2024-09-11T23:56:57.355005+0000","last_active":"2024-09-11T23:58:02.818635+0000","last_peered":"2024-09-11T23:58:02.818635+0000","last_clean":"2024-09-11T23:58:02.818635+0000","last_became_active":"2024-09-11T23:56:57.354690+0000","last_became_peered":"2024-09-11T23:56:57.354690+0000","last_unstale":"2024-09-11T23:58:02.818635+0000","last_undegraded":"2024-09-11T23:58:02.818635+0000","last_fullsized":"2024-09-11T23:58:02.818635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:49.058770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.822225+0000","last_change":"2024-09-11T23:57:04.415317+0000","last_active":"2024-09-11T23:58:02.822225+0000","last_peered":"2024-09-11T23:58:02.822225+0000","last_clean":"2024-09-11T23:58:02.822225+0000","last_became_active":"2024-09-11T23:57:04.413239+0000","last_became_peered":"2024-09-11T23:57:04.413239+0000","last_unstale":"2024-09-11T23:58:02.822225+0000","last_undegraded":"2024-09-11T23:58:02.822225+0000","last_fullsized":"2024-09-11T23:58:02.822225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:19.266871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":90,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:31.150388+0000","last_change":"2024-09-11T23:56:55.274372+0000","last_active":"2024-09-11T23:58:31.150388+0000","last_peered":"2024-09-11T23:58:31.150388+0000","last_clean":"2024-09-11T23:58:31.150388+0000","last_became_active":"2024-09-11T23:56:55.273984+0000","last_became_peered":"2024-09-11T23:56:55.273984+0000","last_unstale":"2024-09-11T23:58:31.150388+0000","last_undegraded":"2024-09-11T23:58:31.150388+0000","last_fullsized":"2024-09-11T23:58:31.150388+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:54.254547+0000","last_clean_scrub_stamp":"2024-09-11T23:56:54.254547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:15.853467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816032+0000","last_change":"2024-09-11T23:56:57.344571+0000","last_active":"2024-09-11T23:58:02.816032+0000","last_peered":"2024-09-11T23:58:02.816032+0000","last_clean":"2024-09-11T23:58:02.816032+0000","last_became_active":"2024-09-11T23:56:57.344228+0000","last_became_peered":"2024-09-11T23:56:57.344228+0000","last_unstale":"2024-09-11T23:58:02.816032+0000","last_undegraded":"2024-09-11T23:58:02.816032+0000","last_fullsized":"2024-09-11T23:58:02.816032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:32.712464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821974+0000","last_change":"2024-09-11T23:57:04.418807+0000","last_active":"2024-09-11T23:58:02.821974+0000","last_peered":"2024-09-11T23:58:02.821974+0000","last_clean":"2024-09-11T23:58:02.821974+0000","last_became_active":"2024-09-11T23:57:04.418303+0000","last_became_peered":"2024-09-11T23:57:04.418303+0000","last_unstale":"2024-09-11T23:58:02.821974+0000","last_undegraded":"2024-09-11T23:58:02.821974+0000","last_fullsized":"2024-09-11T23:58:02.821974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:03.391948+0000","last_clean_scrub_stamp":"2024-09-11T23:57:03.391948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:29.722073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813000+0000","last_change":"2024-09-11T23:56:57.351734+0000","last_active":"2024-09-11T23:58:02.813000+0000","last_peered":"2024-09-11T23:58:02.813000+0000","last_clean":"2024-09-11T23:58:02.813000+0000","last_became_active":"2024-09-11T23:56:57.351386+0000","last_became_peered":"2024-09-11T23:56:57.351386+0000","last_unstale":"2024-09-11T23:58:02.813000+0000","last_undegraded":"2024-09-11T23:58:02.813000+0000","last_fullsized":"2024-09-11T23:58:02.813000+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.091137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821724+0000","last_change":"2024-09-11T23:56:57.354720+0000","last_active":"2024-09-11T23:58:02.821724+0000","last_peered":"2024-09-11T23:58:02.821724+0000","last_clean":"2024-09-11T23:58:02.821724+0000","last_became_active":"2024-09-11T23:56:57.353815+0000","last_became_peered":"2024-09-11T23:56:57.353815+0000","last_unstale":"2024-09-11T23:58:02.821724+0000","last_undegraded":"2024-09-11T23:58:02.821724+0000","last_fullsized":"2024-09-11T23:58:02.821724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:30.516912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821725+0000","last_change":"2024-09-11T23:56:57.359290+0000","last_active":"2024-09-11T23:58:02.821725+0000","last_peered":"2024-09-11T23:58:02.821725+0000","last_clean":"2024-09-11T23:58:02.821725+0000","last_became_active":"2024-09-11T23:56:57.358953+0000","last_became_peered":"2024-09-11T23:56:57.358953+0000","last_unstale":"2024-09-11T23:58:02.821725+0000","last_undegraded":"2024-09-11T23:58:02.821725+0000","last_fullsized":"2024-09-11T23:58:02.821725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:24.894051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816318+0000","last_change":"2024-09-11T23:56:57.363571+0000","last_active":"2024-09-11T23:58:02.816318+0000","last_peered":"2024-09-11T23:58:02.816318+0000","last_clean":"2024-09-11T23:58:02.816318+0000","last_became_active":"2024-09-11T23:56:57.361844+0000","last_became_peered":"2024-09-11T23:56:57.361844+0000","last_unstale":"2024-09-11T23:58:02.816318+0000","last_undegraded":"2024-09-11T23:58:02.816318+0000","last_fullsized":"2024-09-11T23:58:02.816318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:22.693387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816168+0000","last_change":"2024-09-11T23:56:57.359850+0000","last_active":"2024-09-11T23:58:02.816168+0000","last_peered":"2024-09-11T23:58:02.816168+0000","last_clean":"2024-09-11T23:58:02.816168+0000","last_became_active":"2024-09-11T23:56:57.359560+0000","last_became_peered":"2024-09-11T23:56:57.359560+0000","last_unstale":"2024-09-11T23:58:02.816168+0000","last_undegraded":"2024-09-11T23:58:02.816168+0000","last_fullsized":"2024-09-11T23:58:02.816168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:33.015625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813958+0000","last_change":"2024-09-11T23:56:57.352870+0000","last_active":"2024-09-11T23:58:02.813958+0000","last_peered":"2024-09-11T23:58:02.813958+0000","last_clean":"2024-09-11T23:58:02.813958+0000","last_became_active":"2024-09-11T23:56:57.351427+0000","last_became_peered":"2024-09-11T23:56:57.351427+0000","last_unstale":"2024-09-11T23:58:02.813958+0000","last_undegraded":"2024-09-11T23:58:02.813958+0000","last_fullsized":"2024-09-11T23:58:02.813958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:11.895482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.820335+0000","last_change":"2024-09-11T23:56:57.349609+0000","last_active":"2024-09-11T23:58:02.820335+0000","last_peered":"2024-09-11T23:58:02.820335+0000","last_clean":"2024-09-11T23:58:02.820335+0000","last_became_active":"2024-09-11T23:56:57.349307+0000","last_became_peered":"2024-09-11T23:56:57.349307+0000","last_unstale":"2024-09-11T23:58:02.820335+0000","last_undegraded":"2024-09-11T23:58:02.820335+0000","last_fullsized":"2024-09-11T23:58:02.820335+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:49.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815659+0000","last_change":"2024-09-11T23:56:57.357093+0000","last_active":"2024-09-11T23:58:02.815659+0000","last_peered":"2024-09-11T23:58:02.815659+0000","last_clean":"2024-09-11T23:58:02.815659+0000","last_became_active":"2024-09-11T23:56:57.356313+0000","last_became_peered":"2024-09-11T23:56:57.356313+0000","last_unstale":"2024-09-11T23:58:02.815659+0000","last_undegraded":"2024-09-11T23:58:02.815659+0000","last_fullsized":"2024-09-11T23:58:02.815659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:00.861920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816991+0000","last_change":"2024-09-11T23:56:57.345499+0000","last_active":"2024-09-11T23:58:02.816991+0000","last_peered":"2024-09-11T23:58:02.816991+0000","last_clean":"2024-09-11T23:58:02.816991+0000","last_became_active":"2024-09-11T23:56:57.345186+0000","last_became_peered":"2024-09-11T23:56:57.345186+0000","last_unstale":"2024-09-11T23:58:02.816991+0000","last_undegraded":"2024-09-11T23:58:02.816991+0000","last_fullsized":"2024-09-11T23:58:02.816991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:27.680578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814777+0000","last_change":"2024-09-11T23:56:57.351242+0000","last_active":"2024-09-11T23:58:02.814777+0000","last_peered":"2024-09-11T23:58:02.814777+0000","last_clean":"2024-09-11T23:58:02.814777+0000","last_became_active":"2024-09-11T23:56:57.350948+0000","last_became_peered":"2024-09-11T23:56:57.350948+0000","last_unstale":"2024-09-11T23:58:02.814777+0000","last_undegraded":"2024-09-11T23:58:02.814777+0000","last_fullsized":"2024-09-11T23:58:02.814777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:29.979795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.820320+0000","last_change":"2024-09-11T23:56:57.355967+0000","last_active":"2024-09-11T23:58:02.820320+0000","last_peered":"2024-09-11T23:58:02.820320+0000","last_clean":"2024-09-11T23:58:02.820320+0000","last_became_active":"2024-09-11T23:56:57.355437+0000","last_became_peered":"2024-09-11T23:56:57.355437+0000","last_unstale":"2024-09-11T23:58:02.820320+0000","last_undegraded":"2024-09-11T23:58:02.820320+0000","last_fullsized":"2024-09-11T23:58:02.820320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:19.701339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816919+0000","last_change":"2024-09-11T23:56:57.361097+0000","last_active":"2024-09-11T23:58:02.816919+0000","last_peered":"2024-09-11T23:58:02.816919+0000","last_clean":"2024-09-11T23:58:02.816919+0000","last_became_active":"2024-09-11T23:56:57.360700+0000","last_became_peered":"2024-09-11T23:56:57.360700+0000","last_unstale":"2024-09-11T23:58:02.816919+0000","last_undegraded":"2024-09-11T23:58:02.816919+0000","last_fullsized":"2024-09-11T23:58:02.816919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:39.006911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814192+0000","last_change":"2024-09-11T23:56:57.356233+0000","last_active":"2024-09-11T23:58:02.814192+0000","last_peered":"2024-09-11T23:58:02.814192+0000","last_clean":"2024-09-11T23:58:02.814192+0000","last_became_active":"2024-09-11T23:56:57.354705+0000","last_became_peered":"2024-09-11T23:56:57.354705+0000","last_unstale":"2024-09-11T23:58:02.814192+0000","last_undegraded":"2024-09-11T23:58:02.814192+0000","last_fullsized":"2024-09-11T23:58:02.814192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:35.039827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.822155+0000","last_change":"2024-09-11T23:56:57.357881+0000","last_active":"2024-09-11T23:58:02.822155+0000","last_peered":"2024-09-11T23:58:02.822155+0000","last_clean":"2024-09-11T23:58:02.822155+0000","last_became_active":"2024-09-11T23:56:57.357486+0000","last_became_peered":"2024-09-11T23:56:57.357486+0000","last_unstale":"2024-09-11T23:58:02.822155+0000","last_undegraded":"2024-09-11T23:58:02.822155+0000","last_fullsized":"2024-09-11T23:58:02.822155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:24.049072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.812522+0000","last_change":"2024-09-11T23:56:57.355307+0000","last_active":"2024-09-11T23:58:02.812522+0000","last_peered":"2024-09-11T23:58:02.812522+0000","last_clean":"2024-09-11T23:58:02.812522+0000","last_became_active":"2024-09-11T23:56:57.354957+0000","last_became_peered":"2024-09-11T23:56:57.354957+0000","last_unstale":"2024-09-11T23:58:02.812522+0000","last_undegraded":"2024-09-11T23:58:02.812522+0000","last_fullsized":"2024-09-11T23:58:02.812522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:00.217654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813698+0000","last_change":"2024-09-11T23:56:57.361516+0000","last_active":"2024-09-11T23:58:02.813698+0000","last_peered":"2024-09-11T23:58:02.813698+0000","last_clean":"2024-09-11T23:58:02.813698+0000","last_became_active":"2024-09-11T23:56:57.361112+0000","last_became_peered":"2024-09-11T23:56:57.361112+0000","last_unstale":"2024-09-11T23:58:02.813698+0000","last_undegraded":"2024-09-11T23:58:02.813698+0000","last_fullsized":"2024-09-11T23:58:02.813698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:48.861534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.819718+0000","last_change":"2024-09-11T23:56:57.357251+0000","last_active":"2024-09-11T23:58:02.819718+0000","last_peered":"2024-09-11T23:58:02.819718+0000","last_clean":"2024-09-11T23:58:02.819718+0000","last_became_active":"2024-09-11T23:56:57.356932+0000","last_became_peered":"2024-09-11T23:56:57.356932+0000","last_unstale":"2024-09-11T23:58:02.819718+0000","last_undegraded":"2024-09-11T23:58:02.819718+0000","last_fullsized":"2024-09-11T23:58:02.819718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:10.650294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816550+0000","last_change":"2024-09-11T23:56:57.360671+0000","last_active":"2024-09-11T23:58:02.816550+0000","last_peered":"2024-09-11T23:58:02.816550+0000","last_clean":"2024-09-11T23:58:02.816550+0000","last_became_active":"2024-09-11T23:56:57.360351+0000","last_became_peered":"2024-09-11T23:56:57.360351+0000","last_unstale":"2024-09-11T23:58:02.816550+0000","last_undegraded":"2024-09-11T23:58:02.816550+0000","last_fullsized":"2024-09-11T23:58:02.816550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:18.895549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816132+0000","last_change":"2024-09-11T23:56:57.363379+0000","last_active":"2024-09-11T23:58:02.816132+0000","last_peered":"2024-09-11T23:58:02.816132+0000","last_clean":"2024-09-11T23:58:02.816132+0000","last_became_active":"2024-09-11T23:56:57.362652+0000","last_became_peered":"2024-09-11T23:56:57.362652+0000","last_unstale":"2024-09-11T23:58:02.816132+0000","last_undegraded":"2024-09-11T23:58:02.816132+0000","last_fullsized":"2024-09-11T23:58:02.816132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:16.298532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816832+0000","last_change":"2024-09-11T23:56:57.347580+0000","last_active":"2024-09-11T23:58:02.816832+0000","last_peered":"2024-09-11T23:58:02.816832+0000","last_clean":"2024-09-11T23:58:02.816832+0000","last_became_active":"2024-09-11T23:56:57.347276+0000","last_became_peered":"2024-09-11T23:56:57.347276+0000","last_unstale":"2024-09-11T23:58:02.816832+0000","last_undegraded":"2024-09-11T23:58:02.816832+0000","last_fullsized":"2024-09-11T23:58:02.816832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:14.543167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814758+0000","last_change":"2024-09-11T23:56:57.352544+0000","last_active":"2024-09-11T23:58:02.814758+0000","last_peered":"2024-09-11T23:58:02.814758+0000","last_clean":"2024-09-11T23:58:02.814758+0000","last_became_active":"2024-09-11T23:56:57.351672+0000","last_became_peered":"2024-09-11T23:56:57.351672+0000","last_unstale":"2024-09-11T23:58:02.814758+0000","last_undegraded":"2024-09-11T23:58:02.814758+0000","last_fullsized":"2024-09-11T23:58:02.814758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.097494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.817491+0000","last_change":"2024-09-11T23:56:57.360698+0000","last_active":"2024-09-11T23:58:02.817491+0000","last_peered":"2024-09-11T23:58:02.817491+0000","last_clean":"2024-09-11T23:58:02.817491+0000","last_became_active":"2024-09-11T23:56:57.360257+0000","last_became_peered":"2024-09-11T23:56:57.360257+0000","last_unstale":"2024-09-11T23:58:02.817491+0000","last_undegraded":"2024-09-11T23:58:02.817491+0000","last_fullsized":"2024-09-11T23:58:02.817491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:23.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813632+0000","last_change":"2024-09-11T23:56:57.354301+0000","last_active":"2024-09-11T23:58:02.813632+0000","last_peered":"2024-09-11T23:58:02.813632+0000","last_clean":"2024-09-11T23:58:02.813632+0000","last_became_active":"2024-09-11T23:56:57.353936+0000","last_became_peered":"2024-09-11T23:56:57.353936+0000","last_unstale":"2024-09-11T23:58:02.813632+0000","last_undegraded":"2024-09-11T23:58:02.813632+0000","last_fullsized":"2024-09-11T23:58:02.813632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:05.420546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.821582+0000","last_change":"2024-09-11T23:56:57.352615+0000","last_active":"2024-09-11T23:58:02.821582+0000","last_peered":"2024-09-11T23:58:02.821582+0000","last_clean":"2024-09-11T23:58:02.821582+0000","last_became_active":"2024-09-11T23:56:57.352249+0000","last_became_peered":"2024-09-11T23:56:57.352249+0000","last_unstale":"2024-09-11T23:58:02.821582+0000","last_undegraded":"2024-09-11T23:58:02.821582+0000","last_fullsized":"2024-09-11T23:58:02.821582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:18.477555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814504+0000","last_change":"2024-09-11T23:56:57.346309+0000","last_active":"2024-09-11T23:58:02.814504+0000","last_peered":"2024-09-11T23:58:02.814504+0000","last_clean":"2024-09-11T23:58:02.814504+0000","last_became_active":"2024-09-11T23:56:57.345943+0000","last_became_peered":"2024-09-11T23:56:57.345943+0000","last_unstale":"2024-09-11T23:58:02.814504+0000","last_undegraded":"2024-09-11T23:58:02.814504+0000","last_fullsized":"2024-09-11T23:58:02.814504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:20.142093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816859+0000","last_change":"2024-09-11T23:56:57.359749+0000","last_active":"2024-09-11T23:58:02.816859+0000","last_peered":"2024-09-11T23:58:02.816859+0000","last_clean":"2024-09-11T23:58:02.816859+0000","last_became_active":"2024-09-11T23:56:57.359343+0000","last_became_peered":"2024-09-11T23:56:57.359343+0000","last_unstale":"2024-09-11T23:58:02.816859+0000","last_undegraded":"2024-09-11T23:58:02.816859+0000","last_fullsized":"2024-09-11T23:58:02.816859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:59.132011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813115+0000","last_change":"2024-09-11T23:56:57.351843+0000","last_active":"2024-09-11T23:58:02.813115+0000","last_peered":"2024-09-11T23:58:02.813115+0000","last_clean":"2024-09-11T23:58:02.813115+0000","last_became_active":"2024-09-11T23:56:57.351501+0000","last_became_peered":"2024-09-11T23:56:57.351501+0000","last_unstale":"2024-09-11T23:58:02.813115+0000","last_undegraded":"2024-09-11T23:58:02.813115+0000","last_fullsized":"2024-09-11T23:58:02.813115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:51.612821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816219+0000","last_change":"2024-09-11T23:56:57.344691+0000","last_active":"2024-09-11T23:58:02.816219+0000","last_peered":"2024-09-11T23:58:02.816219+0000","last_clean":"2024-09-11T23:58:02.816219+0000","last_became_active":"2024-09-11T23:56:57.344358+0000","last_became_peered":"2024-09-11T23:56:57.344358+0000","last_unstale":"2024-09-11T23:58:02.816219+0000","last_undegraded":"2024-09-11T23:58:02.816219+0000","last_fullsized":"2024-09-11T23:58:02.816219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:22.014079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.814501+0000","last_change":"2024-09-11T23:56:57.352838+0000","last_active":"2024-09-11T23:58:02.814501+0000","last_peered":"2024-09-11T23:58:02.814501+0000","last_clean":"2024-09-11T23:58:02.814501+0000","last_became_active":"2024-09-11T23:56:57.352043+0000","last_became_peered":"2024-09-11T23:56:57.352043+0000","last_unstale":"2024-09-11T23:58:02.814501+0000","last_undegraded":"2024-09-11T23:58:02.814501+0000","last_fullsized":"2024-09-11T23:58:02.814501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:01.897496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.815528+0000","last_change":"2024-09-11T23:56:57.363300+0000","last_active":"2024-09-11T23:58:02.815528+0000","last_peered":"2024-09-11T23:58:02.815528+0000","last_clean":"2024-09-11T23:58:02.815528+0000","last_became_active":"2024-09-11T23:56:57.363001+0000","last_became_peered":"2024-09-11T23:56:57.363001+0000","last_unstale":"2024-09-11T23:58:02.815528+0000","last_undegraded":"2024-09-11T23:58:02.815528+0000","last_fullsized":"2024-09-11T23:58:02.815528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:36.585495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.816145+0000","last_change":"2024-09-11T23:56:57.359008+0000","last_active":"2024-09-11T23:58:02.816145+0000","last_peered":"2024-09-11T23:58:02.816145+0000","last_clean":"2024-09-11T23:58:02.816145+0000","last_became_active":"2024-09-11T23:56:57.358701+0000","last_became_peered":"2024-09-11T23:56:57.358701+0000","last_unstale":"2024-09-11T23:58:02.816145+0000","last_undegraded":"2024-09-11T23:58:02.816145+0000","last_fullsized":"2024-09-11T23:58:02.816145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:24.287725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:58:02.813588+0000","last_change":"2024-09-11T23:56:57.361104+0000","last_active":"2024-09-11T23:58:02.813588+0000","last_peered":"2024-09-11T23:58:02.813588+0000","last_clean":"2024-09-11T23:58:02.813588+0000","last_became_active":"2024-09-11T23:56:57.360095+0000","last_became_peered":"2024-09-11T23:56:57.360095+0000","last_unstale":"2024-09-11T23:58:02.813588+0000","last_undegraded":"2024-09-11T23:58:02.813588+0000","last_fullsized":"2024-09-11T23:58:02.813588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:56:56.327320+0000","last_clean_scrub_stamp":"2024-09-11T23:56:56.327320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:29.577779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69746,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":560,"num_read_kb":358,"num_write":248,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":253517,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579938,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":496144,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808870,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1126400,"data_stored":1145779,"data_compressed":60349,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972396,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1003520,"data_stored":500058,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201328,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":987136,"data_stored":496228,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430261,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1048576,"data_stored":1092839,"data_compressed":60349,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":974848,"data_stored":491859,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1056768,"data_stored":1088028,"data_compressed":60349,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":495540,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":491174,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1064960,"data_stored":555647,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1044480,"data_stored":555820,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":999424,"data_stored":492922,"data_compressed":23664,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35046,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35046,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:58:38.200 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T23:58:38.201 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T23:58:38.201 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-11T23:58:38.201 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-11T23:58:38.496 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:39.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.006+0000 7f49eb4aa640 1 -- 172.21.15.6:0/3581292007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e4106a80 msgr2=0x7f49e4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:39.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.006+0000 7f49eb4aa640 1 --2- 172.21.15.6:0/3581292007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e4106a80 0x7f49e4106e60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009930 tx=0x7f49e002a420 comp rx=0 tx=0).stop 2024-09-11T23:58:39.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.006+0000 7f49eb4aa640 1 -- 172.21.15.6:0/3581292007 shutdown_connections 2024-09-11T23:58:39.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.006+0000 7f49eb4aa640 1 --2- 172.21.15.6:0/3581292007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49e4101420 0x7f49e410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.006+0000 7f49eb4aa640 1 --2- 172.21.15.6:0/3581292007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49e4100a80 0x7f49e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.006+0000 7f49eb4aa640 1 --2- 172.21.15.6:0/3581292007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e4106a80 0x7f49e4106e60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.006+0000 7f49eb4aa640 1 -- 172.21.15.6:0/3581292007 >> 172.21.15.6:0/3581292007 conn(0x7f49e40fc7a0 msgr2=0x7f49e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.006+0000 7f49eb4aa640 1 -- 172.21.15.6:0/3581292007 shutdown_connections 2024-09-11T23:58:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.006+0000 7f49eb4aa640 1 -- 172.21.15.6:0/3581292007 wait complete. 2024-09-11T23:58:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.007+0000 7f49eb4aa640 1 Processor -- start 2024-09-11T23:58:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.007+0000 7f49eb4aa640 1 -- start start 2024-09-11T23:58:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.007+0000 7f49eb4aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49e4100a80 0x7f49e41982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.007+0000 7f49eb4aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e4101420 0x7f49e4198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.007+0000 7f49eb4aa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49e4106a80 0x7f49e419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.007+0000 7f49eb4aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f49e4110cf0 con 0x7f49e4101420 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.007+0000 7f49eb4aa640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f49e4110b70 con 0x7f49e4106a80 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.007+0000 7f49eb4aa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f49e4110e70 con 0x7f49e4100a80 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.007+0000 7f49e8a45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e4101420 0x7f49e4198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.007+0000 7f49e8a45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e4101420 0x7f49e4198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44806/0 (socket says 172.21.15.6:44806) 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.007+0000 7f49e8a45640 1 -- 172.21.15.6:0/4016091895 learned_addr learned my addr 172.21.15.6:0/4016091895 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49e9a47640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49e4106a80 0x7f49e419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49e9246640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49e4100a80 0x7f49e41982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49e8a45640 1 -- 172.21.15.6:0/4016091895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49e4100a80 msgr2=0x7f49e41982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49e8a45640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49e4100a80 0x7f49e41982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49e8a45640 1 -- 172.21.15.6:0/4016091895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49e4106a80 msgr2=0x7f49e419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49e8a45640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49e4106a80 0x7f49e419cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49e8a45640 1 -- 172.21.15.6:0/4016091895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e419d270 con 0x7f49e4101420 2024-09-11T23:58:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49e8a45640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e4101420 0x7f49e4198800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f49d400c920 tx=0x7f49d400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49da7fc640 1 -- 172.21.15.6:0/4016091895 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4007c70 con 0x7f49e4101420 2024-09-11T23:58:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49eb4aa640 1 -- 172.21.15.6:0/4016091895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e419d560 con 0x7f49e4101420 2024-09-11T23:58:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49da7fc640 1 -- 172.21.15.6:0/4016091895 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f49d4007e10 con 0x7f49e4101420 2024-09-11T23:58:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49da7fc640 1 -- 172.21.15.6:0/4016091895 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4018820 con 0x7f49e4101420 2024-09-11T23:58:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.008+0000 7f49eb4aa640 1 -- 172.21.15.6:0/4016091895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e41a4e40 con 0x7f49e4101420 2024-09-11T23:58:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.009+0000 7f49eb4aa640 1 -- 172.21.15.6:0/4016091895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e4100ee0 con 0x7f49e4101420 2024-09-11T23:58:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.010+0000 7f49da7fc640 1 -- 172.21.15.6:0/4016091895 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f49d40189c0 con 0x7f49e4101420 2024-09-11T23:58:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.011+0000 7f49da7fc640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f49d00a2c10 0x7f49d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.011+0000 7f49e9246640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f49d00a2c10 0x7f49d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.011+0000 7f49da7fc640 1 -- 172.21.15.6:0/4016091895 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f49d40cf7b0 con 0x7f49e4101420 2024-09-11T23:58:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.011+0000 7f49e9246640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f49d00a2c10 0x7f49d00a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f49e0000c00 tx=0x7f49e0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.015+0000 7f49da7fc640 1 -- 172.21.15.6:0/4016091895 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f49d4014030 con 0x7f49e4101420 2024-09-11T23:58:39.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:38 smithi134 ceph-mon[34893]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:58:39.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:38 smithi134 ceph-mon[34893]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.230+0000 7f49eb4aa640 1 -- 172.21.15.6:0/4016091895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f49e4199620 con 0x7f49e4101420 2024-09-11T23:58:39.229 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:38 smithi006 ceph-mon[30947]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:58:39.229 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:38 smithi006 ceph-mon[30947]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.230+0000 7f49da7fc640 1 -- 172.21.15.6:0/4016091895 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f49e4199620 con 0x7f49e4101420 2024-09-11T23:58:39.230 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:58:39.230 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T23:58:39.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.232+0000 7f49eb4aa640 1 -- 172.21.15.6:0/4016091895 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f49d00a2c10 msgr2=0x7f49d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:39.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.232+0000 7f49eb4aa640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f49d00a2c10 0x7f49d00a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f49e0000c00 tx=0x7f49e0031400 comp rx=0 tx=0).stop 2024-09-11T23:58:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.232+0000 7f49eb4aa640 1 -- 172.21.15.6:0/4016091895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e4101420 msgr2=0x7f49e4198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.232+0000 7f49eb4aa640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e4101420 0x7f49e4198800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f49d400c920 tx=0x7f49d400cde0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.232+0000 7f49eb4aa640 1 -- 172.21.15.6:0/4016091895 shutdown_connections 2024-09-11T23:58:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.232+0000 7f49eb4aa640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f49d00a2c10 0x7f49d00a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.232+0000 7f49eb4aa640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49e4106a80 0x7f49e419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.232+0000 7f49eb4aa640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e4101420 0x7f49e4198800 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.232+0000 7f49eb4aa640 1 --2- 172.21.15.6:0/4016091895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49e4100a80 0x7f49e41982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.232+0000 7f49eb4aa640 1 -- 172.21.15.6:0/4016091895 >> 172.21.15.6:0/4016091895 conn(0x7f49e40fc7a0 msgr2=0x7f49e406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.233+0000 7f49eb4aa640 1 -- 172.21.15.6:0/4016091895 shutdown_connections 2024-09-11T23:58:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:39.233+0000 7f49eb4aa640 1 -- 172.21.15.6:0/4016091895 wait complete. 2024-09-11T23:58:39.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:38 smithi039 ceph-mon[34543]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:58:39.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:38 smithi039 ceph-mon[34543]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:39.924 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-11T23:58:39.925 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:58:40.187 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:40.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:39 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/4016091895' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T23:58:40.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:39 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/4016091895' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T23:58:40.308 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:39 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/4016091895' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T23:58:40.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.686+0000 7fd25bdc0640 1 -- 172.21.15.6:0/1787233762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd254100e30 msgr2=0x7fd254104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:40.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.686+0000 7fd25bdc0640 1 --2- 172.21.15.6:0/1787233762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd254100e30 0x7fd254104e80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd244009ca0 tx=0x7fd24402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:40.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.686+0000 7fd25bdc0640 1 -- 172.21.15.6:0/1787233762 shutdown_connections 2024-09-11T23:58:40.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.686+0000 7fd25bdc0640 1 --2- 172.21.15.6:0/1787233762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2541055b0 0x7fd25410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.686+0000 7fd25bdc0640 1 --2- 172.21.15.6:0/1787233762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd254100e30 0x7fd254104e80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.686+0000 7fd25bdc0640 1 --2- 172.21.15.6:0/1787233762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd254100480 0x7fd254100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.686+0000 7fd25bdc0640 1 -- 172.21.15.6:0/1787233762 >> 172.21.15.6:0/1787233762 conn(0x7fd254077210 msgr2=0x7fd2540fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.686+0000 7fd25bdc0640 1 -- 172.21.15.6:0/1787233762 shutdown_connections 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.686+0000 7fd25bdc0640 1 -- 172.21.15.6:0/1787233762 wait complete. 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd25bdc0640 1 Processor -- start 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd25bdc0640 1 -- start start 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd25bdc0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd254100480 0x7fd254199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd25bdc0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd254100e30 0x7fd254199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd25bdc0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2541055b0 0x7fd2541a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd25bdc0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd254110560 con 0x7fd254100e30 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd25bdc0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd2541103e0 con 0x7fd254100480 2024-09-11T23:58:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd25bdc0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2541106e0 con 0x7fd2541055b0 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd25935b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd254100e30 0x7fd254199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd25935b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd254100e30 0x7fd254199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54564/0 (socket says 172.21.15.6:54564) 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd25935b640 1 -- 172.21.15.6:0/2233854159 learned_addr learned my addr 172.21.15.6:0/2233854159 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd259b5c640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd254100480 0x7fd254199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.687+0000 7fd25a35d640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2541055b0 0x7fd2541a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.688+0000 7fd25935b640 1 -- 172.21.15.6:0/2233854159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2541055b0 msgr2=0x7fd2541a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.688+0000 7fd25935b640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2541055b0 0x7fd2541a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.688+0000 7fd25935b640 1 -- 172.21.15.6:0/2233854159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd254100480 msgr2=0x7fd254199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.688+0000 7fd25935b640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd254100480 0x7fd254199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.688+0000 7fd25935b640 1 -- 172.21.15.6:0/2233854159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2541a4910 con 0x7fd254100e30 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.688+0000 7fd259b5c640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd254100480 0x7fd254199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.688+0000 7fd25935b640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd254100e30 0x7fd254199890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd244006010 tx=0x7fd244003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.688+0000 7fd252ffd640 1 -- 172.21.15.6:0/2233854159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd244004040 con 0x7fd254100e30 2024-09-11T23:58:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.688+0000 7fd252ffd640 1 -- 172.21.15.6:0/2233854159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd244004690 con 0x7fd254100e30 2024-09-11T23:58:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.688+0000 7fd252ffd640 1 -- 172.21.15.6:0/2233854159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24402f4c0 con 0x7fd254100e30 2024-09-11T23:58:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.688+0000 7fd25bdc0640 1 -- 172.21.15.6:0/2233854159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2541a4ae0 con 0x7fd254100e30 2024-09-11T23:58:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.688+0000 7fd25bdc0640 1 -- 172.21.15.6:0/2233854159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2541a4f40 con 0x7fd254100e30 2024-09-11T23:58:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.689+0000 7fd25bdc0640 1 -- 172.21.15.6:0/2233854159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd254100860 con 0x7fd254100e30 2024-09-11T23:58:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.690+0000 7fd252ffd640 1 -- 172.21.15.6:0/2233854159 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd2440305c0 con 0x7fd254100e30 2024-09-11T23:58:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.691+0000 7fd252ffd640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd23c0a2c10 0x7fd23c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.691+0000 7fd259b5c640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd23c0a2c10 0x7fd23c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.691+0000 7fd252ffd640 1 -- 172.21.15.6:0/2233854159 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fd2440f0c00 con 0x7fd254100e30 2024-09-11T23:58:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.691+0000 7fd259b5c640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd23c0a2c10 0x7fd23c0a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd248006fd0 tx=0x7fd248008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.695+0000 7fd252ffd640 1 -- 172.21.15.6:0/2233854159 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd2440bd7b0 con 0x7fd254100e30 2024-09-11T23:58:40.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.910+0000 7fd25bdc0640 1 -- 172.21.15.6:0/2233854159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2541a5170 con 0x7fd254100e30 2024-09-11T23:58:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.911+0000 7fd252ffd640 1 -- 172.21.15.6:0/2233854159 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11950 (secure 0 0 0) 0x7fd2440098b0 con 0x7fd254100e30 2024-09-11T23:58:40.911 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:58:40.911 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"btime":"2024-09-11T23:57:43:074223+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:56:58.063963+0000","modified":"2024-09-11T23:57:43.074202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24478,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/809129212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":809129212},{"type":"v1","addr":"172.21.15.6:6839","nonce":809129212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/500771395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":500771395},{"type":"v1","addr":"172.21.15.6:6841","nonce":500771395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":18,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":19,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":18,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.39:6839/3561706320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3561706320},{"type":"v1","addr":"172.21.15.39:6839","nonce":3561706320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24490,24491,24478,24472,24461]},"id":1}]} 2024-09-11T23:58:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-09-11T23:58:40.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.914+0000 7fd25bdc0640 1 -- 172.21.15.6:0/2233854159 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd23c0a2c10 msgr2=0x7fd23c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.914+0000 7fd25bdc0640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd23c0a2c10 0x7fd23c0a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd248006fd0 tx=0x7fd248008040 comp rx=0 tx=0).stop 2024-09-11T23:58:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.914+0000 7fd25bdc0640 1 -- 172.21.15.6:0/2233854159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd254100e30 msgr2=0x7fd254199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.914+0000 7fd25bdc0640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd254100e30 0x7fd254199890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd244006010 tx=0x7fd244003ba0 comp rx=0 tx=0).stop 2024-09-11T23:58:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.914+0000 7fd25bdc0640 1 -- 172.21.15.6:0/2233854159 shutdown_connections 2024-09-11T23:58:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.914+0000 7fd25bdc0640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fd23c0a2c10 0x7fd23c0a50d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.914+0000 7fd25bdc0640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2541055b0 0x7fd2541a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.914+0000 7fd25bdc0640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd254100e30 0x7fd254199890 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.914+0000 7fd25bdc0640 1 --2- 172.21.15.6:0/2233854159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd254100480 0x7fd254199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.914+0000 7fd25bdc0640 1 -- 172.21.15.6:0/2233854159 >> 172.21.15.6:0/2233854159 conn(0x7fd254077210 msgr2=0x7fd2540fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.914+0000 7fd25bdc0640 1 -- 172.21.15.6:0/2233854159 shutdown_connections 2024-09-11T23:58:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:40.914+0000 7fd25bdc0640 1 -- 172.21.15.6:0/2233854159 wait complete. 2024-09-11T23:58:41.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:40 smithi134 ceph-mon[34893]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:41.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:40 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2233854159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:41.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:40 smithi006 ceph-mon[30947]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:41.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:40 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2233854159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:41.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:40 smithi039 ceph-mon[34543]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:41.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:40 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2233854159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:41.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:58:41.980 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.482+0000 7f181de81640 1 -- 172.21.15.6:0/3388830302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1818100d20 msgr2=0x7f1818106860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.482+0000 7f181de81640 1 --2- 172.21.15.6:0/3388830302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1818100d20 0x7f1818106860 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f180c009930 tx=0x7f180c02a420 comp rx=0 tx=0).stop 2024-09-11T23:58:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.482+0000 7f181de81640 1 -- 172.21.15.6:0/3388830302 shutdown_connections 2024-09-11T23:58:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.482+0000 7f181de81640 1 --2- 172.21.15.6:0/3388830302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818106fc0 0x7f181810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.482+0000 7f181de81640 1 --2- 172.21.15.6:0/3388830302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1818100d20 0x7f1818106860 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.482+0000 7f181de81640 1 --2- 172.21.15.6:0/3388830302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1818100370 0x7f1818100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.482+0000 7f181de81640 1 -- 172.21.15.6:0/3388830302 >> 172.21.15.6:0/3388830302 conn(0x7f1818077210 msgr2=0x7f18180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.482+0000 7f181de81640 1 -- 172.21.15.6:0/3388830302 shutdown_connections 2024-09-11T23:58:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.482+0000 7f181de81640 1 -- 172.21.15.6:0/3388830302 wait complete. 2024-09-11T23:58:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f181de81640 1 Processor -- start 2024-09-11T23:58:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f181de81640 1 -- start start 2024-09-11T23:58:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f181de81640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1818100370 0x7f18181012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f181de81640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1818100d20 0x7f1818101830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f181de81640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818106fc0 0x7f1818101d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f181de81640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1818111e10 con 0x7f1818100370 2024-09-11T23:58:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f181de81640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1818111c90 con 0x7f1818100d20 2024-09-11T23:58:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f181de81640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1818111f90 con 0x7f1818106fc0 2024-09-11T23:58:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f18177fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1818100370 0x7f18181012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f18177fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1818100370 0x7f18181012f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54578/0 (socket says 172.21.15.6:54578) 2024-09-11T23:58:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f18177fe640 1 -- 172.21.15.6:0/4070218564 learned_addr learned my addr 172.21.15.6:0/4070218564 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f1816ffd640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1818100d20 0x7f1818101830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f1817fff640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818106fc0 0x7f1818101d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f18177fe640 1 -- 172.21.15.6:0/4070218564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818106fc0 msgr2=0x7f1818101d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f18177fe640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818106fc0 0x7f1818101d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f18177fe640 1 -- 172.21.15.6:0/4070218564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1818100d20 msgr2=0x7f1818101830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f18177fe640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1818100d20 0x7f1818101830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.483+0000 7f18177fe640 1 -- 172.21.15.6:0/4070218564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18181a6850 con 0x7f1818100370 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.484+0000 7f18177fe640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1818100370 0x7f18181012f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f180800d950 tx=0x7f180800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.484+0000 7f1814ff9640 1 -- 172.21.15.6:0/4070218564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808017070 con 0x7f1818100370 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.484+0000 7f181de81640 1 -- 172.21.15.6:0/4070218564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18181a6b40 con 0x7f1818100370 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.484+0000 7f1814ff9640 1 -- 172.21.15.6:0/4070218564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1808009c30 con 0x7f1818100370 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.484+0000 7f1814ff9640 1 -- 172.21.15.6:0/4070218564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180800f620 con 0x7f1818100370 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.484+0000 7f181de81640 1 -- 172.21.15.6:0/4070218564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18181a7050 con 0x7f1818100370 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.485+0000 7f181de81640 1 -- 172.21.15.6:0/4070218564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1818100750 con 0x7f1818100370 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.486+0000 7f1814ff9640 1 -- 172.21.15.6:0/4070218564 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f18080109a0 con 0x7f1818100370 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.487+0000 7f1814ff9640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f18000a2c10 0x7f18000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.487+0000 7f1814ff9640 1 -- 172.21.15.6:0/4070218564 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f18080cf210 con 0x7f1818100370 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.487+0000 7f1816ffd640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f18000a2c10 0x7f18000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.487+0000 7f1816ffd640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f18000a2c10 0x7f18000a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f180c006010 tx=0x7f180c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.491+0000 7f1814ff9640 1 -- 172.21.15.6:0/4070218564 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1808009de0 con 0x7f1818100370 2024-09-11T23:58:42.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.704+0000 7f181de81640 1 -- 172.21.15.6:0/4070218564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f181802d7c0 con 0x7f1818100370 2024-09-11T23:58:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.705+0000 7f1814ff9640 1 -- 172.21.15.6:0/4070218564 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11950 (secure 0 0 0) 0x7f180809bcb0 con 0x7f1818100370 2024-09-11T23:58:42.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:58:42.705 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"btime":"2024-09-11T23:57:43:074223+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:56:58.063963+0000","modified":"2024-09-11T23:57:43.074202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24478,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/809129212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":809129212},{"type":"v1","addr":"172.21.15.6:6839","nonce":809129212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/500771395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":500771395},{"type":"v1","addr":"172.21.15.6:6841","nonce":500771395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":18,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":19,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":18,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.39:6839/3561706320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3561706320},{"type":"v1","addr":"172.21.15.39:6839","nonce":3561706320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24490,24491,24478,24472,24461]},"id":1}]} 2024-09-11T23:58:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-09-11T23:58:42.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.708+0000 7f181de81640 1 -- 172.21.15.6:0/4070218564 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f18000a2c10 msgr2=0x7f18000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:42.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.708+0000 7f181de81640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f18000a2c10 0x7f18000a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f180c006010 tx=0x7f180c000bc0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.708+0000 7f181de81640 1 -- 172.21.15.6:0/4070218564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1818100370 msgr2=0x7f18181012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:42.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.708+0000 7f181de81640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1818100370 0x7f18181012f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f180800d950 tx=0x7f180800de10 comp rx=0 tx=0).stop 2024-09-11T23:58:42.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.708+0000 7f181de81640 1 -- 172.21.15.6:0/4070218564 shutdown_connections 2024-09-11T23:58:42.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.708+0000 7f181de81640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f18000a2c10 0x7f18000a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.708+0000 7f181de81640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818106fc0 0x7f1818101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.708+0000 7f181de81640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1818100d20 0x7f1818101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.708+0000 7f181de81640 1 --2- 172.21.15.6:0/4070218564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1818100370 0x7f18181012f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.708+0000 7f181de81640 1 -- 172.21.15.6:0/4070218564 >> 172.21.15.6:0/4070218564 conn(0x7f1818077210 msgr2=0x7f18180fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:42.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.708+0000 7f181de81640 1 -- 172.21.15.6:0/4070218564 shutdown_connections 2024-09-11T23:58:42.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:42.708+0000 7f181de81640 1 -- 172.21.15.6:0/4070218564 wait complete. 2024-09-11T23:58:43.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:42 smithi006 ceph-mon[30947]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:58:43.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:42 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/4070218564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:42 smithi134 ceph-mon[34893]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:58:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:42 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/4070218564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:43.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:42 smithi039 ceph-mon[34543]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:58:43.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:42 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/4070218564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:43.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:58:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:44.173 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:43 smithi006 ceph-mon[30947]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.256+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/3362310058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0cc100310 msgr2=0x7ff0cc1006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.256+0000 7ff0d3d7d640 1 --2- 172.21.15.6:0/3362310058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0cc100310 0x7ff0cc1006f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009900 tx=0x7ff0c802a410 comp rx=0 tx=0).stop 2024-09-11T23:58:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.256+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/3362310058 shutdown_connections 2024-09-11T23:58:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.256+0000 7ff0d3d7d640 1 --2- 172.21.15.6:0/3362310058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0cc106f30 0x7ff0cc10eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.256+0000 7ff0d3d7d640 1 --2- 172.21.15.6:0/3362310058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0cc100cc0 0x7ff0cc106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.256+0000 7ff0d3d7d640 1 --2- 172.21.15.6:0/3362310058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0cc100310 0x7ff0cc1006f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.256+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/3362310058 >> 172.21.15.6:0/3362310058 conn(0x7ff0cc077210 msgr2=0x7ff0cc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.256+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/3362310058 shutdown_connections 2024-09-11T23:58:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.256+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/3362310058 wait complete. 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.257+0000 7ff0d3d7d640 1 Processor -- start 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.257+0000 7ff0d3d7d640 1 -- start start 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.257+0000 7ff0d3d7d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0cc100310 0x7ff0cc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.257+0000 7ff0d3d7d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0cc100cc0 0x7ff0cc198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.257+0000 7ff0d3d7d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0cc106f30 0x7ff0cc19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.257+0000 7ff0d3d7d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc111e00 con 0x7ff0cc106f30 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.257+0000 7ff0d3d7d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc111c80 con 0x7ff0cc100310 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.257+0000 7ff0d3d7d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc111f80 con 0x7ff0cc100cc0 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d231a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0cc106f30 0x7ff0cc19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d231a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0cc106f30 0x7ff0cc19cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54606/0 (socket says 172.21.15.6:54606) 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d231a640 1 -- 172.21.15.6:0/918854342 learned_addr learned my addr 172.21.15.6:0/918854342 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d1b19640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0cc100310 0x7ff0cc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d1318640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0cc100cc0 0x7ff0cc198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d231a640 1 -- 172.21.15.6:0/918854342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0cc100cc0 msgr2=0x7ff0cc198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d231a640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0cc100cc0 0x7ff0cc198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d231a640 1 -- 172.21.15.6:0/918854342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0cc100310 msgr2=0x7ff0cc198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d231a640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0cc100310 0x7ff0cc198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d231a640 1 -- 172.21.15.6:0/918854342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc19d2f0 con 0x7ff0cc106f30 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d231a640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0cc106f30 0x7ff0cc19cc10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400cad0 tx=0x7ff0c400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0c2ffd640 1 -- 172.21.15.6:0/918854342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400ae20 con 0x7ff0cc106f30 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0c2ffd640 1 -- 172.21.15.6:0/918854342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0c4005020 con 0x7ff0cc106f30 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/918854342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0cc19d5e0 con 0x7ff0cc106f30 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0c2ffd640 1 -- 172.21.15.6:0/918854342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400f6b0 con 0x7ff0cc106f30 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.258+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/918854342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0cc1a4ec0 con 0x7ff0cc106f30 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.259+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/918854342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0cc1006f0 con 0x7ff0cc106f30 2024-09-11T23:58:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.260+0000 7ff0c2ffd640 1 -- 172.21.15.6:0/918854342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7ff0c40051d0 con 0x7ff0cc106f30 2024-09-11T23:58:44.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.261+0000 7ff0c2ffd640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff0b80a2c10 0x7ff0b80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.261+0000 7ff0d1b19640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff0b80a2c10 0x7ff0b80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.261+0000 7ff0c2ffd640 1 -- 172.21.15.6:0/918854342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7ff0c40cf600 con 0x7ff0cc106f30 2024-09-11T23:58:44.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.262+0000 7ff0d1b19640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff0b80a2c10 0x7ff0b80a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8031440 tx=0x7ff0c80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:44.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.265+0000 7ff0c2ffd640 1 -- 172.21.15.6:0/918854342 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0c4014030 con 0x7ff0cc106f30 2024-09-11T23:58:44.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:43 smithi039 ceph-mon[34543]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:44.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.443+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/918854342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0cc109b80 con 0x7ff0cc106f30 2024-09-11T23:58:44.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.444+0000 7ff0c2ffd640 1 -- 172.21.15.6:0/918854342 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24668 (secure 0 0 0) 0x7ff0c409c0a0 con 0x7ff0cc106f30 2024-09-11T23:58:44.444 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:58:44.444 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":88,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-11T23:58:02.808790+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:56:54.204314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:56:56.327143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:57:02.826677+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:58:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.447+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/918854342 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff0b80a2c10 msgr2=0x7ff0b80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.447+0000 7ff0d3d7d640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff0b80a2c10 0x7ff0b80a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8031440 tx=0x7ff0c80095f0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.447+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/918854342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0cc106f30 msgr2=0x7ff0cc19cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.447+0000 7ff0d3d7d640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0cc106f30 0x7ff0cc19cc10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400cad0 tx=0x7ff0c400cf90 comp rx=0 tx=0).stop 2024-09-11T23:58:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.447+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/918854342 shutdown_connections 2024-09-11T23:58:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.447+0000 7ff0d3d7d640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff0b80a2c10 0x7ff0b80a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.447+0000 7ff0d3d7d640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0cc106f30 0x7ff0cc19cc10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.447+0000 7ff0d3d7d640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0cc100cc0 0x7ff0cc198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.447+0000 7ff0d3d7d640 1 --2- 172.21.15.6:0/918854342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0cc100310 0x7ff0cc198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.447+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/918854342 >> 172.21.15.6:0/918854342 conn(0x7ff0cc077210 msgr2=0x7ff0cc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:44.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.447+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/918854342 shutdown_connections 2024-09-11T23:58:44.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:44.447+0000 7ff0d3d7d640 1 -- 172.21.15.6:0/918854342 wait complete. 2024-09-11T23:58:44.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:43 smithi134 ceph-mon[34893]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:45.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:44 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/918854342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:45.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:58:45.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:44 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/918854342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:45.451 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:45.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:44 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/918854342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.916+0000 7f46a4569640 1 -- 172.21.15.6:0/686388800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c102570 msgr2=0x7f469c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.916+0000 7f46a4569640 1 --2- 172.21.15.6:0/686388800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c102570 0x7f469c1029b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f468c009900 tx=0x7f468c02a480 comp rx=0 tx=0).stop 2024-09-11T23:58:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.916+0000 7f46a4569640 1 -- 172.21.15.6:0/686388800 shutdown_connections 2024-09-11T23:58:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.916+0000 7f46a4569640 1 --2- 172.21.15.6:0/686388800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f469c102ef0 0x7f469c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.916+0000 7f46a4569640 1 --2- 172.21.15.6:0/686388800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c102570 0x7f469c1029b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.916+0000 7f46a4569640 1 --2- 172.21.15.6:0/686388800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f469c100e20 0x7f469c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.916+0000 7f46a4569640 1 -- 172.21.15.6:0/686388800 >> 172.21.15.6:0/686388800 conn(0x7f469c0fc7d0 msgr2=0x7f469c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.916+0000 7f46a4569640 1 -- 172.21.15.6:0/686388800 shutdown_connections 2024-09-11T23:58:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.916+0000 7f46a4569640 1 -- 172.21.15.6:0/686388800 wait complete. 2024-09-11T23:58:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a4569640 1 Processor -- start 2024-09-11T23:58:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a4569640 1 -- start start 2024-09-11T23:58:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a4569640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f469c100e20 0x7f469c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a4569640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c102570 0x7f469c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a4569640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f469c102ef0 0x7f469c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a4569640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f469c110e00 con 0x7f469c102570 2024-09-11T23:58:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a4569640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f469c110c80 con 0x7f469c102ef0 2024-09-11T23:58:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a4569640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f469c110f80 con 0x7f469c100e20 2024-09-11T23:58:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a1b04640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c102570 0x7f469c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a1b04640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c102570 0x7f469c198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54614/0 (socket says 172.21.15.6:54614) 2024-09-11T23:58:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a1b04640 1 -- 172.21.15.6:0/1806957790 learned_addr learned my addr 172.21.15.6:0/1806957790 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a2305640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f469c100e20 0x7f469c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a2b06640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f469c102ef0 0x7f469c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a1b04640 1 -- 172.21.15.6:0/1806957790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f469c100e20 msgr2=0x7f469c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a1b04640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f469c100e20 0x7f469c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a1b04640 1 -- 172.21.15.6:0/1806957790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f469c102ef0 msgr2=0x7f469c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a1b04640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f469c102ef0 0x7f469c19ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.917+0000 7f46a1b04640 1 -- 172.21.15.6:0/1806957790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c19d390 con 0x7f469c102570 2024-09-11T23:58:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.918+0000 7f46a1b04640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c102570 0x7f469c198920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f468c006010 tx=0x7f468c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.918+0000 7f46937fe640 1 -- 172.21.15.6:0/1806957790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c03f030 con 0x7f469c102570 2024-09-11T23:58:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.918+0000 7f46a4569640 1 -- 172.21.15.6:0/1806957790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469c19d620 con 0x7f469c102570 2024-09-11T23:58:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.918+0000 7f46937fe640 1 -- 172.21.15.6:0/1806957790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f468c003cb0 con 0x7f469c102570 2024-09-11T23:58:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.918+0000 7f46937fe640 1 -- 172.21.15.6:0/1806957790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c035070 con 0x7f469c102570 2024-09-11T23:58:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.918+0000 7f46a4569640 1 -- 172.21.15.6:0/1806957790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469c1a4f60 con 0x7f469c102570 2024-09-11T23:58:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.919+0000 7f46a4569640 1 -- 172.21.15.6:0/1806957790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469c101200 con 0x7f469c102570 2024-09-11T23:58:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.920+0000 7f46937fe640 1 -- 172.21.15.6:0/1806957790 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f468c042030 con 0x7f469c102570 2024-09-11T23:58:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.921+0000 7f46937fe640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f46880a2c10 0x7f46880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.921+0000 7f46a2305640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f46880a2c10 0x7f46880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.921+0000 7f46937fe640 1 -- 172.21.15.6:0/1806957790 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f468c0efa70 con 0x7f469c102570 2024-09-11T23:58:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.922+0000 7f46a2305640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f46880a2c10 0x7f46880a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f469800bbe0 tx=0x7f469800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:45.925+0000 7f46937fe640 1 -- 172.21.15.6:0/1806957790 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f468c0bc4b0 con 0x7f469c102570 2024-09-11T23:58:46.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:46 smithi006 ceph-mon[30947]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-11T23:58:46.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.137+0000 7f46a4569640 1 -- 172.21.15.6:0/1806957790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f469c1a5130 con 0x7f469c102570 2024-09-11T23:58:46.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.138+0000 7f46937fe640 1 -- 172.21.15.6:0/1806957790 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11950 (secure 0 0 0) 0x7f468c0bbdb0 con 0x7f469c102570 2024-09-11T23:58:46.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:58:46.137 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"btime":"2024-09-11T23:57:43:074223+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:56:58.063963+0000","modified":"2024-09-11T23:57:43.074202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24478,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/809129212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":809129212},{"type":"v1","addr":"172.21.15.6:6839","nonce":809129212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/500771395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":500771395},{"type":"v1","addr":"172.21.15.6:6841","nonce":500771395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":18,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":19,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":18,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.39:6839/3561706320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3561706320},{"type":"v1","addr":"172.21.15.39:6839","nonce":3561706320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24490,24491,24478,24472,24461]},"id":1}]} 2024-09-11T23:58:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-09-11T23:58:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.140+0000 7f46a4569640 1 -- 172.21.15.6:0/1806957790 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f46880a2c10 msgr2=0x7f46880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.140+0000 7f46a4569640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f46880a2c10 0x7f46880a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f469800bbe0 tx=0x7f469800b390 comp rx=0 tx=0).stop 2024-09-11T23:58:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.140+0000 7f46a4569640 1 -- 172.21.15.6:0/1806957790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c102570 msgr2=0x7f469c198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.140+0000 7f46a4569640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c102570 0x7f469c198920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f468c006010 tx=0x7f468c0042f0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.140+0000 7f46a4569640 1 -- 172.21.15.6:0/1806957790 shutdown_connections 2024-09-11T23:58:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.140+0000 7f46a4569640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f46880a2c10 0x7f46880a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.140+0000 7f46a4569640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f469c102ef0 0x7f469c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.140+0000 7f46a4569640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c102570 0x7f469c198920 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.140+0000 7f46a4569640 1 --2- 172.21.15.6:0/1806957790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f469c100e20 0x7f469c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.140+0000 7f46a4569640 1 -- 172.21.15.6:0/1806957790 >> 172.21.15.6:0/1806957790 conn(0x7f469c0fc7d0 msgr2=0x7f469c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.140+0000 7f46a4569640 1 -- 172.21.15.6:0/1806957790 shutdown_connections 2024-09-11T23:58:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:46.140+0000 7f46a4569640 1 -- 172.21.15.6:0/1806957790 wait complete. 2024-09-11T23:58:46.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:46 smithi039 ceph-mon[34543]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-11T23:58:46.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:46 smithi134 ceph-mon[34893]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-11T23:58:46.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T23:56:58.063963+0000', 'modified': '2024-09-11T23:57:43.074202+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24491, 'mds_1': 24490, 'mds_2': 24478, 'mds_3': 24472, 'mds_4': 24461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14628': {'gid': 14628, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6839/809129212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6838', 'nonce': 809129212}, {'type': 'v1', 'addr': '172.21.15.6:6839', 'nonce': 809129212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14634': {'gid': 14634, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6841/500771395', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6840', 'nonce': 500771395}, {'type': 'v1', 'addr': '172.21.15.6:6841', 'nonce': 500771395}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6833/3540998066', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6832', 'nonce': 3540998066}, {'type': 'v1', 'addr': '172.21.15.39:6833', 'nonce': 3540998066}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6833/3891726228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 3891726228}, {'type': 'v1', 'addr': '172.21.15.134:6833', 'nonce': 3891726228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6835/2372527607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6834', 'nonce': 2372527607}, {'type': 'v1', 'addr': '172.21.15.39:6835', 'nonce': 2372527607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.39:6837/902336458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6836', 'nonce': 902336458}, {'type': 'v1', 'addr': '172.21.15.39:6837', 'nonce': 902336458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.134:6835/530621436', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 530621436}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 530621436}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.134:6837/4248937946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 4248937946}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 4248937946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.134:6839/45989022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 45989022}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 45989022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.39:6839/3561706320', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6838', 'nonce': 3561706320}, {'type': 'v1', 'addr': '172.21.15.39:6839', 'nonce': 3561706320}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24491, 'qdb_cluster': [24490, 24491, 24478, 24472, 24461]} 2024-09-11T23:58:46.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-11T23:58:46.934 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-11T23:58:47.201 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:47.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:47 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1806957790' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:47.323 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:47 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1806957790' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:47.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:47 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1806957790' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.699+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2791565867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f4102ef0 msgr2=0x7fa7f410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.699+0000 7fa7f8c9b640 1 --2- 172.21.15.6:0/2791565867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f4102ef0 0x7fa7f410da40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009900 tx=0x7fa7ec02a480 comp rx=0 tx=0).stop 2024-09-11T23:58:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.699+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2791565867 shutdown_connections 2024-09-11T23:58:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.699+0000 7fa7f8c9b640 1 --2- 172.21.15.6:0/2791565867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f4102ef0 0x7fa7f410da40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.699+0000 7fa7f8c9b640 1 --2- 172.21.15.6:0/2791565867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f4102570 0x7fa7f41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.699+0000 7fa7f8c9b640 1 --2- 172.21.15.6:0/2791565867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7f4100e20 0x7fa7f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.699+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2791565867 >> 172.21.15.6:0/2791565867 conn(0x7fa7f40fc7d0 msgr2=0x7fa7f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.699+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2791565867 shutdown_connections 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.699+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2791565867 wait complete. 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.700+0000 7fa7f8c9b640 1 Processor -- start 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.700+0000 7fa7f8c9b640 1 -- start start 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.700+0000 7fa7f8c9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7f4100e20 0x7fa7f419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.700+0000 7fa7f8c9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f4102570 0x7fa7f419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.700+0000 7fa7f8c9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f4102ef0 0x7fa7f419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.700+0000 7fa7f8c9b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f4110e30 con 0x7fa7f4102570 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.700+0000 7fa7f8c9b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f4110cb0 con 0x7fa7f4102ef0 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.700+0000 7fa7f8c9b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f4110fb0 con 0x7fa7f4100e20 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.700+0000 7fa7f1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f4102570 0x7fa7f419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7f1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f4102570 0x7fa7f419ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54630/0 (socket says 172.21.15.6:54630) 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7f1d9b640 1 -- 172.21.15.6:0/2782985070 learned_addr learned my addr 172.21.15.6:0/2782985070 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7f259c640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7f4100e20 0x7fa7f419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7f2d9d640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f4102ef0 0x7fa7f419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7f1d9b640 1 -- 172.21.15.6:0/2782985070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7f4100e20 msgr2=0x7fa7f419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7f1d9b640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7f4100e20 0x7fa7f419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7f1d9b640 1 -- 172.21.15.6:0/2782985070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f4102ef0 msgr2=0x7fa7f419eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7f1d9b640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f4102ef0 0x7fa7f419eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7f1d9b640 1 -- 172.21.15.6:0/2782985070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f419f580 con 0x7fa7f4102570 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7f1d9b640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f4102570 0x7fa7f419ab10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800d950 tx=0x7fa7e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7e37fe640 1 -- 172.21.15.6:0/2782985070 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8017070 con 0x7fa7f4102570 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7e37fe640 1 -- 172.21.15.6:0/2782985070 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7e8009c30 con 0x7fa7f4102570 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2782985070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f419f870 con 0x7fa7f4102570 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7e37fe640 1 -- 172.21.15.6:0/2782985070 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e800f620 con 0x7fa7f4102570 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.701+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2782985070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f41a7150 con 0x7fa7f4102570 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.704+0000 7fa7e37fe640 1 -- 172.21.15.6:0/2782985070 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fa7e80109a0 con 0x7fa7f4102570 2024-09-11T23:58:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.704+0000 7fa7fb074740 1 Processor -- start 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.704+0000 7fa7fb074740 1 -- start start 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.704+0000 7fa7fb074740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa0059d0 0x5631aa005db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.704+0000 7fa7fb074740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 0x5631aa010670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.704+0000 7fa7fb074740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa010bb0 0x5631aa012fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.704+0000 7fa7fb074740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5631a9f6c090 con 0x5631aa0062f0 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.704+0000 7fa7fb074740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5631a9f13a70 con 0x5631aa010bb0 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.704+0000 7fa7fb074740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5631a9f68050 con 0x5631aa0059d0 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.704+0000 7fa7e37fe640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa7dc0a2c90 0x7fa7dc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.704+0000 7fa7f259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 0x5631aa010670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 0x5631aa010670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54636/0 (socket says 172.21.15.6:54636) 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f259c640 1 -- 172.21.15.6:0/56349424 learned_addr learned my addr 172.21.15.6:0/56349424 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f1d9b640 1 --2- 172.21.15.6:0/56349424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa010bb0 0x5631aa012fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f2d9d640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa7dc0a2c90 0x7fa7dc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7e37fe640 1 -- 172.21.15.6:0/2782985070 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa7e80cf0c0 con 0x7fa7f4102570 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f2d9d640 1 --2- 172.21.15.6:0/56349424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa0059d0 0x5631aa005db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f259c640 1 -- 172.21.15.6:0/56349424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa0059d0 msgr2=0x5631aa005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f259c640 1 --2- 172.21.15.6:0/56349424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa0059d0 0x5631aa005db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f259c640 1 -- 172.21.15.6:0/56349424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa010bb0 msgr2=0x5631aa012fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f259c640 1 --2- 172.21.15.6:0/56349424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa010bb0 0x5631aa012fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f259c640 1 -- 172.21.15.6:0/56349424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631a9f20130 con 0x5631aa0062f0 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f2d9d640 1 --2- 172.21.15.6:0/56349424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa0059d0 0x5631aa005db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f259c640 1 --2- 172.21.15.6:0/56349424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 0x5631aa010670 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4003b20 tx=0x7fa7e4009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5df0373913ed7d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7e0ff9640 1 -- 172.21.15.6:0/56349424 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4011440 con 0x5631aa0062f0 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7f2d9d640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa7dc0a2c90 0x7fa7dc0a5150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0096c0 tx=0x7fa7ec0058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7e0ff9640 1 -- 172.21.15.6:0/56349424 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7e4015030 con 0x5631aa0062f0 2024-09-11T23:58:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.705+0000 7fa7e0ff9640 1 -- 172.21.15.6:0/56349424 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e40109d0 con 0x5631aa0062f0 2024-09-11T23:58:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.706+0000 7fa7fb074740 1 -- 172.21.15.6:0/56349424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 msgr2=0x5631aa010670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.706+0000 7fa7fb074740 1 --2- 172.21.15.6:0/56349424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 0x5631aa010670 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4003b20 tx=0x7fa7e4009f70 comp rx=0 tx=0).stop 2024-09-11T23:58:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.706+0000 7fa7fb074740 1 -- 172.21.15.6:0/56349424 shutdown_connections 2024-09-11T23:58:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.706+0000 7fa7fb074740 1 --2- 172.21.15.6:0/56349424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa010bb0 0x5631aa012fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.706+0000 7fa7fb074740 1 --2- 172.21.15.6:0/56349424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 0x5631aa010670 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.706+0000 7fa7fb074740 1 --2- 172.21.15.6:0/56349424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa0059d0 0x5631aa005db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.706+0000 7fa7fb074740 1 -- 172.21.15.6:0/56349424 >> 172.21.15.6:0/56349424 conn(0x5631aa001f60 msgr2=0x5631aa002340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.706+0000 7fa7fb074740 1 -- 172.21.15.6:0/56349424 shutdown_connections 2024-09-11T23:58:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.706+0000 7fa7fb074740 1 -- 172.21.15.6:0/56349424 wait complete. 2024-09-11T23:58:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.706+0000 7fa7fb074740 1 -- start start 2024-09-11T23:58:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7fb074740 1 Processor -- start 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7fb074740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0059d0 0x5631aa0103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7fb074740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 0x5631aa00d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7fb074740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa010bb0 0x5631aa00dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7fb074740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5631aa013780 con 0x5631aa0062f0 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7fb074740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5631a9f26f20 con 0x5631aa0059d0 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7fb074740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5631aa013900 con 0x5631aa010bb0 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7fb074740 10 client.0 _ll_register_callbacks cb 0x5631a9ef0030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7f1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 0x5631aa00d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7f1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 0x5631aa00d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54644/0 (socket says 172.21.15.6:54644) 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7f1d9b640 1 -- 172.21.15.6:0/307933284 learned_addr learned my addr 172.21.15.6:0/307933284 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7f2d9d640 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa010bb0 0x5631aa00dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7f259c640 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0059d0 0x5631aa0103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7f1d9b640 1 -- 172.21.15.6:0/307933284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa010bb0 msgr2=0x5631aa00dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7f1d9b640 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa010bb0 0x5631aa00dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7f1d9b640 1 -- 172.21.15.6:0/307933284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0059d0 msgr2=0x5631aa0103d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7f1d9b640 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0059d0 0x5631aa0103d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7f1d9b640 1 -- 172.21.15.6:0/307933284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631a9cdd2b0 con 0x5631aa0062f0 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.707+0000 7fa7f259c640 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0059d0 0x5631aa0103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7f1d9b640 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 0x5631aa00d720 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80978c0 tx=0x7fa7e8066580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13ca962a639108d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7d9ffb640 1 -- 172.21.15.6:0/307933284 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8020040 con 0x5631aa0062f0 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7d9ffb640 1 -- 172.21.15.6:0/307933284 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa7e80a3c40 con 0x5631aa0062f0 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7fb074740 1 -- 172.21.15.6:0/307933284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7e4015030 con 0x5631aa0062f0 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7d9ffb640 1 -- 172.21.15.6:0/307933284 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa7e8009de0 con 0x5631aa0062f0 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7fb074740 10 client.15087 fetch_fsmap learned FSMap version 27 2024-09-11T23:58:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7fb074740 1 -- 172.21.15.6:0/307933284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5631aa01f050 con 0x5631aa0062f0 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7d9ffb640 1 -- 172.21.15.6:0/307933284 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7e4015030 con 0x5631aa0062f0 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7d9ffb640 1 -- 172.21.15.6:0/307933284 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fa7e80b4250 con 0x5631aa0062f0 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7fb074740 10 client.15087 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7fb074740 10 client.15087 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7fb074740 20 client.15087 populate_metadata read hostname 'smithi006' 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7fb074740 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x5631aa021660 0x5631aa022ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7fb074740 4 client.15087 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.708+0000 7fa7fb074740 1 -- 172.21.15.6:0/307933284 --> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631a9f79600 con 0x5631aa021660 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.709+0000 7fa7f259c640 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x5631aa021660 0x5631aa022ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.709+0000 7fa7d9ffb640 10 client.15087 ms_handle_connect on v2:172.21.15.39:6836/902336458 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.709+0000 7fa7f259c640 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x5631aa021660 0x5631aa022ad0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c25ad89fab1f9474 server_cookie=7c361ca4184e3cb5 in_seq=0 out_seq=0 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7d9ffb640 1 -- 172.21.15.6:0/307933284 <== mds.4 v2:172.21.15.39:6836/902336458 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631a9f79600 con 0x5631aa021660 2024-09-11T23:58:47.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7d9ffb640 10 client.15087 handle_command_reply: tid=0 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7fb074740 1 client.15087 shutdown 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7fb074740 1 -- 172.21.15.6:0/307933284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 msgr2=0x5631aa00d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7fb074740 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 0x5631aa00d720 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80978c0 tx=0x7fa7e8066580 comp rx=0 tx=0).stop 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7fb074740 1 -- 172.21.15.6:0/307933284 shutdown_connections 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7fb074740 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x5631aa021660 0x5631aa022ad0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7fb074740 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa010bb0 0x5631aa00dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7d9ffb640 0 client.15087 ms_handle_reset on v2:172.21.15.39:6836/902336458 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7fb074740 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0062f0 0x5631aa00d720 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7fb074740 1 --2- 172.21.15.6:0/307933284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0059d0 0x5631aa0103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7fb074740 1 -- 172.21.15.6:0/307933284 >> 172.21.15.6:0/307933284 conn(0x5631aa001f60 msgr2=0x5631aa007c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7fb074740 1 -- 172.21.15.6:0/307933284 shutdown_connections 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7fb074740 1 -- 172.21.15.6:0/307933284 wait complete. 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.710+0000 7fa7fb074740 20 client.15087 trim_cache size 0 max 16384 2024-09-11T23:58:47.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.728+0000 7fa7fb074740 1 Processor -- start 2024-09-11T23:58:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.728+0000 7fa7fb074740 1 -- start start 2024-09-11T23:58:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.728+0000 7fa7fb074740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0059d0 0x5631aa01d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.728+0000 7fa7fb074740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa0062f0 0x5631aa00d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.728+0000 7fa7fb074740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa010bb0 0x5631aa00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.728+0000 7fa7fb074740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5631aa020e10 con 0x5631aa010bb0 2024-09-11T23:58:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.728+0000 7fa7fb074740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5631aa0214e0 con 0x5631aa0059d0 2024-09-11T23:58:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.728+0000 7fa7fb074740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5631aa021bb0 con 0x5631aa0062f0 2024-09-11T23:58:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.728+0000 7fa7f2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa010bb0 0x5631aa00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.728+0000 7fa7f2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa010bb0 0x5631aa00dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54652/0 (socket says 172.21.15.6:54652) 2024-09-11T23:58:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.728+0000 7fa7f259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0059d0 0x5631aa01d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.729+0000 7fa7f2d9d640 1 -- 172.21.15.6:0/1536184068 learned_addr learned my addr 172.21.15.6:0/1536184068 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.729+0000 7fa7f1d9b640 1 --2- 172.21.15.6:0/1536184068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa0062f0 0x5631aa00d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.729+0000 7fa7f2d9d640 1 -- 172.21.15.6:0/1536184068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa0062f0 msgr2=0x5631aa00d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.729+0000 7fa7f2d9d640 1 --2- 172.21.15.6:0/1536184068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa0062f0 0x5631aa00d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.729+0000 7fa7f2d9d640 1 -- 172.21.15.6:0/1536184068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0059d0 msgr2=0x5631aa01d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.729+0000 7fa7f2d9d640 1 --2- 172.21.15.6:0/1536184068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0059d0 0x5631aa01d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.729+0000 7fa7f2d9d640 1 -- 172.21.15.6:0/1536184068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631aa0132e0 con 0x5631aa010bb0 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.729+0000 7fa7f259c640 1 --2- 172.21.15.6:0/1536184068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0059d0 0x5631aa01d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.729+0000 7fa7f2d9d640 1 --2- 172.21.15.6:0/1536184068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa010bb0 0x5631aa00dc20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec033000 tx=0x7fa7ec03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6384cc8cb910b470 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.729+0000 7fa7dbfff640 1 -- 172.21.15.6:0/1536184068 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec041070 con 0x5631aa010bb0 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.729+0000 7fa7dbfff640 1 -- 172.21.15.6:0/1536184068 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7ec004240 con 0x5631aa010bb0 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.729+0000 7fa7dbfff640 1 -- 172.21.15.6:0/1536184068 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec035040 con 0x5631aa010bb0 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.730+0000 7fa7fb074740 1 -- 172.21.15.6:0/1536184068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa010bb0 msgr2=0x5631aa00dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.730+0000 7fa7fb074740 1 --2- 172.21.15.6:0/1536184068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa010bb0 0x5631aa00dc20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec033000 tx=0x7fa7ec03e000 comp rx=0 tx=0).stop 2024-09-11T23:58:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.730+0000 7fa7fb074740 1 -- 172.21.15.6:0/1536184068 shutdown_connections 2024-09-11T23:58:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.730+0000 7fa7fb074740 1 --2- 172.21.15.6:0/1536184068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa010bb0 0x5631aa00dc20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.730+0000 7fa7fb074740 1 --2- 172.21.15.6:0/1536184068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa0062f0 0x5631aa00d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.730+0000 7fa7fb074740 1 --2- 172.21.15.6:0/1536184068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0059d0 0x5631aa01d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.730+0000 7fa7fb074740 1 -- 172.21.15.6:0/1536184068 >> 172.21.15.6:0/1536184068 conn(0x5631aa001f60 msgr2=0x5631a9ffcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.730+0000 7fa7fb074740 1 -- 172.21.15.6:0/1536184068 shutdown_connections 2024-09-11T23:58:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.730+0000 7fa7fb074740 1 -- 172.21.15.6:0/1536184068 wait complete. 2024-09-11T23:58:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.730+0000 7fa7fb074740 1 -- start start 2024-09-11T23:58:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.730+0000 7fa7fb074740 1 Processor -- start 2024-09-11T23:58:47.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7fb074740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0059d0 0x5631aa024180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7fb074740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0062f0 0x5631aa0246c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7fb074740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa010bb0 0x5631aa089d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7fb074740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5631aa022950 con 0x5631aa0059d0 2024-09-11T23:58:47.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7fb074740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5631aa022280 con 0x5631aa0062f0 2024-09-11T23:58:47.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7fb074740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5631aa023020 con 0x5631aa010bb0 2024-09-11T23:58:47.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7fb074740 10 client.0 _ll_register_callbacks cb 0x7fa7e800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:47.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7f259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0059d0 0x5631aa024180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7f259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0059d0 0x5631aa024180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54658/0 (socket says 172.21.15.6:54658) 2024-09-11T23:58:47.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7f259c640 1 -- 172.21.15.6:0/254229645 learned_addr learned my addr 172.21.15.6:0/254229645 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:47.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7f2d9d640 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa010bb0 0x5631aa089d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7f1d9b640 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0062f0 0x5631aa0246c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7f259c640 1 -- 172.21.15.6:0/254229645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa010bb0 msgr2=0x5631aa089d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7f259c640 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa010bb0 0x5631aa089d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7f259c640 1 -- 172.21.15.6:0/254229645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0062f0 msgr2=0x5631aa0246c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7f259c640 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0062f0 0x5631aa0246c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7f259c640 1 -- 172.21.15.6:0/254229645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631aa08a2a0 con 0x5631aa0059d0 2024-09-11T23:58:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7f1d9b640 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0062f0 0x5631aa0246c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7f259c640 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0059d0 0x5631aa024180 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40044d0 tx=0x7fa7e4009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbe63e7b22a603d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:58:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.731+0000 7fa7d9ffb640 1 -- 172.21.15.6:0/254229645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4004a00 con 0x5631aa0059d0 2024-09-11T23:58:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7d9ffb640 1 -- 172.21.15.6:0/254229645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa7e4004ba0 con 0x5631aa0059d0 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7fb074740 1 -- 172.21.15.6:0/254229645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7ec004240 con 0x5631aa0059d0 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7d9ffb640 1 -- 172.21.15.6:0/254229645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa7e4004da0 con 0x5631aa0059d0 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7fb074740 10 client.15093 fetch_fsmap learned FSMap version 27 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7fb074740 1 -- 172.21.15.6:0/254229645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5631aa08b4e0 con 0x5631aa0059d0 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7d9ffb640 1 -- 172.21.15.6:0/254229645 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7ec004240 con 0x5631aa0059d0 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7d9ffb640 1 -- 172.21.15.6:0/254229645 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fa7e40051c0 con 0x5631aa0059d0 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7fb074740 10 client.15093 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7fb074740 10 client.15093 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7fb074740 20 client.15093 populate_metadata read hostname 'smithi006' 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7fb074740 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x5631aa08fee0 0x5631aa08ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7fb074740 4 client.15093 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.732+0000 7fa7fb074740 1 -- 172.21.15.6:0/254229645 --> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] -- command(tid 0: {"prefix": "status"}) -- 0x5631a9f73b10 con 0x5631aa08fee0 2024-09-11T23:58:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7f1d9b640 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x5631aa08fee0 0x5631aa08ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7f1d9b640 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x5631aa08fee0 0x5631aa08ebf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c14a731bf86faf34 server_cookie=9e5a50207d1e38de in_seq=0 out_seq=0 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7d9ffb640 10 client.15093 ms_handle_connect on v2:172.21.15.39:6836/902336458 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7d9ffb640 1 -- 172.21.15.6:0/254229645 <== mds.4 v2:172.21.15.39:6836/902336458 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5631a9f73b10 con 0x5631aa08fee0 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7d9ffb640 10 client.15093 handle_command_reply: tid=0 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7fb074740 1 client.15093 shutdown 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7fb074740 1 -- 172.21.15.6:0/254229645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0059d0 msgr2=0x5631aa024180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7fb074740 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0059d0 0x5631aa024180 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40044d0 tx=0x7fa7e4009440 comp rx=0 tx=0).stop 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7fb074740 1 -- 172.21.15.6:0/254229645 shutdown_connections 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7fb074740 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x5631aa08fee0 0x5631aa08ebf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7fb074740 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631aa010bb0 0x5631aa089d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7fb074740 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631aa0062f0 0x5631aa0246c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7fb074740 1 --2- 172.21.15.6:0/254229645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631aa0059d0 0x5631aa024180 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7d9ffb640 0 client.15093 ms_handle_reset on v2:172.21.15.39:6836/902336458 2024-09-11T23:58:47.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7fb074740 1 -- 172.21.15.6:0/254229645 >> 172.21.15.6:0/254229645 conn(0x5631aa001f60 msgr2=0x5631aa00d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:47.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7fb074740 1 -- 172.21.15.6:0/254229645 shutdown_connections 2024-09-11T23:58:47.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.733+0000 7fa7fb074740 1 -- 172.21.15.6:0/254229645 wait complete. 2024-09-11T23:58:47.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7fb074740 20 client.15093 trim_cache size 0 max 16384 2024-09-11T23:58:47.752 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:58:47.752 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:58:47.752 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 4, 2024-09-11T23:58:47.752 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24461, 2024-09-11T23:58:47.752 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-11T23:58:47.753 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-11T23:58:47.753 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-11T23:58:47.753 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 65.674706900999993, 2024-09-11T23:58:47.753 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2024-09-11T23:58:47.753 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 88, 2024-09-11T23:58:47.753 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:58:47.753 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 131.54371849099999 2024-09-11T23:58:47.753 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:58:47.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2782985070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa7dc0a2c90 msgr2=0x7fa7dc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7f8c9b640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa7dc0a2c90 0x7fa7dc0a5150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0096c0 tx=0x7fa7ec0058b0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2782985070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f4102570 msgr2=0x7fa7f419ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7f8c9b640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f4102570 0x7fa7f419ab10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800d950 tx=0x7fa7e800de10 comp rx=0 tx=0).stop 2024-09-11T23:58:47.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2782985070 shutdown_connections 2024-09-11T23:58:47.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7f8c9b640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa7dc0a2c90 0x7fa7dc0a5150 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7f8c9b640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f4102ef0 0x7fa7f419eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7f8c9b640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f4102570 0x7fa7f419ab10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7f8c9b640 1 --2- 172.21.15.6:0/2782985070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7f4100e20 0x7fa7f419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2782985070 >> 172.21.15.6:0/2782985070 conn(0x7fa7f40fc7d0 msgr2=0x7fa7f40ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:47.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2782985070 shutdown_connections 2024-09-11T23:58:47.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:47.734+0000 7fa7f8c9b640 1 -- 172.21.15.6:0/2782985070 wait complete. 2024-09-11T23:58:48.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:48 smithi039 ceph-mon[34543]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:58:48.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:48 smithi006 ceph-mon[30947]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:58:48.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:48 smithi134 ceph-mon[34893]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:58:48.524 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-11T23:58:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:49.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.264+0000 7fe89ccfc640 1 -- 172.21.15.6:0/367831915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe898106f10 msgr2=0x7fe89810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.264+0000 7fe89ccfc640 1 --2- 172.21.15.6:0/367831915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe898106f10 0x7fe89810ea90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe890009ca0 tx=0x7fe89002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.264+0000 7fe89ccfc640 1 -- 172.21.15.6:0/367831915 shutdown_connections 2024-09-11T23:58:49.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.264+0000 7fe89ccfc640 1 --2- 172.21.15.6:0/367831915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe898106f10 0x7fe89810ea90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.264+0000 7fe89ccfc640 1 --2- 172.21.15.6:0/367831915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe898102790 0x7fe8981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.264+0000 7fe89ccfc640 1 --2- 172.21.15.6:0/367831915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe898101de0 0x7fe8981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.264+0000 7fe89ccfc640 1 -- 172.21.15.6:0/367831915 >> 172.21.15.6:0/367831915 conn(0x7fe8980fd8c0 msgr2=0x7fe8980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:49.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.264+0000 7fe89ccfc640 1 -- 172.21.15.6:0/367831915 shutdown_connections 2024-09-11T23:58:49.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.264+0000 7fe89ccfc640 1 -- 172.21.15.6:0/367831915 wait complete. 2024-09-11T23:58:49.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.265+0000 7fe89ccfc640 1 Processor -- start 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.265+0000 7fe89ccfc640 1 -- start start 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.265+0000 7fe89ccfc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe898101de0 0x7fe898198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.265+0000 7fe89ccfc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe898102790 0x7fe8981988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.265+0000 7fe89ccfc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe898106f10 0x7fe89819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.265+0000 7fe89ccfc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe898111e20 con 0x7fe898101de0 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.265+0000 7fe89ccfc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe898111ca0 con 0x7fe898106f10 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.265+0000 7fe89ccfc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe898111fa0 con 0x7fe898102790 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.265+0000 7fe89659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe898101de0 0x7fe898198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.265+0000 7fe89659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe898101de0 0x7fe898198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54680/0 (socket says 172.21.15.6:54680) 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.265+0000 7fe89659c640 1 -- 172.21.15.6:0/1914665840 learned_addr learned my addr 172.21.15.6:0/1914665840 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe88dd9b640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe898102790 0x7fe8981988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe896d9d640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe898106f10 0x7fe89819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe89659c640 1 -- 172.21.15.6:0/1914665840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe898102790 msgr2=0x7fe8981988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe89659c640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe898102790 0x7fe8981988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe89659c640 1 -- 172.21.15.6:0/1914665840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe898106f10 msgr2=0x7fe89819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe89659c640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe898106f10 0x7fe89819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe89659c640 1 -- 172.21.15.6:0/1914665840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89819d330 con 0x7fe898101de0 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe896d9d640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe898106f10 0x7fe89819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe89659c640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe898101de0 0x7fe898198380 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe88800c890 tx=0x7fe88800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe88ffff640 1 -- 172.21.15.6:0/1914665840 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888004220 con 0x7fe898101de0 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe89ccfc640 1 -- 172.21.15.6:0/1914665840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89819d620 con 0x7fe898101de0 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe88ffff640 1 -- 172.21.15.6:0/1914665840 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe8880043c0 con 0x7fe898101de0 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe88ffff640 1 -- 172.21.15.6:0/1914665840 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888004a00 con 0x7fe898101de0 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.266+0000 7fe89ccfc640 1 -- 172.21.15.6:0/1914665840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8981a4f00 con 0x7fe898101de0 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.268+0000 7fe88ffff640 1 -- 172.21.15.6:0/1914665840 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe888004bc0 con 0x7fe898101de0 2024-09-11T23:58:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.269+0000 7fe89f0d5740 1 Processor -- start 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.269+0000 7fe89f0d5740 1 -- start start 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.269+0000 7fe88ffff640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe8840a2c10 0x7fe8840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.269+0000 7fe89f0d5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 0x55a2cd76cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.269+0000 7fe89f0d5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76d2f0 0x55a2cd777670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.269+0000 7fe89f0d5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd777bb0 0x55a2cd779fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.269+0000 7fe89f0d5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a2cd6d3090 con 0x55a2cd76c9d0 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.269+0000 7fe89f0d5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a2cd67aa70 con 0x55a2cd777bb0 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.269+0000 7fe89f0d5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a2cd6cf050 con 0x55a2cd76d2f0 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.269+0000 7fe896d9d640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe8840a2c10 0x7fe8840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.269+0000 7fe88ffff640 1 -- 172.21.15.6:0/1914665840 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fe8880cf1d0 con 0x7fe898101de0 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.269+0000 7fe89659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 0x55a2cd76cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe89659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 0x55a2cd76cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54696/0 (socket says 172.21.15.6:54696) 2024-09-11T23:58:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe89659c640 1 -- 172.21.15.6:0/2518783060 learned_addr learned my addr 172.21.15.6:0/2518783060 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe88dd9b640 1 --2- 172.21.15.6:0/2518783060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76d2f0 0x55a2cd777670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe896d9d640 1 --2- 172.21.15.6:0/2518783060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd777bb0 0x55a2cd779fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe89659c640 1 -- 172.21.15.6:0/2518783060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76d2f0 msgr2=0x55a2cd777670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe89659c640 1 --2- 172.21.15.6:0/2518783060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76d2f0 0x55a2cd777670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe89659c640 1 -- 172.21.15.6:0/2518783060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd777bb0 msgr2=0x55a2cd779fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe89659c640 1 --2- 172.21.15.6:0/2518783060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd777bb0 0x55a2cd779fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe89659c640 1 -- 172.21.15.6:0/2518783060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2cd687130 con 0x55a2cd76c9d0 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe896d9d640 1 --2- 172.21.15.6:0/2518783060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd777bb0 0x55a2cd779fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe88dd9b640 1 --2- 172.21.15.6:0/2518783060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76d2f0 0x55a2cd777670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe896d9d640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe8840a2c10 0x7fe8840a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe890031040 tx=0x7fe890009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe89659c640 1 --2- 172.21.15.6:0/2518783060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 0x55a2cd76cdb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe8880ccda0 tx=0x7fe88809b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf47370adbc3ef49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe88cd99640 1 -- 172.21.15.6:0/2518783060 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88801d040 con 0x55a2cd76c9d0 2024-09-11T23:58:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe88cd99640 1 -- 172.21.15.6:0/2518783060 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe88809bc70 con 0x55a2cd76c9d0 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.270+0000 7fe88cd99640 1 -- 172.21.15.6:0/2518783060 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88809b570 con 0x55a2cd76c9d0 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.271+0000 7fe89f0d5740 1 -- 172.21.15.6:0/2518783060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 msgr2=0x55a2cd76cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.271+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/2518783060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 0x55a2cd76cdb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe8880ccda0 tx=0x7fe88809b400 comp rx=0 tx=0).stop 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.271+0000 7fe89f0d5740 1 -- 172.21.15.6:0/2518783060 shutdown_connections 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.271+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/2518783060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd777bb0 0x55a2cd779fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.271+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/2518783060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76d2f0 0x55a2cd777670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.271+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/2518783060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 0x55a2cd76cdb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.271+0000 7fe89f0d5740 1 -- 172.21.15.6:0/2518783060 >> 172.21.15.6:0/2518783060 conn(0x55a2cd768f60 msgr2=0x55a2cd769340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.271+0000 7fe89f0d5740 1 -- 172.21.15.6:0/2518783060 shutdown_connections 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.271+0000 7fe89f0d5740 1 -- 172.21.15.6:0/2518783060 wait complete. 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe89f0d5740 1 -- start start 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe89f0d5740 1 Processor -- start 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe89f0d5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76c9d0 0x55a2cd777450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe89f0d5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76d2f0 0x55a2cd7747f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe89f0d5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd777bb0 0x55a2cd774d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe89f0d5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a2cd77eb90 con 0x55a2cd76d2f0 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe89f0d5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a2cd68df20 con 0x55a2cd777bb0 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe89f0d5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a2cd77ed10 con 0x55a2cd76c9d0 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe89f0d5740 10 client.0 _ll_register_callbacks cb 0x55a2cd657030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe88dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76d2f0 0x55a2cd7747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe88dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76d2f0 0x55a2cd7747f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54708/0 (socket says 172.21.15.6:54708) 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe88dd9b640 1 -- 172.21.15.6:0/122534948 learned_addr learned my addr 172.21.15.6:0/122534948 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe89659c640 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76c9d0 0x55a2cd777450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe896d9d640 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd777bb0 0x55a2cd774d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe88dd9b640 1 -- 172.21.15.6:0/122534948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76c9d0 msgr2=0x55a2cd777450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe88dd9b640 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76c9d0 0x55a2cd777450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe88dd9b640 1 -- 172.21.15.6:0/122534948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd777bb0 msgr2=0x55a2cd774d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe88dd9b640 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd777bb0 0x55a2cd774d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe88dd9b640 1 -- 172.21.15.6:0/122534948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2cd4442b0 con 0x55a2cd76d2f0 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.272+0000 7fe896d9d640 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd777bb0 0x55a2cd774d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe88dd9b640 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76d2f0 0x55a2cd7747f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b990 tx=0x7fe88000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d807529e3170e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe87dffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe87dffb640 1 -- 172.21.15.6:0/122534948 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880003e00 con 0x55a2cd76d2f0 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe87dffb640 1 -- 172.21.15.6:0/122534948 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fe880011440 con 0x55a2cd76d2f0 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe89f0d5740 1 -- 172.21.15.6:0/122534948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe88809bc70 con 0x55a2cd76d2f0 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe87dffb640 1 -- 172.21.15.6:0/122534948 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe880005020 con 0x55a2cd76d2f0 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe89f0d5740 10 client.15105 fetch_fsmap learned FSMap version 27 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe89f0d5740 1 -- 172.21.15.6:0/122534948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a2cd78a560 con 0x55a2cd76d2f0 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe87dffb640 1 -- 172.21.15.6:0/122534948 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe88809bc70 con 0x55a2cd76d2f0 2024-09-11T23:58:49.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe87dffb640 1 -- 172.21.15.6:0/122534948 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fe880011640 con 0x55a2cd76d2f0 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe89f0d5740 10 client.15105 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe89f0d5740 10 client.15105 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe89f0d5740 20 client.15105 populate_metadata read hostname 'smithi006' 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55a2cd78cc30 0x55a2cd78e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe89f0d5740 4 client.15105 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.273+0000 7fe89f0d5740 1 -- 172.21.15.6:0/122534948 --> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2cd6e0600 con 0x55a2cd78cc30 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.274+0000 7fe89659c640 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55a2cd78cc30 0x55a2cd78e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.274+0000 7fe89659c640 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55a2cd78cc30 0x55a2cd78e0a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c56b458e759d61af server_cookie=3c73a88ca8afa111 in_seq=0 out_seq=0 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.274+0000 7fe87dffb640 10 client.15105 ms_handle_connect on v2:172.21.15.134:6834/530621436 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe87dffb640 1 -- 172.21.15.6:0/122534948 <== mds.3 v2:172.21.15.134:6834/530621436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2cd6e0600 con 0x55a2cd78cc30 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe87dffb640 10 client.15105 handle_command_reply: tid=0 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe89f0d5740 1 client.15105 shutdown 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe89f0d5740 1 -- 172.21.15.6:0/122534948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76d2f0 msgr2=0x55a2cd7747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76d2f0 0x55a2cd7747f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b990 tx=0x7fe88000be50 comp rx=0 tx=0).stop 2024-09-11T23:58:49.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe89f0d5740 1 -- 172.21.15.6:0/122534948 shutdown_connections 2024-09-11T23:58:49.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55a2cd78cc30 0x55a2cd78e0a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd777bb0 0x55a2cd774d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76d2f0 0x55a2cd7747f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe87dffb640 0 client.15105 ms_handle_reset on v2:172.21.15.134:6834/530621436 2024-09-11T23:58:49.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/122534948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76c9d0 0x55a2cd777450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe89f0d5740 1 -- 172.21.15.6:0/122534948 >> 172.21.15.6:0/122534948 conn(0x55a2cd768f60 msgr2=0x55a2cd76ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:49.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe89f0d5740 1 -- 172.21.15.6:0/122534948 shutdown_connections 2024-09-11T23:58:49.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe89f0d5740 1 -- 172.21.15.6:0/122534948 wait complete. 2024-09-11T23:58:49.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.275+0000 7fe89f0d5740 20 client.15105 trim_cache size 0 max 16384 2024-09-11T23:58:49.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.293+0000 7fe89f0d5740 1 Processor -- start 2024-09-11T23:58:49.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.293+0000 7fe89f0d5740 1 -- start start 2024-09-11T23:58:49.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.293+0000 7fe89f0d5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 0x55a2cd78d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.293+0000 7fe89f0d5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd76d2f0 0x55a2cd763ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.293+0000 7fe89f0d5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd777bb0 0x55a2cd776650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.293+0000 7fe89f0d5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a2cd78c3e0 con 0x55a2cd76c9d0 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.293+0000 7fe89f0d5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a2cd78cab0 con 0x55a2cd76d2f0 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.293+0000 7fe89f0d5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a2cd78d180 con 0x55a2cd777bb0 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.293+0000 7fe89659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 0x55a2cd78d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.294+0000 7fe89659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 0x55a2cd78d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54714/0 (socket says 172.21.15.6:54714) 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.294+0000 7fe89659c640 1 -- 172.21.15.6:0/87665566 learned_addr learned my addr 172.21.15.6:0/87665566 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.294+0000 7fe89659c640 1 -- 172.21.15.6:0/87665566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd777bb0 msgr2=0x55a2cd776650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.294+0000 7fe89659c640 1 --2- 172.21.15.6:0/87665566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd777bb0 0x55a2cd776650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.294+0000 7fe89659c640 1 -- 172.21.15.6:0/87665566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd76d2f0 msgr2=0x55a2cd763ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.294+0000 7fe89659c640 1 --2- 172.21.15.6:0/87665566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd76d2f0 0x55a2cd763ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.294+0000 7fe89659c640 1 -- 172.21.15.6:0/87665566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2cd7737a0 con 0x55a2cd76c9d0 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.294+0000 7fe89659c640 1 --2- 172.21.15.6:0/87665566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 0x55a2cd78d300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe88800a630 tx=0x7fe888005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bcffe8cb973ec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.294+0000 7fe87ffff640 1 -- 172.21.15.6:0/87665566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88801d040 con 0x55a2cd76c9d0 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.294+0000 7fe87ffff640 1 -- 172.21.15.6:0/87665566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe88809f920 con 0x55a2cd76c9d0 2024-09-11T23:58:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.294+0000 7fe87ffff640 1 -- 172.21.15.6:0/87665566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8880cca70 con 0x55a2cd76c9d0 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 -- 172.21.15.6:0/87665566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 msgr2=0x55a2cd78d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/87665566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 0x55a2cd78d300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe88800a630 tx=0x7fe888005760 comp rx=0 tx=0).stop 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 -- 172.21.15.6:0/87665566 shutdown_connections 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/87665566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd777bb0 0x55a2cd776650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/87665566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd76d2f0 0x55a2cd763ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/87665566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd76c9d0 0x55a2cd78d300 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 -- 172.21.15.6:0/87665566 >> 172.21.15.6:0/87665566 conn(0x55a2cd768f60 msgr2=0x55a2cd775f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 -- 172.21.15.6:0/87665566 shutdown_connections 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 -- 172.21.15.6:0/87665566 wait complete. 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 -- start start 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 Processor -- start 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd76c9d0 0x55a2cd796810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76d2f0 0x55a2cd791b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.295+0000 7fe89f0d5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd777bb0 0x55a2cd792080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe89f0d5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a2cd78df20 con 0x55a2cd777bb0 2024-09-11T23:58:49.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe89f0d5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a2cd78d850 con 0x55a2cd76c9d0 2024-09-11T23:58:49.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe89f0d5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a2cd78e5f0 con 0x55a2cd76d2f0 2024-09-11T23:58:49.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe89f0d5740 10 client.0 _ll_register_callbacks cb 0x7fe8800041f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:49.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe896d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd777bb0 0x55a2cd792080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe896d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd777bb0 0x55a2cd792080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54724/0 (socket says 172.21.15.6:54724) 2024-09-11T23:58:49.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe896d9d640 1 -- 172.21.15.6:0/3574197578 learned_addr learned my addr 172.21.15.6:0/3574197578 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:49.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe89659c640 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd76c9d0 0x55a2cd796810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe88dd9b640 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76d2f0 0x55a2cd791b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe896d9d640 1 -- 172.21.15.6:0/3574197578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76d2f0 msgr2=0x55a2cd791b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe896d9d640 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76d2f0 0x55a2cd791b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe896d9d640 1 -- 172.21.15.6:0/3574197578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd76c9d0 msgr2=0x55a2cd796810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe896d9d640 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd76c9d0 0x55a2cd796810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe896d9d640 1 -- 172.21.15.6:0/3574197578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2cd7925f0 con 0x55a2cd777bb0 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe896d9d640 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd777bb0 0x55a2cd792080 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe890035000 tx=0x7fe8900095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a6b89c90ab2654 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe87dffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.296+0000 7fe87dffb640 1 -- 172.21.15.6:0/3574197578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900305c0 con 0x55a2cd777bb0 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe87dffb640 1 -- 172.21.15.6:0/3574197578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fe890030760 con 0x55a2cd777bb0 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe89f0d5740 1 -- 172.21.15.6:0/3574197578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe88809f920 con 0x55a2cd777bb0 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe87dffb640 1 -- 172.21.15.6:0/3574197578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe89005c050 con 0x55a2cd777bb0 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe89f0d5740 10 client.15111 fetch_fsmap learned FSMap version 27 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe89f0d5740 1 -- 172.21.15.6:0/3574197578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a2cd7f70a0 con 0x55a2cd777bb0 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe87dffb640 1 -- 172.21.15.6:0/3574197578 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe88809f920 con 0x55a2cd777bb0 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe87dffb640 1 -- 172.21.15.6:0/3574197578 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fe89002f9c0 con 0x55a2cd777bb0 2024-09-11T23:58:49.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe89f0d5740 10 client.15111 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe89f0d5740 10 client.15111 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe89f0d5740 20 client.15111 populate_metadata read hostname 'smithi006' 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55a2cd7fbc20 0x55a2cd7fa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe89f0d5740 4 client.15111 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.297+0000 7fe89f0d5740 1 -- 172.21.15.6:0/3574197578 --> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] -- command(tid 0: {"prefix": "status"}) -- 0x55a2cd6dab10 con 0x55a2cd7fbc20 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe89659c640 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55a2cd7fbc20 0x55a2cd7fa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe89659c640 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55a2cd7fbc20 0x55a2cd7fa930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=46e325e13a0c6559 server_cookie=de78c5be9c1d5ae7 in_seq=0 out_seq=0 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe87dffb640 10 client.15111 ms_handle_connect on v2:172.21.15.134:6834/530621436 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe87dffb640 1 -- 172.21.15.6:0/3574197578 <== mds.3 v2:172.21.15.134:6834/530621436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a2cd6dab10 con 0x55a2cd7fbc20 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe87dffb640 10 client.15111 handle_command_reply: tid=0 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe89f0d5740 1 client.15111 shutdown 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe89f0d5740 1 -- 172.21.15.6:0/3574197578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd777bb0 msgr2=0x55a2cd792080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd777bb0 0x55a2cd792080 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe890035000 tx=0x7fe8900095c0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe89f0d5740 1 -- 172.21.15.6:0/3574197578 shutdown_connections 2024-09-11T23:58:49.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55a2cd7fbc20 0x55a2cd7fa930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2cd777bb0 0x55a2cd792080 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a2cd76d2f0 0x55a2cd791b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe89f0d5740 1 --2- 172.21.15.6:0/3574197578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a2cd76c9d0 0x55a2cd796810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe89f0d5740 1 -- 172.21.15.6:0/3574197578 >> 172.21.15.6:0/3574197578 conn(0x55a2cd768f60 msgr2=0x55a2cd768000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:49.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.298+0000 7fe87dffb640 0 client.15111 ms_handle_reset on v2:172.21.15.134:6834/530621436 2024-09-11T23:58:49.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89f0d5740 1 -- 172.21.15.6:0/3574197578 shutdown_connections 2024-09-11T23:58:49.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89f0d5740 1 -- 172.21.15.6:0/3574197578 wait complete. 2024-09-11T23:58:49.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89f0d5740 20 client.15111 trim_cache size 0 max 16384 2024-09-11T23:58:49.308 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:58:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:58:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 3, 2024-09-11T23:58:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24472, 2024-09-11T23:58:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-11T23:58:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-11T23:58:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-11T23:58:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 68.255467491000005, 2024-09-11T23:58:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2024-09-11T23:58:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 88, 2024-09-11T23:58:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:58:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 138.41697671599999 2024-09-11T23:58:49.309 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:58:49.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89ccfc640 1 -- 172.21.15.6:0/1914665840 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe8840a2c10 msgr2=0x7fe8840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89ccfc640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe8840a2c10 0x7fe8840a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe890031040 tx=0x7fe890009360 comp rx=0 tx=0).stop 2024-09-11T23:58:49.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89ccfc640 1 -- 172.21.15.6:0/1914665840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe898101de0 msgr2=0x7fe898198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89ccfc640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe898101de0 0x7fe898198380 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe88800c890 tx=0x7fe88800cd50 comp rx=0 tx=0).stop 2024-09-11T23:58:49.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89ccfc640 1 -- 172.21.15.6:0/1914665840 shutdown_connections 2024-09-11T23:58:49.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89ccfc640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe8840a2c10 0x7fe8840a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89ccfc640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe898106f10 0x7fe89819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89ccfc640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe898102790 0x7fe8981988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89ccfc640 1 --2- 172.21.15.6:0/1914665840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe898101de0 0x7fe898198380 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89ccfc640 1 -- 172.21.15.6:0/1914665840 >> 172.21.15.6:0/1914665840 conn(0x7fe8980fd8c0 msgr2=0x7fe8980fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:49.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89ccfc640 1 -- 172.21.15.6:0/1914665840 shutdown_connections 2024-09-11T23:58:49.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:49.299+0000 7fe89ccfc640 1 -- 172.21.15.6:0/1914665840 wait complete. 2024-09-11T23:58:50.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T23:58:50.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:50 smithi039 ceph-mon[34543]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:50.341 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:50.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:50 smithi006 ceph-mon[30947]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:50.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:50 smithi134 ceph-mon[34893]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.831+0000 7f0d4f129640 1 -- 172.21.15.6:0/3608484141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d48100a80 msgr2=0x7f0d48100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.831+0000 7f0d4f129640 1 --2- 172.21.15.6:0/3608484141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d48100a80 0x7f0d48100ee0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009930 tx=0x7f0d3402a420 comp rx=0 tx=0).stop 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.831+0000 7f0d4f129640 1 -- 172.21.15.6:0/3608484141 shutdown_connections 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.831+0000 7f0d4f129640 1 --2- 172.21.15.6:0/3608484141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d48101420 0x7f0d4810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.831+0000 7f0d4f129640 1 --2- 172.21.15.6:0/3608484141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d48100a80 0x7f0d48100ee0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.831+0000 7f0d4f129640 1 --2- 172.21.15.6:0/3608484141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d48106a80 0x7f0d48106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.831+0000 7f0d4f129640 1 -- 172.21.15.6:0/3608484141 >> 172.21.15.6:0/3608484141 conn(0x7f0d480fc7a0 msgr2=0x7f0d480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.831+0000 7f0d4f129640 1 -- 172.21.15.6:0/3608484141 shutdown_connections 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.831+0000 7f0d4f129640 1 -- 172.21.15.6:0/3608484141 wait complete. 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.832+0000 7f0d4f129640 1 Processor -- start 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.832+0000 7f0d4f129640 1 -- start start 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.832+0000 7f0d4f129640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d48100a80 0x7f0d481983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.832+0000 7f0d4f129640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d48101420 0x7f0d48198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.832+0000 7f0d4f129640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d48106a80 0x7f0d4819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.832+0000 7f0d4f129640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0d48110d80 con 0x7f0d48106a80 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.832+0000 7f0d4f129640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0d48110c00 con 0x7f0d48101420 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.832+0000 7f0d4f129640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d48110f00 con 0x7f0d48100a80 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d4d6c6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d48106a80 0x7f0d4819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d4d6c6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d48106a80 0x7f0d4819cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35202/0 (socket says 172.21.15.6:35202) 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d4d6c6640 1 -- 172.21.15.6:0/3617037136 learned_addr learned my addr 172.21.15.6:0/3617037136 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d4cec5640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d48100a80 0x7f0d481983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d47fff640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d48101420 0x7f0d48198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d4d6c6640 1 -- 172.21.15.6:0/3617037136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d48100a80 msgr2=0x7f0d481983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d4d6c6640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d48100a80 0x7f0d481983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d4d6c6640 1 -- 172.21.15.6:0/3617037136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d48101420 msgr2=0x7f0d48198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d4d6c6640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d48101420 0x7f0d48198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d4d6c6640 1 -- 172.21.15.6:0/3617037136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4819d370 con 0x7f0d48106a80 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d4d6c6640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d48106a80 0x7f0d4819cc90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000cad0 tx=0x7f0d4000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d45ffb640 1 -- 172.21.15.6:0/3617037136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000ae20 con 0x7f0d48106a80 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d45ffb640 1 -- 172.21.15.6:0/3617037136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d40005020 con 0x7f0d48106a80 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d4f129640 1 -- 172.21.15.6:0/3617037136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4819d660 con 0x7f0d48106a80 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.833+0000 7f0d45ffb640 1 -- 172.21.15.6:0/3617037136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000f6b0 con 0x7f0d48106a80 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.834+0000 7f0d4f129640 1 -- 172.21.15.6:0/3617037136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d481a4f40 con 0x7f0d48106a80 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.836+0000 7f0d45ffb640 1 -- 172.21.15.6:0/3617037136 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f0d400051d0 con 0x7f0d48106a80 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.836+0000 7f0d51502740 1 Processor -- start 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.836+0000 7f0d51502740 1 -- start start 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.836+0000 7f0d51502740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d149d0 0x560325d14db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.836+0000 7f0d51502740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d152f0 0x560325d1f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.836+0000 7f0d51502740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 0x560325d21fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.836+0000 7f0d51502740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560325c7b090 con 0x560325d1fbb0 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.836+0000 7f0d51502740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560325c22a70 con 0x560325d149d0 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.836+0000 7f0d51502740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560325c77050 con 0x560325d152f0 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d45ffb640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0d380a2c90 0x7f0d380a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 0x560325d21fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 0x560325d21fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35214/0 (socket says 172.21.15.6:35214) 2024-09-11T23:58:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d47fff640 1 -- 172.21.15.6:0/621913237 learned_addr learned my addr 172.21.15.6:0/621913237 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d4d6c6640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0d380a2c90 0x7f0d380a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d47fff640 1 --2- 172.21.15.6:0/621913237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d149d0 0x560325d14db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d45ffb640 1 -- 172.21.15.6:0/3617037136 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f0d400cf530 con 0x7f0d48106a80 2024-09-11T23:58:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d4cec5640 1 --2- 172.21.15.6:0/621913237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d152f0 0x560325d1f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d47fff640 1 -- 172.21.15.6:0/621913237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d152f0 msgr2=0x560325d1f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d47fff640 1 --2- 172.21.15.6:0/621913237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d152f0 0x560325d1f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d47fff640 1 -- 172.21.15.6:0/621913237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d149d0 msgr2=0x560325d14db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d47fff640 1 --2- 172.21.15.6:0/621913237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d149d0 0x560325d14db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d47fff640 1 -- 172.21.15.6:0/621913237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560325c2f130 con 0x560325d1fbb0 2024-09-11T23:58:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d47fff640 1 --2- 172.21.15.6:0/621913237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 0x560325d21fa0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009930 tx=0x7f0d34000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbaa5eee6df9ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d4d6c6640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0d380a2c90 0x7f0d380a5150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d4009b5d0 tx=0x7f0d4006d8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.837+0000 7f0d32ffd640 1 -- 172.21.15.6:0/621913237 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34035040 con 0x560325d1fbb0 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.838+0000 7f0d32ffd640 1 -- 172.21.15.6:0/621913237 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d34005020 con 0x560325d1fbb0 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.838+0000 7f0d32ffd640 1 -- 172.21.15.6:0/621913237 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34004a00 con 0x560325d1fbb0 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.838+0000 7f0d51502740 1 -- 172.21.15.6:0/621913237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 msgr2=0x560325d21fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.838+0000 7f0d51502740 1 --2- 172.21.15.6:0/621913237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 0x560325d21fa0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009930 tx=0x7f0d34000bc0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.838+0000 7f0d51502740 1 -- 172.21.15.6:0/621913237 shutdown_connections 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.838+0000 7f0d51502740 1 --2- 172.21.15.6:0/621913237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 0x560325d21fa0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.838+0000 7f0d51502740 1 --2- 172.21.15.6:0/621913237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d152f0 0x560325d1f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.838+0000 7f0d51502740 1 --2- 172.21.15.6:0/621913237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d149d0 0x560325d14db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.838+0000 7f0d51502740 1 -- 172.21.15.6:0/621913237 >> 172.21.15.6:0/621913237 conn(0x560325d10f60 msgr2=0x560325d11340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.838+0000 7f0d51502740 1 -- 172.21.15.6:0/621913237 shutdown_connections 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.838+0000 7f0d51502740 1 -- 172.21.15.6:0/621913237 wait complete. 2024-09-11T23:58:50.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d51502740 1 -- start start 2024-09-11T23:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d51502740 1 Processor -- start 2024-09-11T23:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d51502740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d149d0 0x560325d1f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d51502740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d152f0 0x560325d1c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d51502740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 0x560325d1cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d51502740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560325d26b90 con 0x560325d1fbb0 2024-09-11T23:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d51502740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560325c35f20 con 0x560325d152f0 2024-09-11T23:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d51502740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560325d26d10 con 0x560325d149d0 2024-09-11T23:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d51502740 10 client.0 _ll_register_callbacks cb 0x560325bff030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 0x560325d1cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 0x560325d1cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35226/0 (socket says 172.21.15.6:35226) 2024-09-11T23:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d47fff640 1 -- 172.21.15.6:0/43579231 learned_addr learned my addr 172.21.15.6:0/43579231 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.839+0000 7f0d4cec5640 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d152f0 0x560325d1c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d47fff640 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d149d0 0x560325d1f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d47fff640 1 -- 172.21.15.6:0/43579231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d149d0 msgr2=0x560325d1f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d47fff640 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d149d0 0x560325d1f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d47fff640 1 -- 172.21.15.6:0/43579231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d152f0 msgr2=0x560325d1c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d47fff640 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d152f0 0x560325d1c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d47fff640 1 -- 172.21.15.6:0/43579231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603259ec2b0 con 0x560325d1fbb0 2024-09-11T23:58:50.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d47fff640 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 0x560325d1cd30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0d3402a940 tx=0x7f0d34004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636976523409d7eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:50.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d27fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:58:50.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d27fff640 1 -- 172.21.15.6:0/43579231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34035040 con 0x560325d1fbb0 2024-09-11T23:58:50.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d27fff640 1 -- 172.21.15.6:0/43579231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f0d34003ac0 con 0x560325d1fbb0 2024-09-11T23:58:50.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d51502740 1 -- 172.21.15.6:0/43579231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d34005020 con 0x560325d1fbb0 2024-09-11T23:58:50.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d27fff640 1 -- 172.21.15.6:0/43579231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d3405a050 con 0x560325d1fbb0 2024-09-11T23:58:50.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d51502740 10 client.15123 fetch_fsmap learned FSMap version 27 2024-09-11T23:58:50.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d51502740 1 -- 172.21.15.6:0/43579231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560325d32500 con 0x560325d1fbb0 2024-09-11T23:58:50.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.840+0000 7f0d27fff640 1 -- 172.21.15.6:0/43579231 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d34005020 con 0x560325d1fbb0 2024-09-11T23:58:50.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.841+0000 7f0d27fff640 1 -- 172.21.15.6:0/43579231 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f0d3403a040 con 0x560325d1fbb0 2024-09-11T23:58:50.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.841+0000 7f0d51502740 10 client.15123 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:58:50.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.841+0000 7f0d51502740 10 client.15123 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:58:50.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.841+0000 7f0d51502740 20 client.15123 populate_metadata read hostname 'smithi006' 2024-09-11T23:58:50.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.841+0000 7f0d51502740 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x560325d33850 0x560325d359a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.841+0000 7f0d51502740 4 client.15123 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:58:50.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.841+0000 7f0d51502740 1 -- 172.21.15.6:0/43579231 --> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560325c88600 con 0x560325d33850 2024-09-11T23:58:50.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.841+0000 7f0d4cec5640 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x560325d33850 0x560325d359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.842+0000 7f0d4cec5640 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x560325d33850 0x560325d359a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9d44457d6589bd6 server_cookie=394114645a401094 in_seq=0 out_seq=0 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.842+0000 7f0d27fff640 10 client.15123 ms_handle_connect on v2:172.21.15.134:6836/4248937946 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.842+0000 7f0d27fff640 1 -- 172.21.15.6:0/43579231 <== mds.2 v2:172.21.15.134:6836/4248937946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560325c88600 con 0x560325d33850 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.842+0000 7f0d27fff640 10 client.15123 handle_command_reply: tid=0 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.842+0000 7f0d51502740 1 client.15123 shutdown 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.843+0000 7f0d51502740 1 -- 172.21.15.6:0/43579231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 msgr2=0x560325d1cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.843+0000 7f0d51502740 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 0x560325d1cd30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0d3402a940 tx=0x7f0d34004540 comp rx=0 tx=0).stop 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.843+0000 7f0d51502740 1 -- 172.21.15.6:0/43579231 shutdown_connections 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.843+0000 7f0d51502740 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x560325d33850 0x560325d359a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.843+0000 7f0d51502740 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d1fbb0 0x560325d1cd30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.843+0000 7f0d51502740 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d152f0 0x560325d1c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.843+0000 7f0d27fff640 0 client.15123 ms_handle_reset on v2:172.21.15.134:6836/4248937946 2024-09-11T23:58:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.843+0000 7f0d51502740 1 --2- 172.21.15.6:0/43579231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d149d0 0x560325d1f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.843+0000 7f0d51502740 1 -- 172.21.15.6:0/43579231 >> 172.21.15.6:0/43579231 conn(0x560325d10f60 msgr2=0x560325d16c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:50.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.843+0000 7f0d51502740 1 -- 172.21.15.6:0/43579231 shutdown_connections 2024-09-11T23:58:50.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.843+0000 7f0d51502740 1 -- 172.21.15.6:0/43579231 wait complete. 2024-09-11T23:58:50.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.843+0000 7f0d51502740 20 client.15123 trim_cache size 0 max 16384 2024-09-11T23:58:50.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d51502740 1 Processor -- start 2024-09-11T23:58:50.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d51502740 1 -- start start 2024-09-11T23:58:50.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d51502740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 0x560325d1c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d51502740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d152f0 0x560325d0fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d51502740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d1fbb0 0x560325d19ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d51502740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560325d33ce0 con 0x560325d149d0 2024-09-11T23:58:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d51502740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560325d343b0 con 0x560325d152f0 2024-09-11T23:58:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d51502740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560325d34a80 con 0x560325d1fbb0 2024-09-11T23:58:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 0x560325d1c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 0x560325d1c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35232/0 (socket says 172.21.15.6:35232) 2024-09-11T23:58:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d47fff640 1 -- 172.21.15.6:0/793615763 learned_addr learned my addr 172.21.15.6:0/793615763 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d4cec5640 1 --2- 172.21.15.6:0/793615763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d152f0 0x560325d0fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d47fff640 1 -- 172.21.15.6:0/793615763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d1fbb0 msgr2=0x560325d19ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d47fff640 1 --2- 172.21.15.6:0/793615763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d1fbb0 0x560325d19ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d47fff640 1 -- 172.21.15.6:0/793615763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d152f0 msgr2=0x560325d0fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d47fff640 1 --2- 172.21.15.6:0/793615763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d152f0 0x560325d0fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.861+0000 7f0d47fff640 1 -- 172.21.15.6:0/793615763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560325d1f0c0 con 0x560325d149d0 2024-09-11T23:58:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.862+0000 7f0d47fff640 1 --2- 172.21.15.6:0/793615763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 0x560325d1c0b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0d34005940 tx=0x7f0d340057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1f57dec90954b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.862+0000 7f0d327fc640 1 -- 172.21.15.6:0/793615763 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34035040 con 0x560325d149d0 2024-09-11T23:58:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.862+0000 7f0d327fc640 1 -- 172.21.15.6:0/793615763 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d34005560 con 0x560325d149d0 2024-09-11T23:58:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.862+0000 7f0d327fc640 1 -- 172.21.15.6:0/793615763 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34004a70 con 0x560325d149d0 2024-09-11T23:58:50.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.862+0000 7f0d51502740 1 -- 172.21.15.6:0/793615763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 msgr2=0x560325d1c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.862+0000 7f0d51502740 1 --2- 172.21.15.6:0/793615763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 0x560325d1c0b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0d34005940 tx=0x7f0d340057a0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.862+0000 7f0d51502740 1 -- 172.21.15.6:0/793615763 shutdown_connections 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.862+0000 7f0d51502740 1 --2- 172.21.15.6:0/793615763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d1fbb0 0x560325d19ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.862+0000 7f0d51502740 1 --2- 172.21.15.6:0/793615763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d152f0 0x560325d0fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.862+0000 7f0d51502740 1 --2- 172.21.15.6:0/793615763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 0x560325d1c0b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.862+0000 7f0d51502740 1 -- 172.21.15.6:0/793615763 >> 172.21.15.6:0/793615763 conn(0x560325d10f60 msgr2=0x560325d0f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.862+0000 7f0d51502740 1 -- 172.21.15.6:0/793615763 shutdown_connections 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d51502740 1 -- 172.21.15.6:0/793615763 wait complete. 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d51502740 1 -- start start 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d51502740 1 Processor -- start 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d51502740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 0x560325d3e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d51502740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d152f0 0x560325d39470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d51502740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d1fbb0 0x560325d399b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d51502740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560325d35820 con 0x560325d149d0 2024-09-11T23:58:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d51502740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560325d35150 con 0x560325d1fbb0 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d51502740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560325d35ef0 con 0x560325d152f0 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d51502740 10 client.0 _ll_register_callbacks cb 0x7f0d34004380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 0x560325d3e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 0x560325d3e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35234/0 (socket says 172.21.15.6:35234) 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.863+0000 7f0d47fff640 1 -- 172.21.15.6:0/3269856357 learned_addr learned my addr 172.21.15.6:0/3269856357 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d4cec5640 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d152f0 0x560325d39470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d47fff640 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d1fbb0 0x560325d399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d47fff640 1 -- 172.21.15.6:0/3269856357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d152f0 msgr2=0x560325d39470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d47fff640 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d152f0 0x560325d39470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d47fff640 1 -- 172.21.15.6:0/3269856357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d1fbb0 msgr2=0x560325d399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d47fff640 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d1fbb0 0x560325d399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d47fff640 1 -- 172.21.15.6:0/3269856357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560325d39ef0 con 0x560325d149d0 2024-09-11T23:58:50.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d47fff640 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 0x560325d3e0a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0d34040040 tx=0x7f0d340318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893b0c1ee247b645 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d27fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d27fff640 1 -- 172.21.15.6:0/3269856357 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34031d00 con 0x560325d149d0 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d27fff640 1 -- 172.21.15.6:0/3269856357 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f0d34004810 con 0x560325d149d0 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d51502740 1 -- 172.21.15.6:0/3269856357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d34005560 con 0x560325d149d0 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d27fff640 1 -- 172.21.15.6:0/3269856357 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d34004a10 con 0x560325d149d0 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d51502740 10 client.15129 fetch_fsmap learned FSMap version 27 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.864+0000 7f0d51502740 1 -- 172.21.15.6:0/3269856357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560325d9e930 con 0x560325d149d0 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.865+0000 7f0d27fff640 1 -- 172.21.15.6:0/3269856357 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d34005560 con 0x560325d149d0 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.865+0000 7f0d27fff640 1 -- 172.21.15.6:0/3269856357 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f0d3405f480 con 0x560325d149d0 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.865+0000 7f0d51502740 10 client.15129 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.865+0000 7f0d51502740 10 client.15129 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.865+0000 7f0d51502740 20 client.15129 populate_metadata read hostname 'smithi006' 2024-09-11T23:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.865+0000 7f0d51502740 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x560325da2fb0 0x560325da1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.865+0000 7f0d51502740 4 client.15129 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.865+0000 7f0d51502740 1 -- 172.21.15.6:0/3269856357 --> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] -- command(tid 0: {"prefix": "status"}) -- 0x560325c82b10 con 0x560325da2fb0 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.865+0000 7f0d4cec5640 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x560325da2fb0 0x560325da1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d4cec5640 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x560325da2fb0 0x560325da1cc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3af1d7f64b6c5084 server_cookie=51aff3af269057f9 in_seq=0 out_seq=0 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d27fff640 10 client.15129 ms_handle_connect on v2:172.21.15.134:6836/4248937946 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d27fff640 1 -- 172.21.15.6:0/3269856357 <== mds.2 v2:172.21.15.134:6836/4248937946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560325c82b10 con 0x560325da2fb0 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d27fff640 10 client.15129 handle_command_reply: tid=0 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d51502740 1 client.15129 shutdown 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d51502740 1 -- 172.21.15.6:0/3269856357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 msgr2=0x560325d3e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d51502740 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 0x560325d3e0a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0d34040040 tx=0x7f0d340318e0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d51502740 1 -- 172.21.15.6:0/3269856357 shutdown_connections 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d51502740 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x560325da2fb0 0x560325da1cc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d51502740 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560325d1fbb0 0x560325d399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d51502740 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560325d152f0 0x560325d39470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d51502740 1 --2- 172.21.15.6:0/3269856357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560325d149d0 0x560325d3e0a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d51502740 1 -- 172.21.15.6:0/3269856357 >> 172.21.15.6:0/3269856357 conn(0x560325d10f60 msgr2=0x560325d10000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:50.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d27fff640 0 client.15129 ms_handle_reset on v2:172.21.15.134:6836/4248937946 2024-09-11T23:58:50.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d51502740 1 -- 172.21.15.6:0/3269856357 shutdown_connections 2024-09-11T23:58:50.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d51502740 1 -- 172.21.15.6:0/3269856357 wait complete. 2024-09-11T23:58:50.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.866+0000 7f0d51502740 20 client.15129 trim_cache size 0 max 16384 2024-09-11T23:58:50.871 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:58:50.871 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:58:50.871 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 2, 2024-09-11T23:58:50.871 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24478, 2024-09-11T23:58:50.872 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-11T23:58:50.872 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-11T23:58:50.872 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-11T23:58:50.872 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 70.839510915999995, 2024-09-11T23:58:50.872 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2024-09-11T23:58:50.872 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 88, 2024-09-11T23:58:50.872 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:58:50.872 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 137.41077642499999 2024-09-11T23:58:50.872 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:58:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.867+0000 7f0d4f129640 1 -- 172.21.15.6:0/3617037136 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0d380a2c90 msgr2=0x7f0d380a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.867+0000 7f0d4f129640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0d380a2c90 0x7f0d380a5150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d4009b5d0 tx=0x7f0d4006d8e0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.867+0000 7f0d4f129640 1 -- 172.21.15.6:0/3617037136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d48106a80 msgr2=0x7f0d4819cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.867+0000 7f0d4f129640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d48106a80 0x7f0d4819cc90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000cad0 tx=0x7f0d4000cf90 comp rx=0 tx=0).stop 2024-09-11T23:58:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.867+0000 7f0d4f129640 1 -- 172.21.15.6:0/3617037136 shutdown_connections 2024-09-11T23:58:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.867+0000 7f0d4f129640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0d380a2c90 0x7f0d380a5150 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.867+0000 7f0d4f129640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d48106a80 0x7f0d4819cc90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.867+0000 7f0d4f129640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d48101420 0x7f0d48198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.867+0000 7f0d4f129640 1 --2- 172.21.15.6:0/3617037136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d48100a80 0x7f0d481983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.867+0000 7f0d4f129640 1 -- 172.21.15.6:0/3617037136 >> 172.21.15.6:0/3617037136 conn(0x7f0d480fc7a0 msgr2=0x7f0d4806ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:50.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.867+0000 7f0d4f129640 1 -- 172.21.15.6:0/3617037136 shutdown_connections 2024-09-11T23:58:50.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:50.867+0000 7f0d4f129640 1 -- 172.21.15.6:0/3617037136 wait complete. 2024-09-11T23:58:51.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T23:58:51.976 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:52.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:52 smithi039 ceph-mon[34543]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:58:52.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:52 smithi006 ceph-mon[30947]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:58:52.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:52 smithi134 ceph-mon[34893]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:58:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.459+0000 7f0bc6659640 1 -- 172.21.15.6:0/2163141611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bc0102790 msgr2=0x7f0bc01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.459+0000 7f0bc6659640 1 --2- 172.21.15.6:0/2163141611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bc0102790 0x7f0bc01067e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009900 tx=0x7f0bb402a410 comp rx=0 tx=0).stop 2024-09-11T23:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.459+0000 7f0bc6659640 1 -- 172.21.15.6:0/2163141611 shutdown_connections 2024-09-11T23:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.459+0000 7f0bc6659640 1 --2- 172.21.15.6:0/2163141611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc0106f10 0x7f0bc010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.459+0000 7f0bc6659640 1 --2- 172.21.15.6:0/2163141611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bc0102790 0x7f0bc01067e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.459+0000 7f0bc6659640 1 --2- 172.21.15.6:0/2163141611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bc0101de0 0x7f0bc01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.459+0000 7f0bc6659640 1 -- 172.21.15.6:0/2163141611 >> 172.21.15.6:0/2163141611 conn(0x7f0bc00fd8c0 msgr2=0x7f0bc00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.459+0000 7f0bc6659640 1 -- 172.21.15.6:0/2163141611 shutdown_connections 2024-09-11T23:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.459+0000 7f0bc6659640 1 -- 172.21.15.6:0/2163141611 wait complete. 2024-09-11T23:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bc6659640 1 Processor -- start 2024-09-11T23:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bc6659640 1 -- start start 2024-09-11T23:58:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bc6659640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bc0101de0 0x7f0bc01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bc6659640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc0102790 0x7f0bc0198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bc6659640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bc0106f10 0x7f0bc019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bc6659640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc0111e20 con 0x7f0bc0106f10 2024-09-11T23:58:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bc6659640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc0111ca0 con 0x7f0bc0102790 2024-09-11T23:58:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bc6659640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc0111fa0 con 0x7f0bc0101de0 2024-09-11T23:58:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bc4bf6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bc0106f10 0x7f0bc019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bc4bf6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bc0106f10 0x7f0bc019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35262/0 (socket says 172.21.15.6:35262) 2024-09-11T23:58:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bc4bf6640 1 -- 172.21.15.6:0/2957267549 learned_addr learned my addr 172.21.15.6:0/2957267549 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc0102790 0x7f0bc0198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.460+0000 7f0bbffff640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bc0101de0 0x7f0bc01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.461+0000 7f0bc4bf6640 1 -- 172.21.15.6:0/2957267549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bc0101de0 msgr2=0x7f0bc01983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.461+0000 7f0bc4bf6640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bc0101de0 0x7f0bc01983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.461+0000 7f0bc4bf6640 1 -- 172.21.15.6:0/2957267549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc0102790 msgr2=0x7f0bc0198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.461+0000 7f0bc4bf6640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc0102790 0x7f0bc0198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.461+0000 7f0bc4bf6640 1 -- 172.21.15.6:0/2957267549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc019d370 con 0x7f0bc0106f10 2024-09-11T23:58:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.461+0000 7f0bbffff640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bc0101de0 0x7f0bc01983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.461+0000 7f0bc4bf6640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bc0106f10 0x7f0bc019cc90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800eaa0 tx=0x7f0bb800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.461+0000 7f0bbd7fa640 1 -- 172.21.15.6:0/2957267549 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb800cdb0 con 0x7f0bc0106f10 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.461+0000 7f0bbd7fa640 1 -- 172.21.15.6:0/2957267549 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0bb8005020 con 0x7f0bc0106f10 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.461+0000 7f0bc6659640 1 -- 172.21.15.6:0/2957267549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc019d660 con 0x7f0bc0106f10 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.461+0000 7f0bbd7fa640 1 -- 172.21.15.6:0/2957267549 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80116d0 con 0x7f0bc0106f10 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.461+0000 7f0bc6659640 1 -- 172.21.15.6:0/2957267549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc01a4f40 con 0x7f0bc0106f10 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.463+0000 7f0bbd7fa640 1 -- 172.21.15.6:0/2957267549 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f0bb80051d0 con 0x7f0bc0106f10 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bc8a32740 1 Processor -- start 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bc8a32740 1 -- start start 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bc8a32740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 0x5629c0890c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bc8a32740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08911d0 0x5629c089fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bc8a32740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c089ffc0 0x5629c08a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bc8a32740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5629c07f7090 con 0x5629c08908b0 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bc8a32740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5629c079ea70 con 0x5629c08911d0 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bc8a32740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5629c07f3050 con 0x5629c089ffc0 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bbf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 0x5629c0890c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bbf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 0x5629c0890c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35264/0 (socket says 172.21.15.6:35264) 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bbf7fe640 1 -- 172.21.15.6:0/2584117147 learned_addr learned my addr 172.21.15.6:0/2584117147 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bbffff640 1 --2- 172.21.15.6:0/2584117147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08911d0 0x5629c089fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bbd7fa640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0ba80a2c90 0x7f0ba80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.464+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/2584117147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c089ffc0 0x5629c08a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.465+0000 7f0bbf7fe640 1 -- 172.21.15.6:0/2584117147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c089ffc0 msgr2=0x5629c08a23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.465+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/2584117147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c089ffc0 0x5629c08a23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.465+0000 7f0bbf7fe640 1 -- 172.21.15.6:0/2584117147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08911d0 msgr2=0x5629c089fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.465+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/2584117147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08911d0 0x5629c089fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.465+0000 7f0bc4bf6640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0ba80a2c90 0x7f0ba80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.465+0000 7f0bbf7fe640 1 -- 172.21.15.6:0/2584117147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629c07ab130 con 0x5629c08908b0 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.465+0000 7f0bbd7fa640 1 -- 172.21.15.6:0/2957267549 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f0bb80cf620 con 0x7f0bc0106f10 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.465+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/2584117147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 0x5629c0890c90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0bb402a930 tx=0x7f0bb4005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83150327a4b271eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.465+0000 7f0ba67fc640 1 -- 172.21.15.6:0/2584117147 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4044020 con 0x5629c08908b0 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.465+0000 7f0ba67fc640 1 -- 172.21.15.6:0/2584117147 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0bb40317e0 con 0x5629c08908b0 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.465+0000 7f0ba67fc640 1 -- 172.21.15.6:0/2584117147 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4035040 con 0x5629c08908b0 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.466+0000 7f0bc8a32740 1 -- 172.21.15.6:0/2584117147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 msgr2=0x5629c0890c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.466+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/2584117147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 0x5629c0890c90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0bb402a930 tx=0x7f0bb4005c00 comp rx=0 tx=0).stop 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.466+0000 7f0bc4bf6640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0ba80a2c90 0x7f0ba80a5150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8097e20 tx=0x7f0bb8066640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.466+0000 7f0bc8a32740 1 -- 172.21.15.6:0/2584117147 shutdown_connections 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.466+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/2584117147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c089ffc0 0x5629c08a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.466+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/2584117147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08911d0 0x5629c089fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.466+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/2584117147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 0x5629c0890c90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.466+0000 7f0bc8a32740 1 -- 172.21.15.6:0/2584117147 >> 172.21.15.6:0/2584117147 conn(0x5629c088cf60 msgr2=0x5629c088d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.466+0000 7f0bc8a32740 1 -- 172.21.15.6:0/2584117147 shutdown_connections 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.466+0000 7f0bc8a32740 1 -- 172.21.15.6:0/2584117147 wait complete. 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.466+0000 7f0bc8a32740 1 -- start start 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.466+0000 7f0bc8a32740 1 Processor -- start 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bc8a32740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08908b0 0x5629c089f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bc8a32740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c08911d0 0x5629c089cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bc8a32740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c089ffc0 0x5629c089d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bc8a32740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5629c08a2b90 con 0x5629c089ffc0 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bc8a32740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5629c07b1f20 con 0x5629c08908b0 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bc8a32740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5629c08a2d10 con 0x5629c08911d0 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bc8a32740 10 client.0 _ll_register_callbacks cb 0x5629c077b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bbf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c089ffc0 0x5629c089d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bbf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c089ffc0 0x5629c089d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35280/0 (socket says 172.21.15.6:35280) 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bbf7fe640 1 -- 172.21.15.6:0/246026923 learned_addr learned my addr 172.21.15.6:0/246026923 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08908b0 0x5629c089f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bbffff640 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c08911d0 0x5629c089cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bbf7fe640 1 -- 172.21.15.6:0/246026923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c08911d0 msgr2=0x5629c089cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c08911d0 0x5629c089cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bbf7fe640 1 -- 172.21.15.6:0/246026923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08908b0 msgr2=0x5629c089f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08908b0 0x5629c089f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bbf7fe640 1 -- 172.21.15.6:0/246026923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629c05682b0 con 0x5629c089ffc0 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c089ffc0 0x5629c089d0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4032fd0 tx=0x7f0bb4040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f0e1a5251cb9c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.467+0000 7f0b9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0b9f7fe640 1 -- 172.21.15.6:0/246026923 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb404e020 con 0x5629c089ffc0 2024-09-11T23:58:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0b9f7fe640 1 -- 172.21.15.6:0/246026923 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f0bb40048c0 con 0x5629c089ffc0 2024-09-11T23:58:52.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0bc8a32740 1 -- 172.21.15.6:0/246026923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bb40317e0 con 0x5629c089ffc0 2024-09-11T23:58:52.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0b9f7fe640 1 -- 172.21.15.6:0/246026923 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0bb4035070 con 0x5629c089ffc0 2024-09-11T23:58:52.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0bc8a32740 10 client.15141 fetch_fsmap learned FSMap version 27 2024-09-11T23:58:52.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0bc8a32740 1 -- 172.21.15.6:0/246026923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5629c08ae4c0 con 0x5629c089ffc0 2024-09-11T23:58:52.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0b9f7fe640 1 -- 172.21.15.6:0/246026923 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0bb40317e0 con 0x5629c089ffc0 2024-09-11T23:58:52.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0b9f7fe640 1 -- 172.21.15.6:0/246026923 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f0bb404a9c0 con 0x5629c089ffc0 2024-09-11T23:58:52.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0bc8a32740 10 client.15141 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:58:52.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0bc8a32740 10 client.15141 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:58:52.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0bc8a32740 20 client.15141 populate_metadata read hostname 'smithi006' 2024-09-11T23:58:52.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x5629c08af810 0x5629c08b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0bc8a32740 4 client.15141 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:58:52.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.468+0000 7f0bc8a32740 1 -- 172.21.15.6:0/246026923 --> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629c0804600 con 0x5629c08af810 2024-09-11T23:58:52.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.469+0000 7f0bbffff640 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x5629c08af810 0x5629c08b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.469+0000 7f0b9f7fe640 10 client.15141 ms_handle_connect on v2:172.21.15.134:6838/45989022 2024-09-11T23:58:52.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.469+0000 7f0bbffff640 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x5629c08af810 0x5629c08b1a10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8a43f0563ba1d43a server_cookie=1e19e5c1740ecef6 in_seq=0 out_seq=0 2024-09-11T23:58:52.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0b9f7fe640 1 -- 172.21.15.6:0/246026923 <== mds.1 v2:172.21.15.134:6838/45989022 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629c0804600 con 0x5629c08af810 2024-09-11T23:58:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0b9f7fe640 10 client.15141 handle_command_reply: tid=0 2024-09-11T23:58:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0bc8a32740 1 client.15141 shutdown 2024-09-11T23:58:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0bc8a32740 1 -- 172.21.15.6:0/246026923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c089ffc0 msgr2=0x5629c089d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c089ffc0 0x5629c089d0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4032fd0 tx=0x7f0bb4040040 comp rx=0 tx=0).stop 2024-09-11T23:58:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0bc8a32740 1 -- 172.21.15.6:0/246026923 shutdown_connections 2024-09-11T23:58:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x5629c08af810 0x5629c08b1a10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c089ffc0 0x5629c089d0c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c08911d0 0x5629c089cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0b9f7fe640 0 client.15141 ms_handle_reset on v2:172.21.15.134:6838/45989022 2024-09-11T23:58:52.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/246026923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08908b0 0x5629c089f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0bc8a32740 1 -- 172.21.15.6:0/246026923 >> 172.21.15.6:0/246026923 conn(0x5629c088cf60 msgr2=0x5629c0892cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:52.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0bc8a32740 1 -- 172.21.15.6:0/246026923 shutdown_connections 2024-09-11T23:58:52.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.470+0000 7f0bc8a32740 1 -- 172.21.15.6:0/246026923 wait complete. 2024-09-11T23:58:52.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.471+0000 7f0bc8a32740 20 client.15141 trim_cache size 0 max 16384 2024-09-11T23:58:52.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.488+0000 7f0bc8a32740 1 Processor -- start 2024-09-11T23:58:52.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.488+0000 7f0bc8a32740 1 -- start start 2024-09-11T23:58:52.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.488+0000 7f0bc8a32740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c08908b0 0x5629c08b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.488+0000 7f0bc8a32740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08911d0 0x5629c08b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.488+0000 7f0bc8a32740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c089ffc0 0x5629c08afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.488+0000 7f0bc8a32740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5629c08afd50 con 0x5629c08911d0 2024-09-11T23:58:52.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.488+0000 7f0bc8a32740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5629c08b0420 con 0x5629c089ffc0 2024-09-11T23:58:52.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0bc8a32740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5629c08b0af0 con 0x5629c08908b0 2024-09-11T23:58:52.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0bbffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08911d0 0x5629c08b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0bbffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08911d0 0x5629c08b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35286/0 (socket says 172.21.15.6:35286) 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0bbffff640 1 -- 172.21.15.6:0/1286768869 learned_addr learned my addr 172.21.15.6:0/1286768869 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/1286768869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c08908b0 0x5629c08b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0bbffff640 1 -- 172.21.15.6:0/1286768869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c08908b0 msgr2=0x5629c08b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0bbffff640 1 --2- 172.21.15.6:0/1286768869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c08908b0 0x5629c08b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0bbffff640 1 -- 172.21.15.6:0/1286768869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c089ffc0 msgr2=0x5629c08afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0bbffff640 1 --2- 172.21.15.6:0/1286768869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c089ffc0 0x5629c08afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0bbffff640 1 -- 172.21.15.6:0/1286768869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629c089fba0 con 0x5629c08911d0 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0bbffff640 1 --2- 172.21.15.6:0/1286768869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08911d0 0x5629c08b05a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0004570 tx=0x7f0bb000bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1f40ffab4d3d74 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0ba5ffb640 1 -- 172.21.15.6:0/1286768869 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0003d60 con 0x5629c08911d0 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0ba5ffb640 1 -- 172.21.15.6:0/1286768869 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0bb00118f0 con 0x5629c08911d0 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.489+0000 7f0ba5ffb640 1 -- 172.21.15.6:0/1286768869 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb001c8b0 con 0x5629c08911d0 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.490+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286768869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08911d0 msgr2=0x5629c08b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.490+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/1286768869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08911d0 0x5629c08b05a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0004570 tx=0x7f0bb000bdb0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.490+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286768869 shutdown_connections 2024-09-11T23:58:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.490+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/1286768869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c089ffc0 0x5629c08afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.490+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/1286768869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08911d0 0x5629c08b05a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.490+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/1286768869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c08908b0 0x5629c08b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.490+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286768869 >> 172.21.15.6:0/1286768869 conn(0x5629c088cf60 msgr2=0x5629c088d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.490+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286768869 shutdown_connections 2024-09-11T23:58:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.490+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286768869 wait complete. 2024-09-11T23:58:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.490+0000 7f0bc8a32740 1 -- start start 2024-09-11T23:58:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.490+0000 7f0bc8a32740 1 Processor -- start 2024-09-11T23:58:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bc8a32740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 0x5629c08b9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bc8a32740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08911d0 0x5629c08ba510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bc8a32740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c089ffc0 0x5629c08b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bc8a32740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5629c08b1890 con 0x5629c08908b0 2024-09-11T23:58:52.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bc8a32740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5629c08b11c0 con 0x5629c08911d0 2024-09-11T23:58:52.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bc8a32740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5629c08b1f60 con 0x5629c089ffc0 2024-09-11T23:58:52.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bc8a32740 10 client.0 _ll_register_callbacks cb 0x7f0bb000b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:52.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bbf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 0x5629c08b9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bbf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 0x5629c08b9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35294/0 (socket says 172.21.15.6:35294) 2024-09-11T23:58:52.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bbf7fe640 1 -- 172.21.15.6:0/1286637747 learned_addr learned my addr 172.21.15.6:0/1286637747 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:52.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c089ffc0 0x5629c08b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bbffff640 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08911d0 0x5629c08ba510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bbf7fe640 1 -- 172.21.15.6:0/1286637747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c089ffc0 msgr2=0x5629c08b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:52.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c089ffc0 0x5629c08b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bbf7fe640 1 -- 172.21.15.6:0/1286637747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08911d0 msgr2=0x5629c08ba510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:52.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08911d0 0x5629c08ba510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bbf7fe640 1 -- 172.21.15.6:0/1286637747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629c08b3bc0 con 0x5629c08908b0 2024-09-11T23:58:52.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bbf7fe640 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 0x5629c08b9fd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0bb402a930 tx=0x7f0bb402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f289a07d88ec67b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:52.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0b9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:58:52.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0b9f7fe640 1 -- 172.21.15.6:0/1286637747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb404e070 con 0x5629c08908b0 2024-09-11T23:58:52.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0b9f7fe640 1 -- 172.21.15.6:0/1286637747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f0bb4005310 con 0x5629c08908b0 2024-09-11T23:58:52.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.491+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286637747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bb00118f0 con 0x5629c08908b0 2024-09-11T23:58:52.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.492+0000 7f0b9f7fe640 1 -- 172.21.15.6:0/1286637747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0bb4069050 con 0x5629c08908b0 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.492+0000 7f0bc8a32740 10 client.15147 fetch_fsmap learned FSMap version 27 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.492+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286637747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5629c08b86b0 con 0x5629c08908b0 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.492+0000 7f0b9f7fe640 1 -- 172.21.15.6:0/1286637747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0bb00118f0 con 0x5629c08908b0 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.492+0000 7f0b9f7fe640 1 -- 172.21.15.6:0/1286637747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f0bb4060070 con 0x5629c08908b0 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.492+0000 7f0bc8a32740 10 client.15147 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.492+0000 7f0bc8a32740 10 client.15147 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.492+0000 7f0bc8a32740 20 client.15147 populate_metadata read hostname 'smithi006' 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.492+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x5629c091f430 0x5629c091e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.492+0000 7f0bc8a32740 4 client.15147 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.492+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286637747 --> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] -- command(tid 0: {"prefix": "status"}) -- 0x5629c07feb10 con 0x5629c091f430 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.492+0000 7f0bbffff640 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x5629c091f430 0x5629c091e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0bbffff640 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x5629c091f430 0x5629c091e140 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3cc92b6f83615e61 server_cookie=febeb7683aff5526 in_seq=0 out_seq=0 2024-09-11T23:58:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0b9f7fe640 10 client.15147 ms_handle_connect on v2:172.21.15.134:6838/45989022 2024-09-11T23:58:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0b9f7fe640 1 -- 172.21.15.6:0/1286637747 <== mds.1 v2:172.21.15.134:6838/45989022 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5629c07feb10 con 0x5629c091f430 2024-09-11T23:58:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0b9f7fe640 10 client.15147 handle_command_reply: tid=0 2024-09-11T23:58:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0bc8a32740 1 client.15147 shutdown 2024-09-11T23:58:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286637747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 msgr2=0x5629c08b9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 0x5629c08b9fd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0bb402a930 tx=0x7f0bb402a410 comp rx=0 tx=0).stop 2024-09-11T23:58:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286637747 shutdown_connections 2024-09-11T23:58:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5629c089ffc0 0x5629c08b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629c08911d0 0x5629c08ba510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x5629c091f430 0x5629c091e140 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.514 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:58:52.515 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:58:52.515 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 1, 2024-09-11T23:58:52.515 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24490, 2024-09-11T23:58:52.515 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-11T23:58:52.515 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-11T23:58:52.515 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-11T23:58:52.515 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 73.471618445999994, 2024-09-11T23:58:52.515 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2024-09-11T23:58:52.515 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 88, 2024-09-11T23:58:52.515 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:58:52.516 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 133.756477709 2024-09-11T23:58:52.516 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:58:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0bc8a32740 1 --2- 172.21.15.6:0/1286637747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629c08908b0 0x5629c08b9fd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0b9f7fe640 0 client.15147 ms_handle_reset on v2:172.21.15.134:6838/45989022 2024-09-11T23:58:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286637747 >> 172.21.15.6:0/1286637747 conn(0x5629c088cf60 msgr2=0x5629c0887ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286637747 shutdown_connections 2024-09-11T23:58:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.493+0000 7f0bc8a32740 1 -- 172.21.15.6:0/1286637747 wait complete. 2024-09-11T23:58:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc8a32740 20 client.15147 trim_cache size 0 max 16384 2024-09-11T23:58:52.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc6659640 1 -- 172.21.15.6:0/2957267549 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0ba80a2c90 msgr2=0x7f0ba80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc6659640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0ba80a2c90 0x7f0ba80a5150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8097e20 tx=0x7f0bb8066640 comp rx=0 tx=0).stop 2024-09-11T23:58:52.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc6659640 1 -- 172.21.15.6:0/2957267549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bc0106f10 msgr2=0x7f0bc019cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc6659640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bc0106f10 0x7f0bc019cc90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800eaa0 tx=0x7f0bb800ef60 comp rx=0 tx=0).stop 2024-09-11T23:58:52.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc6659640 1 -- 172.21.15.6:0/2957267549 shutdown_connections 2024-09-11T23:58:52.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc6659640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f0ba80a2c90 0x7f0ba80a5150 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc6659640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bc0106f10 0x7f0bc019cc90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc6659640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc0102790 0x7f0bc0198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc6659640 1 --2- 172.21.15.6:0/2957267549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bc0101de0 0x7f0bc01983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc6659640 1 -- 172.21.15.6:0/2957267549 >> 172.21.15.6:0/2957267549 conn(0x7f0bc00fd8c0 msgr2=0x7f0bc00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:52.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc6659640 1 -- 172.21.15.6:0/2957267549 shutdown_connections 2024-09-11T23:58:52.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:52.494+0000 7f0bc6659640 1 -- 172.21.15.6:0/2957267549 wait complete. 2024-09-11T23:58:53.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T23:58:53.532 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.994+0000 7f3928db0640 1 -- 172.21.15.6:0/1144296859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3924102790 msgr2=0x7f39241067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.994+0000 7f3928db0640 1 --2- 172.21.15.6:0/1144296859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3924102790 0x7f39241067e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3918009900 tx=0x7f391802a410 comp rx=0 tx=0).stop 2024-09-11T23:58:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.994+0000 7f3928db0640 1 -- 172.21.15.6:0/1144296859 shutdown_connections 2024-09-11T23:58:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.994+0000 7f3928db0640 1 --2- 172.21.15.6:0/1144296859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3924106f10 0x7f392410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.994+0000 7f3928db0640 1 --2- 172.21.15.6:0/1144296859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3924102790 0x7f39241067e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.994+0000 7f3928db0640 1 --2- 172.21.15.6:0/1144296859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3924101de0 0x7f39241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.994+0000 7f3928db0640 1 -- 172.21.15.6:0/1144296859 >> 172.21.15.6:0/1144296859 conn(0x7f39240fd8c0 msgr2=0x7f39240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.994+0000 7f3928db0640 1 -- 172.21.15.6:0/1144296859 shutdown_connections 2024-09-11T23:58:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.994+0000 7f3928db0640 1 -- 172.21.15.6:0/1144296859 wait complete. 2024-09-11T23:58:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.995+0000 7f3928db0640 1 Processor -- start 2024-09-11T23:58:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.995+0000 7f3928db0640 1 -- start start 2024-09-11T23:58:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.995+0000 7f3928db0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3924101de0 0x7f39240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.995+0000 7f3928db0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3924102790 0x7f3924074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.995+0000 7f3928db0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3924106f10 0x7f3924074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.995+0000 7f3928db0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3924111ec0 con 0x7f3924106f10 2024-09-11T23:58:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.995+0000 7f3928db0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3924111d40 con 0x7f3924101de0 2024-09-11T23:58:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.995+0000 7f3928db0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3924112040 con 0x7f3924102790 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.995+0000 7f3922d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3924106f10 0x7f3924074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.995+0000 7f3922d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3924106f10 0x7f3924074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35320/0 (socket says 172.21.15.6:35320) 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.995+0000 7f3922d9d640 1 -- 172.21.15.6:0/1164413430 learned_addr learned my addr 172.21.15.6:0/1164413430 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f392259c640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3924101de0 0x7f39240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f3921d9b640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3924102790 0x7f3924074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f3922d9d640 1 -- 172.21.15.6:0/1164413430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3924102790 msgr2=0x7f3924074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f3922d9d640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3924102790 0x7f3924074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f3922d9d640 1 -- 172.21.15.6:0/1164413430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3924101de0 msgr2=0x7f39240744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f3922d9d640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3924101de0 0x7f39240744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f3922d9d640 1 -- 172.21.15.6:0/1164413430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39241a69e0 con 0x7f3924106f10 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f392259c640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3924101de0 0x7f39240744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f3922d9d640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3924106f10 0x7f3924074f70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f391c00b970 tx=0x7f391c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f39137fe640 1 -- 172.21.15.6:0/1164413430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c019070 con 0x7f3924106f10 2024-09-11T23:58:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f39137fe640 1 -- 172.21.15.6:0/1164413430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f391c014440 con 0x7f3924106f10 2024-09-11T23:58:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f39137fe640 1 -- 172.21.15.6:0/1164413430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c0075d0 con 0x7f3924106f10 2024-09-11T23:58:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f3928db0640 1 -- 172.21.15.6:0/1164413430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39241a6cd0 con 0x7f3924106f10 2024-09-11T23:58:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.996+0000 7f3928db0640 1 -- 172.21.15.6:0/1164413430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39241a7190 con 0x7f3924106f10 2024-09-11T23:58:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.998+0000 7f39137fe640 1 -- 172.21.15.6:0/1164413430 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f391c01c070 con 0x7f3924106f10 2024-09-11T23:58:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f392b189740 1 Processor -- start 2024-09-11T23:58:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f392b189740 1 -- start start 2024-09-11T23:58:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f392b189740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22c9d0 0x555e5c22cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f392b189740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c22d2f0 0x555e5c237670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f392b189740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c237bb0 0x555e5c239fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f392b189740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555e5c193090 con 0x555e5c237bb0 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f392b189740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555e5c13aa70 con 0x555e5c22c9d0 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f392b189740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555e5c18f050 con 0x555e5c22d2f0 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f39137fe640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f390c0a2c10 0x7f390c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f3921d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c237bb0 0x555e5c239fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f3921d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c237bb0 0x555e5c239fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35332/0 (socket says 172.21.15.6:35332) 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f3921d9b640 1 -- 172.21.15.6:0/1997528570 learned_addr learned my addr 172.21.15.6:0/1997528570 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f3922d9d640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f390c0a2c10 0x7f390c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:53.999+0000 7f392259c640 1 --2- 172.21.15.6:0/1997528570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c22d2f0 0x555e5c237670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.000+0000 7f3921d9b640 1 --2- 172.21.15.6:0/1997528570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22c9d0 0x555e5c22cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.000+0000 7f39137fe640 1 -- 172.21.15.6:0/1164413430 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f391c0ceb00 con 0x7f3924106f10 2024-09-11T23:58:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.000+0000 7f3921d9b640 1 -- 172.21.15.6:0/1997528570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c22d2f0 msgr2=0x555e5c237670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.000+0000 7f3921d9b640 1 --2- 172.21.15.6:0/1997528570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c22d2f0 0x555e5c237670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.000+0000 7f3921d9b640 1 -- 172.21.15.6:0/1997528570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22c9d0 msgr2=0x555e5c22cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.000+0000 7f3921d9b640 1 --2- 172.21.15.6:0/1997528570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22c9d0 0x555e5c22cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.000+0000 7f3921d9b640 1 -- 172.21.15.6:0/1997528570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e5c147130 con 0x555e5c237bb0 2024-09-11T23:58:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.000+0000 7f3921d9b640 1 --2- 172.21.15.6:0/1997528570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c237bb0 0x555e5c239fa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3918005940 tx=0x7f39180058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bc8e743969e6e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.000+0000 7f3922d9d640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f390c0a2c10 0x7f390c0a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f391c09aee0 tx=0x7f391c00e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.000+0000 7f3910ff9640 1 -- 172.21.15.6:0/1997528570 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918035040 con 0x555e5c237bb0 2024-09-11T23:58:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.000+0000 7f3910ff9640 1 -- 172.21.15.6:0/1997528570 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3918031670 con 0x555e5c237bb0 2024-09-11T23:58:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.000+0000 7f3910ff9640 1 -- 172.21.15.6:0/1997528570 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39180047a0 con 0x555e5c237bb0 2024-09-11T23:58:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.001+0000 7f392b189740 1 -- 172.21.15.6:0/1997528570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c237bb0 msgr2=0x555e5c239fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.001+0000 7f392b189740 1 --2- 172.21.15.6:0/1997528570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c237bb0 0x555e5c239fa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3918005940 tx=0x7f39180058b0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.001+0000 7f392b189740 1 -- 172.21.15.6:0/1997528570 shutdown_connections 2024-09-11T23:58:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.001+0000 7f392b189740 1 --2- 172.21.15.6:0/1997528570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c237bb0 0x555e5c239fa0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.001+0000 7f392b189740 1 --2- 172.21.15.6:0/1997528570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c22d2f0 0x555e5c237670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.001+0000 7f392b189740 1 --2- 172.21.15.6:0/1997528570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22c9d0 0x555e5c22cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.001+0000 7f392b189740 1 -- 172.21.15.6:0/1997528570 >> 172.21.15.6:0/1997528570 conn(0x555e5c228f60 msgr2=0x555e5c229340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.001+0000 7f392b189740 1 -- 172.21.15.6:0/1997528570 shutdown_connections 2024-09-11T23:58:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.001+0000 7f392b189740 1 -- 172.21.15.6:0/1997528570 wait complete. 2024-09-11T23:58:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.001+0000 7f392b189740 1 -- start start 2024-09-11T23:58:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.001+0000 7f392b189740 1 Processor -- start 2024-09-11T23:58:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f392b189740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c237410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f392b189740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c22d2f0 0x555e5c234760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f392b189740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c237bb0 0x555e5c234ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f392b189740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555e5c23a780 con 0x555e5c22c9d0 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f392b189740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555e5c14df20 con 0x555e5c237bb0 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f392b189740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555e5c23a900 con 0x555e5c22d2f0 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f392b189740 10 client.0 _ll_register_callbacks cb 0x555e5c117030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f3921d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c237410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f3921d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c237410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35342/0 (socket says 172.21.15.6:35342) 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f3921d9b640 1 -- 172.21.15.6:0/2994782237 learned_addr learned my addr 172.21.15.6:0/2994782237 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f392259c640 1 --2- 172.21.15.6:0/2994782237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c22d2f0 0x555e5c234760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f3921d9b640 1 -- 172.21.15.6:0/2994782237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c22d2f0 msgr2=0x555e5c234760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f3921d9b640 1 --2- 172.21.15.6:0/2994782237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c22d2f0 0x555e5c234760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f3921d9b640 1 -- 172.21.15.6:0/2994782237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c237bb0 msgr2=0x555e5c234ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f3921d9b640 1 --2- 172.21.15.6:0/2994782237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c237bb0 0x555e5c234ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f3921d9b640 1 -- 172.21.15.6:0/2994782237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e5bf042b0 con 0x555e5c22c9d0 2024-09-11T23:58:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f3921d9b640 1 --2- 172.21.15.6:0/2994782237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c237410 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3918005460 tx=0x7f3918009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3449ed9ef2865b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f3909ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:58:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f3909ffb640 1 -- 172.21.15.6:0/2994782237 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391804f070 con 0x555e5c22c9d0 2024-09-11T23:58:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f3909ffb640 1 -- 172.21.15.6:0/2994782237 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f3918004240 con 0x555e5c22c9d0 2024-09-11T23:58:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.002+0000 7f392b189740 1 -- 172.21.15.6:0/2994782237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3918031670 con 0x555e5c22c9d0 2024-09-11T23:58:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.003+0000 7f3909ffb640 1 -- 172.21.15.6:0/2994782237 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f391805b050 con 0x555e5c22c9d0 2024-09-11T23:58:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.003+0000 7f392b189740 10 client.15159 fetch_fsmap learned FSMap version 27 2024-09-11T23:58:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.003+0000 7f392b189740 1 -- 172.21.15.6:0/2994782237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555e5c2460d0 con 0x555e5c22c9d0 2024-09-11T23:58:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.003+0000 7f3909ffb640 1 -- 172.21.15.6:0/2994782237 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3918031670 con 0x555e5c22c9d0 2024-09-11T23:58:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.003+0000 7f3909ffb640 1 -- 172.21.15.6:0/2994782237 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f391803a040 con 0x555e5c22c9d0 2024-09-11T23:58:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.003+0000 7f392b189740 10 client.15159 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:58:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.003+0000 7f392b189740 10 client.15159 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:58:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.003+0000 7f392b189740 20 client.15159 populate_metadata read hostname 'smithi006' 2024-09-11T23:58:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.003+0000 7f392b189740 1 --2- 172.21.15.6:0/2994782237 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555e5c2481d0 0x555e5c249640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.003+0000 7f392b189740 4 client.15159 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:58:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.003+0000 7f392b189740 1 -- 172.21.15.6:0/2994782237 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e5c1a0600 con 0x555e5c2481d0 2024-09-11T23:58:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.004+0000 7f392259c640 1 --2- 172.21.15.6:0/2994782237 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555e5c2481d0 0x555e5c249640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.004+0000 7f3909ffb640 10 client.15159 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-11T23:58:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.004+0000 7f392259c640 1 --2- 172.21.15.6:0/2994782237 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555e5c2481d0 0x555e5c249640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41a109ad60819cec server_cookie=750189301ba6f823 in_seq=0 out_seq=0 2024-09-11T23:58:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f3909ffb640 1 -- 172.21.15.6:0/2994782237 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e5c1a0600 con 0x555e5c2481d0 2024-09-11T23:58:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f3909ffb640 10 client.15159 handle_command_reply: tid=0 2024-09-11T23:58:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f392b189740 1 client.15159 shutdown 2024-09-11T23:58:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f392b189740 1 -- 172.21.15.6:0/2994782237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 msgr2=0x555e5c237410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f392b189740 1 --2- 172.21.15.6:0/2994782237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c237410 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3918005460 tx=0x7f3918009230 comp rx=0 tx=0).stop 2024-09-11T23:58:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f392b189740 1 -- 172.21.15.6:0/2994782237 shutdown_connections 2024-09-11T23:58:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f392b189740 1 --2- 172.21.15.6:0/2994782237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c237bb0 0x555e5c234ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f392b189740 1 --2- 172.21.15.6:0/2994782237 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555e5c2481d0 0x555e5c249640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f392b189740 1 --2- 172.21.15.6:0/2994782237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c22d2f0 0x555e5c234760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f392b189740 1 --2- 172.21.15.6:0/2994782237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c237410 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f392b189740 1 -- 172.21.15.6:0/2994782237 >> 172.21.15.6:0/2994782237 conn(0x555e5c228f60 msgr2=0x555e5c22ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f3909ffb640 0 client.15159 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-11T23:58:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f392b189740 1 -- 172.21.15.6:0/2994782237 shutdown_connections 2024-09-11T23:58:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f392b189740 1 -- 172.21.15.6:0/2994782237 wait complete. 2024-09-11T23:58:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.005+0000 7f392b189740 20 client.15159 trim_cache size 0 max 16384 2024-09-11T23:58:54.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f392b189740 1 Processor -- start 2024-09-11T23:58:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f392b189740 1 -- start start 2024-09-11T23:58:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f392b189740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c2481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f392b189740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22d2f0 0x555e5c249640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f392b189740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c237bb0 0x555e5c247b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f392b189740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555e5c247980 con 0x555e5c22c9d0 2024-09-11T23:58:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f392b189740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555e5c248050 con 0x555e5c22d2f0 2024-09-11T23:58:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f392b189740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555e5c248720 con 0x555e5c237bb0 2024-09-11T23:58:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f3921d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c2481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f3921d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c2481d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35344/0 (socket says 172.21.15.6:35344) 2024-09-11T23:58:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f3921d9b640 1 -- 172.21.15.6:0/2297648741 learned_addr learned my addr 172.21.15.6:0/2297648741 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f3921d9b640 1 -- 172.21.15.6:0/2297648741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c237bb0 msgr2=0x555e5c247b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f3921d9b640 1 --2- 172.21.15.6:0/2297648741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c237bb0 0x555e5c247b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f3921d9b640 1 -- 172.21.15.6:0/2297648741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22d2f0 msgr2=0x555e5c249640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f392259c640 1 --2- 172.21.15.6:0/2297648741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22d2f0 0x555e5c249640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f3921d9b640 1 --2- 172.21.15.6:0/2297648741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22d2f0 0x555e5c249640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.023+0000 7f3921d9b640 1 -- 172.21.15.6:0/2297648741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e5c235280 con 0x555e5c22c9d0 2024-09-11T23:58:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.024+0000 7f3921d9b640 1 --2- 172.21.15.6:0/2297648741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c2481d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3918005ec0 tx=0x7f3918032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5ac07280b69a69 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.024+0000 7f390bfff640 1 -- 172.21.15.6:0/2297648741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391804f030 con 0x555e5c22c9d0 2024-09-11T23:58:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.024+0000 7f390bfff640 1 -- 172.21.15.6:0/2297648741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3918032de0 con 0x555e5c22c9d0 2024-09-11T23:58:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.024+0000 7f390bfff640 1 -- 172.21.15.6:0/2297648741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918035040 con 0x555e5c22c9d0 2024-09-11T23:58:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.024+0000 7f392b189740 1 -- 172.21.15.6:0/2297648741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 msgr2=0x555e5c2481d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.024+0000 7f392b189740 1 --2- 172.21.15.6:0/2297648741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c2481d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3918005ec0 tx=0x7f3918032d00 comp rx=0 tx=0).stop 2024-09-11T23:58:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.024+0000 7f392b189740 1 -- 172.21.15.6:0/2297648741 shutdown_connections 2024-09-11T23:58:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.024+0000 7f392b189740 1 --2- 172.21.15.6:0/2297648741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c237bb0 0x555e5c247b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.024+0000 7f392b189740 1 --2- 172.21.15.6:0/2297648741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22d2f0 0x555e5c249640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.024+0000 7f392b189740 1 --2- 172.21.15.6:0/2297648741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c2481d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.024+0000 7f392b189740 1 -- 172.21.15.6:0/2297648741 >> 172.21.15.6:0/2297648741 conn(0x555e5c228f60 msgr2=0x555e5c229340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392b189740 1 -- 172.21.15.6:0/2297648741 shutdown_connections 2024-09-11T23:58:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392b189740 1 -- 172.21.15.6:0/2297648741 wait complete. 2024-09-11T23:58:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392b189740 1 -- start start 2024-09-11T23:58:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392b189740 1 Processor -- start 2024-09-11T23:58:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392b189740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c230d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392b189740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22d2f0 0x555e5c2312d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392b189740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c237bb0 0x555e5c250890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392b189740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555e5c2494c0 con 0x555e5c22c9d0 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392b189740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555e5c248df0 con 0x555e5c22d2f0 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392b189740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555e5c249b90 con 0x555e5c237bb0 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392b189740 10 client.0 _ll_register_callbacks cb 0x7f39140071a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f3921d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c230d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22d2f0 0x555e5c2312d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22d2f0 0x555e5c2312d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:54138/0 (socket says 172.21.15.6:54138) 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f3921d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c230d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35350/0 (socket says 172.21.15.6:35350) 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.025+0000 7f392259c640 1 -- 172.21.15.6:0/4225177266 learned_addr learned my addr 172.21.15.6:0/4225177266 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.026+0000 7f3921d9b640 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c237bb0 0x555e5c250890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.026+0000 7f392259c640 1 -- 172.21.15.6:0/4225177266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c237bb0 msgr2=0x555e5c250890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.026+0000 7f392259c640 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c237bb0 0x555e5c250890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.026+0000 7f392259c640 1 -- 172.21.15.6:0/4225177266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 msgr2=0x555e5c230d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.026+0000 7f392259c640 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c230d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.026+0000 7f392259c640 1 -- 172.21.15.6:0/4225177266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e5c231b60 con 0x555e5c22d2f0 2024-09-11T23:58:54.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.026+0000 7f3921d9b640 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c230d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:58:54.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.026+0000 7f392259c640 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22d2f0 0x555e5c2312d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x555e5c233ff0 tx=0x7f39140157f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4875488af63f518 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:54.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.026+0000 7f3909ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-11T23:58:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.038+0000 7f3909ffb640 1 -- 172.21.15.6:0/4225177266 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3914024400 con 0x555e5c22d2f0 2024-09-11T23:58:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.038+0000 7f3909ffb640 1 -- 172.21.15.6:0/4225177266 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f39140245a0 con 0x555e5c22d2f0 2024-09-11T23:58:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.038+0000 7f392b189740 1 -- 172.21.15.6:0/4225177266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3918032de0 con 0x555e5c22d2f0 2024-09-11T23:58:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.038+0000 7f3909ffb640 1 -- 172.21.15.6:0/4225177266 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f391402d050 con 0x555e5c22d2f0 2024-09-11T23:58:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.038+0000 7f392b189740 10 client.24851 fetch_fsmap learned FSMap version 27 2024-09-11T23:58:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.038+0000 7f392b189740 1 -- 172.21.15.6:0/4225177266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555e5c251f60 con 0x555e5c22d2f0 2024-09-11T23:58:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.039+0000 7f3909ffb640 1 -- 172.21.15.6:0/4225177266 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3918032de0 con 0x555e5c22d2f0 2024-09-11T23:58:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.039+0000 7f3909ffb640 1 -- 172.21.15.6:0/4225177266 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f39140147d0 con 0x555e5c22d2f0 2024-09-11T23:58:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.039+0000 7f392b189740 10 client.24851 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:58:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.039+0000 7f392b189740 10 client.24851 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:58:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.039+0000 7f392b189740 20 client.24851 populate_metadata read hostname 'smithi006' 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.039+0000 7f392b189740 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555e5c2b6c60 0x555e5c2b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.039+0000 7f392b189740 4 client.24851 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.039+0000 7f392b189740 1 -- 172.21.15.6:0/4225177266 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "status"}) -- 0x555e5c19ab10 con 0x555e5c2b6c60 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.039+0000 7f3921d9b640 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555e5c2b6c60 0x555e5c2b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f3921d9b640 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555e5c2b6c60 0x555e5c2b5970 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2af71134d939c7b1 server_cookie=d1fdc6e1102407ed in_seq=0 out_seq=0 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f3909ffb640 10 client.24851 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f3909ffb640 1 -- 172.21.15.6:0/4225177266 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x555e5c19ab10 con 0x555e5c2b6c60 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f3909ffb640 10 client.24851 handle_command_reply: tid=0 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f392b189740 1 client.24851 shutdown 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f392b189740 1 -- 172.21.15.6:0/4225177266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22d2f0 msgr2=0x555e5c2312d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f392b189740 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22d2f0 0x555e5c2312d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x555e5c233ff0 tx=0x7f39140157f0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f392b189740 1 -- 172.21.15.6:0/4225177266 shutdown_connections 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f392b189740 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555e5c2b6c60 0x555e5c2b5970 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f392b189740 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e5c237bb0 0x555e5c250890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f392b189740 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5c22d2f0 0x555e5c2312d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f3909ffb640 0 client.24851 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-11T23:58:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f392b189740 1 --2- 172.21.15.6:0/4225177266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555e5c22c9d0 0x555e5c230d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.040+0000 7f392b189740 1 -- 172.21.15.6:0/4225177266 >> 172.21.15.6:0/4225177266 conn(0x555e5c228f60 msgr2=0x555e5c22f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f392b189740 1 -- 172.21.15.6:0/4225177266 shutdown_connections 2024-09-11T23:58:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f392b189740 1 -- 172.21.15.6:0/4225177266 wait complete. 2024-09-11T23:58:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f392b189740 20 client.24851 trim_cache size 0 max 16384 2024-09-11T23:58:54.044 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:58:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:58:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-09-11T23:58:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24491, 2024-09-11T23:58:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-11T23:58:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-11T23:58:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-11T23:58:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 115.681946162, 2024-09-11T23:58:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2024-09-11T23:58:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 88, 2024-09-11T23:58:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:58:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 126.519340254 2024-09-11T23:58:54.049 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:58:54.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f3928db0640 1 -- 172.21.15.6:0/1164413430 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f390c0a2c10 msgr2=0x7f390c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:54.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f3928db0640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f390c0a2c10 0x7f390c0a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f391c09aee0 tx=0x7f391c00e040 comp rx=0 tx=0).stop 2024-09-11T23:58:54.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f3928db0640 1 -- 172.21.15.6:0/1164413430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3924106f10 msgr2=0x7f3924074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f3928db0640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3924106f10 0x7f3924074f70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f391c00b970 tx=0x7f391c00be30 comp rx=0 tx=0).stop 2024-09-11T23:58:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f3928db0640 1 -- 172.21.15.6:0/1164413430 shutdown_connections 2024-09-11T23:58:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f3928db0640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f390c0a2c10 0x7f390c0a50d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f3928db0640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3924106f10 0x7f3924074f70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f3928db0640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3924102790 0x7f3924074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f3928db0640 1 --2- 172.21.15.6:0/1164413430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3924101de0 0x7f39240744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f3928db0640 1 -- 172.21.15.6:0/1164413430 >> 172.21.15.6:0/1164413430 conn(0x7f39240fd8c0 msgr2=0x7f39240fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f3928db0640 1 -- 172.21.15.6:0/1164413430 shutdown_connections 2024-09-11T23:58:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:54.041+0000 7f3928db0640 1 -- 172.21.15.6:0/1164413430 wait complete. 2024-09-11T23:58:54.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:54 smithi039 ceph-mon[34543]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:54.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:54 smithi006 ceph-mon[30947]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:54.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:54 smithi134 ceph-mon[34893]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:54.851 INFO:tasks.cephadm:Setup complete, yielding 2024-09-11T23:58:54.851 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T23:58:54.861 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2024-09-11T23:58:54.862 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-11T23:58:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:55.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.606+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/495376221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b38100290 msgr2=0x7f4b38100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:55.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.606+0000 7f4b3fb2b640 1 --2- 172.21.15.6:0/495376221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b38100290 0x7f4b38100690 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400aa10 tx=0x7f4b3402b720 comp rx=0 tx=0).stop 2024-09-11T23:58:55.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.606+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/495376221 shutdown_connections 2024-09-11T23:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.606+0000 7f4b3fb2b640 1 --2- 172.21.15.6:0/495376221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b38101e50 0x7f4b381086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.606+0000 7f4b3fb2b640 1 --2- 172.21.15.6:0/495376221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b38101490 0x7f4b38101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.606+0000 7f4b3fb2b640 1 --2- 172.21.15.6:0/495376221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b38100290 0x7f4b38100690 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.606+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/495376221 >> 172.21.15.6:0/495376221 conn(0x7f4b380fba40 msgr2=0x7f4b380fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.606+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/495376221 shutdown_connections 2024-09-11T23:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.606+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/495376221 wait complete. 2024-09-11T23:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.607+0000 7f4b3fb2b640 1 Processor -- start 2024-09-11T23:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.607+0000 7f4b3fb2b640 1 -- start start 2024-09-11T23:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.607+0000 7f4b3fb2b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b38100290 0x7f4b38197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.607+0000 7f4b3fb2b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b38101490 0x7f4b38198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.607+0000 7f4b3fb2b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b38101e50 0x7f4b3819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.607+0000 7f4b3fb2b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3810b560 con 0x7f4b38101e50 2024-09-11T23:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.607+0000 7f4b3fb2b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3810b3e0 con 0x7f4b38101490 2024-09-11T23:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.607+0000 7f4b3fb2b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3810b6e0 con 0x7f4b38100290 2024-09-11T23:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.607+0000 7f4b3e0c8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b38101e50 0x7f4b3819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.607+0000 7f4b3e0c8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b38101e50 0x7f4b3819f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35372/0 (socket says 172.21.15.6:35372) 2024-09-11T23:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.607+0000 7f4b3e0c8640 1 -- 172.21.15.6:0/1690554384 learned_addr learned my addr 172.21.15.6:0/1690554384 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b3d0c6640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b38101490 0x7f4b38198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b3d8c7640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b38100290 0x7f4b38197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b3e0c8640 1 -- 172.21.15.6:0/1690554384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b38100290 msgr2=0x7f4b38197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b3e0c8640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b38100290 0x7f4b38197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b3e0c8640 1 -- 172.21.15.6:0/1690554384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b38101490 msgr2=0x7f4b38198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b3e0c8640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b38101490 0x7f4b38198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b3e0c8640 1 -- 172.21.15.6:0/1690554384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3819fa60 con 0x7f4b38101e50 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b3e0c8640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b38101e50 0x7f4b3819f3f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000eaa0 tx=0x7f4b3000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b2effd640 1 -- 172.21.15.6:0/1690554384 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30004d20 con 0x7f4b38101e50 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/1690554384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3819fd50 con 0x7f4b38101e50 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b2effd640 1 -- 172.21.15.6:0/1690554384 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4b30005020 con 0x7f4b38101e50 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b2effd640 1 -- 172.21.15.6:0/1690554384 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b300116b0 con 0x7f4b38101e50 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.608+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/1690554384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b381a01e0 con 0x7f4b38101e50 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.609+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/1690554384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b381a0470 con 0x7f4b38101e50 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.610+0000 7f4b2effd640 1 -- 172.21.15.6:0/1690554384 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4b300051d0 con 0x7f4b38101e50 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.611+0000 7f4b2effd640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4b240a2c40 0x7f4b240a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.611+0000 7f4b3d8c7640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4b240a2c40 0x7f4b240a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.611+0000 7f4b2effd640 1 -- 172.21.15.6:0/1690554384 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f4b300cf790 con 0x7f4b38101e50 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.612+0000 7f4b3d8c7640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4b240a2c40 0x7f4b240a5100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4b34000c00 tx=0x7f4b34030d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.615+0000 7f4b2effd640 1 -- 172.21.15.6:0/1690554384 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b30016030 con 0x7f4b38101e50 2024-09-11T23:58:55.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.808+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/1690554384 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f4b38108190 con 0x7f4b240a2c40 2024-09-11T23:58:55.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.810+0000 7f4b2effd640 1 -- 172.21.15.6:0/1690554384 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f4b38108190 con 0x7f4b240a2c40 2024-09-11T23:58:55.809 INFO:teuthology.orchestra.run.smithi006.stdout:Backend: cephadm 2024-09-11T23:58:55.809 INFO:teuthology.orchestra.run.smithi006.stdout:Available: Yes 2024-09-11T23:58:55.809 INFO:teuthology.orchestra.run.smithi006.stdout:Paused: No 2024-09-11T23:58:55.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.811+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/1690554384 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4b240a2c40 msgr2=0x7f4b240a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:55.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.812+0000 7f4b3fb2b640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4b240a2c40 0x7f4b240a5100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4b34000c00 tx=0x7f4b34030d80 comp rx=0 tx=0).stop 2024-09-11T23:58:55.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.812+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/1690554384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b38101e50 msgr2=0x7f4b3819f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:55.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.812+0000 7f4b3fb2b640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b38101e50 0x7f4b3819f3f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000eaa0 tx=0x7f4b3000eea0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.812+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/1690554384 shutdown_connections 2024-09-11T23:58:55.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.812+0000 7f4b3fb2b640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4b240a2c40 0x7f4b240a5100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.812+0000 7f4b3fb2b640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b38101e50 0x7f4b3819f3f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.812+0000 7f4b3fb2b640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b38101490 0x7f4b38198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.812+0000 7f4b3fb2b640 1 --2- 172.21.15.6:0/1690554384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b38100290 0x7f4b38197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.812+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/1690554384 >> 172.21.15.6:0/1690554384 conn(0x7f4b380fba40 msgr2=0x7f4b38106a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:55.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.812+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/1690554384 shutdown_connections 2024-09-11T23:58:55.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:55.812+0000 7f4b3fb2b640 1 -- 172.21.15.6:0/1690554384 wait complete. 2024-09-11T23:58:56.116 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:56 smithi006 ceph-mon[30947]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-11T23:58:56.116 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:56 smithi006 ceph-mon[30947]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:56.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:56 smithi039 ceph-mon[34543]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-11T23:58:56.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:56 smithi039 ceph-mon[34543]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:56.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:56 smithi134 ceph-mon[34893]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-11T23:58:56.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:56 smithi134 ceph-mon[34893]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:56.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-11T23:58:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:57.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:57 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:58:57.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:57 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:58:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.352+0000 7fed231cc640 1 -- 172.21.15.6:0/2498114451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c102690 msgr2=0x7fed1c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.352+0000 7fed231cc640 1 --2- 172.21.15.6:0/2498114451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c102690 0x7fed1c108f20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fed14009ca0 tx=0x7fed1402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.352+0000 7fed231cc640 1 -- 172.21.15.6:0/2498114451 shutdown_connections 2024-09-11T23:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.352+0000 7fed231cc640 1 --2- 172.21.15.6:0/2498114451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c102690 0x7fed1c108f20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.352+0000 7fed231cc640 1 --2- 172.21.15.6:0/2498114451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed1c101cd0 0x7fed1c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.352+0000 7fed231cc640 1 --2- 172.21.15.6:0/2498114451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed1c100ad0 0x7fed1c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.352+0000 7fed231cc640 1 -- 172.21.15.6:0/2498114451 >> 172.21.15.6:0/2498114451 conn(0x7fed1c0fc280 msgr2=0x7fed1c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.352+0000 7fed231cc640 1 -- 172.21.15.6:0/2498114451 shutdown_connections 2024-09-11T23:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.352+0000 7fed231cc640 1 -- 172.21.15.6:0/2498114451 wait complete. 2024-09-11T23:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed231cc640 1 Processor -- start 2024-09-11T23:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed231cc640 1 -- start start 2024-09-11T23:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed231cc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed1c100ad0 0x7fed1c197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed231cc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed1c101cd0 0x7fed1c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed231cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c102690 0x7fed1c19f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed231cc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c10c5e0 con 0x7fed1c102690 2024-09-11T23:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed231cc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c10c460 con 0x7fed1c100ad0 2024-09-11T23:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed231cc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c10c760 con 0x7fed1c101cd0 2024-09-11T23:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed20f68640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed1c100ad0 0x7fed1c197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed1bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed1c101cd0 0x7fed1c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed20f68640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed1c100ad0 0x7fed1c197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:54160/0 (socket says 172.21.15.6:54160) 2024-09-11T23:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed21769640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c102690 0x7fed1c19f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed20f68640 1 -- 172.21.15.6:0/2826657577 learned_addr learned my addr 172.21.15.6:0/2826657577 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed20f68640 1 -- 172.21.15.6:0/2826657577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed1c101cd0 msgr2=0x7fed1c1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed20f68640 1 --2- 172.21.15.6:0/2826657577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed1c101cd0 0x7fed1c1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed20f68640 1 -- 172.21.15.6:0/2826657577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c102690 msgr2=0x7fed1c19f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed20f68640 1 --2- 172.21.15.6:0/2826657577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c102690 0x7fed1c19f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.353+0000 7fed20f68640 1 -- 172.21.15.6:0/2826657577 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1c19f9c0 con 0x7fed1c100ad0 2024-09-11T23:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.354+0000 7fed20f68640 1 --2- 172.21.15.6:0/2826657577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed1c100ad0 0x7fed1c197da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed1000e9c0 tx=0x7fed1000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.354+0000 7fed19ffb640 1 -- 172.21.15.6:0/2826657577 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1000cde0 con 0x7fed1c100ad0 2024-09-11T23:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.354+0000 7fed231cc640 1 -- 172.21.15.6:0/2826657577 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed1c19fcb0 con 0x7fed1c100ad0 2024-09-11T23:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.354+0000 7fed19ffb640 1 -- 172.21.15.6:0/2826657577 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed100108e0 con 0x7fed1c100ad0 2024-09-11T23:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.354+0000 7fed19ffb640 1 -- 172.21.15.6:0/2826657577 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10018990 con 0x7fed1c100ad0 2024-09-11T23:58:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.354+0000 7fed231cc640 1 -- 172.21.15.6:0/2826657577 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed1c1a01a0 con 0x7fed1c100ad0 2024-09-11T23:58:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.355+0000 7fed231cc640 1 -- 172.21.15.6:0/2826657577 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed1c1a03d0 con 0x7fed1c100ad0 2024-09-11T23:58:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.357+0000 7fed19ffb640 1 -- 172.21.15.6:0/2826657577 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fed1001f020 con 0x7fed1c100ad0 2024-09-11T23:58:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.357+0000 7fed19ffb640 1 --2- 172.21.15.6:0/2826657577 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fed0c0a2c10 0x7fed0c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.357+0000 7fed19ffb640 1 -- 172.21.15.6:0/2826657577 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fed100cf6f0 con 0x7fed1c100ad0 2024-09-11T23:58:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.358+0000 7fed1bfff640 1 --2- 172.21.15.6:0/2826657577 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fed0c0a2c10 0x7fed0c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.358+0000 7fed1bfff640 1 --2- 172.21.15.6:0/2826657577 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fed0c0a2c10 0x7fed0c0a50d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed08009bd0 tx=0x7fed08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.363+0000 7fed19ffb640 1 -- 172.21.15.6:0/2826657577 <== mon.2 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed1009c190 con 0x7fed1c100ad0 2024-09-11T23:58:57.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:57 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:58:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.557+0000 7fed231cc640 1 -- 172.21.15.6:0/2826657577 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fed1c0fd080 con 0x7fed0c0a2c10 2024-09-11T23:58:57.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.570+0000 7fed19ffb640 1 -- 172.21.15.6:0/2826657577 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4061 (secure 0 0 0) 0x7fed1c0fd080 con 0x7fed0c0a2c10 2024-09-11T23:58:57.569 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T23:58:57.569 INFO:teuthology.orchestra.run.smithi006.stdout:mds.a smithi006 running (2m) 61s ago 2m 15.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 8541334edb50 2024-09-11T23:58:57.569 INFO:teuthology.orchestra.run.smithi006.stdout:mds.b smithi039 running (2m) 63s ago 2m 26.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 af7e0b346c48 2024-09-11T23:58:57.570 INFO:teuthology.orchestra.run.smithi006.stdout:mds.c smithi134 running (2m) 63s ago 2m 17.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 ef0578a1e408 2024-09-11T23:58:57.570 INFO:teuthology.orchestra.run.smithi006.stdout:mds.d smithi006 running (2m) 61s ago 2m 13.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 74910b18e733 2024-09-11T23:58:57.570 INFO:teuthology.orchestra.run.smithi006.stdout:mds.e smithi039 running (2m) 63s ago 2m 18.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 6701705a5984 2024-09-11T23:58:57.570 INFO:teuthology.orchestra.run.smithi006.stdout:mds.f smithi134 running (2m) 63s ago 2m 18.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 0df0a443c5a9 2024-09-11T23:58:57.570 INFO:teuthology.orchestra.run.smithi006.stdout:mds.g smithi006 running (2m) 61s ago 2m 15.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 d4c228503df0 2024-09-11T23:58:57.570 INFO:teuthology.orchestra.run.smithi006.stdout:mds.h smithi039 running (2m) 63s ago 2m 19.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 8d283df81d1e 2024-09-11T23:58:57.570 INFO:teuthology.orchestra.run.smithi006.stdout:mds.i smithi134 running (2m) 63s ago 2m 16.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 df762ac0fc02 2024-09-11T23:58:57.570 INFO:teuthology.orchestra.run.smithi006.stdout:mds.j smithi006 running (2m) 61s ago 2m 15.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 d581500acb01 2024-09-11T23:58:57.570 INFO:teuthology.orchestra.run.smithi006.stdout:mds.k smithi039 running (2m) 63s ago 2m 17.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 0897b5e62414 2024-09-11T23:58:57.570 INFO:teuthology.orchestra.run.smithi006.stdout:mds.l smithi134 running (2m) 63s ago 2m 14.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 750e15f3a5c6 2024-09-11T23:58:57.570 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.x smithi006 *:9283,8765 running (9m) 61s ago 9m 507M - 19.1.1-298-gb53b6d3e 54467abc55f8 3fff39688a1e 2024-09-11T23:58:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.y smithi039 *:8443,8765 running (7m) 63s ago 7m 444M - 19.1.1-298-gb53b6d3e 54467abc55f8 68268aeae500 2024-09-11T23:58:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.z smithi134 *:8443,8765 running (7m) 63s ago 7m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 8d7ce96313ec 2024-09-11T23:58:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:mon.a smithi006 running (9m) 61s ago 9m 50.8M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 83d8db6a4319 2024-09-11T23:58:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:mon.b smithi039 running (8m) 63s ago 8m 42.2M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 5251c8b9cc65 2024-09-11T23:58:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:mon.c smithi134 running (8m) 63s ago 8m 43.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 e1bedf32451d 2024-09-11T23:58:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (7m) 61s ago 7m 45.9M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 b0a56c975ab0 2024-09-11T23:58:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi039 running (7m) 63s ago 7m 44.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 2f89cabb1d15 2024-09-11T23:58:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi134 running (6m) 63s ago 6m 58.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 ea27079d9aad 2024-09-11T23:58:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi006 running (6m) 61s ago 6m 54.9M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 afb68bdd50f5 2024-09-11T23:58:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi039 running (5m) 63s ago 5m 42.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 cc6f5ed77322 2024-09-11T23:58:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (5m) 63s ago 5m 58.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 7554b50df916 2024-09-11T23:58:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6 smithi006 running (5m) 61s ago 5m 41.7M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 725e326b6984 2024-09-11T23:58:57.572 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7 smithi039 running (4m) 63s ago 4m 45.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 ca8ffffaeace 2024-09-11T23:58:57.572 INFO:teuthology.orchestra.run.smithi006.stdout:osd.8 smithi134 running (4m) 63s ago 4m 54.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 45377378fd16 2024-09-11T23:58:57.572 INFO:teuthology.orchestra.run.smithi006.stdout:osd.9 smithi006 running (3m) 61s ago 3m 52.6M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 4454061ad4d2 2024-09-11T23:58:57.572 INFO:teuthology.orchestra.run.smithi006.stdout:osd.10 smithi039 running (3m) 63s ago 3m 45.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 0ad1b0104ec1 2024-09-11T23:58:57.572 INFO:teuthology.orchestra.run.smithi006.stdout:osd.11 smithi134 running (3m) 63s ago 3m 40.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 b57a69d1ffc9 2024-09-11T23:58:57.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.572+0000 7fed231cc640 1 -- 172.21.15.6:0/2826657577 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fed0c0a2c10 msgr2=0x7fed0c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:57.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.572+0000 7fed231cc640 1 --2- 172.21.15.6:0/2826657577 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fed0c0a2c10 0x7fed0c0a50d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed08009bd0 tx=0x7fed08005f90 comp rx=0 tx=0).stop 2024-09-11T23:58:57.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.572+0000 7fed231cc640 1 -- 172.21.15.6:0/2826657577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed1c100ad0 msgr2=0x7fed1c197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:57.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.572+0000 7fed231cc640 1 --2- 172.21.15.6:0/2826657577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed1c100ad0 0x7fed1c197da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed1000e9c0 tx=0x7fed1000ee80 comp rx=0 tx=0).stop 2024-09-11T23:58:57.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.572+0000 7fed231cc640 1 -- 172.21.15.6:0/2826657577 shutdown_connections 2024-09-11T23:58:57.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.572+0000 7fed231cc640 1 --2- 172.21.15.6:0/2826657577 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fed0c0a2c10 0x7fed0c0a50d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.572+0000 7fed231cc640 1 --2- 172.21.15.6:0/2826657577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c102690 0x7fed1c19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.572+0000 7fed231cc640 1 --2- 172.21.15.6:0/2826657577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed1c101cd0 0x7fed1c1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.572+0000 7fed231cc640 1 --2- 172.21.15.6:0/2826657577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed1c100ad0 0x7fed1c197da0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.572+0000 7fed231cc640 1 -- 172.21.15.6:0/2826657577 >> 172.21.15.6:0/2826657577 conn(0x7fed1c0fc280 msgr2=0x7fed1c0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:57.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.572+0000 7fed231cc640 1 -- 172.21.15.6:0/2826657577 shutdown_connections 2024-09-11T23:58:57.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:57.572+0000 7fed231cc640 1 -- 172.21.15.6:0/2826657577 wait complete. 2024-09-11T23:58:58.040 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:58 smithi039 ceph-mon[34543]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:58:58.041 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:58 smithi039 ceph-mon[34543]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:58.269 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:58 smithi006 ceph-mon[30947]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:58:58.270 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:58 smithi006 ceph-mon[30947]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:58.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:58 smithi134 ceph-mon[34893]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:58:58.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:58 smithi134 ceph-mon[34893]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:59.037 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-11T23:58:59.327 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:59.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:59 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:58:59.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:59 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:58:59.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:59 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:58:59.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:58:59 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:58:59.737 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:59 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:58:59.737 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:59 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:58:59.737 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:59 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:58:59.737 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:58:59 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:58:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:59 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:58:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:59 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:58:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:59 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:58:59.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:58:59 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:58:59.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.825+0000 7f26cc4ce640 1 -- 172.21.15.6:0/1371323432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c41026c0 msgr2=0x7f26c4104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:59.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.825+0000 7f26cc4ce640 1 --2- 172.21.15.6:0/1371323432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c41026c0 0x7f26c4104ab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009900 tx=0x7f26c002a410 comp rx=0 tx=0).stop 2024-09-11T23:58:59.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.825+0000 7f26cc4ce640 1 -- 172.21.15.6:0/1371323432 shutdown_connections 2024-09-11T23:58:59.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.825+0000 7f26cc4ce640 1 --2- 172.21.15.6:0/1371323432 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26c4107920 0x7f26c4109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:59.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.825+0000 7f26cc4ce640 1 --2- 172.21.15.6:0/1371323432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26c4104ff0 0x7f26c41073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:59.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.825+0000 7f26cc4ce640 1 --2- 172.21.15.6:0/1371323432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c41026c0 0x7f26c4104ab0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:59.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.825+0000 7f26cc4ce640 1 -- 172.21.15.6:0/1371323432 >> 172.21.15.6:0/1371323432 conn(0x7f26c40fc280 msgr2=0x7f26c40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.825+0000 7f26cc4ce640 1 -- 172.21.15.6:0/1371323432 shutdown_connections 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.825+0000 7f26cc4ce640 1 -- 172.21.15.6:0/1371323432 wait complete. 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.825+0000 7f26cc4ce640 1 Processor -- start 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26cc4ce640 1 -- start start 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26cc4ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c41026c0 0x7f26c4102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26cc4ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26c4104ff0 0x7f26c4100670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26cc4ce640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26c4107920 0x7f26c4100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26cc4ce640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f26c410d780 con 0x7f26c41026c0 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26cc4ce640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f26c410d600 con 0x7f26c4107920 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26cc4ce640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f26c410d900 con 0x7f26c4104ff0 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26ca26a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c41026c0 0x7f26c4102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26ca26a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c41026c0 0x7f26c4102020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35410/0 (socket says 172.21.15.6:35410) 2024-09-11T23:58:59.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26ca26a640 1 -- 172.21.15.6:0/196460897 learned_addr learned my addr 172.21.15.6:0/196460897 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26caa6b640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26c4107920 0x7f26c4100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26c9a69640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26c4104ff0 0x7f26c4100670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26ca26a640 1 -- 172.21.15.6:0/196460897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26c4104ff0 msgr2=0x7f26c4100670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26ca26a640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26c4104ff0 0x7f26c4100670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26ca26a640 1 -- 172.21.15.6:0/196460897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26c4107920 msgr2=0x7f26c4100bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26ca26a640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26c4107920 0x7f26c4100bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.826+0000 7f26ca26a640 1 -- 172.21.15.6:0/196460897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c4101470 con 0x7f26c41026c0 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.827+0000 7f26ca26a640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c41026c0 0x7f26c4102020 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f26c0004770 tx=0x7f26c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.827+0000 7f26bb7fe640 1 -- 172.21.15.6:0/196460897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c003f030 con 0x7f26c41026c0 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.827+0000 7f26bb7fe640 1 -- 172.21.15.6:0/196460897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f26c0003cb0 con 0x7f26c41026c0 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.827+0000 7f26cc4ce640 1 -- 172.21.15.6:0/196460897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c41a1fd0 con 0x7f26c41026c0 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.827+0000 7f26bb7fe640 1 -- 172.21.15.6:0/196460897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0035070 con 0x7f26c41026c0 2024-09-11T23:58:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.827+0000 7f26cc4ce640 1 -- 172.21.15.6:0/196460897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c41a23f0 con 0x7f26c41026c0 2024-09-11T23:58:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.828+0000 7f26cc4ce640 1 -- 172.21.15.6:0/196460897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c40fdd70 con 0x7f26c41026c0 2024-09-11T23:58:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.829+0000 7f26bb7fe640 1 -- 172.21.15.6:0/196460897 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f26c0042030 con 0x7f26c41026c0 2024-09-11T23:58:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.830+0000 7f26bb7fe640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f26b00a2c10 0x7f26b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.830+0000 7f26c9a69640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f26b00a2c10 0x7f26b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.830+0000 7f26bb7fe640 1 -- 172.21.15.6:0/196460897 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f26c00efde0 con 0x7f26c41026c0 2024-09-11T23:58:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.831+0000 7f26c9a69640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f26b00a2c10 0x7f26b00a50d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f26c4101da0 tx=0x7f26b4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:58:59.835+0000 7f26bb7fe640 1 -- 172.21.15.6:0/196460897 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26c00bc880 con 0x7f26c41026c0 2024-09-11T23:59:00.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.021+0000 7f26cc4ce640 1 -- 172.21.15.6:0/196460897 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f26c4062630 con 0x7f26b00a2c10 2024-09-11T23:59:00.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.030+0000 7f26bb7fe640 1 -- 172.21.15.6:0/196460897 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f26c4062630 con 0x7f26b00a2c10 2024-09-11T23:59:00.029 INFO:teuthology.orchestra.run.smithi006.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-11T23:59:00.029 INFO:teuthology.orchestra.run.smithi006.stdout:mds.all 12/12 1s ago 2m smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi039=b;smithi039=e;smithi039=h;smithi039=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l;count:12 2024-09-11T23:59:00.029 INFO:teuthology.orchestra.run.smithi006.stdout:mgr 3/3 1s ago 8m smithi006=x;smithi039=y;smithi134=z;count:3 2024-09-11T23:59:00.029 INFO:teuthology.orchestra.run.smithi006.stdout:mon 3/3 1s ago 8m smithi006:172.21.15.6=a;smithi039:172.21.15.39=b;smithi134:172.21.15.134=c;count:3 2024-09-11T23:59:00.030 INFO:teuthology.orchestra.run.smithi006.stdout:osd 12 1s ago - 2024-09-11T23:59:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.032+0000 7f26cc4ce640 1 -- 172.21.15.6:0/196460897 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f26b00a2c10 msgr2=0x7f26b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.032+0000 7f26cc4ce640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f26b00a2c10 0x7f26b00a50d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f26c4101da0 tx=0x7f26b4009110 comp rx=0 tx=0).stop 2024-09-11T23:59:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.032+0000 7f26cc4ce640 1 -- 172.21.15.6:0/196460897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c41026c0 msgr2=0x7f26c4102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.032+0000 7f26cc4ce640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c41026c0 0x7f26c4102020 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f26c0004770 tx=0x7f26c00042f0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.032+0000 7f26cc4ce640 1 -- 172.21.15.6:0/196460897 shutdown_connections 2024-09-11T23:59:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.032+0000 7f26cc4ce640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f26b00a2c10 0x7f26b00a50d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.032+0000 7f26cc4ce640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26c4107920 0x7f26c4100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.032+0000 7f26cc4ce640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26c4104ff0 0x7f26c4100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.032+0000 7f26cc4ce640 1 --2- 172.21.15.6:0/196460897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c41026c0 0x7f26c4102020 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.032+0000 7f26cc4ce640 1 -- 172.21.15.6:0/196460897 >> 172.21.15.6:0/196460897 conn(0x7f26c40fc280 msgr2=0x7f26c4103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.032+0000 7f26cc4ce640 1 -- 172.21.15.6:0/196460897 shutdown_connections 2024-09-11T23:59:00.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:00.032+0000 7f26cc4ce640 1 -- 172.21.15.6:0/196460897 wait complete. 2024-09-11T23:59:00.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-11T23:59:00.863 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:00.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:00 smithi006 ceph-mon[30947]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:00.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:59:00.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:59:00.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:00.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:00.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:59:00.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:00 smithi134 ceph-mon[34893]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:00.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:59:00.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:59:00.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:00.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:00.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:59:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:00 smithi039 ceph-mon[34543]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:59:01.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:59:01.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:01.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:01.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-11T23:59:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.334+0000 7f0080e23640 1 -- 172.21.15.6:0/878404266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f007c1037c0 msgr2=0x7f007c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.334+0000 7f0080e23640 1 --2- 172.21.15.6:0/878404266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f007c1037c0 0x7f007c10a050 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0074009ca0 tx=0x7f007402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.334+0000 7f0080e23640 1 -- 172.21.15.6:0/878404266 shutdown_connections 2024-09-11T23:59:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.334+0000 7f0080e23640 1 --2- 172.21.15.6:0/878404266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f007c1037c0 0x7f007c10a050 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.334+0000 7f0080e23640 1 --2- 172.21.15.6:0/878404266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007c102e00 0x7f007c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.334+0000 7f0080e23640 1 --2- 172.21.15.6:0/878404266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c101c00 0x7f007c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.334+0000 7f0080e23640 1 -- 172.21.15.6:0/878404266 >> 172.21.15.6:0/878404266 conn(0x7f007c0fd390 msgr2=0x7f007c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.334+0000 7f0080e23640 1 -- 172.21.15.6:0/878404266 shutdown_connections 2024-09-11T23:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.334+0000 7f0080e23640 1 -- 172.21.15.6:0/878404266 wait complete. 2024-09-11T23:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.335+0000 7f0080e23640 1 Processor -- start 2024-09-11T23:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.335+0000 7f0080e23640 1 -- start start 2024-09-11T23:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f0080e23640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f007c101c00 0x7f007c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f0080e23640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007c102e00 0x7f007c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f0080e23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c1037c0 0x7f007c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f0080e23640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f007c10d730 con 0x7f007c101c00 2024-09-11T23:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f0080e23640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f007c10d5b0 con 0x7f007c102e00 2024-09-11T23:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f0080e23640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f007c10d8b0 con 0x7f007c1037c0 2024-09-11T23:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f007a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f007c101c00 0x7f007c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f007a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f007c101c00 0x7f007c075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43948/0 (socket says 172.21.15.6:43948) 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f007a59c640 1 -- 172.21.15.6:0/3592345769 learned_addr learned my addr 172.21.15.6:0/3592345769 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f0079d9b640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007c102e00 0x7f007c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f007ad9d640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c1037c0 0x7f007c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f007a59c640 1 -- 172.21.15.6:0/3592345769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c1037c0 msgr2=0x7f007c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f007a59c640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c1037c0 0x7f007c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f007a59c640 1 -- 172.21.15.6:0/3592345769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007c102e00 msgr2=0x7f007c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f007a59c640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007c102e00 0x7f007c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f007a59c640 1 -- 172.21.15.6:0/3592345769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007c0753e0 con 0x7f007c101c00 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f007a59c640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f007c101c00 0x7f007c075f90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f006c00e9c0 tx=0x7f006c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f00737fe640 1 -- 172.21.15.6:0/3592345769 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c00cd80 con 0x7f007c101c00 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f0080e23640 1 -- 172.21.15.6:0/3592345769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007c1a1f70 con 0x7f007c101c00 2024-09-11T23:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f00737fe640 1 -- 172.21.15.6:0/3592345769 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f006c0035f0 con 0x7f007c101c00 2024-09-11T23:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.336+0000 7f00737fe640 1 -- 172.21.15.6:0/3592345769 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c010690 con 0x7f007c101c00 2024-09-11T23:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.337+0000 7f0080e23640 1 -- 172.21.15.6:0/3592345769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f007c1a2310 con 0x7f007c101c00 2024-09-11T23:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.337+0000 7f0080e23640 1 -- 172.21.15.6:0/3592345769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007c109050 con 0x7f007c101c00 2024-09-11T23:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.339+0000 7f00737fe640 1 -- 172.21.15.6:0/3592345769 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f006c0037a0 con 0x7f007c101c00 2024-09-11T23:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.340+0000 7f00737fe640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f00680a2c10 0x7f00680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.340+0000 7f0079d9b640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f00680a2c10 0x7f00680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.340+0000 7f00737fe640 1 -- 172.21.15.6:0/3592345769 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f006c0cfd20 con 0x7f007c101c00 2024-09-11T23:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.340+0000 7f0079d9b640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f00680a2c10 0x7f00680a50d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f007c075d10 tx=0x7f006400b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.343+0000 7f00737fe640 1 -- 172.21.15.6:0/3592345769 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f006c016370 con 0x7f007c101c00 2024-09-11T23:59:01.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.525+0000 7f0080e23640 1 -- 172.21.15.6:0/3592345769 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f007c062630 con 0x7f00680a2c10 2024-09-11T23:59:01.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.527+0000 7f00737fe640 1 -- 172.21.15.6:0/3592345769 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f007c062630 con 0x7f00680a2c10 2024-09-11T23:59:01.525 INFO:teuthology.orchestra.run.smithi006.stdout:HOST ADDR LABELS STATUS 2024-09-11T23:59:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006 172.21.15.6 2024-09-11T23:59:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:smithi039 172.21.15.39 2024-09-11T23:59:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:smithi134 172.21.15.134 2024-09-11T23:59:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:3 hosts in cluster 2024-09-11T23:59:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.529+0000 7f0080e23640 1 -- 172.21.15.6:0/3592345769 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f00680a2c10 msgr2=0x7f00680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.529+0000 7f0080e23640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f00680a2c10 0x7f00680a50d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f007c075d10 tx=0x7f006400b590 comp rx=0 tx=0).stop 2024-09-11T23:59:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.529+0000 7f0080e23640 1 -- 172.21.15.6:0/3592345769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f007c101c00 msgr2=0x7f007c075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.529+0000 7f0080e23640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f007c101c00 0x7f007c075f90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f006c00e9c0 tx=0x7f006c00ee80 comp rx=0 tx=0).stop 2024-09-11T23:59:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.529+0000 7f0080e23640 1 -- 172.21.15.6:0/3592345769 shutdown_connections 2024-09-11T23:59:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.529+0000 7f0080e23640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f00680a2c10 0x7f00680a50d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.529+0000 7f0080e23640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c1037c0 0x7f007c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.529+0000 7f0080e23640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007c102e00 0x7f007c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.529+0000 7f0080e23640 1 --2- 172.21.15.6:0/3592345769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f007c101c00 0x7f007c075f90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.529+0000 7f0080e23640 1 -- 172.21.15.6:0/3592345769 >> 172.21.15.6:0/3592345769 conn(0x7f007c0fd390 msgr2=0x7f007c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.529+0000 7f0080e23640 1 -- 172.21.15.6:0/3592345769 shutdown_connections 2024-09-11T23:59:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:01.529+0000 7f0080e23640 1 -- 172.21.15.6:0/3592345769 wait complete. 2024-09-11T23:59:01.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:01 smithi006 ceph-mon[30947]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:01.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:01 smithi134 ceph-mon[34893]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:02.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:01 smithi039 ceph-mon[34543]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:02.247 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-11T23:59:02.505 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:02.929 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:02 smithi006 ceph-mon[30947]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:59:02.930 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:02 smithi006 ceph-mon[30947]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:02.930 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:02 smithi006 ceph-mon[30947]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-11T23:59:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:02 smithi134 ceph-mon[34893]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:59:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:02 smithi134 ceph-mon[34893]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:02 smithi134 ceph-mon[34893]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-11T23:59:03.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.014+0000 7f78b4d02640 1 -- 172.21.15.6:0/3163425804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78b0102e00 msgr2=0x7f78b0103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:03.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.014+0000 7f78b4d02640 1 --2- 172.21.15.6:0/3163425804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78b0102e00 0x7f78b0103280 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009900 tx=0x7f78a002a410 comp rx=0 tx=0).stop 2024-09-11T23:59:03.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.014+0000 7f78b4d02640 1 -- 172.21.15.6:0/3163425804 shutdown_connections 2024-09-11T23:59:03.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.014+0000 7f78b4d02640 1 --2- 172.21.15.6:0/3163425804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78b01037c0 0x7f78b010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.014+0000 7f78b4d02640 1 --2- 172.21.15.6:0/3163425804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78b0102e00 0x7f78b0103280 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.014+0000 7f78b4d02640 1 --2- 172.21.15.6:0/3163425804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b0101c00 0x7f78b0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.014+0000 7f78b4d02640 1 -- 172.21.15.6:0/3163425804 >> 172.21.15.6:0/3163425804 conn(0x7f78b00fd390 msgr2=0x7f78b00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.014+0000 7f78b4d02640 1 -- 172.21.15.6:0/3163425804 shutdown_connections 2024-09-11T23:59:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.014+0000 7f78b4d02640 1 -- 172.21.15.6:0/3163425804 wait complete. 2024-09-11T23:59:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.015+0000 7f78b4d02640 1 Processor -- start 2024-09-11T23:59:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.015+0000 7f78b4d02640 1 -- start start 2024-09-11T23:59:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.015+0000 7f78b4d02640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78b0101c00 0x7f78b0197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.015+0000 7f78b4d02640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78b0102e00 0x7f78b0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.015+0000 7f78b4d02640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b01037c0 0x7f78b019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.015+0000 7f78b4d02640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f78b010d830 con 0x7f78b0102e00 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.015+0000 7f78b4d02640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f78b010d6b0 con 0x7f78b01037c0 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.015+0000 7f78b4d02640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f78b010d9b0 con 0x7f78b0101c00 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78add9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78b0102e00 0x7f78b0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78add9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78b0102e00 0x7f78b0198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43968/0 (socket says 172.21.15.6:43968) 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78add9b640 1 -- 172.21.15.6:0/3446037085 learned_addr learned my addr 172.21.15.6:0/3446037085 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78ae59c640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78b0101c00 0x7f78b0197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78aed9d640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b01037c0 0x7f78b019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78add9b640 1 -- 172.21.15.6:0/3446037085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78b0101c00 msgr2=0x7f78b0197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78add9b640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78b0101c00 0x7f78b0197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78add9b640 1 -- 172.21.15.6:0/3446037085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b01037c0 msgr2=0x7f78b019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78add9b640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b01037c0 0x7f78b019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78add9b640 1 -- 172.21.15.6:0/3446037085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b019faf0 con 0x7f78b0102e00 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78aed9d640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b01037c0 0x7f78b019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78add9b640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78b0102e00 0x7f78b0198400 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f78a00314e0 tx=0x7f78a0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78a77fe640 1 -- 172.21.15.6:0/3446037085 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a003f070 con 0x7f78b0102e00 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78b4d02640 1 -- 172.21.15.6:0/3446037085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b019fd80 con 0x7f78b0102e00 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78a77fe640 1 -- 172.21.15.6:0/3446037085 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78a0031e40 con 0x7f78b0102e00 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78a77fe640 1 -- 172.21.15.6:0/3446037085 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0035030 con 0x7f78b0102e00 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.016+0000 7f78b4d02640 1 -- 172.21.15.6:0/3446037085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b01a02d0 con 0x7f78b0102e00 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.017+0000 7f78b4d02640 1 -- 172.21.15.6:0/3446037085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b0109050 con 0x7f78b0102e00 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.019+0000 7f78a77fe640 1 -- 172.21.15.6:0/3446037085 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f78a0042070 con 0x7f78b0102e00 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.020+0000 7f78a77fe640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f789c0a2bb0 0x7f789c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.020+0000 7f78ae59c640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f789c0a2bb0 0x7f789c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:03.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.020+0000 7f78a77fe640 1 -- 172.21.15.6:0/3446037085 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f78a00f02f0 con 0x7f78b0102e00 2024-09-11T23:59:03.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.020+0000 7f78ae59c640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f789c0a2bb0 0x7f789c0a5070 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f78b0102c60 tx=0x7f7898009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:03.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.024+0000 7f78a77fe640 1 -- 172.21.15.6:0/3446037085 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f78a00bcef0 con 0x7f78b0102e00 2024-09-11T23:59:03.047 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:02 smithi039 ceph-mon[34543]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:59:03.047 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:02 smithi039 ceph-mon[34543]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:03.047 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:02 smithi039 ceph-mon[34543]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-11T23:59:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.206+0000 7f78b4d02640 1 -- 172.21.15.6:0/3446037085 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f78b0062630 con 0x7f789c0a2bb0 2024-09-11T23:59:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.208+0000 7f78a77fe640 1 -- 172.21.15.6:0/3446037085 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f78b0062630 con 0x7f789c0a2bb0 2024-09-11T23:59:03.207 INFO:teuthology.orchestra.run.smithi006.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-11T23:59:03.207 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330000H400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-11T23:59:03.207 INFO:teuthology.orchestra.run.smithi006.stdout:smithi039 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736102QX4P0KGN 3726G No 3m ago Has a FileSystem, LVM detected 2024-09-11T23:59:03.207 INFO:teuthology.orchestra.run.smithi006.stdout:smithi134 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62420002400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-11T23:59:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.210+0000 7f78b4d02640 1 -- 172.21.15.6:0/3446037085 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f789c0a2bb0 msgr2=0x7f789c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.210+0000 7f78b4d02640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f789c0a2bb0 0x7f789c0a5070 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f78b0102c60 tx=0x7f7898009110 comp rx=0 tx=0).stop 2024-09-11T23:59:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.210+0000 7f78b4d02640 1 -- 172.21.15.6:0/3446037085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78b0102e00 msgr2=0x7f78b0198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.210+0000 7f78b4d02640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78b0102e00 0x7f78b0198400 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f78a00314e0 tx=0x7f78a0003c80 comp rx=0 tx=0).stop 2024-09-11T23:59:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.210+0000 7f78b4d02640 1 -- 172.21.15.6:0/3446037085 shutdown_connections 2024-09-11T23:59:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.210+0000 7f78b4d02640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f789c0a2bb0 0x7f789c0a5070 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.210+0000 7f78b4d02640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b01037c0 0x7f78b019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.210+0000 7f78b4d02640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78b0102e00 0x7f78b0198400 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.210+0000 7f78b4d02640 1 --2- 172.21.15.6:0/3446037085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78b0101c00 0x7f78b0197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.210+0000 7f78b4d02640 1 -- 172.21.15.6:0/3446037085 >> 172.21.15.6:0/3446037085 conn(0x7f78b00fd390 msgr2=0x7f78b0106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:03.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.210+0000 7f78b4d02640 1 -- 172.21.15.6:0/3446037085 shutdown_connections 2024-09-11T23:59:03.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:03.210+0000 7f78b4d02640 1 -- 172.21.15.6:0/3446037085 wait complete. 2024-09-11T23:59:03.881 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T23:59:03.891 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2024-09-11T23:59:03.892 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T23:59:04.153 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:04.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.620+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/80077845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe4102690 msgr2=0x7f7fe4108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.620+0000 7f7fe8f4a640 1 --2- 172.21.15.6:0/80077845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe4102690 0x7f7fe4108f20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc009ca0 tx=0x7f7fdc02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.620+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/80077845 shutdown_connections 2024-09-11T23:59:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.620+0000 7f7fe8f4a640 1 --2- 172.21.15.6:0/80077845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe4102690 0x7f7fe4108f20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.620+0000 7f7fe8f4a640 1 --2- 172.21.15.6:0/80077845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fe4101cd0 0x7f7fe4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.620+0000 7f7fe8f4a640 1 --2- 172.21.15.6:0/80077845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe4100ad0 0x7f7fe4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.620+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/80077845 >> 172.21.15.6:0/80077845 conn(0x7f7fe40fc280 msgr2=0x7f7fe40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.620+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/80077845 shutdown_connections 2024-09-11T23:59:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.620+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/80077845 wait complete. 2024-09-11T23:59:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.620+0000 7f7fe8f4a640 1 Processor -- start 2024-09-11T23:59:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.620+0000 7f7fe8f4a640 1 -- start start 2024-09-11T23:59:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fe8f4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe4100ad0 0x7f7fe4197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fe8f4a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe4101cd0 0x7f7fe4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fe8f4a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fe4102690 0x7f7fe419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fe8f4a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe410c660 con 0x7f7fe4101cd0 2024-09-11T23:59:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fe8f4a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe410c4e0 con 0x7f7fe4102690 2024-09-11T23:59:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fe8f4a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe410c7e0 con 0x7f7fe4100ad0 2024-09-11T23:59:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fdbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe4101cd0 0x7f7fe4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fdbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe4101cd0 0x7f7fe4198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43998/0 (socket says 172.21.15.6:43998) 2024-09-11T23:59:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fdbfff640 1 -- 172.21.15.6:0/4146570851 learned_addr learned my addr 172.21.15.6:0/4146570851 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fe259c640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe4100ad0 0x7f7fe4197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fe2d9d640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fe4102690 0x7f7fe419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fdbfff640 1 -- 172.21.15.6:0/4146570851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe4100ad0 msgr2=0x7f7fe4197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fdbfff640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe4100ad0 0x7f7fe4197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fdbfff640 1 -- 172.21.15.6:0/4146570851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fe4102690 msgr2=0x7f7fe419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fdbfff640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fe4102690 0x7f7fe419f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fdbfff640 1 -- 172.21.15.6:0/4146570851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe419fa60 con 0x7f7fe4101cd0 2024-09-11T23:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.621+0000 7f7fdbfff640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe4101cd0 0x7f7fe4198370 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00b4a0 tx=0x7f7fcc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.622+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/4146570851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc014070 con 0x7f7fe4101cd0 2024-09-11T23:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.622+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/4146570851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fcc010ac0 con 0x7f7fe4101cd0 2024-09-11T23:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.622+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/4146570851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc017c30 con 0x7f7fe4101cd0 2024-09-11T23:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.622+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/4146570851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe419fd50 con 0x7f7fe4101cd0 2024-09-11T23:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.622+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/4146570851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe41a0250 con 0x7f7fe4101cd0 2024-09-11T23:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.623+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/4146570851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe41a04e0 con 0x7f7fe4101cd0 2024-09-11T23:59:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.624+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/4146570851 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f7fcc017070 con 0x7f7fe4101cd0 2024-09-11T23:59:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.624+0000 7f7fdb7fe640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7fd00a2c30 0x7f7fd00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.625+0000 7f7fe259c640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7fd00a2c30 0x7f7fd00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.625+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/4146570851 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f7fcc0ce590 con 0x7f7fe4101cd0 2024-09-11T23:59:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.625+0000 7f7fe259c640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7fd00a2c30 0x7f7fd00a50f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4101b30 tx=0x7f7fd400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.629+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/4146570851 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7fcc09ab40 con 0x7f7fe4101cd0 2024-09-11T23:59:04.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.844+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/4146570851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7fe41a06b0 con 0x7f7fe4101cd0 2024-09-11T23:59:04.844 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:04 smithi006 ceph-mon[30947]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:04.844 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:04 smithi006 ceph-mon[30947]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.845+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/4146570851 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3114 (secure 0 0 0) 0x7f7fcc09ee40 con 0x7f7fe4101cd0 2024-09-11T23:59:04.844 INFO:teuthology.orchestra.run.smithi006.stdout:e27 2024-09-11T23:59:04.844 INFO:teuthology.orchestra.run.smithi006.stdout:btime 2024-09-11T23:57:43:074223+0000 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 27 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-09-11T23:56:58.063963+0000 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-09-11T23:57:43.074202+0000 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-09-11T23:59:04.845 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 300 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 5 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1,2,3,4 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=24491,1=24490,2=24478,3=24472,4=24461} 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-09-11T23:59:04.846 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-09-11T23:59:04.847 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3,4] 2024-09-11T23:59:04.847 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-09-11T23:59:04.847 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-09-11T23:59:04.847 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-09-11T23:59:04.847 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-09-11T23:59:04.847 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 0 2024-09-11T23:59:04.847 INFO:teuthology.orchestra.run.smithi006.stdout:qdb_cluster leader: 24491 members: 24490,24491,24478,24472,24461 2024-09-11T23:59:04.847 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b{0:24491} state up:active seq 4 addr [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:04.847 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.e{0:24443} state up:standby-replay seq 1 addr [v2:172.21.15.39:6834/2372527607,v1:172.21.15.39:6835/2372527607] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:04.847 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.i{1:24490} state up:active seq 17 addr [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:04.847 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.l{1:24430} state up:standby-replay seq 1 addr [v2:172.21.15.134:6832/3891726228,v1:172.21.15.134:6833/3891726228] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:04.848 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c{2:24478} state up:active seq 18 addr [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:04.848 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.k{2:24419} state up:standby-replay seq 1 addr [v2:172.21.15.39:6832/3540998066,v1:172.21.15.39:6833/3540998066] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:04.848 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.f{3:24472} state up:active seq 19 addr [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:04.848 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a{3:14634} state up:standby-replay seq 1 addr [v2:172.21.15.6:6840/500771395,v1:172.21.15.6:6841/500771395] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:04.848 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.h{4:24461} state up:active seq 18 addr [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:04.848 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.g{4:14628} state up:standby-replay seq 1 addr [v2:172.21.15.6:6838/809129212,v1:172.21.15.6:6839/809129212] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:04.848 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:59:04.848 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:59:04.848 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-09-11T23:59:04.848 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:59:04.848 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.j{-1:14562} state up:standby seq 1 addr [v2:172.21.15.6:6834/3405315500,v1:172.21.15.6:6835/3405315500] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:04.848 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d{-1:14574} state up:standby seq 1 addr [v2:172.21.15.6:6836/2319638912,v1:172.21.15.6:6837/2319638912] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:04.849 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-09-11T23:59:04.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.848+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/4146570851 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7fd00a2c30 msgr2=0x7f7fd00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:04.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.848+0000 7f7fe8f4a640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7fd00a2c30 0x7f7fd00a50f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4101b30 tx=0x7f7fd400b390 comp rx=0 tx=0).stop 2024-09-11T23:59:04.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.848+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/4146570851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe4101cd0 msgr2=0x7f7fe4198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:04.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.848+0000 7f7fe8f4a640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe4101cd0 0x7f7fe4198370 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00b4a0 tx=0x7f7fcc00b960 comp rx=0 tx=0).stop 2024-09-11T23:59:04.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.848+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/4146570851 shutdown_connections 2024-09-11T23:59:04.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.848+0000 7f7fe8f4a640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7fd00a2c30 0x7f7fd00a50f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:04.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.848+0000 7f7fe8f4a640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fe4102690 0x7f7fe419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:04.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.848+0000 7f7fe8f4a640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe4101cd0 0x7f7fe4198370 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:04.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.848+0000 7f7fe8f4a640 1 --2- 172.21.15.6:0/4146570851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe4100ad0 0x7f7fe4197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:04.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.848+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/4146570851 >> 172.21.15.6:0/4146570851 conn(0x7f7fe40fc280 msgr2=0x7f7fe406a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:04.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.848+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/4146570851 shutdown_connections 2024-09-11T23:59:04.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:04.848+0000 7f7fe8f4a640 1 -- 172.21.15.6:0/4146570851 wait complete. 2024-09-11T23:59:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:04 smithi134 ceph-mon[34893]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:04 smithi134 ceph-mon[34893]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:05.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:04 smithi039 ceph-mon[34543]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:05.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:04 smithi039 ceph-mon[34543]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:05.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-11T23:59:05.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:05 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/4146570851' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T23:59:05.884 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:05.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:05 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/4146570851' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T23:59:06.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:05 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/4146570851' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T23:59:06.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.379+0000 7fb5eabca640 1 -- 172.21.15.6:0/4197592802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5e4101c00 msgr2=0x7fb5e4102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:06.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.379+0000 7fb5eabca640 1 --2- 172.21.15.6:0/4197592802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5e4101c00 0x7fb5e4102000 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009ca0 tx=0x7fb5d402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:06.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.379+0000 7fb5eabca640 1 -- 172.21.15.6:0/4197592802 shutdown_connections 2024-09-11T23:59:06.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.379+0000 7fb5eabca640 1 --2- 172.21.15.6:0/4197592802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5e41037c0 0x7fb5e410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:06.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.379+0000 7fb5eabca640 1 --2- 172.21.15.6:0/4197592802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5e4102e00 0x7fb5e4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.379+0000 7fb5eabca640 1 --2- 172.21.15.6:0/4197592802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5e4101c00 0x7fb5e4102000 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.379+0000 7fb5eabca640 1 -- 172.21.15.6:0/4197592802 >> 172.21.15.6:0/4197592802 conn(0x7fb5e40fd390 msgr2=0x7fb5e40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.379+0000 7fb5eabca640 1 -- 172.21.15.6:0/4197592802 shutdown_connections 2024-09-11T23:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.379+0000 7fb5eabca640 1 -- 172.21.15.6:0/4197592802 wait complete. 2024-09-11T23:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.380+0000 7fb5eabca640 1 Processor -- start 2024-09-11T23:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.380+0000 7fb5eabca640 1 -- start start 2024-09-11T23:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.380+0000 7fb5eabca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5e4101c00 0x7fb5e4197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.380+0000 7fb5eabca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5e4102e00 0x7fb5e4198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.380+0000 7fb5eabca640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5e41037c0 0x7fb5e419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.380+0000 7fb5eabca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e410d730 con 0x7fb5e4102e00 2024-09-11T23:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.380+0000 7fb5eabca640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e410d5b0 con 0x7fb5e41037c0 2024-09-11T23:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.380+0000 7fb5eabca640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e410d8b0 con 0x7fb5e4101c00 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.380+0000 7fb5e3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5e4102e00 0x7fb5e4198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.380+0000 7fb5e3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5e4102e00 0x7fb5e4198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44010/0 (socket says 172.21.15.6:44010) 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.380+0000 7fb5e3fff640 1 -- 172.21.15.6:0/3288867880 learned_addr learned my addr 172.21.15.6:0/3288867880 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e8966640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5e4101c00 0x7fb5e4197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e9167640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5e41037c0 0x7fb5e419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e3fff640 1 -- 172.21.15.6:0/3288867880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5e4101c00 msgr2=0x7fb5e4197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e3fff640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5e4101c00 0x7fb5e4197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e3fff640 1 -- 172.21.15.6:0/3288867880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5e41037c0 msgr2=0x7fb5e419f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e3fff640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5e41037c0 0x7fb5e419f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e3fff640 1 -- 172.21.15.6:0/3288867880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e419fa40 con 0x7fb5e4102e00 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e8966640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5e4101c00 0x7fb5e4197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e9167640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5e41037c0 0x7fb5e419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e3fff640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5e4102e00 0x7fb5e4198350 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00d770 tx=0x7fb5cc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e1ffb640 1 -- 172.21.15.6:0/3288867880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc017070 con 0x7fb5e4102e00 2024-09-11T23:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e1ffb640 1 -- 172.21.15.6:0/3288867880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5cc0054d0 con 0x7fb5e4102e00 2024-09-11T23:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5eabca640 1 -- 172.21.15.6:0/3288867880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e419fd30 con 0x7fb5e4102e00 2024-09-11T23:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5e1ffb640 1 -- 172.21.15.6:0/3288867880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc004cf0 con 0x7fb5e4102e00 2024-09-11T23:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.381+0000 7fb5eabca640 1 -- 172.21.15.6:0/3288867880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e41a01c0 con 0x7fb5e4102e00 2024-09-11T23:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.382+0000 7fb5eabca640 1 -- 172.21.15.6:0/3288867880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e41090a0 con 0x7fb5e4102e00 2024-09-11T23:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.384+0000 7fb5e1ffb640 1 -- 172.21.15.6:0/3288867880 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb5cc004e90 con 0x7fb5e4102e00 2024-09-11T23:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.384+0000 7fb5e1ffb640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb5d00a2bb0 0x7fb5d00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.384+0000 7fb5e1ffb640 1 -- 172.21.15.6:0/3288867880 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fb5cc0ceea0 con 0x7fb5e4102e00 2024-09-11T23:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.384+0000 7fb5e8966640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb5d00a2bb0 0x7fb5d00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.385+0000 7fb5e8966640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb5d00a2bb0 0x7fb5d00a5070 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4000f80 tx=0x7fb5d4009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.388+0000 7fb5e1ffb640 1 -- 172.21.15.6:0/3288867880 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb5cc09baa0 con 0x7fb5e4102e00 2024-09-11T23:59:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.568+0000 7fb5eabca640 1 -- 172.21.15.6:0/3288867880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fb5e4062e90 con 0x7fb5e4102e00 2024-09-11T23:59:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.569+0000 7fb5e1ffb640 1 -- 172.21.15.6:0/3288867880 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+5567 (secure 0 0 0) 0x7fb5cc09b3a0 con 0x7fb5e4102e00 2024-09-11T23:59:06.568 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 88 2024-09-11T23:59:06.568 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 4901345a-7098-11ef-bcea-c7b262605968 2024-09-11T23:59:06.568 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-09-11T23:49:14.063848+0000 2024-09-11T23:59:06.568 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-09-11T23:58:02.808790+0000 2024-09-11T23:59:06.568 INFO:teuthology.orchestra.run.smithi006.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T23:59:06.568 INFO:teuthology.orchestra.run.smithi006.stdout:crush_version 27 2024-09-11T23:59:06.568 INFO:teuthology.orchestra.run.smithi006.stdout:full_ratio 0.95 2024-09-11T23:59:06.568 INFO:teuthology.orchestra.run.smithi006.stdout:backfillfull_ratio 0.9 2024-09-11T23:59:06.568 INFO:teuthology.orchestra.run.smithi006.stdout:nearfull_ratio 0.85 2024-09-11T23:59:06.568 INFO:teuthology.orchestra.run.smithi006.stdout:require_min_compat_client luminous 2024-09-11T23:59:06.568 INFO:teuthology.orchestra.run.smithi006.stdout:min_compat_client luminous 2024-09-11T23:59:06.568 INFO:teuthology.orchestra.run.smithi006.stdout:require_osd_release squid 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:stretch_mode_enabled false 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:max_osd 12 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6802/2698750681,v1:172.21.15.6:6803/2698750681] [v2:172.21.15.6:6804/2698750681,v1:172.21.15.6:6805/2698750681] exists,up 32cb5f2f-250f-4cf6-ad78-a79f03f5cc10 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6800/1024701609,v1:172.21.15.39:6801/1024701609] [v2:172.21.15.39:6802/1024701609,v1:172.21.15.39:6803/1024701609] exists,up 748f368e-0065-4cd1-bf7d-09eb7144226a 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 up in weight 1 up_from 18 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/3895287235,v1:172.21.15.134:6801/3895287235] [v2:172.21.15.134:6802/3895287235,v1:172.21.15.134:6803/3895287235] exists,up c143215f-b1f7-4095-9015-1d810941ece5 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 up in weight 1 up_from 24 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6810/2291614871,v1:172.21.15.6:6811/2291614871] [v2:172.21.15.6:6812/2291614871,v1:172.21.15.6:6813/2291614871] exists,up 9278237a-27a1-40bc-9bac-9b234b7b82b0 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 up in weight 1 up_from 31 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6808/1537139335,v1:172.21.15.39:6809/1537139335] [v2:172.21.15.39:6810/1537139335,v1:172.21.15.39:6811/1537139335] exists,up 1945486a-37b3-40c9-8854-0c9d0b63f3aa 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 up in weight 1 up_from 36 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/1350729565,v1:172.21.15.134:6809/1350729565] [v2:172.21.15.134:6810/1350729565,v1:172.21.15.134:6811/1350729565] exists,up d57840a8-4d24-432a-9368-863496d55a95 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6 up in weight 1 up_from 43 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6818/1313356243,v1:172.21.15.6:6819/1313356243] [v2:172.21.15.6:6820/1313356243,v1:172.21.15.6:6821/1313356243] exists,up de6a7236-3d15-4b09-b2be-4b23a03e512f 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7 up in weight 1 up_from 48 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6816/2076370620,v1:172.21.15.39:6817/2076370620] [v2:172.21.15.39:6818/2076370620,v1:172.21.15.39:6819/2076370620] exists,up 1534560b-9f95-476e-8c70-a6e62eb0621c 2024-09-11T23:59:06.570 INFO:teuthology.orchestra.run.smithi006.stdout:osd.8 up in weight 1 up_from 55 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/3894059543,v1:172.21.15.134:6817/3894059543] [v2:172.21.15.134:6818/3894059543,v1:172.21.15.134:6819/3894059543] exists,up dfe976d0-c581-4c77-a075-77eeb02e9153 2024-09-11T23:59:06.570 INFO:teuthology.orchestra.run.smithi006.stdout:osd.9 up in weight 1 up_from 62 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6826/4076879536,v1:172.21.15.6:6827/4076879536] [v2:172.21.15.6:6828/4076879536,v1:172.21.15.6:6829/4076879536] exists,up 65dd99b2-6515-4d89-b660-26fe171e8323 2024-09-11T23:59:06.570 INFO:teuthology.orchestra.run.smithi006.stdout:osd.10 up in weight 1 up_from 67 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6824/3939755012,v1:172.21.15.39:6825/3939755012] [v2:172.21.15.39:6826/3939755012,v1:172.21.15.39:6827/3939755012] exists,up 59380dc6-81fd-4f46-84a1-a5c18746b61c 2024-09-11T23:59:06.570 INFO:teuthology.orchestra.run.smithi006.stdout:osd.11 up in weight 1 up_from 74 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/932807401,v1:172.21.15.134:6825/932807401] [v2:172.21.15.134:6826/932807401,v1:172.21.15.134:6827/932807401] exists,up dd4acadd-641f-4a0f-abda-589d1a0482e6 2024-09-11T23:59:06.570 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.5 [8,11] 2024-09-11T23:59:06.570 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.6 [8,11] 2024-09-11T23:59:06.570 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.e [2,1] 2024-09-11T23:59:06.570 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.16 [2,4] 2024-09-11T23:59:06.570 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.e [4,6] 2024-09-11T23:59:06.570 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.1d [4,8] 2024-09-11T23:59:06.570 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 4.7 [5,8] 2024-09-11T23:59:06.570 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 4.f [9,8] 2024-09-11T23:59:06.571 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 4.14 [9,10] 2024-09-11T23:59:06.571 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 4.1b [9,8] 2024-09-11T23:59:06.571 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/4111388064 expires 2024-09-12T23:50:00.847021+0000 2024-09-11T23:59:06.571 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/2784482923 expires 2024-09-12T23:50:00.847021+0000 2024-09-11T23:59:06.571 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6800/2279576750 expires 2024-09-12T23:50:00.847021+0000 2024-09-11T23:59:06.571 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6801/1826197239 expires 2024-09-12T23:49:36.127456+0000 2024-09-11T23:59:06.571 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6800/1826197239 expires 2024-09-12T23:49:36.127456+0000 2024-09-11T23:59:06.571 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/619991212 expires 2024-09-12T23:50:00.847021+0000 2024-09-11T23:59:06.571 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/3073584278 expires 2024-09-12T23:49:36.127456+0000 2024-09-11T23:59:06.571 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6801/2279576750 expires 2024-09-12T23:50:00.847021+0000 2024-09-11T23:59:06.572 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/3649466939 expires 2024-09-12T23:49:36.127456+0000 2024-09-11T23:59:06.572 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/2071921193 expires 2024-09-12T23:49:36.127456+0000 2024-09-11T23:59:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.572+0000 7fb5eabca640 1 -- 172.21.15.6:0/3288867880 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb5d00a2bb0 msgr2=0x7fb5d00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.572+0000 7fb5eabca640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb5d00a2bb0 0x7fb5d00a5070 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4000f80 tx=0x7fb5d4009360 comp rx=0 tx=0).stop 2024-09-11T23:59:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.572+0000 7fb5eabca640 1 -- 172.21.15.6:0/3288867880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5e4102e00 msgr2=0x7fb5e4198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.572+0000 7fb5eabca640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5e4102e00 0x7fb5e4198350 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00d770 tx=0x7fb5cc00dc30 comp rx=0 tx=0).stop 2024-09-11T23:59:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.572+0000 7fb5eabca640 1 -- 172.21.15.6:0/3288867880 shutdown_connections 2024-09-11T23:59:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.572+0000 7fb5eabca640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb5d00a2bb0 0x7fb5d00a5070 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.572+0000 7fb5eabca640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5e41037c0 0x7fb5e419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.572+0000 7fb5eabca640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5e4102e00 0x7fb5e4198350 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.572+0000 7fb5eabca640 1 --2- 172.21.15.6:0/3288867880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5e4101c00 0x7fb5e4197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.572+0000 7fb5eabca640 1 -- 172.21.15.6:0/3288867880 >> 172.21.15.6:0/3288867880 conn(0x7fb5e40fd390 msgr2=0x7fb5e4106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.572+0000 7fb5eabca640 1 -- 172.21.15.6:0/3288867880 shutdown_connections 2024-09-11T23:59:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:06.572+0000 7fb5eabca640 1 -- 172.21.15.6:0/3288867880 wait complete. 2024-09-11T23:59:06.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:06 smithi006 ceph-mon[30947]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-11T23:59:06.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:06 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3288867880' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T23:59:06.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:06 smithi134 ceph-mon[34893]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-11T23:59:06.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:06 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3288867880' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T23:59:07.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:06 smithi039 ceph-mon[34543]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-11T23:59:07.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:06 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3288867880' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T23:59:07.208 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-11T23:59:07.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:59:07.480 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:07.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.947+0000 7f42f55e4640 1 -- 172.21.15.6:0/4176163530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42f0101de0 msgr2=0x7f42f01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:07.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.947+0000 7f42f55e4640 1 --2- 172.21.15.6:0/4176163530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42f0101de0 0x7f42f01021c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009900 tx=0x7f42e002a410 comp rx=0 tx=0).stop 2024-09-11T23:59:07.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.947+0000 7f42f55e4640 1 -- 172.21.15.6:0/4176163530 shutdown_connections 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.947+0000 7f42f55e4640 1 --2- 172.21.15.6:0/4176163530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42f0106f10 0x7f42f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.947+0000 7f42f55e4640 1 --2- 172.21.15.6:0/4176163530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f42f0102790 0x7f42f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.947+0000 7f42f55e4640 1 --2- 172.21.15.6:0/4176163530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42f0101de0 0x7f42f01021c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.947+0000 7f42f55e4640 1 -- 172.21.15.6:0/4176163530 >> 172.21.15.6:0/4176163530 conn(0x7f42f00fd8c0 msgr2=0x7f42f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.947+0000 7f42f55e4640 1 -- 172.21.15.6:0/4176163530 shutdown_connections 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.947+0000 7f42f55e4640 1 -- 172.21.15.6:0/4176163530 wait complete. 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.947+0000 7f42f55e4640 1 Processor -- start 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42f55e4640 1 -- start start 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42f55e4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f42f0101de0 0x7f42f0198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42f55e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42f0102790 0x7f42f0198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42f55e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42f0106f10 0x7f42f019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42f55e4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f42f0111e40 con 0x7f42f0106f10 2024-09-11T23:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42f55e4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f42f0111cc0 con 0x7f42f0101de0 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42f55e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f42f0111fc0 con 0x7f42f0102790 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42ef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42f0106f10 0x7f42f019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42ef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42f0106f10 0x7f42f019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44028/0 (socket says 172.21.15.6:44028) 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42ef7fe640 1 -- 172.21.15.6:0/624311034 learned_addr learned my addr 172.21.15.6:0/624311034 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42eeffd640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f42f0101de0 0x7f42f0198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42ee7fc640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42f0102790 0x7f42f0198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42ef7fe640 1 -- 172.21.15.6:0/624311034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42f0102790 msgr2=0x7f42f0198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42ef7fe640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42f0102790 0x7f42f0198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42ef7fe640 1 -- 172.21.15.6:0/624311034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f42f0101de0 msgr2=0x7f42f0198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42ef7fe640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f42f0101de0 0x7f42f0198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.948+0000 7f42ef7fe640 1 -- 172.21.15.6:0/624311034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f019d2f0 con 0x7f42f0106f10 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.949+0000 7f42ef7fe640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42f0106f10 0x7f42f019cc10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f42e800b970 tx=0x7f42e800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.949+0000 7f42e7fff640 1 -- 172.21.15.6:0/624311034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8019070 con 0x7f42f0106f10 2024-09-11T23:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.949+0000 7f42f55e4640 1 -- 172.21.15.6:0/624311034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f019d5e0 con 0x7f42f0106f10 2024-09-11T23:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.949+0000 7f42e7fff640 1 -- 172.21.15.6:0/624311034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f42e8014440 con 0x7f42f0106f10 2024-09-11T23:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.949+0000 7f42e7fff640 1 -- 172.21.15.6:0/624311034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e80075d0 con 0x7f42f0106f10 2024-09-11T23:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.949+0000 7f42f55e4640 1 -- 172.21.15.6:0/624311034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f01a4ec0 con 0x7f42f0106f10 2024-09-11T23:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.950+0000 7f42f55e4640 1 -- 172.21.15.6:0/624311034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f01021c0 con 0x7f42f0106f10 2024-09-11T23:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.951+0000 7f42e7fff640 1 -- 172.21.15.6:0/624311034 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f42e801c070 con 0x7f42f0106f10 2024-09-11T23:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.952+0000 7f42e7fff640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f42dc0a2b80 0x7f42dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.952+0000 7f42eeffd640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f42dc0a2b80 0x7f42dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.952+0000 7f42e7fff640 1 -- 172.21.15.6:0/624311034 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f42e80ce7f0 con 0x7f42f0106f10 2024-09-11T23:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.952+0000 7f42eeffd640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f42dc0a2b80 0x7f42dc0a5040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f42e0031440 tx=0x7f42e0005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:07.956+0000 7f42e7fff640 1 -- 172.21.15.6:0/624311034 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42e809ada0 con 0x7f42f0106f10 2024-09-11T23:59:08.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.167+0000 7f42f55e4640 1 -- 172.21.15.6:0/624311034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42f002d7c0 con 0x7f42f0106f10 2024-09-11T23:59:08.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.168+0000 7f42e7fff640 1 -- 172.21.15.6:0/624311034 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11950 (secure 0 0 0) 0x7f42e809f0a0 con 0x7f42f0106f10 2024-09-11T23:59:08.167 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:59:08.167 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"btime":"2024-09-11T23:57:43:074223+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:56:58.063963+0000","modified":"2024-09-11T23:57:43.074202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24478,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/809129212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":809129212},{"type":"v1","addr":"172.21.15.6:6839","nonce":809129212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/500771395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":500771395},{"type":"v1","addr":"172.21.15.6:6841","nonce":500771395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":18,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":19,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":18,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.39:6839/3561706320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3561706320},{"type":"v1","addr":"172.21.15.39:6839","nonce":3561706320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24490,24491,24478,24472,24461]},"id":1}]} 2024-09-11T23:59:08.167 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-09-11T23:59:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.170+0000 7f42f55e4640 1 -- 172.21.15.6:0/624311034 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f42dc0a2b80 msgr2=0x7f42dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.170+0000 7f42f55e4640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f42dc0a2b80 0x7f42dc0a5040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f42e0031440 tx=0x7f42e0005e80 comp rx=0 tx=0).stop 2024-09-11T23:59:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.170+0000 7f42f55e4640 1 -- 172.21.15.6:0/624311034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42f0106f10 msgr2=0x7f42f019cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.170+0000 7f42f55e4640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42f0106f10 0x7f42f019cc10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f42e800b970 tx=0x7f42e800bd70 comp rx=0 tx=0).stop 2024-09-11T23:59:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.170+0000 7f42f55e4640 1 -- 172.21.15.6:0/624311034 shutdown_connections 2024-09-11T23:59:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.170+0000 7f42f55e4640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f42dc0a2b80 0x7f42dc0a5040 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.170+0000 7f42f55e4640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42f0106f10 0x7f42f019cc10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.170+0000 7f42f55e4640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42f0102790 0x7f42f0198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.170+0000 7f42f55e4640 1 --2- 172.21.15.6:0/624311034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f42f0101de0 0x7f42f0198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.170+0000 7f42f55e4640 1 -- 172.21.15.6:0/624311034 >> 172.21.15.6:0/624311034 conn(0x7f42f00fd8c0 msgr2=0x7f42f00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.170+0000 7f42f55e4640 1 -- 172.21.15.6:0/624311034 shutdown_connections 2024-09-11T23:59:08.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:08.170+0000 7f42f55e4640 1 -- 172.21.15.6:0/624311034 wait complete. 2024-09-11T23:59:08.820 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:08 smithi006 ceph-mon[30947]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-11T23:59:08.820 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:08 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/624311034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:08.852 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:59:08.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:08 smithi134 ceph-mon[34893]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-11T23:59:08.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:08 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/624311034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:09.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:08 smithi039 ceph-mon[34543]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-11T23:59:09.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:08 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/624311034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:09.114 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.581+0000 7f027cad7640 1 -- 172.21.15.6:0/2518501773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0278100480 msgr2=0x7f0278100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.581+0000 7f027cad7640 1 --2- 172.21.15.6:0/2518501773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0278100480 0x7f0278100860 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0268009900 tx=0x7f026802a410 comp rx=0 tx=0).stop 2024-09-11T23:59:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.582+0000 7f027cad7640 1 -- 172.21.15.6:0/2518501773 shutdown_connections 2024-09-11T23:59:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.582+0000 7f027cad7640 1 --2- 172.21.15.6:0/2518501773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02781055b0 0x7f027810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.582+0000 7f027cad7640 1 --2- 172.21.15.6:0/2518501773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0278100e30 0x7f0278104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.582+0000 7f027cad7640 1 --2- 172.21.15.6:0/2518501773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0278100480 0x7f0278100860 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.582+0000 7f027cad7640 1 -- 172.21.15.6:0/2518501773 >> 172.21.15.6:0/2518501773 conn(0x7f0278077210 msgr2=0x7f02780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:09.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.582+0000 7f027cad7640 1 -- 172.21.15.6:0/2518501773 shutdown_connections 2024-09-11T23:59:09.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.582+0000 7f027cad7640 1 -- 172.21.15.6:0/2518501773 wait complete. 2024-09-11T23:59:09.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.582+0000 7f027cad7640 1 Processor -- start 2024-09-11T23:59:09.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f027cad7640 1 -- start start 2024-09-11T23:59:09.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f027cad7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0278100480 0x7f02781983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:09.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f027cad7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0278100e30 0x7f02781988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:09.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f027cad7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02781055b0 0x7f027819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:09.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f027cad7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f027810fc40 con 0x7f02781055b0 2024-09-11T23:59:09.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f027cad7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f027810fac0 con 0x7f0278100480 2024-09-11T23:59:09.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f027cad7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f027810fdc0 con 0x7f0278100e30 2024-09-11T23:59:09.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f0276d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02781055b0 0x7f027819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:09.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f027659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0278100480 0x7f02781983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:09.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f0276d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02781055b0 0x7f027819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44048/0 (socket says 172.21.15.6:44048) 2024-09-11T23:59:09.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f0276d9d640 1 -- 172.21.15.6:0/745585245 learned_addr learned my addr 172.21.15.6:0/745585245 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:09.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f0275d9b640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0278100e30 0x7f02781988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:09.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f0276d9d640 1 -- 172.21.15.6:0/745585245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0278100e30 msgr2=0x7f02781988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:09.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f0276d9d640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0278100e30 0x7f02781988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:09.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f0276d9d640 1 -- 172.21.15.6:0/745585245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0278100480 msgr2=0x7f02781983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:09.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f0276d9d640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0278100480 0x7f02781983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:09.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f0276d9d640 1 -- 172.21.15.6:0/745585245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027819d360 con 0x7f02781055b0 2024-09-11T23:59:09.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.583+0000 7f027659c640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0278100480 0x7f02781983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.584+0000 7f0276d9d640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02781055b0 0x7f027819cc80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f027000cce0 tx=0x7f027000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.584+0000 7f02677fe640 1 -- 172.21.15.6:0/745585245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027000f450 con 0x7f02781055b0 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.584+0000 7f02677fe640 1 -- 172.21.15.6:0/745585245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f027000faa0 con 0x7f02781055b0 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.584+0000 7f027cad7640 1 -- 172.21.15.6:0/745585245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027819d650 con 0x7f02781055b0 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.584+0000 7f02677fe640 1 -- 172.21.15.6:0/745585245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270018b70 con 0x7f02781055b0 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.584+0000 7f027cad7640 1 -- 172.21.15.6:0/745585245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02781a4f30 con 0x7f02781055b0 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.585+0000 7f027cad7640 1 -- 172.21.15.6:0/745585245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0278100860 con 0x7f02781055b0 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.586+0000 7f02677fe640 1 -- 172.21.15.6:0/745585245 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f0270018d10 con 0x7f02781055b0 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.587+0000 7f02677fe640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f02600a2c00 0x7f02600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.587+0000 7f027659c640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f02600a2c00 0x7f02600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.587+0000 7f02677fe640 1 -- 172.21.15.6:0/745585245 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f02700cf750 con 0x7f02781055b0 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.587+0000 7f027659c640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f02600a2c00 0x7f02600a50c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0268031440 tx=0x7f0268005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.591+0000 7f02677fe640 1 -- 172.21.15.6:0/745585245 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0270014030 con 0x7f02781055b0 2024-09-11T23:59:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.806+0000 7f027cad7640 1 -- 172.21.15.6:0/745585245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0278108200 con 0x7f02781055b0 2024-09-11T23:59:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.807+0000 7f02677fe640 1 -- 172.21.15.6:0/745585245 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11950 (secure 0 0 0) 0x7f027009c2f0 con 0x7f02781055b0 2024-09-11T23:59:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:59:09.806 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"btime":"2024-09-11T23:57:43:074223+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:56:58.063963+0000","modified":"2024-09-11T23:57:43.074202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24478,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/809129212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":809129212},{"type":"v1","addr":"172.21.15.6:6839","nonce":809129212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/500771395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":500771395},{"type":"v1","addr":"172.21.15.6:6841","nonce":500771395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":18,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":19,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":18,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.39:6839/3561706320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3561706320},{"type":"v1","addr":"172.21.15.39:6839","nonce":3561706320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24490,24491,24478,24472,24461]},"id":1}]} 2024-09-11T23:59:09.806 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-09-11T23:59:09.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.809+0000 7f027cad7640 1 -- 172.21.15.6:0/745585245 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f02600a2c00 msgr2=0x7f02600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:09.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.809+0000 7f027cad7640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f02600a2c00 0x7f02600a50c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0268031440 tx=0x7f0268005b50 comp rx=0 tx=0).stop 2024-09-11T23:59:09.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.809+0000 7f027cad7640 1 -- 172.21.15.6:0/745585245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02781055b0 msgr2=0x7f027819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:09.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.809+0000 7f027cad7640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02781055b0 0x7f027819cc80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f027000cce0 tx=0x7f027000a620 comp rx=0 tx=0).stop 2024-09-11T23:59:09.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.809+0000 7f027cad7640 1 -- 172.21.15.6:0/745585245 shutdown_connections 2024-09-11T23:59:09.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.809+0000 7f027cad7640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f02600a2c00 0x7f02600a50c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.809+0000 7f027cad7640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02781055b0 0x7f027819cc80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.809+0000 7f027cad7640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0278100e30 0x7f02781988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.809+0000 7f027cad7640 1 --2- 172.21.15.6:0/745585245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0278100480 0x7f02781983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.809+0000 7f027cad7640 1 -- 172.21.15.6:0/745585245 >> 172.21.15.6:0/745585245 conn(0x7f0278077210 msgr2=0x7f0278103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.809+0000 7f027cad7640 1 -- 172.21.15.6:0/745585245 shutdown_connections 2024-09-11T23:59:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:09.809+0000 7f027cad7640 1 -- 172.21.15.6:0/745585245 wait complete. 2024-09-11T23:59:10.538 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:59:10.801 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:10.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:10 smithi006 ceph-mon[30947]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-11T23:59:10.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:10 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/745585245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:10 smithi134 ceph-mon[34893]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-11T23:59:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:10 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/745585245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:11.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:10 smithi039 ceph-mon[34543]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-11T23:59:11.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:10 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/745585245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.274+0000 7fa0dce1a640 1 -- 172.21.15.6:0/1663246236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d8103ff0 msgr2=0x7fa0d81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.274+0000 7fa0dce1a640 1 --2- 172.21.15.6:0/1663246236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d8103ff0 0x7fa0d81043d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009900 tx=0x7fa0c802a410 comp rx=0 tx=0).stop 2024-09-11T23:59:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.274+0000 7fa0dce1a640 1 -- 172.21.15.6:0/1663246236 shutdown_connections 2024-09-11T23:59:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.274+0000 7fa0dce1a640 1 --2- 172.21.15.6:0/1663246236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0d8109120 0x7fa0d8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.274+0000 7fa0dce1a640 1 --2- 172.21.15.6:0/1663246236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0d81049a0 0x7fa0d81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.274+0000 7fa0dce1a640 1 --2- 172.21.15.6:0/1663246236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d8103ff0 0x7fa0d81043d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.274+0000 7fa0dce1a640 1 -- 172.21.15.6:0/1663246236 >> 172.21.15.6:0/1663246236 conn(0x7fa0d80ffa90 msgr2=0x7fa0d8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.274+0000 7fa0dce1a640 1 -- 172.21.15.6:0/1663246236 shutdown_connections 2024-09-11T23:59:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.274+0000 7fa0dce1a640 1 -- 172.21.15.6:0/1663246236 wait complete. 2024-09-11T23:59:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.274+0000 7fa0dce1a640 1 Processor -- start 2024-09-11T23:59:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0dce1a640 1 -- start start 2024-09-11T23:59:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0dce1a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0d8103ff0 0x7fa0d819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0dce1a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d81049a0 0x7fa0d819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0dce1a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0d8109120 0x7fa0d819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0dce1a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d8114050 con 0x7fa0d81049a0 2024-09-11T23:59:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0dce1a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d8113ed0 con 0x7fa0d8103ff0 2024-09-11T23:59:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0dce1a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d81141d0 con 0x7fa0d8109120 2024-09-11T23:59:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0d5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d81049a0 0x7fa0d819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0d5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d81049a0 0x7fa0d819aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52518/0 (socket says 172.21.15.6:52518) 2024-09-11T23:59:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0d659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0d8103ff0 0x7fa0d819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0d5d9b640 1 -- 172.21.15.6:0/3765009177 learned_addr learned my addr 172.21.15.6:0/3765009177 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0d6d9d640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0d8109120 0x7fa0d819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0d5d9b640 1 -- 172.21.15.6:0/3765009177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0d8109120 msgr2=0x7fa0d819ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0d5d9b640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0d8109120 0x7fa0d819ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0d5d9b640 1 -- 172.21.15.6:0/3765009177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0d8103ff0 msgr2=0x7fa0d819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0d5d9b640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0d8103ff0 0x7fa0d819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0d5d9b640 1 -- 172.21.15.6:0/3765009177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d819f560 con 0x7fa0d81049a0 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0d6d9d640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0d8109120 0x7fa0d819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.275+0000 7fa0d5d9b640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d81049a0 0x7fa0d819aaf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00d950 tx=0x7fa0cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.276+0000 7fa0c77fe640 1 -- 172.21.15.6:0/3765009177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc017070 con 0x7fa0d81049a0 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.276+0000 7fa0dce1a640 1 -- 172.21.15.6:0/3765009177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d819f850 con 0x7fa0d81049a0 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.276+0000 7fa0c77fe640 1 -- 172.21.15.6:0/3765009177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0cc009c30 con 0x7fa0d81049a0 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.276+0000 7fa0c77fe640 1 -- 172.21.15.6:0/3765009177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc00f620 con 0x7fa0d81049a0 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.276+0000 7fa0dce1a640 1 -- 172.21.15.6:0/3765009177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d81a7130 con 0x7fa0d81049a0 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.277+0000 7fa0dce1a640 1 -- 172.21.15.6:0/3765009177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d81043d0 con 0x7fa0d81049a0 2024-09-11T23:59:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.279+0000 7fa0c77fe640 1 -- 172.21.15.6:0/3765009177 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fa0cc0109a0 con 0x7fa0d81049a0 2024-09-11T23:59:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.279+0000 7fa0c77fe640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa0c00a2b80 0x7fa0c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.280+0000 7fa0d659c640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa0c00a2b80 0x7fa0c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.280+0000 7fa0c77fe640 1 -- 172.21.15.6:0/3765009177 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa0cc0cefb0 con 0x7fa0d81049a0 2024-09-11T23:59:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.280+0000 7fa0d659c640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa0c00a2b80 0x7fa0c00a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8031440 tx=0x7fa0c8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.283+0000 7fa0c77fe640 1 -- 172.21.15.6:0/3765009177 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa0cc009de0 con 0x7fa0d81049a0 2024-09-11T23:59:11.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.460+0000 7fa0dce1a640 1 -- 172.21.15.6:0/3765009177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0d802d7c0 con 0x7fa0d81049a0 2024-09-11T23:59:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.462+0000 7fa0c77fe640 1 -- 172.21.15.6:0/3765009177 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24668 (secure 0 0 0) 0x7fa0cc09bbb0 con 0x7fa0d81049a0 2024-09-11T23:59:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-11T23:59:11.462 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":88,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-11T23:58:02.808790+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:56:54.204314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:56:56.327143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:57:02.826677+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:59:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.464+0000 7fa0dce1a640 1 -- 172.21.15.6:0/3765009177 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa0c00a2b80 msgr2=0x7fa0c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.464+0000 7fa0dce1a640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa0c00a2b80 0x7fa0c00a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8031440 tx=0x7fa0c8005b50 comp rx=0 tx=0).stop 2024-09-11T23:59:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.464+0000 7fa0dce1a640 1 -- 172.21.15.6:0/3765009177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d81049a0 msgr2=0x7fa0d819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.464+0000 7fa0dce1a640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d81049a0 0x7fa0d819aaf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00d950 tx=0x7fa0cc00de10 comp rx=0 tx=0).stop 2024-09-11T23:59:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.464+0000 7fa0dce1a640 1 -- 172.21.15.6:0/3765009177 shutdown_connections 2024-09-11T23:59:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.464+0000 7fa0dce1a640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa0c00a2b80 0x7fa0c00a5040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.464+0000 7fa0dce1a640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0d8109120 0x7fa0d819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.464+0000 7fa0dce1a640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d81049a0 0x7fa0d819aaf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.464+0000 7fa0dce1a640 1 --2- 172.21.15.6:0/3765009177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0d8103ff0 0x7fa0d819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.464+0000 7fa0dce1a640 1 -- 172.21.15.6:0/3765009177 >> 172.21.15.6:0/3765009177 conn(0x7fa0d80ffa90 msgr2=0x7fa0d8100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.464+0000 7fa0dce1a640 1 -- 172.21.15.6:0/3765009177 shutdown_connections 2024-09-11T23:59:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:11.464+0000 7fa0dce1a640 1 -- 172.21.15.6:0/3765009177 wait complete. 2024-09-11T23:59:11.830 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:11 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3765009177' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:11.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:11 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3765009177' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:12.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:11 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3765009177' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:12.149 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T23:56:58.063963+0000', 'modified': '2024-09-11T23:57:43.074202+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24491, 'mds_1': 24490, 'mds_2': 24478, 'mds_3': 24472, 'mds_4': 24461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14628': {'gid': 14628, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6839/809129212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6838', 'nonce': 809129212}, {'type': 'v1', 'addr': '172.21.15.6:6839', 'nonce': 809129212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14634': {'gid': 14634, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6841/500771395', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6840', 'nonce': 500771395}, {'type': 'v1', 'addr': '172.21.15.6:6841', 'nonce': 500771395}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6833/3540998066', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6832', 'nonce': 3540998066}, {'type': 'v1', 'addr': '172.21.15.39:6833', 'nonce': 3540998066}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6833/3891726228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 3891726228}, {'type': 'v1', 'addr': '172.21.15.134:6833', 'nonce': 3891726228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6835/2372527607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6834', 'nonce': 2372527607}, {'type': 'v1', 'addr': '172.21.15.39:6835', 'nonce': 2372527607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.39:6837/902336458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6836', 'nonce': 902336458}, {'type': 'v1', 'addr': '172.21.15.39:6837', 'nonce': 902336458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.134:6835/530621436', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 530621436}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 530621436}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.134:6837/4248937946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 4248937946}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 4248937946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.134:6839/45989022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 45989022}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 45989022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.39:6839/3561706320', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6838', 'nonce': 3561706320}, {'type': 'v1', 'addr': '172.21.15.39:6839', 'nonce': 3561706320}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24491, 'qdb_cluster': [24490, 24491, 24478, 24472, 24461]} 2024-09-11T23:59:12.150 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-11T23:59:12.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-11T23:59:12.415 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:12.826 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:12 smithi006 ceph-mon[30947]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-11T23:59:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.909+0000 7f19a925a640 1 -- 172.21.15.6:0/1168527915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4101420 msgr2=0x7f19a410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.909+0000 7f19a925a640 1 --2- 172.21.15.6:0/1168527915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4101420 0x7f19a410d950 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f199c009cd0 tx=0x7f199c02a8e0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.909+0000 7f19a925a640 1 -- 172.21.15.6:0/1168527915 shutdown_connections 2024-09-11T23:59:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.909+0000 7f19a925a640 1 --2- 172.21.15.6:0/1168527915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4101420 0x7f19a410d950 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.909+0000 7f19a925a640 1 --2- 172.21.15.6:0/1168527915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a4100a80 0x7f19a4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.909+0000 7f19a925a640 1 --2- 172.21.15.6:0/1168527915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a4106a80 0x7f19a4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.909+0000 7f19a925a640 1 -- 172.21.15.6:0/1168527915 >> 172.21.15.6:0/1168527915 conn(0x7f19a40fc7a0 msgr2=0x7f19a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.909+0000 7f19a925a640 1 -- 172.21.15.6:0/1168527915 shutdown_connections 2024-09-11T23:59:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.909+0000 7f19a925a640 1 -- 172.21.15.6:0/1168527915 wait complete. 2024-09-11T23:59:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.910+0000 7f19a925a640 1 Processor -- start 2024-09-11T23:59:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.910+0000 7f19a925a640 1 -- start start 2024-09-11T23:59:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.910+0000 7f19a925a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4100a80 0x7f19a4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.910+0000 7f19a925a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a4101420 0x7f19a41988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.910+0000 7f19a925a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a4106a80 0x7f19a419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.910+0000 7f19a925a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4110d30 con 0x7f19a4100a80 2024-09-11T23:59:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.910+0000 7f19a925a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4110bb0 con 0x7f19a4101420 2024-09-11T23:59:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.910+0000 7f19a925a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4110eb0 con 0x7f19a4106a80 2024-09-11T23:59:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.910+0000 7f19a2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4100a80 0x7f19a4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.910+0000 7f19a2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4100a80 0x7f19a4198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52536/0 (socket says 172.21.15.6:52536) 2024-09-11T23:59:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.910+0000 7f19a2d9d640 1 -- 172.21.15.6:0/3113241220 learned_addr learned my addr 172.21.15.6:0/3113241220 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.910+0000 7f199bfff640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a4101420 0x7f19a41988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.911+0000 7f19a359e640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a4106a80 0x7f19a419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.911+0000 7f19a2d9d640 1 -- 172.21.15.6:0/3113241220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a4106a80 msgr2=0x7f19a419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.911+0000 7f19a2d9d640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a4106a80 0x7f19a419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.911+0000 7f19a2d9d640 1 -- 172.21.15.6:0/3113241220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a4101420 msgr2=0x7f19a41988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.911+0000 7f19a2d9d640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a4101420 0x7f19a41988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.911+0000 7f19a2d9d640 1 -- 172.21.15.6:0/3113241220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a419d320 con 0x7f19a4100a80 2024-09-11T23:59:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.911+0000 7f19a2d9d640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4100a80 0x7f19a4198370 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f199400c970 tx=0x7f199400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.911+0000 7f19a0d99640 1 -- 172.21.15.6:0/3113241220 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994007bb0 con 0x7f19a4100a80 2024-09-11T23:59:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.911+0000 7f19a925a640 1 -- 172.21.15.6:0/3113241220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a419d610 con 0x7f19a4100a80 2024-09-11T23:59:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.911+0000 7f19a0d99640 1 -- 172.21.15.6:0/3113241220 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1994007d50 con 0x7f19a4100a80 2024-09-11T23:59:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.911+0000 7f19a0d99640 1 -- 172.21.15.6:0/3113241220 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199400f450 con 0x7f19a4100a80 2024-09-11T23:59:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.911+0000 7f19a925a640 1 -- 172.21.15.6:0/3113241220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a41a4ef0 con 0x7f19a4100a80 2024-09-11T23:59:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.913+0000 7f19a0d99640 1 -- 172.21.15.6:0/3113241220 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f1994004f20 con 0x7f19a4100a80 2024-09-11T23:59:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19ab633740 1 Processor -- start 2024-09-11T23:59:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19ab633740 1 -- start start 2024-09-11T23:59:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19ab633740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 0x560fc3870db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19ab633740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc38712f0 0x560fc387b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19ab633740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc387bbb0 0x560fc387dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19ab633740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560fc37d7090 con 0x560fc38709d0 2024-09-11T23:59:12.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19ab633740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560fc377ea70 con 0x560fc38712f0 2024-09-11T23:59:12.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19ab633740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560fc37d3050 con 0x560fc387bbb0 2024-09-11T23:59:12.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19a359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 0x560fc3870db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19a359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 0x560fc3870db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52544/0 (socket says 172.21.15.6:52544) 2024-09-11T23:59:12.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19a359e640 1 -- 172.21.15.6:0/1718207290 learned_addr learned my addr 172.21.15.6:0/1718207290 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:12.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19a2d9d640 1 --2- 172.21.15.6:0/1718207290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc38712f0 0x560fc387b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f199bfff640 1 --2- 172.21.15.6:0/1718207290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc387bbb0 0x560fc387dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.914+0000 7f19a0d99640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f19900a2b80 0x7f19900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.915+0000 7f19a359e640 1 -- 172.21.15.6:0/1718207290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc387bbb0 msgr2=0x560fc387dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.915+0000 7f19a359e640 1 --2- 172.21.15.6:0/1718207290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc387bbb0 0x560fc387dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.915+0000 7f19a359e640 1 -- 172.21.15.6:0/1718207290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc38712f0 msgr2=0x560fc387b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.915+0000 7f19a359e640 1 --2- 172.21.15.6:0/1718207290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc38712f0 0x560fc387b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.915+0000 7f19a359e640 1 -- 172.21.15.6:0/1718207290 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fc378b130 con 0x560fc38709d0 2024-09-11T23:59:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.915+0000 7f19a359e640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f19900a2b80 0x7f19900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.915+0000 7f19a0d99640 1 -- 172.21.15.6:0/3113241220 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f19940cf090 con 0x7f19a4100a80 2024-09-11T23:59:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.915+0000 7f19a359e640 1 --2- 172.21.15.6:0/1718207290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 0x560fc3870db0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f199c009a60 tx=0x7f199c031430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78a837fcf5800fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.915+0000 7f19997fa640 1 -- 172.21.15.6:0/1718207290 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c04d070 con 0x560fc38709d0 2024-09-11T23:59:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.915+0000 7f19997fa640 1 -- 172.21.15.6:0/1718207290 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f199c043070 con 0x560fc38709d0 2024-09-11T23:59:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.915+0000 7f19997fa640 1 -- 172.21.15.6:0/1718207290 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c030be0 con 0x560fc38709d0 2024-09-11T23:59:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.916+0000 7f19ab633740 1 -- 172.21.15.6:0/1718207290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 msgr2=0x560fc3870db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.916+0000 7f19a359e640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f19900a2b80 0x7f19900a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f199c009430 tx=0x7f199c04b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.916+0000 7f19ab633740 1 --2- 172.21.15.6:0/1718207290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 0x560fc3870db0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f199c009a60 tx=0x7f199c031430 comp rx=0 tx=0).stop 2024-09-11T23:59:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.916+0000 7f19ab633740 1 -- 172.21.15.6:0/1718207290 shutdown_connections 2024-09-11T23:59:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.916+0000 7f19ab633740 1 --2- 172.21.15.6:0/1718207290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc387bbb0 0x560fc387dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.916+0000 7f19ab633740 1 --2- 172.21.15.6:0/1718207290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc38712f0 0x560fc387b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.916+0000 7f19ab633740 1 --2- 172.21.15.6:0/1718207290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 0x560fc3870db0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.916+0000 7f19ab633740 1 -- 172.21.15.6:0/1718207290 >> 172.21.15.6:0/1718207290 conn(0x560fc386cf60 msgr2=0x560fc386d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.916+0000 7f19ab633740 1 -- 172.21.15.6:0/1718207290 shutdown_connections 2024-09-11T23:59:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.916+0000 7f19ab633740 1 -- 172.21.15.6:0/1718207290 wait complete. 2024-09-11T23:59:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.916+0000 7f19ab633740 1 -- start start 2024-09-11T23:59:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.916+0000 7f19ab633740 1 Processor -- start 2024-09-11T23:59:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19ab633740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38709d0 0x560fc387b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19ab633740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc38712f0 0x560fc38787a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19ab633740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc387bbb0 0x560fc3878ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19ab633740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560fc387e780 con 0x560fc387bbb0 2024-09-11T23:59:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19ab633740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560fc3791f20 con 0x560fc38712f0 2024-09-11T23:59:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19ab633740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560fc387e900 con 0x560fc38709d0 2024-09-11T23:59:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19ab633740 10 client.0 _ll_register_callbacks cb 0x560fc375b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19a359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc387bbb0 0x560fc3878ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19a359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc387bbb0 0x560fc3878ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52552/0 (socket says 172.21.15.6:52552) 2024-09-11T23:59:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19a359e640 1 -- 172.21.15.6:0/3011312539 learned_addr learned my addr 172.21.15.6:0/3011312539 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f199bfff640 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc38712f0 0x560fc38787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19a2d9d640 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38709d0 0x560fc387b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19a359e640 1 -- 172.21.15.6:0/3011312539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38709d0 msgr2=0x560fc387b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19a359e640 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38709d0 0x560fc387b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19a359e640 1 -- 172.21.15.6:0/3011312539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc38712f0 msgr2=0x560fc38787a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19a359e640 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc38712f0 0x560fc38787a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f19a359e640 1 -- 172.21.15.6:0/3011312539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fc35482b0 con 0x560fc387bbb0 2024-09-11T23:59:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.917+0000 7f199bfff640 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc38712f0 0x560fc38787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f19a359e640 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc387bbb0 0x560fc3878ce0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f199c02a920 tx=0x7f199c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb368b30a7016e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f198a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f198a7fc640 1 -- 172.21.15.6:0/3011312539 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c04d070 con 0x560fc387bbb0 2024-09-11T23:59:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f198a7fc640 1 -- 172.21.15.6:0/3011312539 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f199c031620 con 0x560fc387bbb0 2024-09-11T23:59:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f19ab633740 1 -- 172.21.15.6:0/3011312539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f199c043070 con 0x560fc387bbb0 2024-09-11T23:59:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f198a7fc640 1 -- 172.21.15.6:0/3011312539 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f199c061050 con 0x560fc387bbb0 2024-09-11T23:59:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f19ab633740 10 client.15237 fetch_fsmap learned FSMap version 27 2024-09-11T23:59:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f19ab633740 1 -- 172.21.15.6:0/3011312539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560fc388a0a0 con 0x560fc387bbb0 2024-09-11T23:59:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f198a7fc640 1 -- 172.21.15.6:0/3011312539 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f199c043070 con 0x560fc387bbb0 2024-09-11T23:59:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f198a7fc640 1 -- 172.21.15.6:0/3011312539 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f199c030070 con 0x560fc387bbb0 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f19ab633740 10 client.15237 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f19ab633740 10 client.15237 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f19ab633740 20 client.15237 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f19ab633740 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x560fc388c1b0 0x560fc388d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f19ab633740 4 client.15237 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.918+0000 7f19ab633740 1 -- 172.21.15.6:0/3011312539 --> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fc37e4600 con 0x560fc388c1b0 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.919+0000 7f19a2d9d640 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x560fc388c1b0 0x560fc388d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.919+0000 7f198a7fc640 10 client.15237 ms_handle_connect on v2:172.21.15.39:6836/902336458 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.919+0000 7f19a2d9d640 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x560fc388c1b0 0x560fc388d620 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f7d16deb4dcd18e9 server_cookie=34ec6a2cc6ac7198 in_seq=0 out_seq=0 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f198a7fc640 1 -- 172.21.15.6:0/3011312539 <== mds.4 v2:172.21.15.39:6836/902336458 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560fc37e4600 con 0x560fc388c1b0 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f198a7fc640 10 client.15237 handle_command_reply: tid=0 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f19ab633740 1 client.15237 shutdown 2024-09-11T23:59:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f19ab633740 1 -- 172.21.15.6:0/3011312539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc387bbb0 msgr2=0x560fc3878ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f19ab633740 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc387bbb0 0x560fc3878ce0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f199c02a920 tx=0x7f199c004a40 comp rx=0 tx=0).stop 2024-09-11T23:59:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f19ab633740 1 -- 172.21.15.6:0/3011312539 shutdown_connections 2024-09-11T23:59:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f19ab633740 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x560fc388c1b0 0x560fc388d620 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f19ab633740 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc387bbb0 0x560fc3878ce0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f19ab633740 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc38712f0 0x560fc38787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f198a7fc640 0 client.15237 ms_handle_reset on v2:172.21.15.39:6836/902336458 2024-09-11T23:59:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f19ab633740 1 --2- 172.21.15.6:0/3011312539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38709d0 0x560fc387b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f19ab633740 1 -- 172.21.15.6:0/3011312539 >> 172.21.15.6:0/3011312539 conn(0x560fc386cf60 msgr2=0x560fc3872c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f19ab633740 1 -- 172.21.15.6:0/3011312539 shutdown_connections 2024-09-11T23:59:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f19ab633740 1 -- 172.21.15.6:0/3011312539 wait complete. 2024-09-11T23:59:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.920+0000 7f19ab633740 20 client.15237 trim_cache size 0 max 16384 2024-09-11T23:59:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f19ab633740 1 Processor -- start 2024-09-11T23:59:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f19ab633740 1 -- start start 2024-09-11T23:59:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f19ab633740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38709d0 0x560fc388d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f19ab633740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38712f0 0x560fc387a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f19ab633740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc387bbb0 0x560fc3875a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f19ab633740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560fc388b960 con 0x560fc38712f0 2024-09-11T23:59:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f19ab633740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560fc388c030 con 0x560fc387bbb0 2024-09-11T23:59:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f19ab633740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560fc388c700 con 0x560fc38709d0 2024-09-11T23:59:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f199bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38712f0 0x560fc387a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f199bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38712f0 0x560fc387a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52568/0 (socket says 172.21.15.6:52568) 2024-09-11T23:59:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f199bfff640 1 -- 172.21.15.6:0/3561138689 learned_addr learned my addr 172.21.15.6:0/3561138689 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f19a2d9d640 1 --2- 172.21.15.6:0/3561138689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38709d0 0x560fc388d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f19a359e640 1 --2- 172.21.15.6:0/3561138689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc387bbb0 0x560fc3875a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f199bfff640 1 -- 172.21.15.6:0/3561138689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38709d0 msgr2=0x560fc388d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f199bfff640 1 --2- 172.21.15.6:0/3561138689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38709d0 0x560fc388d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f199bfff640 1 -- 172.21.15.6:0/3561138689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc387bbb0 msgr2=0x560fc3875a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f199bfff640 1 --2- 172.21.15.6:0/3561138689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc387bbb0 0x560fc3875a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.939+0000 7f199bfff640 1 -- 172.21.15.6:0/3561138689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fc3871120 con 0x560fc38712f0 2024-09-11T23:59:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.940+0000 7f199bfff640 1 --2- 172.21.15.6:0/3561138689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38712f0 0x560fc387a600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f198c0045c0 tx=0x7f198c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0c212c667db689 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.940+0000 7f1998ff9640 1 -- 172.21.15.6:0/3561138689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c003b50 con 0x560fc38712f0 2024-09-11T23:59:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.940+0000 7f1998ff9640 1 -- 172.21.15.6:0/3561138689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f198c0054d0 con 0x560fc38712f0 2024-09-11T23:59:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.940+0000 7f1998ff9640 1 -- 172.21.15.6:0/3561138689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c004ca0 con 0x560fc38712f0 2024-09-11T23:59:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 -- 172.21.15.6:0/3561138689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38712f0 msgr2=0x560fc387a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 --2- 172.21.15.6:0/3561138689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38712f0 0x560fc387a600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f198c0045c0 tx=0x7f198c00bcb0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 -- 172.21.15.6:0/3561138689 shutdown_connections 2024-09-11T23:59:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 --2- 172.21.15.6:0/3561138689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc387bbb0 0x560fc3875a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 --2- 172.21.15.6:0/3561138689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38712f0 0x560fc387a600 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 --2- 172.21.15.6:0/3561138689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38709d0 0x560fc388d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 -- 172.21.15.6:0/3561138689 >> 172.21.15.6:0/3561138689 conn(0x560fc386cf60 msgr2=0x560fc3879ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 -- 172.21.15.6:0/3561138689 shutdown_connections 2024-09-11T23:59:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 -- 172.21.15.6:0/3561138689 wait complete. 2024-09-11T23:59:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 -- start start 2024-09-11T23:59:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 Processor -- start 2024-09-11T23:59:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 0x560fc3891080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38712f0 0x560fc38915c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc387bbb0 0x560fc3895700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560fc388d4a0 con 0x560fc38709d0 2024-09-11T23:59:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.941+0000 7f19ab633740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560fc388cdd0 con 0x560fc387bbb0 2024-09-11T23:59:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19ab633740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560fc388db70 con 0x560fc38712f0 2024-09-11T23:59:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19ab633740 10 client.0 _ll_register_callbacks cb 0x7f199c04b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19a2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 0x560fc3891080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19a2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 0x560fc3891080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52580/0 (socket says 172.21.15.6:52580) 2024-09-11T23:59:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19a2d9d640 1 -- 172.21.15.6:0/941028738 learned_addr learned my addr 172.21.15.6:0/941028738 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19a359e640 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc387bbb0 0x560fc3895700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f199bfff640 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38712f0 0x560fc38915c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19a2d9d640 1 -- 172.21.15.6:0/941028738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38712f0 msgr2=0x560fc38915c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19a2d9d640 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38712f0 0x560fc38915c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19a2d9d640 1 -- 172.21.15.6:0/941028738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc387bbb0 msgr2=0x560fc3895700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19a2d9d640 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc387bbb0 0x560fc3895700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19a2d9d640 1 -- 172.21.15.6:0/941028738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fc3895d70 con 0x560fc38709d0 2024-09-11T23:59:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19a2d9d640 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 0x560fc3891080 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f19940979f0 tx=0x7f19940cf290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992633b551833b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f198a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f198a7fc640 1 -- 172.21.15.6:0/941028738 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199401d040 con 0x560fc38709d0 2024-09-11T23:59:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f198a7fc640 1 -- 172.21.15.6:0/941028738 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f1994099630 con 0x560fc38709d0 2024-09-11T23:59:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19ab633740 1 -- 172.21.15.6:0/941028738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f198c0054d0 con 0x560fc38709d0 2024-09-11T23:59:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f198a7fc640 1 -- 172.21.15.6:0/941028738 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f199409bc90 con 0x560fc38709d0 2024-09-11T23:59:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.942+0000 7f19ab633740 10 client.15243 fetch_fsmap learned FSMap version 27 2024-09-11T23:59:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.943+0000 7f19ab633740 1 -- 172.21.15.6:0/941028738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560fc38f6440 con 0x560fc38709d0 2024-09-11T23:59:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.943+0000 7f198a7fc640 1 -- 172.21.15.6:0/941028738 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f198c0054d0 con 0x560fc38709d0 2024-09-11T23:59:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.943+0000 7f198a7fc640 1 -- 172.21.15.6:0/941028738 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f1994097c00 con 0x560fc38709d0 2024-09-11T23:59:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.943+0000 7f19ab633740 10 client.15243 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:59:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.943+0000 7f19ab633740 10 client.15243 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:59:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.943+0000 7f19ab633740 20 client.15243 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.943+0000 7f19ab633740 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x560fc38fafd0 0x560fc38f9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.943+0000 7f19ab633740 4 client.15243 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.943+0000 7f19ab633740 1 -- 172.21.15.6:0/941028738 --> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] -- command(tid 0: {"prefix": "status"}) -- 0x560fc37deb10 con 0x560fc38fafd0 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.943+0000 7f199bfff640 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x560fc38fafd0 0x560fc38f9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f199bfff640 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x560fc38fafd0 0x560fc38f9ce0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=97e22e7d252e101e server_cookie=29c2a17aaae759f in_seq=0 out_seq=0 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f198a7fc640 10 client.15243 ms_handle_connect on v2:172.21.15.39:6836/902336458 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f198a7fc640 1 -- 172.21.15.6:0/941028738 <== mds.4 v2:172.21.15.39:6836/902336458 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x560fc37deb10 con 0x560fc38fafd0 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f198a7fc640 10 client.15243 handle_command_reply: tid=0 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f19ab633740 1 client.15243 shutdown 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f19ab633740 1 -- 172.21.15.6:0/941028738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 msgr2=0x560fc3891080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f19ab633740 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 0x560fc3891080 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f19940979f0 tx=0x7f19940cf290 comp rx=0 tx=0).stop 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f19ab633740 1 -- 172.21.15.6:0/941028738 shutdown_connections 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f19ab633740 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.39:6836/902336458,v1:172.21.15.39:6837/902336458] conn(0x560fc38fafd0 0x560fc38f9ce0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f19ab633740 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fc387bbb0 0x560fc3895700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f19ab633740 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fc38712f0 0x560fc38915c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f19ab633740 1 --2- 172.21.15.6:0/941028738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fc38709d0 0x560fc3891080 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f19ab633740 1 -- 172.21.15.6:0/941028738 >> 172.21.15.6:0/941028738 conn(0x560fc386cf60 msgr2=0x560fc386c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f198a7fc640 0 client.15243 ms_handle_reset on v2:172.21.15.39:6836/902336458 2024-09-11T23:59:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f19ab633740 1 -- 172.21.15.6:0/941028738 shutdown_connections 2024-09-11T23:59:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f19ab633740 1 -- 172.21.15.6:0/941028738 wait complete. 2024-09-11T23:59:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.944+0000 7f19ab633740 20 client.15243 trim_cache size 0 max 16384 2024-09-11T23:59:12.956 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:59:12.957 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:12.957 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 4, 2024-09-11T23:59:12.957 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24461, 2024-09-11T23:59:12.957 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-11T23:59:12.957 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-11T23:59:12.957 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-11T23:59:12.958 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 90.885442376, 2024-09-11T23:59:12.958 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2024-09-11T23:59:12.958 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 88, 2024-09-11T23:59:12.958 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:59:12.958 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 156.75445349399999 2024-09-11T23:59:12.959 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:59:12.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.945+0000 7f19a925a640 1 -- 172.21.15.6:0/3113241220 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f19900a2b80 msgr2=0x7f19900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.945+0000 7f19a925a640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f19900a2b80 0x7f19900a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f199c009430 tx=0x7f199c04b000 comp rx=0 tx=0).stop 2024-09-11T23:59:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.945+0000 7f19a925a640 1 -- 172.21.15.6:0/3113241220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4100a80 msgr2=0x7f19a4198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.945+0000 7f19a925a640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4100a80 0x7f19a4198370 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f199400c970 tx=0x7f199400ce30 comp rx=0 tx=0).stop 2024-09-11T23:59:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.945+0000 7f19a925a640 1 -- 172.21.15.6:0/3113241220 shutdown_connections 2024-09-11T23:59:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.945+0000 7f19a925a640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f19900a2b80 0x7f19900a5040 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.945+0000 7f19a925a640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a4106a80 0x7f19a419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.945+0000 7f19a925a640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a4101420 0x7f19a41988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.945+0000 7f19a925a640 1 --2- 172.21.15.6:0/3113241220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4100a80 0x7f19a4198370 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.945+0000 7f19a925a640 1 -- 172.21.15.6:0/3113241220 >> 172.21.15.6:0/3113241220 conn(0x7f19a40fc7a0 msgr2=0x7f19a406a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.945+0000 7f19a925a640 1 -- 172.21.15.6:0/3113241220 shutdown_connections 2024-09-11T23:59:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:12.945+0000 7f19a925a640 1 -- 172.21.15.6:0/3113241220 wait complete. 2024-09-11T23:59:12.961 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:12 smithi134 ceph-mon[34893]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-11T23:59:13.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:12 smithi039 ceph-mon[34543]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-11T23:59:13.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-11T23:59:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:14.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.328+0000 7fa71129d640 1 -- 172.21.15.6:0/2111640651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa70c100a80 msgr2=0x7fa70c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.328+0000 7fa71129d640 1 --2- 172.21.15.6:0/2111640651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa70c100a80 0x7fa70c100ee0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009930 tx=0x7fa6f402a420 comp rx=0 tx=0).stop 2024-09-11T23:59:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.328+0000 7fa71129d640 1 -- 172.21.15.6:0/2111640651 shutdown_connections 2024-09-11T23:59:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.328+0000 7fa71129d640 1 --2- 172.21.15.6:0/2111640651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa70c101420 0x7fa70c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.328+0000 7fa71129d640 1 --2- 172.21.15.6:0/2111640651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa70c100a80 0x7fa70c100ee0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.328+0000 7fa71129d640 1 --2- 172.21.15.6:0/2111640651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa70c106a80 0x7fa70c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.328+0000 7fa71129d640 1 -- 172.21.15.6:0/2111640651 >> 172.21.15.6:0/2111640651 conn(0x7fa70c0fc7a0 msgr2=0x7fa70c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.328+0000 7fa71129d640 1 -- 172.21.15.6:0/2111640651 shutdown_connections 2024-09-11T23:59:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.328+0000 7fa71129d640 1 -- 172.21.15.6:0/2111640651 wait complete. 2024-09-11T23:59:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa71129d640 1 Processor -- start 2024-09-11T23:59:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa71129d640 1 -- start start 2024-09-11T23:59:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa71129d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa70c100a80 0x7fa70c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa71129d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa70c101420 0x7fa70c1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa71129d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa70c106a80 0x7fa70c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa71129d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c110d30 con 0x7fa70c101420 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa71129d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c110bb0 con 0x7fa70c100a80 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa71129d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c110eb0 con 0x7fa70c106a80 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa703fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa70c101420 0x7fa70c1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa703fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa70c101420 0x7fa70c1988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52588/0 (socket says 172.21.15.6:52588) 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa703fff640 1 -- 172.21.15.6:0/2512013542 learned_addr learned my addr 172.21.15.6:0/2512013542 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa70affd640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa70c100a80 0x7fa70c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa703fff640 1 -- 172.21.15.6:0/2512013542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa70c106a80 msgr2=0x7fa70c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa703fff640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa70c106a80 0x7fa70c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa703fff640 1 -- 172.21.15.6:0/2512013542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa70c100a80 msgr2=0x7fa70c198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa703fff640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa70c100a80 0x7fa70c198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa703fff640 1 -- 172.21.15.6:0/2512013542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70c19d320 con 0x7fa70c101420 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.329+0000 7fa703fff640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa70c101420 0x7fa70c1988b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4005940 tx=0x7fa6f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.330+0000 7fa708ff9640 1 -- 172.21.15.6:0/2512013542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f403f030 con 0x7fa70c101420 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.330+0000 7fa708ff9640 1 -- 172.21.15.6:0/2512013542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa6f40318a0 con 0x7fa70c101420 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.330+0000 7fa71129d640 1 -- 172.21.15.6:0/2512013542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa70c19d5b0 con 0x7fa70c101420 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.330+0000 7fa708ff9640 1 -- 172.21.15.6:0/2512013542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4035070 con 0x7fa70c101420 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.330+0000 7fa71129d640 1 -- 172.21.15.6:0/2512013542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa70c1a4ef0 con 0x7fa70c101420 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.332+0000 7fa708ff9640 1 -- 172.21.15.6:0/2512013542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fa6f4042030 con 0x7fa70c101420 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.332+0000 7fa713676740 1 Processor -- start 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.332+0000 7fa713676740 1 -- start start 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa708ff9640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa6f80a2c00 0x7fa6f80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa713676740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c10799d0 0x55e9c1079db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa713676740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 0x55e9c1084670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa713676740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c1084bb0 0x55e9c1086fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa713676740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e9c0fe0090 con 0x55e9c107a2f0 2024-09-11T23:59:14.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa713676740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e9c0f87a70 con 0x55e9c1084bb0 2024-09-11T23:59:14.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa713676740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e9c0fdc050 con 0x55e9c10799d0 2024-09-11T23:59:14.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa70b7fe640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa6f80a2c00 0x7fa6f80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa708ff9640 1 -- 172.21.15.6:0/2512013542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa6f40efad0 con 0x7fa70c101420 2024-09-11T23:59:14.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa703fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 0x55e9c1084670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa703fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 0x55e9c1084670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52590/0 (socket says 172.21.15.6:52590) 2024-09-11T23:59:14.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa703fff640 1 -- 172.21.15.6:0/1631781222 learned_addr learned my addr 172.21.15.6:0/1631781222 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:14.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa70b7fe640 1 --2- 172.21.15.6:0/1631781222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c1084bb0 0x55e9c1086fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa70affd640 1 --2- 172.21.15.6:0/1631781222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c10799d0 0x55e9c1079db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa703fff640 1 -- 172.21.15.6:0/1631781222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c10799d0 msgr2=0x55e9c1079db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa703fff640 1 --2- 172.21.15.6:0/1631781222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c10799d0 0x55e9c1079db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa703fff640 1 -- 172.21.15.6:0/1631781222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c1084bb0 msgr2=0x55e9c1086fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa703fff640 1 --2- 172.21.15.6:0/1631781222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c1084bb0 0x55e9c1086fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa703fff640 1 -- 172.21.15.6:0/1631781222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9c0f94130 con 0x55e9c107a2f0 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa703fff640 1 --2- 172.21.15.6:0/1631781222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 0x55e9c1084670 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40b8430 tx=0x7fa6f40bbe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9e0112cc3cdbb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.333+0000 7fa70b7fe640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa6f80a2c00 0x7fa6f80a50c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa704005fd0 tx=0x7fa704009c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.334+0000 7fa7017fa640 1 -- 172.21.15.6:0/1631781222 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4049040 con 0x55e9c107a2f0 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.334+0000 7fa7017fa640 1 -- 172.21.15.6:0/1631781222 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa6f4003e20 con 0x55e9c107a2f0 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.334+0000 7fa7017fa640 1 -- 172.21.15.6:0/1631781222 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40c4c40 con 0x55e9c107a2f0 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.334+0000 7fa713676740 1 -- 172.21.15.6:0/1631781222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 msgr2=0x55e9c1084670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.334+0000 7fa713676740 1 --2- 172.21.15.6:0/1631781222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 0x55e9c1084670 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40b8430 tx=0x7fa6f40bbe60 comp rx=0 tx=0).stop 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 -- 172.21.15.6:0/1631781222 shutdown_connections 2024-09-11T23:59:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 --2- 172.21.15.6:0/1631781222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c1084bb0 0x55e9c1086fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 --2- 172.21.15.6:0/1631781222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 0x55e9c1084670 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 --2- 172.21.15.6:0/1631781222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c10799d0 0x55e9c1079db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 -- 172.21.15.6:0/1631781222 >> 172.21.15.6:0/1631781222 conn(0x55e9c1075f60 msgr2=0x55e9c1076340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 -- 172.21.15.6:0/1631781222 shutdown_connections 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 -- 172.21.15.6:0/1631781222 wait complete. 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 -- start start 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 Processor -- start 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c10799d0 0x55e9c10843c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c107a2f0 0x55e9c1081710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c1084bb0 0x55e9c1081c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e9c108b950 con 0x55e9c10799d0 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e9c0f9af20 con 0x55e9c1084bb0 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.335+0000 7fa713676740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e9c108bad0 con 0x55e9c107a2f0 2024-09-11T23:59:14.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa713676740 10 client.0 _ll_register_callbacks cb 0x55e9c0f64030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa70affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c10799d0 0x55e9c10843c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa70affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c10799d0 0x55e9c10843c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52606/0 (socket says 172.21.15.6:52606) 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa70affd640 1 -- 172.21.15.6:0/1576895270 learned_addr learned my addr 172.21.15.6:0/1576895270 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa70b7fe640 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c1084bb0 0x55e9c1081c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa703fff640 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c107a2f0 0x55e9c1081710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa70affd640 1 -- 172.21.15.6:0/1576895270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c107a2f0 msgr2=0x55e9c1081710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa70affd640 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c107a2f0 0x55e9c1081710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa70affd640 1 -- 172.21.15.6:0/1576895270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c1084bb0 msgr2=0x55e9c1081c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa70affd640 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c1084bb0 0x55e9c1081c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa70affd640 1 -- 172.21.15.6:0/1576895270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9c0d512b0 con 0x55e9c10799d0 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa70b7fe640 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c1084bb0 0x55e9c1081c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa70affd640 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c10799d0 0x55e9c10843c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc012740 tx=0x7fa6fc012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe03c51d5b1c4d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa6f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa6f27fc640 1 -- 172.21.15.6:0/1576895270 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc00f920 con 0x55e9c10799d0 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa713676740 1 -- 172.21.15.6:0/1576895270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9c0fed600 con 0x55e9c10799d0 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa6f27fc640 1 -- 172.21.15.6:0/1576895270 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa6fc00fac0 con 0x55e9c10799d0 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa6f27fc640 1 -- 172.21.15.6:0/1576895270 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa6fc00fcc0 con 0x55e9c10799d0 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.336+0000 7fa713676740 10 client.15255 fetch_fsmap learned FSMap version 27 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.337+0000 7fa713676740 1 -- 172.21.15.6:0/1576895270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e9c1097200 con 0x55e9c10799d0 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.337+0000 7fa6f27fc640 1 -- 172.21.15.6:0/1576895270 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55e9c0fed600 con 0x55e9c10799d0 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.337+0000 7fa6f27fc640 1 -- 172.21.15.6:0/1576895270 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fa6fc01c420 con 0x55e9c10799d0 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.337+0000 7fa713676740 10 client.15255 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.337+0000 7fa713676740 10 client.15255 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.337+0000 7fa713676740 20 client.15255 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.337+0000 7fa713676740 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55e9c10998a0 0x55e9c109ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.337+0000 7fa713676740 4 client.15255 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.337+0000 7fa713676740 1 -- 172.21.15.6:0/1576895270 --> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9c0fe7b10 con 0x55e9c10998a0 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.337+0000 7fa703fff640 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55e9c10998a0 0x55e9c109ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.338+0000 7fa6f27fc640 10 client.15255 ms_handle_connect on v2:172.21.15.134:6834/530621436 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.338+0000 7fa703fff640 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55e9c10998a0 0x55e9c109ad10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4e8d04e85e47bbe1 server_cookie=2fbe1bc6152b0d81 in_seq=0 out_seq=0 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.338+0000 7fa6f27fc640 1 -- 172.21.15.6:0/1576895270 <== mds.3 v2:172.21.15.134:6834/530621436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9c0fe7b10 con 0x55e9c10998a0 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.338+0000 7fa6f27fc640 10 client.15255 handle_command_reply: tid=0 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa713676740 1 client.15255 shutdown 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa713676740 1 -- 172.21.15.6:0/1576895270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c10799d0 msgr2=0x55e9c10843c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa713676740 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c10799d0 0x55e9c10843c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc012740 tx=0x7fa6fc012c00 comp rx=0 tx=0).stop 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa713676740 1 -- 172.21.15.6:0/1576895270 shutdown_connections 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa713676740 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55e9c10998a0 0x55e9c109ad10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa713676740 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c1084bb0 0x55e9c1081c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa713676740 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c107a2f0 0x55e9c1081710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa6f27fc640 0 client.15255 ms_handle_reset on v2:172.21.15.134:6834/530621436 2024-09-11T23:59:14.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa713676740 1 --2- 172.21.15.6:0/1576895270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c10799d0 0x55e9c10843c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa713676740 1 -- 172.21.15.6:0/1576895270 >> 172.21.15.6:0/1576895270 conn(0x55e9c1075f60 msgr2=0x55e9c107bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:14.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa713676740 1 -- 172.21.15.6:0/1576895270 shutdown_connections 2024-09-11T23:59:14.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa713676740 1 -- 172.21.15.6:0/1576895270 wait complete. 2024-09-11T23:59:14.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.339+0000 7fa713676740 20 client.15255 trim_cache size 0 max 16384 2024-09-11T23:59:14.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa713676740 1 Processor -- start 2024-09-11T23:59:14.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa713676740 1 -- start start 2024-09-11T23:59:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa713676740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c10799d0 0x55e9c1099f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa713676740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 0x55e9c10a3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa713676740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c1084bb0 0x55e9c10a3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa713676740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e9c1099050 con 0x55e9c107a2f0 2024-09-11T23:59:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa713676740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e9c1099720 con 0x55e9c10799d0 2024-09-11T23:59:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa713676740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e9c1099df0 con 0x55e9c1084bb0 2024-09-11T23:59:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa703fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 0x55e9c10a3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa703fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 0x55e9c10a3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52614/0 (socket says 172.21.15.6:52614) 2024-09-11T23:59:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa703fff640 1 -- 172.21.15.6:0/488499631 learned_addr learned my addr 172.21.15.6:0/488499631 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa70affd640 1 --2- 172.21.15.6:0/488499631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c10799d0 0x55e9c1099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa703fff640 1 -- 172.21.15.6:0/488499631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c1084bb0 msgr2=0x55e9c10a3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.357+0000 7fa70b7fe640 1 --2- 172.21.15.6:0/488499631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c1084bb0 0x55e9c10a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.358+0000 7fa703fff640 1 --2- 172.21.15.6:0/488499631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c1084bb0 0x55e9c10a3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.358+0000 7fa703fff640 1 -- 172.21.15.6:0/488499631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c10799d0 msgr2=0x55e9c1099f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.358+0000 7fa703fff640 1 --2- 172.21.15.6:0/488499631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c10799d0 0x55e9c1099f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.358+0000 7fa703fff640 1 -- 172.21.15.6:0/488499631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9c1075a00 con 0x55e9c107a2f0 2024-09-11T23:59:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.358+0000 7fa70affd640 1 --2- 172.21.15.6:0/488499631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c10799d0 0x55e9c1099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.358+0000 7fa70b7fe640 1 --2- 172.21.15.6:0/488499631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c1084bb0 0x55e9c10a3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.358+0000 7fa703fff640 1 --2- 172.21.15.6:0/488499631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 0x55e9c10a3000 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009900 tx=0x7fa6f40dc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a3e668804a6855 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.358+0000 7fa700ff9640 1 -- 172.21.15.6:0/488499631 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4049040 con 0x55e9c107a2f0 2024-09-11T23:59:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.358+0000 7fa700ff9640 1 -- 172.21.15.6:0/488499631 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa6f4004460 con 0x55e9c107a2f0 2024-09-11T23:59:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.358+0000 7fa700ff9640 1 -- 172.21.15.6:0/488499631 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40b8640 con 0x55e9c107a2f0 2024-09-11T23:59:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 -- 172.21.15.6:0/488499631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 msgr2=0x55e9c10a3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 --2- 172.21.15.6:0/488499631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 0x55e9c10a3000 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009900 tx=0x7fa6f40dc040 comp rx=0 tx=0).stop 2024-09-11T23:59:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 -- 172.21.15.6:0/488499631 shutdown_connections 2024-09-11T23:59:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 --2- 172.21.15.6:0/488499631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c1084bb0 0x55e9c10a3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 --2- 172.21.15.6:0/488499631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c107a2f0 0x55e9c10a3000 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 --2- 172.21.15.6:0/488499631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c10799d0 0x55e9c1099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 -- 172.21.15.6:0/488499631 >> 172.21.15.6:0/488499631 conn(0x55e9c1075f60 msgr2=0x55e9c1083680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 -- 172.21.15.6:0/488499631 shutdown_connections 2024-09-11T23:59:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 -- 172.21.15.6:0/488499631 wait complete. 2024-09-11T23:59:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 -- start start 2024-09-11T23:59:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 Processor -- start 2024-09-11T23:59:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c10799d0 0x55e9c10a0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.359+0000 7fa713676740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c107a2f0 0x55e9c10a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa713676740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c1084bb0 0x55e9c1101fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa713676740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e9c109ab90 con 0x55e9c1084bb0 2024-09-11T23:59:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa713676740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e9c109a4c0 con 0x55e9c107a2f0 2024-09-11T23:59:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa713676740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e9c109b260 con 0x55e9c10799d0 2024-09-11T23:59:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa713676740 10 client.0 _ll_register_callbacks cb 0x7fa6fc009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa70b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c1084bb0 0x55e9c1101fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa70b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c1084bb0 0x55e9c1101fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52626/0 (socket says 172.21.15.6:52626) 2024-09-11T23:59:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa703fff640 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c107a2f0 0x55e9c10a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa70b7fe640 1 -- 172.21.15.6:0/914812439 learned_addr learned my addr 172.21.15.6:0/914812439 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa70affd640 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c10799d0 0x55e9c10a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa70b7fe640 1 -- 172.21.15.6:0/914812439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c10799d0 msgr2=0x55e9c10a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa70b7fe640 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c10799d0 0x55e9c10a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa70b7fe640 1 -- 172.21.15.6:0/914812439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c107a2f0 msgr2=0x55e9c10a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa70b7fe640 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c107a2f0 0x55e9c10a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa70b7fe640 1 -- 172.21.15.6:0/914812439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9c10a0ea0 con 0x55e9c1084bb0 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa703fff640 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c107a2f0 0x55e9c10a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa70b7fe640 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c1084bb0 0x55e9c1101fb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa704015f20 tx=0x7fa704005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242e99cf4e2e0b3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa6f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa6f27fc640 1 -- 172.21.15.6:0/914812439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7040095b0 con 0x55e9c1084bb0 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa6f27fc640 1 -- 172.21.15.6:0/914812439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa7040137a0 con 0x55e9c1084bb0 2024-09-11T23:59:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.360+0000 7fa713676740 1 -- 172.21.15.6:0/914812439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6f4004460 con 0x55e9c1084bb0 2024-09-11T23:59:14.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.361+0000 7fa6f27fc640 1 -- 172.21.15.6:0/914812439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa704034050 con 0x55e9c1084bb0 2024-09-11T23:59:14.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.361+0000 7fa713676740 10 client.15261 fetch_fsmap learned FSMap version 27 2024-09-11T23:59:14.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.361+0000 7fa713676740 1 -- 172.21.15.6:0/914812439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e9c1103540 con 0x55e9c1084bb0 2024-09-11T23:59:14.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.361+0000 7fa6f27fc640 1 -- 172.21.15.6:0/914812439 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa6f4004460 con 0x55e9c1084bb0 2024-09-11T23:59:14.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.361+0000 7fa6f27fc640 1 -- 172.21.15.6:0/914812439 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fa7040239e0 con 0x55e9c1084bb0 2024-09-11T23:59:14.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.361+0000 7fa713676740 10 client.15261 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:59:14.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.361+0000 7fa713676740 10 client.15261 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:59:14.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.361+0000 7fa713676740 20 client.15261 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:14.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.361+0000 7fa713676740 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55e9c11081a0 0x55e9c1106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.361+0000 7fa713676740 4 client.15261 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.361+0000 7fa713676740 1 -- 172.21.15.6:0/914812439 --> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] -- command(tid 0: {"prefix": "status"}) -- 0x55e9c0f640e0 con 0x55e9c11081a0 2024-09-11T23:59:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.361+0000 7fa70affd640 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55e9c11081a0 0x55e9c1106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa70affd640 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55e9c11081a0 0x55e9c1106eb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fe11b364ffee60f1 server_cookie=d22356c1d39fc21e in_seq=0 out_seq=0 2024-09-11T23:59:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa6f27fc640 10 client.15261 ms_handle_connect on v2:172.21.15.134:6834/530621436 2024-09-11T23:59:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa6f27fc640 1 -- 172.21.15.6:0/914812439 <== mds.3 v2:172.21.15.134:6834/530621436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e9c0f640e0 con 0x55e9c11081a0 2024-09-11T23:59:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa6f27fc640 10 client.15261 handle_command_reply: tid=0 2024-09-11T23:59:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa713676740 1 client.15261 shutdown 2024-09-11T23:59:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa713676740 1 -- 172.21.15.6:0/914812439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c1084bb0 msgr2=0x55e9c1101fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa713676740 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c1084bb0 0x55e9c1101fb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa704015f20 tx=0x7fa704005bd0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa713676740 1 -- 172.21.15.6:0/914812439 shutdown_connections 2024-09-11T23:59:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa713676740 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.134:6834/530621436,v1:172.21.15.134:6835/530621436] conn(0x55e9c11081a0 0x55e9c1106eb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa713676740 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9c1084bb0 0x55e9c1101fb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa713676740 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9c107a2f0 0x55e9c10a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa713676740 1 --2- 172.21.15.6:0/914812439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9c10799d0 0x55e9c10a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa6f27fc640 0 client.15261 ms_handle_reset on v2:172.21.15.134:6834/530621436 2024-09-11T23:59:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa713676740 1 -- 172.21.15.6:0/914812439 >> 172.21.15.6:0/914812439 conn(0x55e9c1075f60 msgr2=0x55e9c1082a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa713676740 1 -- 172.21.15.6:0/914812439 shutdown_connections 2024-09-11T23:59:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa713676740 1 -- 172.21.15.6:0/914812439 wait complete. 2024-09-11T23:59:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.362+0000 7fa713676740 20 client.15261 trim_cache size 0 max 16384 2024-09-11T23:59:14.370 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:59:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 3, 2024-09-11T23:59:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24472, 2024-09-11T23:59:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-11T23:59:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-11T23:59:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-11T23:59:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 93.319234911999999, 2024-09-11T23:59:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2024-09-11T23:59:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 88, 2024-09-11T23:59:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:59:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 163.48074425799999 2024-09-11T23:59:14.371 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:59:14.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.363+0000 7fa71129d640 1 -- 172.21.15.6:0/2512013542 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa6f80a2c00 msgr2=0x7fa6f80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.363+0000 7fa71129d640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa6f80a2c00 0x7fa6f80a50c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa704005fd0 tx=0x7fa704009c30 comp rx=0 tx=0).stop 2024-09-11T23:59:14.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.363+0000 7fa71129d640 1 -- 172.21.15.6:0/2512013542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa70c101420 msgr2=0x7fa70c1988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.363+0000 7fa71129d640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa70c101420 0x7fa70c1988b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4005940 tx=0x7fa6f40042f0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.363+0000 7fa71129d640 1 -- 172.21.15.6:0/2512013542 shutdown_connections 2024-09-11T23:59:14.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.363+0000 7fa71129d640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa6f80a2c00 0x7fa6f80a50c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.363+0000 7fa71129d640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa70c106a80 0x7fa70c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.363+0000 7fa71129d640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa70c101420 0x7fa70c1988b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.363+0000 7fa71129d640 1 --2- 172.21.15.6:0/2512013542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa70c100a80 0x7fa70c198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.363+0000 7fa71129d640 1 -- 172.21.15.6:0/2512013542 >> 172.21.15.6:0/2512013542 conn(0x7fa70c0fc7a0 msgr2=0x7fa70c06ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.363+0000 7fa71129d640 1 -- 172.21.15.6:0/2512013542 shutdown_connections 2024-09-11T23:59:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:14.363+0000 7fa71129d640 1 -- 172.21.15.6:0/2512013542 wait complete. 2024-09-11T23:59:14.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:14 smithi134 ceph-mon[34893]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-11T23:59:14.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:14 smithi006 ceph-mon[30947]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-11T23:59:15.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:14 smithi039 ceph-mon[34543]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-11T23:59:15.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T23:59:15.385 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:15.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.879+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/123365186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b4102790 msgr2=0x7fa9b41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:15.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.879+0000 7fa9bb6cd640 1 --2- 172.21.15.6:0/123365186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b4102790 0x7fa9b41067e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4009900 tx=0x7fa9a402a410 comp rx=0 tx=0).stop 2024-09-11T23:59:15.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.879+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/123365186 shutdown_connections 2024-09-11T23:59:15.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.879+0000 7fa9bb6cd640 1 --2- 172.21.15.6:0/123365186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4106f10 0x7fa9b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.879+0000 7fa9bb6cd640 1 --2- 172.21.15.6:0/123365186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b4102790 0x7fa9b41067e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.879+0000 7fa9bb6cd640 1 --2- 172.21.15.6:0/123365186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9b4101de0 0x7fa9b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.879+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/123365186 >> 172.21.15.6:0/123365186 conn(0x7fa9b40fd8c0 msgr2=0x7fa9b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:15.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.879+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/123365186 shutdown_connections 2024-09-11T23:59:15.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.879+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/123365186 wait complete. 2024-09-11T23:59:15.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.880+0000 7fa9bb6cd640 1 Processor -- start 2024-09-11T23:59:15.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.880+0000 7fa9bb6cd640 1 -- start start 2024-09-11T23:59:15.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.880+0000 7fa9bb6cd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9b4101de0 0x7fa9b4198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.880+0000 7fa9bb6cd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b4102790 0x7fa9b4198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.880+0000 7fa9bb6cd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4106f10 0x7fa9b419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.880+0000 7fa9bb6cd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b4111e20 con 0x7fa9b4102790 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.880+0000 7fa9bb6cd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b4111ca0 con 0x7fa9b4101de0 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.880+0000 7fa9bb6cd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b4111fa0 con 0x7fa9b4106f10 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9b8c68640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b4102790 0x7fa9b4198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9b8c68640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b4102790 0x7fa9b4198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52638/0 (socket says 172.21.15.6:52638) 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9b8c68640 1 -- 172.21.15.6:0/3396349052 learned_addr learned my addr 172.21.15.6:0/3396349052 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9b9469640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9b4101de0 0x7fa9b4198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9b9c6a640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4106f10 0x7fa9b419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9b8c68640 1 -- 172.21.15.6:0/3396349052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4106f10 msgr2=0x7fa9b419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9b8c68640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4106f10 0x7fa9b419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9b8c68640 1 -- 172.21.15.6:0/3396349052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9b4101de0 msgr2=0x7fa9b4198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9b8c68640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9b4101de0 0x7fa9b4198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9b8c68640 1 -- 172.21.15.6:0/3396349052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b419d2d0 con 0x7fa9b4102790 2024-09-11T23:59:15.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9b9469640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9b4101de0 0x7fa9b4198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9b8c68640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b4102790 0x7fa9b4198860 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4005940 tx=0x7fa9a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9aa7fc640 1 -- 172.21.15.6:0/3396349052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a403f030 con 0x7fa9b4102790 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9aa7fc640 1 -- 172.21.15.6:0/3396349052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9a4003cb0 con 0x7fa9b4102790 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9aa7fc640 1 -- 172.21.15.6:0/3396349052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4035070 con 0x7fa9b4102790 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/3396349052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b419d560 con 0x7fa9b4102790 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.881+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/3396349052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b419d9f0 con 0x7fa9b4102790 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.884+0000 7fa9aa7fc640 1 -- 172.21.15.6:0/3396349052 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fa9a4042030 con 0x7fa9b4102790 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.884+0000 7fa9bdaa6740 1 Processor -- start 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.884+0000 7fa9bdaa6740 1 -- start start 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.884+0000 7fa9bdaa6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba69d0 0x55c31dba6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.884+0000 7fa9bdaa6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 0x55c31dbb1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.884+0000 7fa9bdaa6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dbb1bb0 0x55c31dbb3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.884+0000 7fa9bdaa6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c31db0d090 con 0x55c31dba72f0 2024-09-11T23:59:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.884+0000 7fa9bdaa6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c31dab4a70 con 0x55c31dbb1bb0 2024-09-11T23:59:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.884+0000 7fa9bdaa6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c31db09050 con 0x55c31dba69d0 2024-09-11T23:59:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9469640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 0x55c31dbb1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9469640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 0x55c31dbb1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52646/0 (socket says 172.21.15.6:52646) 2024-09-11T23:59:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9469640 1 -- 172.21.15.6:0/3660275187 learned_addr learned my addr 172.21.15.6:0/3660275187 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b8c68640 1 --2- 172.21.15.6:0/3660275187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dbb1bb0 0x55c31dbb3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9aa7fc640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa9a00a2b80 0x7fa9a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9c6a640 1 --2- 172.21.15.6:0/3660275187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba69d0 0x55c31dba6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9469640 1 -- 172.21.15.6:0/3660275187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba69d0 msgr2=0x55c31dba6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9469640 1 --2- 172.21.15.6:0/3660275187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba69d0 0x55c31dba6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9469640 1 -- 172.21.15.6:0/3660275187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dbb1bb0 msgr2=0x55c31dbb3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9469640 1 --2- 172.21.15.6:0/3660275187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dbb1bb0 0x55c31dbb3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9469640 1 -- 172.21.15.6:0/3660275187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31dac1130 con 0x55c31dba72f0 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9c6a640 1 --2- 172.21.15.6:0/3660275187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba69d0 0x55c31dba6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9c6a640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa9a00a2b80 0x7fa9a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9aa7fc640 1 -- 172.21.15.6:0/3396349052 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa9a40efaa0 con 0x7fa9b4102790 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9469640 1 --2- 172.21.15.6:0/3660275187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 0x55c31dbb1670 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00115f0 tx=0x7fa9b0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd128313c07040fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa99f7fe640 1 -- 172.21.15.6:0/3660275187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b001e070 con 0x55c31dba72f0 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa9b9c6a640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa9a00a2b80 0x7fa9a00a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac007f80 tx=0x7fa9ac004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa99f7fe640 1 -- 172.21.15.6:0/3660275187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9b000faf0 con 0x55c31dba72f0 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.885+0000 7fa99f7fe640 1 -- 172.21.15.6:0/3660275187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0019b60 con 0x55c31dba72f0 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.886+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3660275187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 msgr2=0x55c31dbb1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.886+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/3660275187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 0x55c31dbb1670 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00115f0 tx=0x7fa9b0011ab0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.886+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3660275187 shutdown_connections 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.886+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/3660275187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dbb1bb0 0x55c31dbb3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.886+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/3660275187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 0x55c31dbb1670 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.886+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/3660275187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba69d0 0x55c31dba6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.886+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3660275187 >> 172.21.15.6:0/3660275187 conn(0x55c31dba2f60 msgr2=0x55c31dba3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.886+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3660275187 shutdown_connections 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.886+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3660275187 wait complete. 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9bdaa6740 1 -- start start 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9bdaa6740 1 Processor -- start 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9bdaa6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba69d0 0x55c31dbb1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9bdaa6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba72f0 0x55c31dbae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9bdaa6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dbb1bb0 0x55c31dbaecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9bdaa6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c31dbb4780 con 0x55c31dba69d0 2024-09-11T23:59:15.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9bdaa6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c31dac7f20 con 0x55c31dbb1bb0 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9bdaa6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c31dbb4900 con 0x55c31dba72f0 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9bdaa6740 10 client.0 _ll_register_callbacks cb 0x55c31da91030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9b9469640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba69d0 0x55c31dbb1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9b9469640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba69d0 0x55c31dbb1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52658/0 (socket says 172.21.15.6:52658) 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9b9469640 1 -- 172.21.15.6:0/1920560479 learned_addr learned my addr 172.21.15.6:0/1920560479 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9b9c6a640 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dbb1bb0 0x55c31dbaecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.887+0000 7fa9b8c68640 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba72f0 0x55c31dbae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa9b9469640 1 -- 172.21.15.6:0/1920560479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba72f0 msgr2=0x55c31dbae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa9b9469640 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba72f0 0x55c31dbae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa9b9469640 1 -- 172.21.15.6:0/1920560479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dbb1bb0 msgr2=0x55c31dbaecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa9b9469640 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dbb1bb0 0x55c31dbaecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa9b9469640 1 -- 172.21.15.6:0/1920560479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31d87e2b0 con 0x55c31dba69d0 2024-09-11T23:59:15.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa9b9469640 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba69d0 0x55c31dbb1440 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa9b001c040 tx=0x7fa9b000f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177dccdbaa322558 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa99cff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa99cff9640 1 -- 172.21.15.6:0/1920560479 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0029060 con 0x55c31dba69d0 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa99cff9640 1 -- 172.21.15.6:0/1920560479 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa9b0004040 con 0x55c31dba69d0 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/1920560479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9b000faf0 con 0x55c31dba69d0 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa99cff9640 1 -- 172.21.15.6:0/1920560479 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa9b0030050 con 0x55c31dba69d0 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa9bdaa6740 10 client.15273 fetch_fsmap learned FSMap version 27 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/1920560479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c31dbc0090 con 0x55c31dba69d0 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.888+0000 7fa99cff9640 1 -- 172.21.15.6:0/1920560479 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9b000faf0 con 0x55c31dba69d0 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.889+0000 7fa99cff9640 1 -- 172.21.15.6:0/1920560479 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fa9b00035f0 con 0x55c31dba69d0 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.889+0000 7fa9bdaa6740 10 client.15273 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.889+0000 7fa9bdaa6740 10 client.15273 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.889+0000 7fa9bdaa6740 20 client.15273 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:15.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.889+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x55c31dbc2480 0x55c31dbc38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.889+0000 7fa9bdaa6740 4 client.15273 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.889+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/1920560479 --> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c31db1a600 con 0x55c31dbc2480 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.889+0000 7fa9b8c68640 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x55c31dbc2480 0x55c31dbc38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.889+0000 7fa9b8c68640 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x55c31dbc2480 0x55c31dbc38f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eaa7077b4d1fdd62 server_cookie=4720aba9474a6968 in_seq=0 out_seq=0 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.889+0000 7fa99cff9640 10 client.15273 ms_handle_connect on v2:172.21.15.134:6836/4248937946 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.890+0000 7fa99cff9640 1 -- 172.21.15.6:0/1920560479 <== mds.2 v2:172.21.15.134:6836/4248937946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c31db1a600 con 0x55c31dbc2480 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.890+0000 7fa99cff9640 10 client.15273 handle_command_reply: tid=0 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.890+0000 7fa9bdaa6740 1 client.15273 shutdown 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.890+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/1920560479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba69d0 msgr2=0x55c31dbb1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.890+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba69d0 0x55c31dbb1440 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa9b001c040 tx=0x7fa9b000f8f0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.890+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/1920560479 shutdown_connections 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.890+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x55c31dbc2480 0x55c31dbc38f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.890+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dbb1bb0 0x55c31dbaecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.890+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba72f0 0x55c31dbae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.890+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/1920560479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba69d0 0x55c31dbb1440 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.890+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/1920560479 >> 172.21.15.6:0/1920560479 conn(0x55c31dba2f60 msgr2=0x55c31dba8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:15.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.890+0000 7fa99cff9640 0 client.15273 ms_handle_reset on v2:172.21.15.134:6836/4248937946 2024-09-11T23:59:15.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.891+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/1920560479 shutdown_connections 2024-09-11T23:59:15.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.891+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/1920560479 wait complete. 2024-09-11T23:59:15.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.891+0000 7fa9bdaa6740 20 client.15273 trim_cache size 0 max 16384 2024-09-11T23:59:15.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.909+0000 7fa9bdaa6740 1 Processor -- start 2024-09-11T23:59:15.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9bdaa6740 1 -- start start 2024-09-11T23:59:15.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9bdaa6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dba69d0 0x55c31dbc1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9bdaa6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba72f0 0x55c31dbc3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9bdaa6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dbb1bb0 0x55c31dba7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9bdaa6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c31dbc1c30 con 0x55c31dbb1bb0 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9bdaa6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c31dbc2300 con 0x55c31dba69d0 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9bdaa6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c31dbc29d0 con 0x55c31dba72f0 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b9c6a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dbb1bb0 0x55c31dba7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b9c6a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dbb1bb0 0x55c31dba7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52672/0 (socket says 172.21.15.6:52672) 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b9469640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dba69d0 0x55c31dbc1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b9c6a640 1 -- 172.21.15.6:0/2567880446 learned_addr learned my addr 172.21.15.6:0/2567880446 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b8c68640 1 --2- 172.21.15.6:0/2567880446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba72f0 0x55c31dbc3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b9c6a640 1 -- 172.21.15.6:0/2567880446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba72f0 msgr2=0x55c31dbc3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b9c6a640 1 --2- 172.21.15.6:0/2567880446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba72f0 0x55c31dbc3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b9c6a640 1 -- 172.21.15.6:0/2567880446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dba69d0 msgr2=0x55c31dbc1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b9c6a640 1 --2- 172.21.15.6:0/2567880446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dba69d0 0x55c31dbc1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b9c6a640 1 -- 172.21.15.6:0/2567880446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31dbb4890 con 0x55c31dbb1bb0 2024-09-11T23:59:15.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b9469640 1 --2- 172.21.15.6:0/2567880446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dba69d0 0x55c31dbc1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:15.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b8c68640 1 --2- 172.21.15.6:0/2567880446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba72f0 0x55c31dbc3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:15.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.910+0000 7fa9b9c6a640 1 --2- 172.21.15.6:0/2567880446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dbb1bb0 0x55c31dba7b70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac012900 tx=0x7fa9ac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64cc9fa1d90ac29 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:15.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.911+0000 7fa99effd640 1 -- 172.21.15.6:0/2567880446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac01eb60 con 0x55c31dbb1bb0 2024-09-11T23:59:15.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.911+0000 7fa99effd640 1 -- 172.21.15.6:0/2567880446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9ac016070 con 0x55c31dbb1bb0 2024-09-11T23:59:15.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.911+0000 7fa99effd640 1 -- 172.21.15.6:0/2567880446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac01d450 con 0x55c31dbb1bb0 2024-09-11T23:59:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.911+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/2567880446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dbb1bb0 msgr2=0x55c31dba7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.911+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/2567880446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dbb1bb0 0x55c31dba7b70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac012900 tx=0x7fa9ac014000 comp rx=0 tx=0).stop 2024-09-11T23:59:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.911+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/2567880446 shutdown_connections 2024-09-11T23:59:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.911+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/2567880446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dbb1bb0 0x55c31dba7b70 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.911+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/2567880446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dba72f0 0x55c31dbc3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.911+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/2567880446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dba69d0 0x55c31dbc1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.911+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/2567880446 >> 172.21.15.6:0/2567880446 conn(0x55c31dba2f60 msgr2=0x55c31dba8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.912+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/2567880446 shutdown_connections 2024-09-11T23:59:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.912+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/2567880446 wait complete. 2024-09-11T23:59:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.912+0000 7fa9bdaa6740 1 -- start start 2024-09-11T23:59:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.912+0000 7fa9bdaa6740 1 Processor -- start 2024-09-11T23:59:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.912+0000 7fa9bdaa6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dba69d0 0x55c31dbc49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.912+0000 7fa9bdaa6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 0x55c31dbc4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.912+0000 7fa9bdaa6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dbb1bb0 0x55c31dbc5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.912+0000 7fa9bdaa6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c31dbc3770 con 0x55c31dba72f0 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.912+0000 7fa9bdaa6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c31dbc30a0 con 0x55c31dba69d0 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.912+0000 7fa9bdaa6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c31dbc3e40 con 0x55c31dbb1bb0 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.912+0000 7fa9bdaa6740 10 client.0 _ll_register_callbacks cb 0x7fa9b001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.912+0000 7fa9b8c68640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 0x55c31dbc4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9b8c68640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 0x55c31dbc4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52682/0 (socket says 172.21.15.6:52682) 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9b8c68640 1 -- 172.21.15.6:0/3202627537 learned_addr learned my addr 172.21.15.6:0/3202627537 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9b9469640 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dba69d0 0x55c31dbc49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9b9c6a640 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dbb1bb0 0x55c31dbc5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9b9469640 1 -- 172.21.15.6:0/3202627537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dbb1bb0 msgr2=0x55c31dbc5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9b9469640 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dbb1bb0 0x55c31dbc5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9b9469640 1 -- 172.21.15.6:0/3202627537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 msgr2=0x55c31dbc4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9b9469640 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 0x55c31dbc4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9b9469640 1 -- 172.21.15.6:0/3202627537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31dc2acb0 con 0x55c31dba69d0 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9b8c68640 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 0x55c31dbc4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9b9469640 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dba69d0 0x55c31dbc49e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0011af0 tx=0x7fa9b0005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96cbc0545a533c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa99cff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa99cff9640 1 -- 172.21.15.6:0/3202627537 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b001e040 con 0x55c31dba69d0 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3202627537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9ac016070 con 0x55c31dba69d0 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa99cff9640 1 -- 172.21.15.6:0/3202627537 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa9b0019410 con 0x55c31dba69d0 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa99cff9640 1 -- 172.21.15.6:0/3202627537 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa9b00035f0 con 0x55c31dba69d0 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9bdaa6740 10 client.24947 fetch_fsmap learned FSMap version 27 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.913+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3202627537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c31dc2bf20 con 0x55c31dba69d0 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.914+0000 7fa99cff9640 1 -- 172.21.15.6:0/3202627537 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9ac016070 con 0x55c31dba69d0 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.914+0000 7fa99cff9640 1 -- 172.21.15.6:0/3202627537 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fa9b0019840 con 0x55c31dba69d0 2024-09-11T23:59:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.914+0000 7fa9bdaa6740 10 client.24947 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.914+0000 7fa9bdaa6740 10 client.24947 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.914+0000 7fa9bdaa6740 20 client.24947 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.914+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x55c31dc30a50 0x55c31dc2f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.914+0000 7fa9bdaa6740 4 client.24947 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.914+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3202627537 --> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] -- command(tid 0: {"prefix": "status"}) -- 0x55c31db14b10 con 0x55c31dc30a50 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.914+0000 7fa9b8c68640 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x55c31dc30a50 0x55c31dc2f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa99cff9640 10 client.24947 ms_handle_connect on v2:172.21.15.134:6836/4248937946 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.914+0000 7fa9b8c68640 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x55c31dc30a50 0x55c31dc2f760 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bd4563ea3832b09f server_cookie=4b03f97337cd47c9 in_seq=0 out_seq=0 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa99cff9640 1 -- 172.21.15.6:0/3202627537 <== mds.2 v2:172.21.15.134:6836/4248937946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c31db14b10 con 0x55c31dc30a50 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa99cff9640 10 client.24947 handle_command_reply: tid=0 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa9bdaa6740 1 client.24947 shutdown 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3202627537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dba69d0 msgr2=0x55c31dbc49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dba69d0 0x55c31dbc49e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0011af0 tx=0x7fa9b0005d30 comp rx=0 tx=0).stop 2024-09-11T23:59:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3202627537 shutdown_connections 2024-09-11T23:59:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.134:6836/4248937946,v1:172.21.15.134:6837/4248937946] conn(0x55c31dc30a50 0x55c31dc2f760 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c31dbb1bb0 0x55c31dbc5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa99cff9640 0 client.24947 ms_handle_reset on v2:172.21.15.134:6836/4248937946 2024-09-11T23:59:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c31dba72f0 0x55c31dbc4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa9bdaa6740 1 --2- 172.21.15.6:0/3202627537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c31dba69d0 0x55c31dbc49e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3202627537 >> 172.21.15.6:0/3202627537 conn(0x55c31dba2f60 msgr2=0x55c31dba8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3202627537 shutdown_connections 2024-09-11T23:59:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa9bdaa6740 1 -- 172.21.15.6:0/3202627537 wait complete. 2024-09-11T23:59:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.915+0000 7fa9bdaa6740 20 client.24947 trim_cache size 0 max 16384 2024-09-11T23:59:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:59:15.920 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:15.920 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 2, 2024-09-11T23:59:15.920 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24478, 2024-09-11T23:59:15.920 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-11T23:59:15.920 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-11T23:59:15.920 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-11T23:59:15.920 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 95.888459726999997, 2024-09-11T23:59:15.920 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2024-09-11T23:59:15.920 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 88, 2024-09-11T23:59:15.920 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:59:15.920 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 162.45972432299999 2024-09-11T23:59:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:59:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.916+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/3396349052 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa9a00a2b80 msgr2=0x7fa9a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.916+0000 7fa9bb6cd640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa9a00a2b80 0x7fa9a00a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac007f80 tx=0x7fa9ac004a40 comp rx=0 tx=0).stop 2024-09-11T23:59:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.916+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/3396349052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b4102790 msgr2=0x7fa9b4198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.916+0000 7fa9bb6cd640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b4102790 0x7fa9b4198860 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4005940 tx=0x7fa9a40042f0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.916+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/3396349052 shutdown_connections 2024-09-11T23:59:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.916+0000 7fa9bb6cd640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa9a00a2b80 0x7fa9a00a5040 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.916+0000 7fa9bb6cd640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4106f10 0x7fa9b419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.916+0000 7fa9bb6cd640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b4102790 0x7fa9b4198860 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.916+0000 7fa9bb6cd640 1 --2- 172.21.15.6:0/3396349052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9b4101de0 0x7fa9b4198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.916+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/3396349052 >> 172.21.15.6:0/3396349052 conn(0x7fa9b40fd8c0 msgr2=0x7fa9b40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.916+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/3396349052 shutdown_connections 2024-09-11T23:59:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:15.916+0000 7fa9bb6cd640 1 -- 172.21.15.6:0/3396349052 wait complete. 2024-09-11T23:59:16.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T23:59:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:16.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:16 smithi006 ceph-mon[30947]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-11T23:59:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:16 smithi134 ceph-mon[34893]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-11T23:59:17.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:16 smithi039 ceph-mon[34543]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-11T23:59:17.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.356+0000 7f3548ba0640 1 -- 172.21.15.6:0/1605375599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3544103660 msgr2=0x7f354410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.356+0000 7f3548ba0640 1 --2- 172.21.15.6:0/1605375599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3544103660 0x7f354410bb50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3538009900 tx=0x7f353802a480 comp rx=0 tx=0).stop 2024-09-11T23:59:17.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.356+0000 7f3548ba0640 1 -- 172.21.15.6:0/1605375599 shutdown_connections 2024-09-11T23:59:17.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.356+0000 7f3548ba0640 1 --2- 172.21.15.6:0/1605375599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f354410c170 0x7f354410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.356+0000 7f3548ba0640 1 --2- 172.21.15.6:0/1605375599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3544103660 0x7f354410bb50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.356+0000 7f3548ba0640 1 --2- 172.21.15.6:0/1605375599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3544102d40 0x7f3544103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.356+0000 7f3548ba0640 1 -- 172.21.15.6:0/1605375599 >> 172.21.15.6:0/1605375599 conn(0x7f35440fc7a0 msgr2=0x7f35440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.356+0000 7f3548ba0640 1 -- 172.21.15.6:0/1605375599 shutdown_connections 2024-09-11T23:59:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.356+0000 7f3548ba0640 1 -- 172.21.15.6:0/1605375599 wait complete. 2024-09-11T23:59:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f3548ba0640 1 Processor -- start 2024-09-11T23:59:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f3548ba0640 1 -- start start 2024-09-11T23:59:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f3548ba0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3544102d40 0x7f35441983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f3548ba0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3544103660 0x7f35441988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f3548ba0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f354410c170 0x7f354419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f3548ba0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3544111e20 con 0x7f3544102d40 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f3548ba0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3544111ca0 con 0x7f354410c170 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f3548ba0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3544111fa0 con 0x7f3544103660 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f354259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3544102d40 0x7f35441983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f354259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3544102d40 0x7f35441983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52708/0 (socket says 172.21.15.6:52708) 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f354259c640 1 -- 172.21.15.6:0/414051028 learned_addr learned my addr 172.21.15.6:0/414051028 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f3541d9b640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3544103660 0x7f35441988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f3542d9d640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f354410c170 0x7f354419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f354259c640 1 -- 172.21.15.6:0/414051028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3544103660 msgr2=0x7f35441988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f354259c640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3544103660 0x7f35441988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f354259c640 1 -- 172.21.15.6:0/414051028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f354410c170 msgr2=0x7f354419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f354259c640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f354410c170 0x7f354419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f354259c640 1 -- 172.21.15.6:0/414051028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354419d350 con 0x7f3544102d40 2024-09-11T23:59:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.357+0000 7f3542d9d640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f354410c170 0x7f354419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.358+0000 7f354259c640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3544102d40 0x7f35441983a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f353400e9f0 tx=0x7f353400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.358+0000 7f35337fe640 1 -- 172.21.15.6:0/414051028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353400cd80 con 0x7f3544102d40 2024-09-11T23:59:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.358+0000 7f3548ba0640 1 -- 172.21.15.6:0/414051028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f354419d640 con 0x7f3544102d40 2024-09-11T23:59:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.358+0000 7f35337fe640 1 -- 172.21.15.6:0/414051028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35340108e0 con 0x7f3544102d40 2024-09-11T23:59:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.358+0000 7f35337fe640 1 -- 172.21.15.6:0/414051028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534018920 con 0x7f3544102d40 2024-09-11T23:59:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.358+0000 7f3548ba0640 1 -- 172.21.15.6:0/414051028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35441a4f20 con 0x7f3544102d40 2024-09-11T23:59:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.360+0000 7f35337fe640 1 -- 172.21.15.6:0/414051028 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3534010a90 con 0x7f3544102d40 2024-09-11T23:59:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.360+0000 7f354af79740 1 Processor -- start 2024-09-11T23:59:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.360+0000 7f354af79740 1 -- start start 2024-09-11T23:59:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f354af79740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a74adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f354af79740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a755670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f354af79740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 0x563a2a757fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f354af79740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563a2a6b1090 con 0x563a2a755bb0 2024-09-11T23:59:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f354af79740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563a2a658a70 con 0x563a2a74b2f0 2024-09-11T23:59:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f354af79740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563a2a6ad050 con 0x563a2a74a9d0 2024-09-11T23:59:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f3541d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 0x563a2a757fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f3541d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 0x563a2a757fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52718/0 (socket says 172.21.15.6:52718) 2024-09-11T23:59:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f35337fe640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f352c0a2b80 0x7f352c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f3541d9b640 1 -- 172.21.15.6:0/3623336364 learned_addr learned my addr 172.21.15.6:0/3623336364 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f354259c640 1 --2- 172.21.15.6:0/3623336364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a755670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f3542d9d640 1 --2- 172.21.15.6:0/3623336364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a74adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f3542d9d640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f352c0a2b80 0x7f352c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f3541d9b640 1 -- 172.21.15.6:0/3623336364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 msgr2=0x563a2a74adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f3541d9b640 1 --2- 172.21.15.6:0/3623336364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a74adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f3541d9b640 1 -- 172.21.15.6:0/3623336364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 msgr2=0x563a2a755670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f3541d9b640 1 --2- 172.21.15.6:0/3623336364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a755670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f3541d9b640 1 -- 172.21.15.6:0/3623336364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a2a665130 con 0x563a2a755bb0 2024-09-11T23:59:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f354259c640 1 --2- 172.21.15.6:0/3623336364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a755670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f35337fe640 1 -- 172.21.15.6:0/414051028 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f35340cf720 con 0x7f3544102d40 2024-09-11T23:59:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.361+0000 7f3541d9b640 1 --2- 172.21.15.6:0/3623336364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 0x563a2a757fa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3538009900 tx=0x7f3538032b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8355e06ae8ddf3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.362+0000 7f3542d9d640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f352c0a2b80 0x7f352c0a5040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f353c005c40 tx=0x7f353c009200 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.362+0000 7f3530ff9640 1 -- 172.21.15.6:0/3623336364 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538040070 con 0x563a2a755bb0 2024-09-11T23:59:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.362+0000 7f3530ff9640 1 -- 172.21.15.6:0/3623336364 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3538004030 con 0x563a2a755bb0 2024-09-11T23:59:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.362+0000 7f3530ff9640 1 -- 172.21.15.6:0/3623336364 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538035040 con 0x563a2a755bb0 2024-09-11T23:59:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.362+0000 7f354af79740 1 -- 172.21.15.6:0/3623336364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 msgr2=0x563a2a757fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.362+0000 7f354af79740 1 --2- 172.21.15.6:0/3623336364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 0x563a2a757fa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3538009900 tx=0x7f3538032b00 comp rx=0 tx=0).stop 2024-09-11T23:59:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.362+0000 7f354af79740 1 -- 172.21.15.6:0/3623336364 shutdown_connections 2024-09-11T23:59:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.362+0000 7f354af79740 1 --2- 172.21.15.6:0/3623336364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 0x563a2a757fa0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.362+0000 7f354af79740 1 --2- 172.21.15.6:0/3623336364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a755670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.362+0000 7f354af79740 1 --2- 172.21.15.6:0/3623336364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a74adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.362+0000 7f354af79740 1 -- 172.21.15.6:0/3623336364 >> 172.21.15.6:0/3623336364 conn(0x563a2a746f60 msgr2=0x563a2a747340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f354af79740 1 -- 172.21.15.6:0/3623336364 shutdown_connections 2024-09-11T23:59:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f354af79740 1 -- 172.21.15.6:0/3623336364 wait complete. 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f354af79740 1 -- start start 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f354af79740 1 Processor -- start 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f354af79740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a7553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f354af79740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74b2f0 0x563a2a752730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f354af79740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a755bb0 0x563a2a752c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f354af79740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563a2a758780 con 0x563a2a74b2f0 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f354af79740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563a2a66bf20 con 0x563a2a755bb0 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f354af79740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563a2a758900 con 0x563a2a74a9d0 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f354af79740 10 client.0 _ll_register_callbacks cb 0x563a2a635030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f3541d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74b2f0 0x563a2a752730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f3541d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74b2f0 0x563a2a752730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52720/0 (socket says 172.21.15.6:52720) 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f3541d9b640 1 -- 172.21.15.6:0/3021767973 learned_addr learned my addr 172.21.15.6:0/3021767973 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.363+0000 7f354259c640 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a7553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f3541d9b640 1 -- 172.21.15.6:0/3021767973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 msgr2=0x563a2a7553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f3542d9d640 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a755bb0 0x563a2a752c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f3541d9b640 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a7553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f3541d9b640 1 -- 172.21.15.6:0/3021767973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a755bb0 msgr2=0x563a2a752c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f3541d9b640 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a755bb0 0x563a2a752c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f3541d9b640 1 -- 172.21.15.6:0/3021767973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a2a4222b0 con 0x563a2a74b2f0 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f3541d9b640 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74b2f0 0x563a2a752730 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3538006010 tx=0x7f353802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de2a94160223436 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f3529ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f3529ffb640 1 -- 172.21.15.6:0/3021767973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538040070 con 0x563a2a74b2f0 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f3529ffb640 1 -- 172.21.15.6:0/3021767973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f35380316a0 con 0x563a2a74b2f0 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f354af79740 1 -- 172.21.15.6:0/3021767973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3538004030 con 0x563a2a74b2f0 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f3529ffb640 1 -- 172.21.15.6:0/3021767973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3538056050 con 0x563a2a74b2f0 2024-09-11T23:59:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f354af79740 10 client.15291 fetch_fsmap learned FSMap version 27 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f354af79740 1 -- 172.21.15.6:0/3021767973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563a2a764030 con 0x563a2a74b2f0 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.364+0000 7f3529ffb640 1 -- 172.21.15.6:0/3021767973 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3538004030 con 0x563a2a74b2f0 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.365+0000 7f3529ffb640 1 -- 172.21.15.6:0/3021767973 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f35380035f0 con 0x563a2a74b2f0 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.365+0000 7f354af79740 10 client.15291 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.365+0000 7f354af79740 10 client.15291 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.365+0000 7f354af79740 20 client.15291 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.365+0000 7f354af79740 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x563a2a7661b0 0x563a2a767620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.365+0000 7f354af79740 4 client.15291 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.365+0000 7f354af79740 1 -- 172.21.15.6:0/3021767973 --> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a2a6be600 con 0x563a2a7661b0 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.365+0000 7f354259c640 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x563a2a7661b0 0x563a2a767620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.365+0000 7f354259c640 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x563a2a7661b0 0x563a2a767620 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6933df97f46b1e18 server_cookie=b305fa76cee81039 in_seq=0 out_seq=0 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.365+0000 7f3529ffb640 10 client.15291 ms_handle_connect on v2:172.21.15.134:6838/45989022 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f3529ffb640 1 -- 172.21.15.6:0/3021767973 <== mds.1 v2:172.21.15.134:6838/45989022 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a2a6be600 con 0x563a2a7661b0 2024-09-11T23:59:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f3529ffb640 10 client.15291 handle_command_reply: tid=0 2024-09-11T23:59:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f354af79740 1 client.15291 shutdown 2024-09-11T23:59:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f354af79740 1 -- 172.21.15.6:0/3021767973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74b2f0 msgr2=0x563a2a752730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f354af79740 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74b2f0 0x563a2a752730 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3538006010 tx=0x7f353802a480 comp rx=0 tx=0).stop 2024-09-11T23:59:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f354af79740 1 -- 172.21.15.6:0/3021767973 shutdown_connections 2024-09-11T23:59:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f354af79740 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a755bb0 0x563a2a752c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f354af79740 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x563a2a7661b0 0x563a2a767620 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f354af79740 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74b2f0 0x563a2a752730 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f354af79740 1 --2- 172.21.15.6:0/3021767973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a7553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f3529ffb640 0 client.15291 ms_handle_reset on v2:172.21.15.134:6838/45989022 2024-09-11T23:59:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f354af79740 1 -- 172.21.15.6:0/3021767973 >> 172.21.15.6:0/3021767973 conn(0x563a2a746f60 msgr2=0x563a2a74cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.366+0000 7f354af79740 1 -- 172.21.15.6:0/3021767973 shutdown_connections 2024-09-11T23:59:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.367+0000 7f354af79740 1 -- 172.21.15.6:0/3021767973 wait complete. 2024-09-11T23:59:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.367+0000 7f354af79740 20 client.15291 trim_cache size 0 max 16384 2024-09-11T23:59:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.385+0000 7f354af79740 1 Processor -- start 2024-09-11T23:59:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.385+0000 7f354af79740 1 -- start start 2024-09-11T23:59:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.385+0000 7f354af79740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a765ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.385+0000 7f354af79740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a766880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.385+0000 7f354af79740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 0x563a2a76f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.385+0000 7f354af79740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563a2a765960 con 0x563a2a755bb0 2024-09-11T23:59:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.385+0000 7f354af79740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563a2a766030 con 0x563a2a74b2f0 2024-09-11T23:59:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.385+0000 7f354af79740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563a2a766700 con 0x563a2a74a9d0 2024-09-11T23:59:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f3542d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 0x563a2a76f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f3542d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 0x563a2a76f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52722/0 (socket says 172.21.15.6:52722) 2024-09-11T23:59:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f3542d9d640 1 -- 172.21.15.6:0/1653634576 learned_addr learned my addr 172.21.15.6:0/1653634576 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f354259c640 1 --2- 172.21.15.6:0/1653634576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a765ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f3541d9b640 1 --2- 172.21.15.6:0/1653634576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a766880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f3542d9d640 1 -- 172.21.15.6:0/1653634576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 msgr2=0x563a2a765ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f3542d9d640 1 --2- 172.21.15.6:0/1653634576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a765ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f3542d9d640 1 -- 172.21.15.6:0/1653634576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 msgr2=0x563a2a766880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f3542d9d640 1 --2- 172.21.15.6:0/1653634576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a766880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f3542d9d640 1 -- 172.21.15.6:0/1653634576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a2a746d90 con 0x563a2a755bb0 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f354259c640 1 --2- 172.21.15.6:0/1653634576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a765ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f3541d9b640 1 --2- 172.21.15.6:0/1653634576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a766880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f3542d9d640 1 --2- 172.21.15.6:0/1653634576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 0x563a2a76f900 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f353c00f7b0 tx=0x7f353c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70876a36528052ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f352bfff640 1 -- 172.21.15.6:0/1653634576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c024070 con 0x563a2a755bb0 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f352bfff640 1 -- 172.21.15.6:0/1653634576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f353c011e20 con 0x563a2a755bb0 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.386+0000 7f352bfff640 1 -- 172.21.15.6:0/1653634576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c018040 con 0x563a2a755bb0 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.387+0000 7f354af79740 1 -- 172.21.15.6:0/1653634576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 msgr2=0x563a2a76f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.387+0000 7f354af79740 1 --2- 172.21.15.6:0/1653634576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 0x563a2a76f900 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f353c00f7b0 tx=0x7f353c009650 comp rx=0 tx=0).stop 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.387+0000 7f354af79740 1 -- 172.21.15.6:0/1653634576 shutdown_connections 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.387+0000 7f354af79740 1 --2- 172.21.15.6:0/1653634576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a755bb0 0x563a2a76f900 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.387+0000 7f354af79740 1 --2- 172.21.15.6:0/1653634576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a766880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.387+0000 7f354af79740 1 --2- 172.21.15.6:0/1653634576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a74a9d0 0x563a2a765ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.387+0000 7f354af79740 1 -- 172.21.15.6:0/1653634576 >> 172.21.15.6:0/1653634576 conn(0x563a2a746f60 msgr2=0x563a2a741ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.387+0000 7f354af79740 1 -- 172.21.15.6:0/1653634576 shutdown_connections 2024-09-11T23:59:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.387+0000 7f354af79740 1 -- 172.21.15.6:0/1653634576 wait complete. 2024-09-11T23:59:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.387+0000 7f354af79740 1 -- start start 2024-09-11T23:59:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.387+0000 7f354af79740 1 Processor -- start 2024-09-11T23:59:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354af79740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74a9d0 0x563a2a76fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354af79740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a770160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354af79740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a755bb0 0x563a2a76b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354af79740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563a2a7674a0 con 0x563a2a74a9d0 2024-09-11T23:59:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354af79740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563a2a766dd0 con 0x563a2a74b2f0 2024-09-11T23:59:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354af79740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563a2a767b70 con 0x563a2a755bb0 2024-09-11T23:59:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354af79740 10 client.0 _ll_register_callbacks cb 0x7f3538009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:17.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74a9d0 0x563a2a76fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74a9d0 0x563a2a76fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52726/0 (socket says 172.21.15.6:52726) 2024-09-11T23:59:17.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354259c640 1 -- 172.21.15.6:0/27600859 learned_addr learned my addr 172.21.15.6:0/27600859 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:17.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f3541d9b640 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a770160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f3542d9d640 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a755bb0 0x563a2a76b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354259c640 1 -- 172.21.15.6:0/27600859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a755bb0 msgr2=0x563a2a76b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:17.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354259c640 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a755bb0 0x563a2a76b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354259c640 1 -- 172.21.15.6:0/27600859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 msgr2=0x563a2a770160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:17.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354259c640 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a770160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354259c640 1 -- 172.21.15.6:0/27600859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a2a76b850 con 0x563a2a74a9d0 2024-09-11T23:59:17.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f3542d9d640 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a755bb0 0x563a2a76b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:17.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f354259c640 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74a9d0 0x563a2a76fc20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f353409b920 tx=0x7f3534000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57983cda3926c71c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:17.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f3529ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:17.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.388+0000 7f3529ffb640 1 -- 172.21.15.6:0/27600859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353409ffd0 con 0x563a2a74a9d0 2024-09-11T23:59:17.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f3529ffb640 1 -- 172.21.15.6:0/27600859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f3534098290 con 0x563a2a74a9d0 2024-09-11T23:59:17.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f354af79740 1 -- 172.21.15.6:0/27600859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f353c011e20 con 0x563a2a74a9d0 2024-09-11T23:59:17.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f3529ffb640 1 -- 172.21.15.6:0/27600859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f35340a4890 con 0x563a2a74a9d0 2024-09-11T23:59:17.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f354af79740 10 client.15297 fetch_fsmap learned FSMap version 27 2024-09-11T23:59:17.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f354af79740 1 -- 172.21.15.6:0/27600859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563a2a7d0490 con 0x563a2a74a9d0 2024-09-11T23:59:17.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f3529ffb640 1 -- 172.21.15.6:0/27600859 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f353c011e20 con 0x563a2a74a9d0 2024-09-11T23:59:17.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f3529ffb640 1 -- 172.21.15.6:0/27600859 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f35340a4ae0 con 0x563a2a74a9d0 2024-09-11T23:59:17.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f354af79740 10 client.15297 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:59:17.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f354af79740 10 client.15297 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:59:17.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f354af79740 20 client.15297 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:17.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f354af79740 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x563a2a7d5020 0x563a2a7d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f354af79740 4 client.15297 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:17.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f354af79740 1 -- 172.21.15.6:0/27600859 --> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] -- command(tid 0: {"prefix": "status"}) -- 0x563a2a6b8b10 con 0x563a2a7d5020 2024-09-11T23:59:17.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.389+0000 7f3541d9b640 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x563a2a7d5020 0x563a2a7d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f3529ffb640 10 client.15297 ms_handle_connect on v2:172.21.15.134:6838/45989022 2024-09-11T23:59:17.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f3541d9b640 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x563a2a7d5020 0x563a2a7d3d30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a852c25c0163fc71 server_cookie=798e5668795e38a3 in_seq=0 out_seq=0 2024-09-11T23:59:17.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f3529ffb640 1 -- 172.21.15.6:0/27600859 <== mds.1 v2:172.21.15.134:6838/45989022 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563a2a6b8b10 con 0x563a2a7d5020 2024-09-11T23:59:17.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f3529ffb640 10 client.15297 handle_command_reply: tid=0 2024-09-11T23:59:17.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f354af79740 1 client.15297 shutdown 2024-09-11T23:59:17.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f354af79740 1 -- 172.21.15.6:0/27600859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74a9d0 msgr2=0x563a2a76fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f354af79740 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74a9d0 0x563a2a76fc20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f353409b920 tx=0x7f3534000bc0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f354af79740 1 -- 172.21.15.6:0/27600859 shutdown_connections 2024-09-11T23:59:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f354af79740 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a2a755bb0 0x563a2a76b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f354af79740 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563a2a74b2f0 0x563a2a770160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f354af79740 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.134:6838/45989022,v1:172.21.15.134:6839/45989022] conn(0x563a2a7d5020 0x563a2a7d3d30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f3529ffb640 0 client.15297 ms_handle_reset on v2:172.21.15.134:6838/45989022 2024-09-11T23:59:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f354af79740 1 --2- 172.21.15.6:0/27600859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a2a74a9d0 0x563a2a76fc20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f354af79740 1 -- 172.21.15.6:0/27600859 >> 172.21.15.6:0/27600859 conn(0x563a2a746f60 msgr2=0x563a2a7457e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f354af79740 1 -- 172.21.15.6:0/27600859 shutdown_connections 2024-09-11T23:59:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f354af79740 1 -- 172.21.15.6:0/27600859 wait complete. 2024-09-11T23:59:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.390+0000 7f354af79740 20 client.15297 trim_cache size 0 max 16384 2024-09-11T23:59:17.406 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:59:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 1, 2024-09-11T23:59:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24490, 2024-09-11T23:59:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-11T23:59:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-11T23:59:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-11T23:59:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 98.368613733000004, 2024-09-11T23:59:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2024-09-11T23:59:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 88, 2024-09-11T23:59:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:59:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 158.65347256000001 2024-09-11T23:59:17.407 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:59:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.391+0000 7f3548ba0640 1 -- 172.21.15.6:0/414051028 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f352c0a2b80 msgr2=0x7f352c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.391+0000 7f3548ba0640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f352c0a2b80 0x7f352c0a5040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f353c005c40 tx=0x7f353c009200 comp rx=0 tx=0).stop 2024-09-11T23:59:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.391+0000 7f3548ba0640 1 -- 172.21.15.6:0/414051028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3544102d40 msgr2=0x7f35441983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.391+0000 7f3548ba0640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3544102d40 0x7f35441983a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f353400e9f0 tx=0x7f353400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.391+0000 7f3548ba0640 1 -- 172.21.15.6:0/414051028 shutdown_connections 2024-09-11T23:59:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.391+0000 7f3548ba0640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f352c0a2b80 0x7f352c0a5040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.391+0000 7f3548ba0640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f354410c170 0x7f354419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.391+0000 7f3548ba0640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3544103660 0x7f35441988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.391+0000 7f3548ba0640 1 --2- 172.21.15.6:0/414051028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3544102d40 0x7f35441983a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.391+0000 7f3548ba0640 1 -- 172.21.15.6:0/414051028 >> 172.21.15.6:0/414051028 conn(0x7f35440fc7a0 msgr2=0x7f35440fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.391+0000 7f3548ba0640 1 -- 172.21.15.6:0/414051028 shutdown_connections 2024-09-11T23:59:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:17.391+0000 7f3548ba0640 1 -- 172.21.15.6:0/414051028 wait complete. 2024-09-11T23:59:18.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T23:59:18.346 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:18.723 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:18 smithi006 ceph-mon[30947]: pgmap v356: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-11T23:59:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.805+0000 7fc49b969640 1 -- 172.21.15.6:0/2763724017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc494106f10 msgr2=0x7fc49410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.805+0000 7fc49b969640 1 --2- 172.21.15.6:0/2763724017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc494106f10 0x7fc49410ea90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc484009ca0 tx=0x7fc48402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.805+0000 7fc49b969640 1 -- 172.21.15.6:0/2763724017 shutdown_connections 2024-09-11T23:59:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.805+0000 7fc49b969640 1 --2- 172.21.15.6:0/2763724017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc494106f10 0x7fc49410ea90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.805+0000 7fc49b969640 1 --2- 172.21.15.6:0/2763724017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc494102790 0x7fc4941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.805+0000 7fc49b969640 1 --2- 172.21.15.6:0/2763724017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc494101de0 0x7fc4941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.805+0000 7fc49b969640 1 -- 172.21.15.6:0/2763724017 >> 172.21.15.6:0/2763724017 conn(0x7fc4940fd8c0 msgr2=0x7fc4940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.806+0000 7fc49b969640 1 -- 172.21.15.6:0/2763724017 shutdown_connections 2024-09-11T23:59:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.806+0000 7fc49b969640 1 -- 172.21.15.6:0/2763724017 wait complete. 2024-09-11T23:59:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.806+0000 7fc49b969640 1 Processor -- start 2024-09-11T23:59:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.806+0000 7fc49b969640 1 -- start start 2024-09-11T23:59:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.806+0000 7fc49b969640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc494101de0 0x7fc494198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.806+0000 7fc49b969640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc494102790 0x7fc494198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.806+0000 7fc49b969640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc494106f10 0x7fc49419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.806+0000 7fc49b969640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc494111e20 con 0x7fc494101de0 2024-09-11T23:59:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.806+0000 7fc49b969640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc494111ca0 con 0x7fc494106f10 2024-09-11T23:59:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.806+0000 7fc49b969640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc494111fa0 con 0x7fc494102790 2024-09-11T23:59:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc499705640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc494101de0 0x7fc494198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc499705640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc494101de0 0x7fc494198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52754/0 (socket says 172.21.15.6:52754) 2024-09-11T23:59:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc499705640 1 -- 172.21.15.6:0/2241754545 learned_addr learned my addr 172.21.15.6:0/2241754545 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc498f04640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc494102790 0x7fc494198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc499f06640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc494106f10 0x7fc49419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc499705640 1 -- 172.21.15.6:0/2241754545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc494102790 msgr2=0x7fc494198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc499705640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc494102790 0x7fc494198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc499705640 1 -- 172.21.15.6:0/2241754545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc494106f10 msgr2=0x7fc49419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc499705640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc494106f10 0x7fc49419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc499705640 1 -- 172.21.15.6:0/2241754545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49419d2f0 con 0x7fc494101de0 2024-09-11T23:59:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc499f06640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc494106f10 0x7fc49419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc499705640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc494101de0 0x7fc494198340 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00d770 tx=0x7fc48c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc4927fc640 1 -- 172.21.15.6:0/2241754545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c017070 con 0x7fc494101de0 2024-09-11T23:59:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc4927fc640 1 -- 172.21.15.6:0/2241754545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc48c0054d0 con 0x7fc494101de0 2024-09-11T23:59:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc49b969640 1 -- 172.21.15.6:0/2241754545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc49419d5e0 con 0x7fc494101de0 2024-09-11T23:59:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc4927fc640 1 -- 172.21.15.6:0/2241754545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c004cf0 con 0x7fc494101de0 2024-09-11T23:59:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.807+0000 7fc49b969640 1 -- 172.21.15.6:0/2241754545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4941a4ec0 con 0x7fc494101de0 2024-09-11T23:59:18.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.810+0000 7fc4927fc640 1 -- 172.21.15.6:0/2241754545 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fc48c004e90 con 0x7fc494101de0 2024-09-11T23:59:18.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.810+0000 7fc49dd42740 1 Processor -- start 2024-09-11T23:59:18.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.810+0000 7fc49dd42740 1 -- start start 2024-09-11T23:59:18.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.810+0000 7fc49dd42740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b19d0 0x55a0562b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.810+0000 7fc49dd42740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 0x55a0562bc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.810+0000 7fc49dd42740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 0x55a0562befa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.810+0000 7fc4927fc640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc47c0a2b80 0x7fc47c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.810+0000 7fc49dd42740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a056218090 con 0x55a0562b22f0 2024-09-11T23:59:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.810+0000 7fc49dd42740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a0561bfa70 con 0x55a0562b19d0 2024-09-11T23:59:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.810+0000 7fc49dd42740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a056214050 con 0x55a0562bcbb0 2024-09-11T23:59:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499705640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 0x55a0562bc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499f06640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc47c0a2b80 0x7fc47c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499705640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 0x55a0562bc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52756/0 (socket says 172.21.15.6:52756) 2024-09-11T23:59:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499705640 1 -- 172.21.15.6:0/91462737 learned_addr learned my addr 172.21.15.6:0/91462737 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc498f04640 1 --2- 172.21.15.6:0/91462737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 0x55a0562befa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc4927fc640 1 -- 172.21.15.6:0/2241754545 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fc48c0cee10 con 0x7fc494101de0 2024-09-11T23:59:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499f06640 1 --2- 172.21.15.6:0/91462737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b19d0 0x55a0562b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499705640 1 -- 172.21.15.6:0/91462737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 msgr2=0x55a0562befa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499705640 1 --2- 172.21.15.6:0/91462737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 0x55a0562befa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499705640 1 -- 172.21.15.6:0/91462737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b19d0 msgr2=0x55a0562b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499705640 1 --2- 172.21.15.6:0/91462737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b19d0 0x55a0562b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499705640 1 -- 172.21.15.6:0/91462737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0561cc130 con 0x55a0562b22f0 2024-09-11T23:59:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499f06640 1 --2- 172.21.15.6:0/91462737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b19d0 0x55a0562b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499705640 1 --2- 172.21.15.6:0/91462737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 0x55a0562bc670 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc48c009610 tx=0x7fc48c06b1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7e92e7cbc49590 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc499f06640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc47c0a2b80 0x7fc47c0a5040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc484005e30 tx=0x7fc484005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc47b7fe640 1 -- 172.21.15.6:0/91462737 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c020070 con 0x55a0562b22f0 2024-09-11T23:59:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc47b7fe640 1 -- 172.21.15.6:0/91462737 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc48c009c30 con 0x55a0562b22f0 2024-09-11T23:59:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.811+0000 7fc47b7fe640 1 -- 172.21.15.6:0/91462737 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c09f6c0 con 0x55a0562b22f0 2024-09-11T23:59:18.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.812+0000 7fc49dd42740 1 -- 172.21.15.6:0/91462737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 msgr2=0x55a0562bc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:18.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.812+0000 7fc49dd42740 1 --2- 172.21.15.6:0/91462737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 0x55a0562bc670 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc48c009610 tx=0x7fc48c06b1c0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.812+0000 7fc49dd42740 1 -- 172.21.15.6:0/91462737 shutdown_connections 2024-09-11T23:59:18.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.812+0000 7fc49dd42740 1 --2- 172.21.15.6:0/91462737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 0x55a0562befa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.812+0000 7fc49dd42740 1 --2- 172.21.15.6:0/91462737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 0x55a0562bc670 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.812+0000 7fc49dd42740 1 --2- 172.21.15.6:0/91462737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b19d0 0x55a0562b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.812+0000 7fc49dd42740 1 -- 172.21.15.6:0/91462737 >> 172.21.15.6:0/91462737 conn(0x55a0562adf60 msgr2=0x55a0562ae340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:18.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.812+0000 7fc49dd42740 1 -- 172.21.15.6:0/91462737 shutdown_connections 2024-09-11T23:59:18.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.812+0000 7fc49dd42740 1 -- 172.21.15.6:0/91462737 wait complete. 2024-09-11T23:59:18.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc49dd42740 1 -- start start 2024-09-11T23:59:18.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc49dd42740 1 Processor -- start 2024-09-11T23:59:18.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc49dd42740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b19d0 0x55a0562bc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc49dd42740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 0x55a0562b9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc49dd42740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 0x55a0562b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc49dd42740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a0562bf780 con 0x55a0562b22f0 2024-09-11T23:59:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc49dd42740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a0561d2f20 con 0x55a0562b19d0 2024-09-11T23:59:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc49dd42740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a0562bf900 con 0x55a0562bcbb0 2024-09-11T23:59:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc49dd42740 10 client.0 _ll_register_callbacks cb 0x55a05619c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc498f04640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 0x55a0562b9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc498f04640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 0x55a0562b9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52764/0 (socket says 172.21.15.6:52764) 2024-09-11T23:59:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc498f04640 1 -- 172.21.15.6:0/2751463593 learned_addr learned my addr 172.21.15.6:0/2751463593 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc499705640 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b19d0 0x55a0562bc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.813+0000 7fc499f06640 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 0x55a0562b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc498f04640 1 -- 172.21.15.6:0/2751463593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 msgr2=0x55a0562b9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc498f04640 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 0x55a0562b9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc498f04640 1 -- 172.21.15.6:0/2751463593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b19d0 msgr2=0x55a0562bc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc498f04640 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b19d0 0x55a0562bc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc498f04640 1 -- 172.21.15.6:0/2751463593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a055f892b0 con 0x55a0562b22f0 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc498f04640 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 0x55a0562b9750 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc48800bf00 tx=0x7fc488011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00df830ea0d40e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc478ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc478ff9640 1 -- 172.21.15.6:0/2751463593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488004020 con 0x55a0562b22f0 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc478ff9640 1 -- 172.21.15.6:0/2751463593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fc4880041c0 con 0x55a0562b22f0 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc49dd42740 1 -- 172.21.15.6:0/2751463593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a056225600 con 0x55a0562b22f0 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc478ff9640 1 -- 172.21.15.6:0/2751463593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc488024050 con 0x55a0562b22f0 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc49dd42740 10 client.15309 fetch_fsmap learned FSMap version 27 2024-09-11T23:59:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc49dd42740 1 -- 172.21.15.6:0/2751463593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a0562cb050 con 0x55a0562b22f0 2024-09-11T23:59:18.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc478ff9640 1 -- 172.21.15.6:0/2751463593 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55a056225600 con 0x55a0562b22f0 2024-09-11T23:59:18.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.814+0000 7fc478ff9640 1 -- 172.21.15.6:0/2751463593 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fc4880037f0 con 0x55a0562b22f0 2024-09-11T23:59:18.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.815+0000 7fc49dd42740 10 client.15309 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:59:18.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.815+0000 7fc49dd42740 10 client.15309 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:59:18.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.815+0000 7fc49dd42740 20 client.15309 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:18.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.815+0000 7fc49dd42740 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55a0562cd6a0 0x55a0562ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.815+0000 7fc49dd42740 4 client.15309 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:18.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.815+0000 7fc49dd42740 1 -- 172.21.15.6:0/2751463593 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a05621fb10 con 0x55a0562cd6a0 2024-09-11T23:59:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.815+0000 7fc499705640 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55a0562cd6a0 0x55a0562ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.815+0000 7fc499705640 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55a0562cd6a0 0x55a0562ceb10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1f2bca8a6b88c85 server_cookie=ef935954a751d7ce in_seq=0 out_seq=0 2024-09-11T23:59:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.815+0000 7fc478ff9640 10 client.15309 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-11T23:59:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc478ff9640 1 -- 172.21.15.6:0/2751463593 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc48c080e80 con 0x55a0562cd6a0 2024-09-11T23:59:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc478ff9640 10 client.15309 handle_command_reply: tid=0 2024-09-11T23:59:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc49dd42740 1 client.15309 shutdown 2024-09-11T23:59:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc49dd42740 1 -- 172.21.15.6:0/2751463593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 msgr2=0x55a0562b9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc49dd42740 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 0x55a0562b9750 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc48800bf00 tx=0x7fc488011810 comp rx=0 tx=0).stop 2024-09-11T23:59:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc49dd42740 1 -- 172.21.15.6:0/2751463593 shutdown_connections 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc49dd42740 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55a0562cd6a0 0x55a0562ceb10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc49dd42740 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 0x55a0562b9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc49dd42740 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b22f0 0x55a0562b9750 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc478ff9640 0 client.15309 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc49dd42740 1 --2- 172.21.15.6:0/2751463593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b19d0 0x55a0562bc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc49dd42740 1 -- 172.21.15.6:0/2751463593 >> 172.21.15.6:0/2751463593 conn(0x55a0562adf60 msgr2=0x55a0562b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc49dd42740 1 -- 172.21.15.6:0/2751463593 shutdown_connections 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.816+0000 7fc49dd42740 1 -- 172.21.15.6:0/2751463593 wait complete. 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.817+0000 7fc49dd42740 20 client.15309 trim_cache size 0 max 16384 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.834+0000 7fc49dd42740 1 Processor -- start 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.834+0000 7fc49dd42740 1 -- start start 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc49dd42740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562b19d0 0x55a0562b8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc49dd42740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b22f0 0x55a0562b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc49dd42740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562bcbb0 0x55a0562b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc49dd42740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a0562cce50 con 0x55a0562bcbb0 2024-09-11T23:59:18.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc49dd42740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a0562cd520 con 0x55a0562b22f0 2024-09-11T23:59:18.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc49dd42740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a0562cdbf0 con 0x55a0562b19d0 2024-09-11T23:59:18.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc499f06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562bcbb0 0x55a0562b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc499f06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562bcbb0 0x55a0562b6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52768/0 (socket says 172.21.15.6:52768) 2024-09-11T23:59:18.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc499f06640 1 -- 172.21.15.6:0/3022436177 learned_addr learned my addr 172.21.15.6:0/3022436177 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:18.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc498f04640 1 --2- 172.21.15.6:0/3022436177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b22f0 0x55a0562b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc499f06640 1 -- 172.21.15.6:0/3022436177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562b19d0 msgr2=0x55a0562b8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:18.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc499f06640 1 --2- 172.21.15.6:0/3022436177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562b19d0 0x55a0562b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc499f06640 1 -- 172.21.15.6:0/3022436177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b22f0 msgr2=0x55a0562b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:18.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc499f06640 1 --2- 172.21.15.6:0/3022436177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b22f0 0x55a0562b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc499f06640 1 -- 172.21.15.6:0/3022436177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0562bf890 con 0x55a0562bcbb0 2024-09-11T23:59:18.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc499f06640 1 --2- 172.21.15.6:0/3022436177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562bcbb0 0x55a0562b6ef0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc4840317e0 tx=0x7fc48403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86d66d0ab40ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:18.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc47affd640 1 -- 172.21.15.6:0/3022436177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484050070 con 0x55a0562bcbb0 2024-09-11T23:59:18.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc47affd640 1 -- 172.21.15.6:0/3022436177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc484036030 con 0x55a0562bcbb0 2024-09-11T23:59:18.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.835+0000 7fc47affd640 1 -- 172.21.15.6:0/3022436177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484030820 con 0x55a0562bcbb0 2024-09-11T23:59:18.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.836+0000 7fc49dd42740 1 -- 172.21.15.6:0/3022436177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562bcbb0 msgr2=0x55a0562b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:18.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.836+0000 7fc49dd42740 1 --2- 172.21.15.6:0/3022436177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562bcbb0 0x55a0562b6ef0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc4840317e0 tx=0x7fc48403d000 comp rx=0 tx=0).stop 2024-09-11T23:59:18.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.836+0000 7fc49dd42740 1 -- 172.21.15.6:0/3022436177 shutdown_connections 2024-09-11T23:59:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.836+0000 7fc49dd42740 1 --2- 172.21.15.6:0/3022436177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562bcbb0 0x55a0562b6ef0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.836+0000 7fc49dd42740 1 --2- 172.21.15.6:0/3022436177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b22f0 0x55a0562b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.836+0000 7fc49dd42740 1 --2- 172.21.15.6:0/3022436177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562b19d0 0x55a0562b8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.836+0000 7fc49dd42740 1 -- 172.21.15.6:0/3022436177 >> 172.21.15.6:0/3022436177 conn(0x55a0562adf60 msgr2=0x55a0562a8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.836+0000 7fc49dd42740 1 -- 172.21.15.6:0/3022436177 shutdown_connections 2024-09-11T23:59:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.836+0000 7fc49dd42740 1 -- 172.21.15.6:0/3022436177 wait complete. 2024-09-11T23:59:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.836+0000 7fc49dd42740 1 -- start start 2024-09-11T23:59:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc49dd42740 1 Processor -- start 2024-09-11T23:59:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc49dd42740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b19d0 0x55a0562d7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc49dd42740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b22f0 0x55a0562d7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc49dd42740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 0x55a0562d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc49dd42740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a0562ce990 con 0x55a0562b19d0 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc49dd42740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a0562ce2c0 con 0x55a0562b22f0 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc49dd42740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a0562cf060 con 0x55a0562bcbb0 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc49dd42740 10 client.0 _ll_register_callbacks cb 0x7fc48800bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc499705640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b19d0 0x55a0562d7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc499705640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b19d0 0x55a0562d7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52778/0 (socket says 172.21.15.6:52778) 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc499705640 1 -- 172.21.15.6:0/2756036610 learned_addr learned my addr 172.21.15.6:0/2756036610 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc498f04640 1 --2- 172.21.15.6:0/2756036610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b22f0 0x55a0562d7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc499705640 1 -- 172.21.15.6:0/2756036610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 msgr2=0x55a0562d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc499705640 1 --2- 172.21.15.6:0/2756036610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 0x55a0562d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc499705640 1 -- 172.21.15.6:0/2756036610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b22f0 msgr2=0x55a0562d7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc499705640 1 --2- 172.21.15.6:0/2756036610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b22f0 0x55a0562d7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.837+0000 7fc499705640 1 -- 172.21.15.6:0/2756036610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0562d0ba0 con 0x55a0562b19d0 2024-09-11T23:59:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc499705640 1 --2- 172.21.15.6:0/2756036610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b19d0 0x55a0562d7010 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0cc920 tx=0x7fc48c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775f588f4be2caac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc478ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc478ff9640 1 -- 172.21.15.6:0/2756036610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c020040 con 0x55a0562b19d0 2024-09-11T23:59:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc478ff9640 1 -- 172.21.15.6:0/2756036610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fc48c097980 con 0x55a0562b19d0 2024-09-11T23:59:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc49dd42740 1 -- 172.21.15.6:0/2756036610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc484036030 con 0x55a0562b19d0 2024-09-11T23:59:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc478ff9640 1 -- 172.21.15.6:0/2756036610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc48c09b0e0 con 0x55a0562b19d0 2024-09-11T23:59:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc49dd42740 10 client.15315 fetch_fsmap learned FSMap version 27 2024-09-11T23:59:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc49dd42740 1 -- 172.21.15.6:0/2756036610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a0562d5630 con 0x55a0562b19d0 2024-09-11T23:59:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc478ff9640 1 -- 172.21.15.6:0/2756036610 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc484036030 con 0x55a0562b19d0 2024-09-11T23:59:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc478ff9640 1 -- 172.21.15.6:0/2756036610 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fc48c0b40d0 con 0x55a0562b19d0 2024-09-11T23:59:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc49dd42740 10 client.15315 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T23:59:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc49dd42740 10 client.15315 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:59:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc49dd42740 20 client.15315 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc49dd42740 1 --2- 172.21.15.6:0/2756036610 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55a0562cd6a0 0x55a05633acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc49dd42740 4 client.15315 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc49dd42740 1 -- 172.21.15.6:0/2756036610 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "status"}) -- 0x55a05619c0e0 con 0x55a0562cd6a0 2024-09-11T23:59:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.838+0000 7fc498f04640 1 --2- 172.21.15.6:0/2756036610 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55a0562cd6a0 0x55a05633acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc478ff9640 10 client.15315 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-11T23:59:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc498f04640 1 --2- 172.21.15.6:0/2756036610 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55a0562cd6a0 0x55a05633acd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=628d3e8643d45211 server_cookie=a84b8077c89302dc in_seq=0 out_seq=0 2024-09-11T23:59:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc478ff9640 1 -- 172.21.15.6:0/2756036610 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a05619c0e0 con 0x55a0562cd6a0 2024-09-11T23:59:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc478ff9640 10 client.15315 handle_command_reply: tid=0 2024-09-11T23:59:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc49dd42740 1 client.15315 shutdown 2024-09-11T23:59:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc49dd42740 1 -- 172.21.15.6:0/2756036610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b19d0 msgr2=0x55a0562d7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc49dd42740 1 --2- 172.21.15.6:0/2756036610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b19d0 0x55a0562d7010 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0cc920 tx=0x7fc48c00b480 comp rx=0 tx=0).stop 2024-09-11T23:59:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc49dd42740 1 -- 172.21.15.6:0/2756036610 shutdown_connections 2024-09-11T23:59:18.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc49dd42740 1 --2- 172.21.15.6:0/2756036610 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55a0562cd6a0 0x55a05633acd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc49dd42740 1 --2- 172.21.15.6:0/2756036610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0562bcbb0 0x55a0562d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc49dd42740 1 --2- 172.21.15.6:0/2756036610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a0562b22f0 0x55a0562d7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc478ff9640 0 client.15315 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-11T23:59:18.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc49dd42740 1 --2- 172.21.15.6:0/2756036610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a0562b19d0 0x55a0562d7010 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.839+0000 7fc49dd42740 1 -- 172.21.15.6:0/2756036610 >> 172.21.15.6:0/2756036610 conn(0x55a0562adf60 msgr2=0x55a0562b7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:18.903 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:59:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "4901345a-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-09-11T23:59:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24491, 2024-09-11T23:59:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-11T23:59:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-11T23:59:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-11T23:59:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 140.48194013599999, 2024-09-11T23:59:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2024-09-11T23:59:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 88, 2024-09-11T23:59:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:59:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 151.31933440099999 2024-09-11T23:59:18.904 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:59:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49dd42740 1 -- 172.21.15.6:0/2756036610 shutdown_connections 2024-09-11T23:59:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49dd42740 1 -- 172.21.15.6:0/2756036610 wait complete. 2024-09-11T23:59:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49dd42740 20 client.15315 trim_cache size 0 max 16384 2024-09-11T23:59:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49b969640 1 -- 172.21.15.6:0/2241754545 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc47c0a2b80 msgr2=0x7fc47c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49b969640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc47c0a2b80 0x7fc47c0a5040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc484005e30 tx=0x7fc484005d80 comp rx=0 tx=0).stop 2024-09-11T23:59:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49b969640 1 -- 172.21.15.6:0/2241754545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc494101de0 msgr2=0x7fc494198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49b969640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc494101de0 0x7fc494198340 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00d770 tx=0x7fc48c00dc30 comp rx=0 tx=0).stop 2024-09-11T23:59:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49b969640 1 -- 172.21.15.6:0/2241754545 shutdown_connections 2024-09-11T23:59:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49b969640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc47c0a2b80 0x7fc47c0a5040 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49b969640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc494106f10 0x7fc49419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49b969640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc494102790 0x7fc494198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49b969640 1 --2- 172.21.15.6:0/2241754545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc494101de0 0x7fc494198340 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49b969640 1 -- 172.21.15.6:0/2241754545 >> 172.21.15.6:0/2241754545 conn(0x7fc4940fd8c0 msgr2=0x7fc4940fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49b969640 1 -- 172.21.15.6:0/2241754545 shutdown_connections 2024-09-11T23:59:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:18.840+0000 7fc49b969640 1 -- 172.21.15.6:0/2241754545 wait complete. 2024-09-11T23:59:18.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:18 smithi134 ceph-mon[34893]: pgmap v356: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-11T23:59:19.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:18 smithi039 ceph-mon[34543]: pgmap v356: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-11T23:59:19.611 INFO:teuthology.run_tasks:Running task sequential... 2024-09-11T23:59:19.622 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-11T23:59:19.622 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-11T23:59:19.622 INFO:teuthology.task.print:Enabling mgr modules 2024-09-11T23:59:19.623 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-11T23:59:19.637 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-11T23:59:19.638 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-11T23:59:19.638 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-11T23:59:19.638 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:59:19.638 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:19.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:19.638 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-11T23:59:19.656 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-11T23:59:19.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:19.657 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:59:19.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:19.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-09-11T23:59:19.839 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-11T23:59:19.839 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T23:59:19.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T23:59:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.558+0000 7f761b048640 1 -- 172.21.15.6:0/717456569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7614103740 msgr2=0x7f7614107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.558+0000 7f761b048640 1 --2- 172.21.15.6:0/717456569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7614103740 0x7f7614107b80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7608009930 tx=0x7f760802a420 comp rx=0 tx=0).stop 2024-09-11T23:59:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.558+0000 7f761b048640 1 -- 172.21.15.6:0/717456569 shutdown_connections 2024-09-11T23:59:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.558+0000 7f761b048640 1 --2- 172.21.15.6:0/717456569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7614108290 0x7f761410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.558+0000 7f761b048640 1 --2- 172.21.15.6:0/717456569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7614103740 0x7f7614107b80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.558+0000 7f761b048640 1 --2- 172.21.15.6:0/717456569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7614102d90 0x7f7614103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.558+0000 7f761b048640 1 -- 172.21.15.6:0/717456569 >> 172.21.15.6:0/717456569 conn(0x7f76140fc7d0 msgr2=0x7f76140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.558+0000 7f761b048640 1 -- 172.21.15.6:0/717456569 shutdown_connections 2024-09-11T23:59:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.558+0000 7f761b048640 1 -- 172.21.15.6:0/717456569 wait complete. 2024-09-11T23:59:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.559+0000 7f761b048640 1 Processor -- start 2024-09-11T23:59:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.559+0000 7f761b048640 1 -- start start 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.559+0000 7f761b048640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7614102d90 0x7f7614198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.559+0000 7f761b048640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7614103740 0x7f76141989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.559+0000 7f761b048640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7614108290 0x7f761419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.559+0000 7f761b048640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7614111f40 con 0x7f7614103740 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.559+0000 7f761b048640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7614111dc0 con 0x7f7614108290 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.559+0000 7f761b048640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76141120c0 con 0x7f7614102d90 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.559+0000 7f7613fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7614103740 0x7f76141989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.559+0000 7f7613fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7614103740 0x7f76141989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51876/0 (socket says 172.21.15.6:51876) 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.559+0000 7f7613fff640 1 -- 172.21.15.6:0/434138473 learned_addr learned my addr 172.21.15.6:0/434138473 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f76195e5640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7614108290 0x7f761419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f7618de4640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7614102d90 0x7f7614198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f7613fff640 1 -- 172.21.15.6:0/434138473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7614102d90 msgr2=0x7f7614198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f7613fff640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7614102d90 0x7f7614198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f7613fff640 1 -- 172.21.15.6:0/434138473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7614108290 msgr2=0x7f761419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f7613fff640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7614108290 0x7f761419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f7613fff640 1 -- 172.21.15.6:0/434138473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761419d420 con 0x7f7614103740 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f76195e5640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7614108290 0x7f761419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f7613fff640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7614103740 0x7f76141989b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7608009230 tx=0x7f7608004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f7611ffb640 1 -- 172.21.15.6:0/434138473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760803f030 con 0x7f7614103740 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f761b048640 1 -- 172.21.15.6:0/434138473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761419d6b0 con 0x7f7614103740 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f7611ffb640 1 -- 172.21.15.6:0/434138473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7608003aa0 con 0x7f7614103740 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f7611ffb640 1 -- 172.21.15.6:0/434138473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608035070 con 0x7f7614103740 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.560+0000 7f761b048640 1 -- 172.21.15.6:0/434138473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76141a4ff0 con 0x7f7614103740 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.562+0000 7f761b048640 1 -- 172.21.15.6:0/434138473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f761406a7f0 con 0x7f7614103740 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.563+0000 7f7611ffb640 1 -- 172.21.15.6:0/434138473 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f7608042030 con 0x7f7614103740 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.563+0000 7f7611ffb640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75fc0a2b80 0x7f75fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.564+0000 7f7611ffb640 1 -- 172.21.15.6:0/434138473 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f76080efff0 con 0x7f7614103740 2024-09-11T23:59:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.564+0000 7f7618de4640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75fc0a2b80 0x7f75fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.564+0000 7f7618de4640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75fc0a2b80 0x7f75fc0a5040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f76040058c0 tx=0x7f760400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.567+0000 7f7611ffb640 1 -- 172.21.15.6:0/434138473 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f76080bcb90 con 0x7f7614103740 2024-09-11T23:59:20.781 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:20 smithi006 ceph-mon[30947]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:20.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.780+0000 7f761b048640 1 -- 172.21.15.6:0/434138473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7614103170 con 0x7f7614103740 2024-09-11T23:59:20.782 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T23:59:20.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.781+0000 7f7611ffb640 1 -- 172.21.15.6:0/434138473 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+88 (secure 0 0 0) 0x7f76080bc490 con 0x7f7614103740 2024-09-11T23:59:20.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.783+0000 7f761b048640 1 -- 172.21.15.6:0/434138473 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75fc0a2b80 msgr2=0x7f75fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.783+0000 7f761b048640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75fc0a2b80 0x7f75fc0a5040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f76040058c0 tx=0x7f760400a4c0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.783+0000 7f761b048640 1 -- 172.21.15.6:0/434138473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7614103740 msgr2=0x7f76141989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.783+0000 7f761b048640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7614103740 0x7f76141989b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7608009230 tx=0x7f7608004270 comp rx=0 tx=0).stop 2024-09-11T23:59:20.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.783+0000 7f761b048640 1 -- 172.21.15.6:0/434138473 shutdown_connections 2024-09-11T23:59:20.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.783+0000 7f761b048640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75fc0a2b80 0x7f75fc0a5040 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.783+0000 7f761b048640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7614108290 0x7f761419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.783+0000 7f761b048640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7614103740 0x7f76141989b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.783+0000 7f761b048640 1 --2- 172.21.15.6:0/434138473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7614102d90 0x7f7614198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.783+0000 7f761b048640 1 -- 172.21.15.6:0/434138473 >> 172.21.15.6:0/434138473 conn(0x7f76140fc7d0 msgr2=0x7f7614105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:20.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.784+0000 7f761b048640 1 -- 172.21.15.6:0/434138473 shutdown_connections 2024-09-11T23:59:20.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:20.784+0000 7f761b048640 1 -- 172.21.15.6:0/434138473 wait complete. 2024-09-11T23:59:20.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:20 smithi134 ceph-mon[34893]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:21.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:20 smithi039 ceph-mon[34543]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:21.437 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:59:21.438 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:59:21.438 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-09-11T23:59:21.438 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:59:21.438 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:21.438 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:59:21.438 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:59:21.438 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:59:21.438 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:59:21.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:21.438 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-09-11T23:59:21.456 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:59:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:59:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-09-11T23:59:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T23:59:21.458 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42147sec preferred_lft 42147sec 2024-09-11T23:59:21.458 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2024-09-11T23:59:21.458 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:59:21.458 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:59:21.458 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:59:21.458 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-09-11T23:59:21.458 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:59:21.458 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:59:21.458 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-11T23:59:21.458 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:59:21.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2024-09-11T23:59:21.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2024-09-11T23:59:21.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:59:21.459 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-11T23:59:21.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:59:21.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:21.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:21.736 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:59:21.762 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-09-11T23:59:21.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:21.764 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-09-11T23:59:21.823 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-09-11T23:59:21.823 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:59:21.823 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T23:59:21.823 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T23:59:21.823 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:59:21.823 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:59:21.823 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-11T23:59:21.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:59:21.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:59:21.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:59:21.824 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-11T23:59:21.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:59:21.945 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:21 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/434138473' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:59:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:21.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:21 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/434138473' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:59:21.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:21.955 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-11T23:59:21.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:21.972 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-09-11T23:59:22.028 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:59:22.028 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-11T23:59:22.028 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:59:22.028 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T23:59:22.028 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-11T23:59:22.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:21 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/434138473' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:59:22.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:59:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:22.147 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T23:59:22.147 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:59:22.147 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-11T23:59:22.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T23:59:22.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:59:22.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T23:59:22.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T23:59:22.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T23:59:22.148 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-11T23:59:22.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:59:22.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:22.265 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:59:22.265 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-11T23:59:22.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-09-11T23:59:22.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:59:22.265 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-11T23:59:22.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:59:22.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:22.344 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-11T23:59:22.344 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:59:22.345 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:22.360 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:59:22.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:59:22.361 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:22.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-11T23:59:22.484 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:59:22.541 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-11T23:59:22.541 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-11T23:59:22.542 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/b0ed31f593f303c44cc4ce9d8ab25f59d283523d95c87932900bb12276d65312/merged 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/73f2e7d067efc8a88115377d38c2a4b3fb7eda75eb152f512a6a9252ad5b5173/merged 2024-09-11T23:59:22.543 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-09-11T23:59:22.544 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:59:22.544 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/98e2a9c70737b7538855e17f7d5fa329104ffc99235f9dd4e9388b6b9a1920d2/merged 2024-09-11T23:59:22.544 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/876f84d9d20194a1dac0aec56353c454ec6ea5ac07879f4f68ae180f7ca7510a/merged 2024-09-11T23:59:22.544 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8f9befd29af261d3ef3e37db80bf310c91eab6ce7d7b3a5bacc91a5f7a393057/merged 2024-09-11T23:59:22.544 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/00409ab6c6fa67372f1d06d53fa184935ee9cac77356c70aa3c96d61fb5bea9d/merged 2024-09-11T23:59:22.544 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/ae5757e571f064c418d9af8358e3d21eeb24ee49dfe88c7975545133e5c426c5/merged 2024-09-11T23:59:22.544 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6924ce0d6e4bdcb154b309a04a2fbda96f9b4a2383e25d7de675b5dabee071e6/merged 2024-09-11T23:59:22.544 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/25b9a3fa1368fe98d6a66742a68c3efda1a75ce2acdcff43de72af7241d0e10a/merged 2024-09-11T23:59:22.544 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8a766fca849e9f765baabad12abf3f377c3077fbc27872b0cd00981497ac2ffb/merged 2024-09-11T23:59:22.544 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-11T23:59:22.544 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:59:22.544 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:59:22.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:22.545 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-11T23:59:22.597 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:59:22.597 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/56b1cd4b-989d-4ef6-986d-f369a19625d5 --client_fs=cephfs) 2024-09-11T23:59:22.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-11T23:59:22.666 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:59:22.722 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-11T23:59:22.722 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-11T23:59:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-11T23:59:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-11T23:59:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-11T23:59:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-11T23:59:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-11T23:59:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T23:59:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T23:59:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T23:59:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T23:59:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-11T23:59:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-11T23:59:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-09-11T23:59:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/b0ed31f593f303c44cc4ce9d8ab25f59d283523d95c87932900bb12276d65312/merged 2024-09-11T23:59:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/73f2e7d067efc8a88115377d38c2a4b3fb7eda75eb152f512a6a9252ad5b5173/merged 2024-09-11T23:59:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-09-11T23:59:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:59:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/98e2a9c70737b7538855e17f7d5fa329104ffc99235f9dd4e9388b6b9a1920d2/merged 2024-09-11T23:59:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/876f84d9d20194a1dac0aec56353c454ec6ea5ac07879f4f68ae180f7ca7510a/merged 2024-09-11T23:59:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8f9befd29af261d3ef3e37db80bf310c91eab6ce7d7b3a5bacc91a5f7a393057/merged 2024-09-11T23:59:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/00409ab6c6fa67372f1d06d53fa184935ee9cac77356c70aa3c96d61fb5bea9d/merged 2024-09-11T23:59:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/ae5757e571f064c418d9af8358e3d21eeb24ee49dfe88c7975545133e5c426c5/merged 2024-09-11T23:59:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6924ce0d6e4bdcb154b309a04a2fbda96f9b4a2383e25d7de675b5dabee071e6/merged 2024-09-11T23:59:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/25b9a3fa1368fe98d6a66742a68c3efda1a75ce2acdcff43de72af7241d0e10a/merged 2024-09-11T23:59:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8a766fca849e9f765baabad12abf3f377c3077fbc27872b0cd00981497ac2ffb/merged 2024-09-11T23:59:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-11T23:59:22.726 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:59:22.726 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:59:22.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:22.726 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-11T23:59:22.727 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2024-09-11T23:59:22.726+0000 7f8565927480 -1 init, newargv = 0x5619a114ba50 newargc=15 2024-09-11T23:59:22.727 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[85882]: starting ceph client 2024-09-11T23:59:22.748 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[85882]: starting fuse 2024-09-11T23:59:22.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:22 smithi006 ceph-mon[30947]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:59:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:22 smithi134 ceph-mon[34893]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:59:23.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:22 smithi039 ceph-mon[34543]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-11T23:59:23.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-11T23:59:23.878 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:59:23.940 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-11T23:59:23.940 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-11T23:59:23.940 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-11T23:59:23.940 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-11T23:59:23.940 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-11T23:59:23.940 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-11T23:59:23.940 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-11T23:59:23.940 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-11T23:59:23.940 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T23:59:23.941 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/b0ed31f593f303c44cc4ce9d8ab25f59d283523d95c87932900bb12276d65312/merged 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/73f2e7d067efc8a88115377d38c2a4b3fb7eda75eb152f512a6a9252ad5b5173/merged 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/98e2a9c70737b7538855e17f7d5fa329104ffc99235f9dd4e9388b6b9a1920d2/merged 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/876f84d9d20194a1dac0aec56353c454ec6ea5ac07879f4f68ae180f7ca7510a/merged 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8f9befd29af261d3ef3e37db80bf310c91eab6ce7d7b3a5bacc91a5f7a393057/merged 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/00409ab6c6fa67372f1d06d53fa184935ee9cac77356c70aa3c96d61fb5bea9d/merged 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/ae5757e571f064c418d9af8358e3d21eeb24ee49dfe88c7975545133e5c426c5/merged 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6924ce0d6e4bdcb154b309a04a2fbda96f9b4a2383e25d7de675b5dabee071e6/merged 2024-09-11T23:59:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/25b9a3fa1368fe98d6a66742a68c3efda1a75ce2acdcff43de72af7241d0e10a/merged 2024-09-11T23:59:23.943 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8a766fca849e9f765baabad12abf3f377c3077fbc27872b0cd00981497ac2ffb/merged 2024-09-11T23:59:23.943 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-11T23:59:23.943 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:59:23.943 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:59:23.943 INFO:teuthology.orchestra.run.smithi006.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:23.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:23.944 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-11T23:59:24.003 INFO:teuthology.orchestra.run.smithi006.stdout:120 2024-09-11T23:59:24.004 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-11T23:59:24.004 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:59:24.004 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2024-09-11T23:59:24.004 DEBUG:teuthology.orchestra.run.smithi006:> import re 2024-09-11T23:59:24.004 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-09-11T23:59:24.004 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2024-09-11T23:59:24.004 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-11T23:59:24.004 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:59:24.005 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2024-09-11T23:59:24.006 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2024-09-11T23:59:24.006 DEBUG:teuthology.orchestra.run.smithi006:> return f 2024-09-11T23:59:24.006 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:59:24.006 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-11T23:59:24.006 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2024-09-11T23:59:24.006 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-09-11T23:59:24.133 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.85882.asok 2024-09-11T23:59:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:24.144 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.85882.asok 2024-09-11T23:59:24.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:24.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.85882.asok status 2024-09-11T23:59:24.286 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-11T23:59:24.286 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2024-09-11T23:59:24.286 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:59:24.286 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "85882", 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/volumes/qa/sv_0/56b1cd4b-989d-4ef6-986d-f369a19625d5" 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 15327, 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-09-11T23:59:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 15327 2024-09-11T23:59:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-11T23:59:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-11T23:59:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-11T23:59:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:59:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 558730673 2024-09-11T23:59:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-11T23:59:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-11T23:59:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-11T23:59:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-11T23:59:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:59:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 558730673 2024-09-11T23:59:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-11T23:59:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.15327 192.168.0.1:0/558730673", 2024-09-11T23:59:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/558730673", 2024-09-11T23:59:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 5, 2024-09-11T23:59:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 27, 2024-09-11T23:59:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 88, 2024-09-11T23:59:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:59:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2024-09-11T23:59:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2024-09-11T23:59:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-11T23:59:24.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:24.295 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2024-09-11T23:59:24.295 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:24.312 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2024-09-11T23:59:24.312 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:24.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:24.313 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:24.387 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T23:59:24.397 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T23:59:24.397 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2024-09-11T23:59:24.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-11T23:59:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.535+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1541381226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b28107820 msgr2=0x7f2b28109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.535+0000 7f2b2f03c640 1 --2- 172.21.15.6:0/1541381226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b28107820 0x7f2b28109c90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009ca0 tx=0x7f2b2002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.535+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1541381226 shutdown_connections 2024-09-11T23:59:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.535+0000 7f2b2f03c640 1 --2- 172.21.15.6:0/1541381226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b28107820 0x7f2b28109c90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.535+0000 7f2b2f03c640 1 --2- 172.21.15.6:0/1541381226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b28104ef0 0x7f2b281072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.535+0000 7f2b2f03c640 1 --2- 172.21.15.6:0/1541381226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b281025c0 0x7f2b281049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.535+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1541381226 >> 172.21.15.6:0/1541381226 conn(0x7f2b280fc1c0 msgr2=0x7f2b280fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.535+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1541381226 shutdown_connections 2024-09-11T23:59:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.535+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1541381226 wait complete. 2024-09-11T23:59:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.536+0000 7f2b2f03c640 1 Processor -- start 2024-09-11T23:59:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.536+0000 7f2b2f03c640 1 -- start start 2024-09-11T23:59:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.536+0000 7f2b2f03c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b281025c0 0x7f2b28197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.536+0000 7f2b2f03c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b28104ef0 0x7f2b28198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.536+0000 7f2b2f03c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b28107820 0x7f2b2819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.536+0000 7f2b2f03c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2810d690 con 0x7f2b281025c0 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.536+0000 7f2b2f03c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2810d510 con 0x7f2b28107820 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.536+0000 7f2b2f03c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2810d810 con 0x7f2b28104ef0 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.536+0000 7f2b2cdd8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b281025c0 0x7f2b28197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.536+0000 7f2b2cdd8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b281025c0 0x7f2b28197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51894/0 (socket says 172.21.15.6:51894) 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.536+0000 7f2b2cdd8640 1 -- 172.21.15.6:0/1209088043 learned_addr learned my addr 172.21.15.6:0/1209088043 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b2d5d9640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b28107820 0x7f2b2819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b27fff640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b28104ef0 0x7f2b28198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b2cdd8640 1 -- 172.21.15.6:0/1209088043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b28104ef0 msgr2=0x7f2b28198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b2cdd8640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b28104ef0 0x7f2b28198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b2cdd8640 1 -- 172.21.15.6:0/1209088043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b28107820 msgr2=0x7f2b2819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b2cdd8640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b28107820 0x7f2b2819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b2cdd8640 1 -- 172.21.15.6:0/1209088043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2819f9f0 con 0x7f2b281025c0 2024-09-11T23:59:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b2d5d9640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b28107820 0x7f2b2819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b2cdd8640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b281025c0 0x7f2b28197dd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00e9f0 tx=0x7f2b1c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b25ffb640 1 -- 172.21.15.6:0/1209088043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c00cd80 con 0x7f2b281025c0 2024-09-11T23:59:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b25ffb640 1 -- 172.21.15.6:0/1209088043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b1c0108e0 con 0x7f2b281025c0 2024-09-11T23:59:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1209088043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2819fce0 con 0x7f2b281025c0 2024-09-11T23:59:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b25ffb640 1 -- 172.21.15.6:0/1209088043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c018920 con 0x7f2b281025c0 2024-09-11T23:59:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.537+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1209088043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b281a01d0 con 0x7f2b281025c0 2024-09-11T23:59:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.538+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1209088043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b280fdcb0 con 0x7f2b281025c0 2024-09-11T23:59:24.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.540+0000 7f2b25ffb640 1 -- 172.21.15.6:0/1209088043 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f2b1c010a90 con 0x7f2b281025c0 2024-09-11T23:59:24.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.540+0000 7f2b25ffb640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2b180a2c00 0x7f2b180a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.541+0000 7f2b27fff640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2b180a2c00 0x7f2b180a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.541+0000 7f2b25ffb640 1 -- 172.21.15.6:0/1209088043 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f2b1c0cf780 con 0x7f2b281025c0 2024-09-11T23:59:24.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.541+0000 7f2b27fff640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2b180a2c00 0x7f2b180a50c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2b140095f0 tx=0x7f2b14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:24.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.544+0000 7f2b25ffb640 1 -- 172.21.15.6:0/1209088043 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b1c09c380 con 0x7f2b281025c0 2024-09-11T23:59:24.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:24.759+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1209088043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f2b2802d7c0 con 0x7f2b281025c0 2024-09-11T23:59:24.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:24 smithi006 ceph-mon[30947]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:24.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:24 smithi134 ceph-mon[34893]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:25.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:24 smithi039 ceph-mon[34543]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.703+0000 7f2b25ffb640 1 -- 172.21.15.6:0/1209088043 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f2b1c09bc80 con 0x7f2b281025c0 2024-09-11T23:59:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.705+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1209088043 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2b180a2c00 msgr2=0x7f2b180a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.705+0000 7f2b2f03c640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2b180a2c00 0x7f2b180a50c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2b140095f0 tx=0x7f2b14005f90 comp rx=0 tx=0).stop 2024-09-11T23:59:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.705+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1209088043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b281025c0 msgr2=0x7f2b28197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.705+0000 7f2b2f03c640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b281025c0 0x7f2b28197dd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00e9f0 tx=0x7f2b1c00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.705+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1209088043 shutdown_connections 2024-09-11T23:59:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.705+0000 7f2b2f03c640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2b180a2c00 0x7f2b180a50c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.705+0000 7f2b2f03c640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b28107820 0x7f2b2819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.705+0000 7f2b2f03c640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b28104ef0 0x7f2b28198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.705+0000 7f2b2f03c640 1 --2- 172.21.15.6:0/1209088043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b281025c0 0x7f2b28197dd0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.705+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1209088043 >> 172.21.15.6:0/1209088043 conn(0x7f2b280fc1c0 msgr2=0x7f2b28102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.705+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1209088043 shutdown_connections 2024-09-11T23:59:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.705+0000 7f2b2f03c640 1 -- 172.21.15.6:0/1209088043 wait complete. 2024-09-11T23:59:25.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-11T23:59:25.740 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:25 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1209088043' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-11T23:59:25.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.824+0000 7f66f6391640 1 -- 172.21.15.6:0/3185686368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66f0101c60 msgr2=0x7f66f01020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.824+0000 7f66f6391640 1 --2- 172.21.15.6:0/3185686368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66f0101c60 0x7f66f01020e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009900 tx=0x7f66e402a410 comp rx=0 tx=0).stop 2024-09-11T23:59:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.824+0000 7f66f6391640 1 -- 172.21.15.6:0/3185686368 shutdown_connections 2024-09-11T23:59:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.824+0000 7f66f6391640 1 --2- 172.21.15.6:0/3185686368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66f0102620 0x7f66f0108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.824+0000 7f66f6391640 1 --2- 172.21.15.6:0/3185686368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66f0101c60 0x7f66f01020e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.824+0000 7f66f6391640 1 --2- 172.21.15.6:0/3185686368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f0100a70 0x7f66f0100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.824+0000 7f66f6391640 1 -- 172.21.15.6:0/3185686368 >> 172.21.15.6:0/3185686368 conn(0x7f66f00fc1f0 msgr2=0x7f66f00fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.824+0000 7f66f6391640 1 -- 172.21.15.6:0/3185686368 shutdown_connections 2024-09-11T23:59:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.824+0000 7f66f6391640 1 -- 172.21.15.6:0/3185686368 wait complete. 2024-09-11T23:59:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.825+0000 7f66f6391640 1 Processor -- start 2024-09-11T23:59:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.825+0000 7f66f6391640 1 -- start start 2024-09-11T23:59:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.825+0000 7f66f6391640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66f0100a70 0x7f66f010b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.825+0000 7f66f6391640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f0101c60 0x7f66f0109a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.825+0000 7f66f6391640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66f0102620 0x7f66f0109f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.825+0000 7f66f6391640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f66f010d750 con 0x7f66f0100a70 2024-09-11T23:59:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.825+0000 7f66f6391640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f66f010d5d0 con 0x7f66f0101c60 2024-09-11T23:59:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.825+0000 7f66f6391640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f66f010d8d0 con 0x7f66f0102620 2024-09-11T23:59:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.825+0000 7f66effff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66f0100a70 0x7f66f010b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.825+0000 7f66effff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66f0100a70 0x7f66f010b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51924/0 (socket says 172.21.15.6:51924) 2024-09-11T23:59:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.825+0000 7f66effff640 1 -- 172.21.15.6:0/3039290737 learned_addr learned my addr 172.21.15.6:0/3039290737 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66effff640 1 -- 172.21.15.6:0/3039290737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66f0102620 msgr2=0x7f66f0109f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66f492e640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66f0102620 0x7f66f0109f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66ef7fe640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f0101c60 0x7f66f0109a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66effff640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66f0102620 0x7f66f0109f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66effff640 1 -- 172.21.15.6:0/3039290737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f0101c60 msgr2=0x7f66f0109a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66effff640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f0101c60 0x7f66f0109a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66effff640 1 -- 172.21.15.6:0/3039290737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f010a800 con 0x7f66f0100a70 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66f492e640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66f0102620 0x7f66f0109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66ef7fe640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f0101c60 0x7f66f0109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66effff640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66f0100a70 0x7f66f010b3f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f66e000d770 tx=0x7f66e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66ed7fa640 1 -- 172.21.15.6:0/3039290737 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0017070 con 0x7f66f0100a70 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66ed7fa640 1 -- 172.21.15.6:0/3039290737 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66e0009c30 con 0x7f66f0100a70 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66ed7fa640 1 -- 172.21.15.6:0/3039290737 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0003d00 con 0x7f66f0100a70 2024-09-11T23:59:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66f6391640 1 -- 172.21.15.6:0/3039290737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f01a1f30 con 0x7f66f0100a70 2024-09-11T23:59:25.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.826+0000 7f66f6391640 1 -- 172.21.15.6:0/3039290737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f01a2340 con 0x7f66f0100a70 2024-09-11T23:59:25.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.827+0000 7f66f6391640 1 -- 172.21.15.6:0/3039290737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f0107f20 con 0x7f66f0100a70 2024-09-11T23:59:25.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.828+0000 7f66ed7fa640 1 -- 172.21.15.6:0/3039290737 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f66e0003ea0 con 0x7f66f0100a70 2024-09-11T23:59:25.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.829+0000 7f66ed7fa640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f66d80a2b80 0x7f66d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:25.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.829+0000 7f66ef7fe640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f66d80a2b80 0x7f66d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:25.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.829+0000 7f66ed7fa640 1 -- 172.21.15.6:0/3039290737 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f66e00cf120 con 0x7f66f0100a70 2024-09-11T23:59:25.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.830+0000 7f66ef7fe640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f66d80a2b80 0x7f66d80a5040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66e4005ab0 tx=0x7f66e4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:25.832+0000 7f66ed7fa640 1 -- 172.21.15.6:0/3039290737 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66e009bd20 con 0x7f66f0100a70 2024-09-11T23:59:26.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.032+0000 7f66f6391640 1 -- 172.21.15.6:0/3039290737 --> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f66f0063180 con 0x7f66d80a2b80 2024-09-11T23:59:26.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:25 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1209088043' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-11T23:59:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.052+0000 7f66ed7fa640 1 -- 172.21.15.6:0/3039290737 <== mgr.14150 v2:172.21.15.6:6800/306795778 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f66f0063180 con 0x7f66d80a2b80 2024-09-11T23:59:26.052 INFO:teuthology.orchestra.run.smithi006.stdout:{} 2024-09-11T23:59:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.054+0000 7f66f6391640 1 -- 172.21.15.6:0/3039290737 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f66d80a2b80 msgr2=0x7f66d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.054+0000 7f66f6391640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f66d80a2b80 0x7f66d80a5040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66e4005ab0 tx=0x7f66e4000bc0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.054+0000 7f66f6391640 1 -- 172.21.15.6:0/3039290737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66f0100a70 msgr2=0x7f66f010b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.054+0000 7f66f6391640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66f0100a70 0x7f66f010b3f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f66e000d770 tx=0x7f66e000dc30 comp rx=0 tx=0).stop 2024-09-11T23:59:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.054+0000 7f66f6391640 1 -- 172.21.15.6:0/3039290737 shutdown_connections 2024-09-11T23:59:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.054+0000 7f66f6391640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f66d80a2b80 0x7f66d80a5040 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.054+0000 7f66f6391640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66f0102620 0x7f66f0109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.054+0000 7f66f6391640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f0101c60 0x7f66f0109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.054+0000 7f66f6391640 1 --2- 172.21.15.6:0/3039290737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66f0100a70 0x7f66f010b3f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.054+0000 7f66f6391640 1 -- 172.21.15.6:0/3039290737 >> 172.21.15.6:0/3039290737 conn(0x7f66f00fc1f0 msgr2=0x7f66f01050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.054+0000 7f66f6391640 1 -- 172.21.15.6:0/3039290737 shutdown_connections 2024-09-11T23:59:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-11T23:59:26.054+0000 7f66f6391640 1 -- 172.21.15.6:0/3039290737 wait complete. 2024-09-11T23:59:26.064 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-11T23:59:26.076 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-11T23:59:26.152 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2024-09-11T23:59:26.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-11T23:59:26.154 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T23:59:26.170 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-11T23:59:26.171 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T23:59:26.171 INFO:tasks.workunit:timeout=3h 2024-09-11T23:59:26.171 INFO:tasks.workunit:cleanup=True 2024-09-11T23:59:26.172 DEBUG:teuthology.orchestra.run.smithi006:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:26.189 INFO:teuthology.orchestra.run.smithi006.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:26.189 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-11T23:59:26.190 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-11T23:59:26.190 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:59:26.190 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-11T23:59:26.190 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-11 23:57:46.388802061 +0000 2024-09-11T23:59:26.190 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-11 23:57:46.388802061 +0000 2024-09-11T23:59:26.190 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-11 23:59:24.384598969 +0000 2024-09-11T23:59:26.190 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-09-11T23:59:26.190 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:26.190 DEBUG:teuthology.orchestra.run.smithi006:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-11T23:59:26.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:25 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1209088043' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-11T23:59:26.263 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-11T23:59:26.320 INFO:tasks.workunit.client.0.smithi006.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T23:59:26.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:59:26 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:59:26.037+0000 7fa4d9299640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:26.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:59:26 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:59:26.037+0000 7fa4d9299640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:26.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:59:26 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:59:26.037+0000 7fa4d9299640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:26.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:59:26 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:59:26.037+0000 7fa4d9299640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:26.369 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 11 23:59:26 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-11T23:59:26.037+0000 7fa4d9299640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:27.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:26 smithi039 ceph-mon[34543]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-11T23:59:27.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:26 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1209088043' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T23:59:27.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:26 smithi039 ceph-mon[34543]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:59:27.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:26 smithi006 ceph-mon[30947]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-11T23:59:27.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:26 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1209088043' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T23:59:27.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:26 smithi006 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:59:27.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:26 smithi134 ceph-mon[34893]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-11T23:59:27.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:26 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1209088043' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T23:59:27.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:26 smithi134 ceph-mon[34893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:59:28.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:27 smithi039 ceph-mon[34543]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:28.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:27 smithi006 ceph-mon[30947]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:28.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:27 smithi134 ceph-mon[34893]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:29.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:28 smithi039 ceph-mon[34543]: pgmap v361: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-11T23:59:29.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:28 smithi039 ceph-mon[34543]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-11T23:59:29.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:28 smithi006 ceph-mon[30947]: pgmap v361: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-11T23:59:29.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:28 smithi006 ceph-mon[30947]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-11T23:59:29.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:28 smithi134 ceph-mon[34893]: pgmap v361: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-11T23:59:29.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:28 smithi134 ceph-mon[34893]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-11T23:59:31.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:30 smithi039 ceph-mon[34543]: pgmap v362: 129 pgs: 129 active+clean; 648 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-11T23:59:31.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:30 smithi006 ceph-mon[30947]: pgmap v362: 129 pgs: 129 active+clean; 648 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-11T23:59:31.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:30 smithi134 ceph-mon[34893]: pgmap v362: 129 pgs: 129 active+clean; 648 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-11T23:59:33.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:32 smithi039 ceph-mon[34543]: pgmap v363: 129 pgs: 129 active+clean; 659 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-09-11T23:59:33.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:32 smithi006 ceph-mon[30947]: pgmap v363: 129 pgs: 129 active+clean; 659 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-09-11T23:59:33.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:32 smithi134 ceph-mon[34893]: pgmap v363: 129 pgs: 129 active+clean; 659 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-09-11T23:59:35.005 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:34 smithi134 ceph-mon[34893]: pgmap v364: 129 pgs: 129 active+clean; 659 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-11T23:59:35.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:34 smithi039 ceph-mon[34543]: pgmap v364: 129 pgs: 129 active+clean; 659 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-11T23:59:35.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:34 smithi006 ceph-mon[30947]: pgmap v364: 129 pgs: 129 active+clean; 659 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-11T23:59:37.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:36 smithi039 ceph-mon[34543]: pgmap v365: 129 pgs: 129 active+clean; 659 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-11T23:59:37.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:36 smithi006 ceph-mon[30947]: pgmap v365: 129 pgs: 129 active+clean; 659 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-11T23:59:37.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:36 smithi134 ceph-mon[34893]: pgmap v365: 129 pgs: 129 active+clean; 659 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-11T23:59:39.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:38 smithi039 ceph-mon[34543]: pgmap v366: 129 pgs: 129 active+clean; 666 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-09-11T23:59:39.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:38 smithi006 ceph-mon[30947]: pgmap v366: 129 pgs: 129 active+clean; 666 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-09-11T23:59:39.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:38 smithi134 ceph-mon[34893]: pgmap v366: 129 pgs: 129 active+clean; 666 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-09-11T23:59:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.298+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/829818240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe08102d50 msgr2=0x7fbe081031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.298+0000 7fbe0d7cf640 1 --2- 172.21.15.6:0/829818240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe08102d50 0x7fbe081031d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009900 tx=0x7fbdfc02a410 comp rx=0 tx=0).stop 2024-09-11T23:59:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.299+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/829818240 shutdown_connections 2024-09-11T23:59:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.299+0000 7fbe0d7cf640 1 --2- 172.21.15.6:0/829818240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe08103710 0x7fbe08109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.299+0000 7fbe0d7cf640 1 --2- 172.21.15.6:0/829818240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe08102d50 0x7fbe081031d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.299+0000 7fbe0d7cf640 1 --2- 172.21.15.6:0/829818240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe08101b60 0x7fbe08101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.299+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/829818240 >> 172.21.15.6:0/829818240 conn(0x7fbe080fd2e0 msgr2=0x7fbe080ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.299+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/829818240 shutdown_connections 2024-09-11T23:59:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.299+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/829818240 wait complete. 2024-09-11T23:59:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.299+0000 7fbe0d7cf640 1 Processor -- start 2024-09-11T23:59:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.299+0000 7fbe0d7cf640 1 -- start start 2024-09-11T23:59:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe0d7cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe08101b60 0x7fbe08075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe0d7cf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe08102d50 0x7fbe080745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe0d7cf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe08103710 0x7fbe08074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe0d7cf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0810d670 con 0x7fbe08101b60 2024-09-11T23:59:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe0d7cf640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0810d4f0 con 0x7fbe08102d50 2024-09-11T23:59:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe0d7cf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0810d7f0 con 0x7fbe08103710 2024-09-11T23:59:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe08101b60 0x7fbe08075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe08101b60 0x7fbe08075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39774/0 (socket says 172.21.15.6:39774) 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe06ffd640 1 -- 172.21.15.6:0/2238670511 learned_addr learned my addr 172.21.15.6:0/2238670511 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe067fc640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe08102d50 0x7fbe080745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe077fe640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe08103710 0x7fbe08074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe06ffd640 1 -- 172.21.15.6:0/2238670511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe08103710 msgr2=0x7fbe08074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe08103710 0x7fbe08074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe06ffd640 1 -- 172.21.15.6:0/2238670511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe08102d50 msgr2=0x7fbe080745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe08102d50 0x7fbe080745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe06ffd640 1 -- 172.21.15.6:0/2238670511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe080753b0 con 0x7fbe08101b60 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.300+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe08101b60 0x7fbe08075fa0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800ea80 tx=0x7fbdf800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.301+0000 7fbdeffff640 1 -- 172.21.15.6:0/2238670511 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800ce40 con 0x7fbe08101b60 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.301+0000 7fbdeffff640 1 -- 172.21.15.6:0/2238670511 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdf8011920 con 0x7fbe08101b60 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.301+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/2238670511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe081a1e50 con 0x7fbe08101b60 2024-09-11T23:59:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.301+0000 7fbdeffff640 1 -- 172.21.15.6:0/2238670511 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf801aaa0 con 0x7fbe08101b60 2024-09-11T23:59:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.301+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/2238670511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe081a2250 con 0x7fbe08101b60 2024-09-11T23:59:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.303+0000 7fbdeffff640 1 -- 172.21.15.6:0/2238670511 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 137883+0+0 (secure 0 0 0) 0x7fbdf8011ad0 con 0x7fbe08101b60 2024-09-11T23:59:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.303+0000 7fbe10646740 1 Processor -- start 2024-09-11T23:59:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.303+0000 7fbe10646740 1 -- start start 2024-09-11T23:59:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.303+0000 7fbe10646740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2818da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.303+0000 7fbe10646740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e28192e0 0x55e6e281dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe10646740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e281e370 0x55e6e2820830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe10646740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e6e277c2f0 con 0x55e6e28189a0 2024-09-11T23:59:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe10646740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e6e2724270 con 0x55e6e281e370 2024-09-11T23:59:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe10646740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e6e27782b0 con 0x55e6e28192e0 2024-09-11T23:59:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe077fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2818da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe077fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2818da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39780/0 (socket says 172.21.15.6:39780) 2024-09-11T23:59:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe077fe640 1 -- 172.21.15.6:0/4108261614 learned_addr learned my addr 172.21.15.6:0/4108261614 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/4108261614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e28192e0 0x55e6e281dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbdeffff640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbdf00a2c10 0x7fbdf00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe067fc640 1 --2- 172.21.15.6:0/4108261614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e281e370 0x55e6e2820830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe077fe640 1 -- 172.21.15.6:0/4108261614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e28192e0 msgr2=0x55e6e281dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe077fe640 1 --2- 172.21.15.6:0/4108261614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e28192e0 0x55e6e281dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe077fe640 1 -- 172.21.15.6:0/4108261614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e281e370 msgr2=0x55e6e2820830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe077fe640 1 --2- 172.21.15.6:0/4108261614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e281e370 0x55e6e2820830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe077fe640 1 -- 172.21.15.6:0/4108261614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6e2723340 con 0x55e6e28189a0 2024-09-11T23:59:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe077fe640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbdf00a2c10 0x7fbdf00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbdeffff640 1 -- 172.21.15.6:0/2238670511 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fbdf80cfb50 con 0x7fbe08101b60 2024-09-11T23:59:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.304+0000 7fbe077fe640 1 --2- 172.21.15.6:0/4108261614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2818da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000cd60 tx=0x7fbe0000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98386ae0df026fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbded7fa640 1 -- 172.21.15.6:0/4108261614 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe00022070 con 0x55e6e28189a0 2024-09-11T23:59:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbded7fa640 1 -- 172.21.15.6:0/4108261614 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe00018070 con 0x55e6e28189a0 2024-09-11T23:59:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbded7fa640 1 -- 172.21.15.6:0/4108261614 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0001cab0 con 0x55e6e28189a0 2024-09-11T23:59:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbe077fe640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbdf00a2c10 0x7fbdf00a50d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbe0001f000 tx=0x7fbe00020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbe10646740 1 -- 172.21.15.6:0/4108261614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 msgr2=0x55e6e2818da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbe10646740 1 --2- 172.21.15.6:0/4108261614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2818da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000cd60 tx=0x7fbe0000e720 comp rx=0 tx=0).stop 2024-09-11T23:59:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbe10646740 1 -- 172.21.15.6:0/4108261614 shutdown_connections 2024-09-11T23:59:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbe10646740 1 --2- 172.21.15.6:0/4108261614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e281e370 0x55e6e2820830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbe10646740 1 --2- 172.21.15.6:0/4108261614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e28192e0 0x55e6e281dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbe10646740 1 --2- 172.21.15.6:0/4108261614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2818da0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbe10646740 1 -- 172.21.15.6:0/4108261614 >> 172.21.15.6:0/4108261614 conn(0x55e6e2814010 msgr2=0x55e6e2814410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbe10646740 1 -- 172.21.15.6:0/4108261614 shutdown_connections 2024-09-11T23:59:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.305+0000 7fbe10646740 1 -- 172.21.15.6:0/4108261614 wait complete. 2024-09-11T23:59:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe10646740 1 -- start start 2024-09-11T23:59:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe10646740 1 Processor -- start 2024-09-11T23:59:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe10646740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2822b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe10646740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e28192e0 0x55e6e28230a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe10646740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e281e370 0x55e6e282a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe10646740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e6e2821340 con 0x55e6e28189a0 2024-09-11T23:59:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe10646740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e6e2705290 con 0x55e6e28192e0 2024-09-11T23:59:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe10646740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e6e28214c0 con 0x55e6e281e370 2024-09-11T23:59:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe10646740 10 client.0 _ll_register_callbacks cb 0x55e6e2736140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2822b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2822b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39784/0 (socket says 172.21.15.6:39784) 2024-09-11T23:59:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe06ffd640 1 -- 172.21.15.6:0/4287980653 learned_addr learned my addr 172.21.15.6:0/4287980653 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe077fe640 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e281e370 0x55e6e282a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.306+0000 7fbe06ffd640 1 -- 172.21.15.6:0/4287980653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e281e370 msgr2=0x55e6e282a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e281e370 0x55e6e282a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbe067fc640 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e28192e0 0x55e6e28230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbe06ffd640 1 -- 172.21.15.6:0/4287980653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e28192e0 msgr2=0x55e6e28230a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e28192e0 0x55e6e28230a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbe06ffd640 1 -- 172.21.15.6:0/4287980653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6e248f210 con 0x55e6e28189a0 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2822b60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8098860 tx=0x7fbdf809b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8facfa798c2ef28a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbdeaff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbdeaff5640 1 -- 172.21.15.6:0/4287980653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf801ae40 con 0x55e6e28189a0 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbdeaff5640 1 -- 172.21.15.6:0/4287980653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fbdf8004b60 con 0x55e6e28189a0 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbe10646740 1 -- 172.21.15.6:0/4287980653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe00018070 con 0x55e6e28189a0 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbdeaff5640 1 -- 172.21.15.6:0/4287980653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbdf809c590 con 0x55e6e28189a0 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbe10646740 10 client.15357 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbe10646740 1 -- 172.21.15.6:0/4287980653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e6e255b620 con 0x55e6e28189a0 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbdeaff5640 1 -- 172.21.15.6:0/4287980653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe00018070 con 0x55e6e28189a0 2024-09-11T23:59:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.307+0000 7fbdeaff5640 1 -- 172.21.15.6:0/4287980653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fbdf8022030 con 0x55e6e28189a0 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.308+0000 7fbe10646740 10 client.15357 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.308+0000 7fbe10646740 10 client.15357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.308+0000 7fbe10646740 20 client.15357 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.308+0000 7fbe10646740 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e6e282e7d0 0x55e6e2830c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.308+0000 7fbe10646740 4 client.15357 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.308+0000 7fbe10646740 1 -- 172.21.15.6:0/4287980653 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6e2789a20 con 0x55e6e282e7d0 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.308+0000 7fbe067fc640 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e6e282e7d0 0x55e6e2830c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.308+0000 7fbe067fc640 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e6e282e7d0 0x55e6e2830c00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d32baa59e2ceb51d server_cookie=40273091992fc6f6 in_seq=0 out_seq=0 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.308+0000 7fbdeaff5640 10 client.15357 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbdeaff5640 1 -- 172.21.15.6:0/4287980653 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6e2789a20 con 0x55e6e282e7d0 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbdeaff5640 10 client.15357 handle_command_reply: tid=0 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbe10646740 1 client.15357 shutdown 2024-09-11T23:59:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbe10646740 1 -- 172.21.15.6:0/4287980653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 msgr2=0x55e6e2822b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbe10646740 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2822b60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8098860 tx=0x7fbdf809b8b0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbe10646740 1 -- 172.21.15.6:0/4287980653 shutdown_connections 2024-09-11T23:59:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbe10646740 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e6e282e7d0 0x55e6e2830c00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbe10646740 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e281e370 0x55e6e282a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbe10646740 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e28192e0 0x55e6e28230a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbdeaff5640 0 client.15357 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-11T23:59:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbe10646740 1 --2- 172.21.15.6:0/4287980653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2822b60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbe10646740 1 -- 172.21.15.6:0/4287980653 >> 172.21.15.6:0/4287980653 conn(0x55e6e2814010 msgr2=0x55e6e2815820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbe10646740 1 -- 172.21.15.6:0/4287980653 shutdown_connections 2024-09-11T23:59:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbe10646740 1 -- 172.21.15.6:0/4287980653 wait complete. 2024-09-11T23:59:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.309+0000 7fbe10646740 20 client.15357 trim_cache size 0 max 16384 2024-09-11T23:59:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe10646740 1 Processor -- start 2024-09-11T23:59:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe10646740 1 -- start start 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe10646740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e281daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe10646740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e28192e0 0x55e6e282a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe10646740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e281e370 0x55e6e2815400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe10646740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbe081ac710 con 0x55e6e28189a0 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe10646740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbe081ae250 con 0x55e6e28192e0 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe10646740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe081acde0 con 0x55e6e281e370 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e281daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e281daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39786/0 (socket says 172.21.15.6:39786) 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe06ffd640 1 -- 172.21.15.6:0/1688885974 learned_addr learned my addr 172.21.15.6:0/1688885974 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe067fc640 1 --2- 172.21.15.6:0/1688885974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e28192e0 0x55e6e282a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe06ffd640 1 -- 172.21.15.6:0/1688885974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e281e370 msgr2=0x55e6e2815400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/1688885974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e281e370 0x55e6e2815400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe06ffd640 1 -- 172.21.15.6:0/1688885974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e28192e0 msgr2=0x55e6e282a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/1688885974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e28192e0 0x55e6e282a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.324+0000 7fbe06ffd640 1 -- 172.21.15.6:0/1688885974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6e2822ff0 con 0x55e6e28189a0 2024-09-11T23:59:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/1688885974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e281daa0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8098810 tx=0x7fbdf80cfdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c93c0131e072e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbdecff9640 1 -- 172.21.15.6:0/1688885974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8066070 con 0x55e6e28189a0 2024-09-11T23:59:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbdecff9640 1 -- 172.21.15.6:0/1688885974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdf80b8050 con 0x55e6e28189a0 2024-09-11T23:59:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbdecff9640 1 -- 172.21.15.6:0/1688885974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf809b610 con 0x55e6e28189a0 2024-09-11T23:59:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbe10646740 1 -- 172.21.15.6:0/1688885974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 msgr2=0x55e6e281daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbe10646740 1 --2- 172.21.15.6:0/1688885974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e281daa0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8098810 tx=0x7fbdf80cfdd0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbe10646740 1 -- 172.21.15.6:0/1688885974 shutdown_connections 2024-09-11T23:59:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbe10646740 1 --2- 172.21.15.6:0/1688885974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e281e370 0x55e6e2815400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbe10646740 1 --2- 172.21.15.6:0/1688885974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e28192e0 0x55e6e282a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbe10646740 1 --2- 172.21.15.6:0/1688885974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e281daa0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbe10646740 1 -- 172.21.15.6:0/1688885974 >> 172.21.15.6:0/1688885974 conn(0x55e6e2814010 msgr2=0x55e6e28131c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbe10646740 1 -- 172.21.15.6:0/1688885974 shutdown_connections 2024-09-11T23:59:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.325+0000 7fbe10646740 1 -- 172.21.15.6:0/1688885974 wait complete. 2024-09-11T23:59:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe10646740 1 -- start start 2024-09-11T23:59:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe10646740 1 Processor -- start 2024-09-11T23:59:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe10646740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2827bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe10646740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e28192e0 0x55e6e28280f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe10646740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e281e370 0x55e6e28290b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe10646740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbe081adb80 con 0x55e6e28189a0 2024-09-11T23:59:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe10646740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbe081ad4b0 con 0x55e6e281e370 2024-09-11T23:59:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe10646740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe081aa6f0 con 0x55e6e28192e0 2024-09-11T23:59:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe10646740 10 client.0 _ll_register_callbacks cb 0x7fbdf809b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2827bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2827bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39802/0 (socket says 172.21.15.6:39802) 2024-09-11T23:59:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe06ffd640 1 -- 172.21.15.6:0/2723281029 learned_addr learned my addr 172.21.15.6:0/2723281029 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe067fc640 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e28192e0 0x55e6e28280f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe077fe640 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e281e370 0x55e6e28290b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe06ffd640 1 -- 172.21.15.6:0/2723281029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e28192e0 msgr2=0x55e6e28280f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e28192e0 0x55e6e28280f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe06ffd640 1 -- 172.21.15.6:0/2723281029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e281e370 msgr2=0x55e6e28290b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e281e370 0x55e6e28290b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe06ffd640 1 -- 172.21.15.6:0/2723281029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6e28296c0 con 0x55e6e28189a0 2024-09-11T23:59:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe077fe640 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e281e370 0x55e6e28290b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.326+0000 7fbe067fc640 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e28192e0 0x55e6e28280f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbe06ffd640 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2827bb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80a45d0 tx=0x7fbdf80cfe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfe37dd2e12dce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbdeaff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbdeaff5640 1 -- 172.21.15.6:0/2723281029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8066070 con 0x55e6e28189a0 2024-09-11T23:59:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbdeaff5640 1 -- 172.21.15.6:0/2723281029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fbdf809b2e0 con 0x55e6e28189a0 2024-09-11T23:59:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbe10646740 1 -- 172.21.15.6:0/2723281029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdf80b8050 con 0x55e6e28189a0 2024-09-11T23:59:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbdeaff5640 1 -- 172.21.15.6:0/2723281029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbdf809be90 con 0x55e6e28189a0 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbe10646740 10 client.15363 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbe10646740 1 -- 172.21.15.6:0/2723281029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e6e2899790 con 0x55e6e28189a0 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbdeaff5640 1 -- 172.21.15.6:0/2723281029 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdf80b8050 con 0x55e6e28189a0 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbdeaff5640 1 -- 172.21.15.6:0/2723281029 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fbdf8022050 con 0x55e6e28189a0 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbe10646740 10 client.15363 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbe10646740 10 client.15363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbe10646740 20 client.15363 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbe10646740 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e6e2899f10 0x55e6e289c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbe10646740 4 client.15363 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.327+0000 7fbe10646740 1 -- 172.21.15.6:0/2723281029 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e6e2783d70 con 0x55e6e2899f10 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.328+0000 7fbe067fc640 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e6e2899f10 0x55e6e289c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.328+0000 7fbe067fc640 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e6e2899f10 0x55e6e289c330 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dff403de9a87b1ac server_cookie=afc53a1a3bc0db00 in_seq=0 out_seq=0 2024-09-11T23:59:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.328+0000 7fbdeaff5640 10 client.15363 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-11T23:59:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.342+0000 7fbdeaff5640 1 -- 172.21.15.6:0/2723281029 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e6e2783d70 con 0x55e6e2899f10 2024-09-11T23:59:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.342+0000 7fbdeaff5640 10 client.15363 handle_command_reply: tid=0 2024-09-11T23:59:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.342+0000 7fbe10646740 1 client.15363 shutdown 2024-09-11T23:59:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.342+0000 7fbe10646740 1 -- 172.21.15.6:0/2723281029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 msgr2=0x55e6e2827bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe10646740 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2827bb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80a45d0 tx=0x7fbdf80cfe40 comp rx=0 tx=0).stop 2024-09-11T23:59:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe10646740 1 -- 172.21.15.6:0/2723281029 shutdown_connections 2024-09-11T23:59:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe10646740 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6e281e370 0x55e6e28290b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe10646740 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e6e2899f10 0x55e6e289c330 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe10646740 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6e28192e0 0x55e6e28280f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe10646740 1 --2- 172.21.15.6:0/2723281029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6e28189a0 0x55e6e2827bb0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbdeaff5640 0 client.15363 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-11T23:59:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe10646740 1 -- 172.21.15.6:0/2723281029 >> 172.21.15.6:0/2723281029 conn(0x55e6e2814010 msgr2=0x55e6e28143f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe10646740 1 -- 172.21.15.6:0/2723281029 shutdown_connections 2024-09-11T23:59:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe10646740 1 -- 172.21.15.6:0/2723281029 wait complete. 2024-09-11T23:59:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe10646740 20 client.15363 trim_cache size 0 max 16384 2024-09-11T23:59:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-11T23:59:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-11T23:59:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-11T23:59:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-11T23:59:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/2238670511 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbdf00a2c10 msgr2=0x7fbdf00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe0d7cf640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbdf00a2c10 0x7fbdf00a50d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbe0001f000 tx=0x7fbe00020000 comp rx=0 tx=0).stop 2024-09-11T23:59:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/2238670511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe08101b60 msgr2=0x7fbe08075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe0d7cf640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe08101b60 0x7fbe08075fa0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800ea80 tx=0x7fbdf800ef40 comp rx=0 tx=0).stop 2024-09-11T23:59:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/2238670511 shutdown_connections 2024-09-11T23:59:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe0d7cf640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbdf00a2c10 0x7fbdf00a50d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe0d7cf640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe08103710 0x7fbe08074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe0d7cf640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe08102d50 0x7fbe080745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe0d7cf640 1 --2- 172.21.15.6:0/2238670511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe08101b60 0x7fbe08075fa0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.343+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/2238670511 >> 172.21.15.6:0/2238670511 conn(0x7fbe080fd2e0 msgr2=0x7fbe081061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.344+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/2238670511 shutdown_connections 2024-09-11T23:59:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:39.344+0000 7fbe0d7cf640 1 -- 172.21.15.6:0/2238670511 wait complete. 2024-09-11T23:59:41.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:40 smithi039 ceph-mon[34543]: pgmap v367: 129 pgs: 129 active+clean; 666 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-11T23:59:41.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:40 smithi006 ceph-mon[30947]: pgmap v367: 129 pgs: 129 active+clean; 666 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-11T23:59:41.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:40 smithi134 ceph-mon[34893]: pgmap v367: 129 pgs: 129 active+clean; 666 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-11T23:59:43.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:42 smithi039 ceph-mon[34543]: pgmap v368: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-11T23:59:43.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:42 smithi006 ceph-mon[30947]: pgmap v368: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-11T23:59:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:42 smithi134 ceph-mon[34893]: pgmap v368: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-11T23:59:45.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:44 smithi039 ceph-mon[34543]: pgmap v369: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-11T23:59:45.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:44 smithi006 ceph-mon[30947]: pgmap v369: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-11T23:59:45.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:44 smithi134 ceph-mon[34893]: pgmap v369: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-11T23:59:47.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:46 smithi039 ceph-mon[34543]: pgmap v370: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.4 KiB/s wr, 14 op/s 2024-09-11T23:59:47.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:46 smithi006 ceph-mon[30947]: pgmap v370: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.4 KiB/s wr, 14 op/s 2024-09-11T23:59:47.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:46 smithi134 ceph-mon[34893]: pgmap v370: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.4 KiB/s wr, 14 op/s 2024-09-11T23:59:49.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:48 smithi039 ceph-mon[34543]: pgmap v371: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.4 KiB/s wr, 16 op/s 2024-09-11T23:59:49.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:48 smithi006 ceph-mon[30947]: pgmap v371: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.4 KiB/s wr, 16 op/s 2024-09-11T23:59:49.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:48 smithi134 ceph-mon[34893]: pgmap v371: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.4 KiB/s wr, 16 op/s 2024-09-11T23:59:51.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:50 smithi039 ceph-mon[34543]: pgmap v372: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-11T23:59:51.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:50 smithi006 ceph-mon[30947]: pgmap v372: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-11T23:59:51.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:50 smithi134 ceph-mon[34893]: pgmap v372: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-11T23:59:52.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.435+0000 7fdf7a711640 1 -- 172.21.15.6:0/3505744023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf74100a40 msgr2=0x7fdf74100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.435+0000 7fdf7a711640 1 --2- 172.21.15.6:0/3505744023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf74100a40 0x7fdf74100e40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009900 tx=0x7fdf6402a410 comp rx=0 tx=0).stop 2024-09-11T23:59:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.435+0000 7fdf7a711640 1 -- 172.21.15.6:0/3505744023 shutdown_connections 2024-09-11T23:59:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.436+0000 7fdf7a711640 1 --2- 172.21.15.6:0/3505744023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf741025f0 0x7fdf74108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.436+0000 7fdf7a711640 1 --2- 172.21.15.6:0/3505744023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf74101c30 0x7fdf741020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.436+0000 7fdf7a711640 1 --2- 172.21.15.6:0/3505744023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf74100a40 0x7fdf74100e40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.436+0000 7fdf7a711640 1 -- 172.21.15.6:0/3505744023 >> 172.21.15.6:0/3505744023 conn(0x7fdf740fc1c0 msgr2=0x7fdf740fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.436+0000 7fdf7a711640 1 -- 172.21.15.6:0/3505744023 shutdown_connections 2024-09-11T23:59:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.436+0000 7fdf7a711640 1 -- 172.21.15.6:0/3505744023 wait complete. 2024-09-11T23:59:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.436+0000 7fdf7a711640 1 Processor -- start 2024-09-11T23:59:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.436+0000 7fdf7a711640 1 -- start start 2024-09-11T23:59:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.436+0000 7fdf7a711640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf74100a40 0x7fdf7406a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.436+0000 7fdf7a711640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf74101c30 0x7fdf7419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf7a711640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf741025f0 0x7fdf7419f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf7a711640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7410c550 con 0x7fdf74101c30 2024-09-11T23:59:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf7a711640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7410c3d0 con 0x7fdf741025f0 2024-09-11T23:59:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf7a711640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7410c6d0 con 0x7fdf74100a40 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf74101c30 0x7fdf7419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf74101c30 0x7fdf7419cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54410/0 (socket says 172.21.15.6:54410) 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf737fe640 1 -- 172.21.15.6:0/1499259589 learned_addr learned my addr 172.21.15.6:0/1499259589 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf73fff640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf74100a40 0x7fdf7406a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf78cae640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf741025f0 0x7fdf7419f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf737fe640 1 -- 172.21.15.6:0/1499259589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf74100a40 msgr2=0x7fdf7406a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf737fe640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf74100a40 0x7fdf7406a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf737fe640 1 -- 172.21.15.6:0/1499259589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf741025f0 msgr2=0x7fdf7419f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf737fe640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf741025f0 0x7fdf7419f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf737fe640 1 -- 172.21.15.6:0/1499259589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7419f9f0 con 0x7fdf74101c30 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf737fe640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf74101c30 0x7fdf7419cae0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800d950 tx=0x7fdf6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf717fa640 1 -- 172.21.15.6:0/1499259589 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68017070 con 0x7fdf74101c30 2024-09-11T23:59:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf717fa640 1 -- 172.21.15.6:0/1499259589 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf68009c30 con 0x7fdf74101c30 2024-09-11T23:59:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf7a711640 1 -- 172.21.15.6:0/1499259589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7419fce0 con 0x7fdf74101c30 2024-09-11T23:59:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.437+0000 7fdf717fa640 1 -- 172.21.15.6:0/1499259589 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800f620 con 0x7fdf74101c30 2024-09-11T23:59:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.438+0000 7fdf7a711640 1 -- 172.21.15.6:0/1499259589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf741a01d0 con 0x7fdf74101c30 2024-09-11T23:59:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.440+0000 7fdf717fa640 1 -- 172.21.15.6:0/1499259589 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 137883+0+0 (secure 0 0 0) 0x7fdf680109a0 con 0x7fdf74101c30 2024-09-11T23:59:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.440+0000 7fdf7d4ab740 1 Processor -- start 2024-09-11T23:59:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.440+0000 7fdf7d4ab740 1 -- start start 2024-09-11T23:59:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.440+0000 7fdf7d4ab740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56508054f9a0 0x56508054fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.440+0000 7fdf7d4ab740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 0x565080554da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf7d4ab740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080557830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf7d4ab740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5650804b32f0 con 0x5650805502e0 2024-09-11T23:59:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf7d4ab740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56508045b270 con 0x56508054f9a0 2024-09-11T23:59:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf7d4ab740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5650804af2b0 con 0x565080555370 2024-09-11T23:59:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf73fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 0x565080554da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf73fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 0x565080554da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54414/0 (socket says 172.21.15.6:54414) 2024-09-11T23:59:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf73fff640 1 -- 172.21.15.6:0/3216903772 learned_addr learned my addr 172.21.15.6:0/3216903772 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf717fa640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdf5c0a2c10 0x7fdf5c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf78cae640 1 --2- 172.21.15.6:0/3216903772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56508054f9a0 0x56508054fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf78cae640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdf5c0a2c10 0x7fdf5c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf73fff640 1 -- 172.21.15.6:0/3216903772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 msgr2=0x565080557830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf717fa640 1 -- 172.21.15.6:0/1499259589 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fdf680cf180 con 0x7fdf74101c30 2024-09-11T23:59:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf737fe640 1 --2- 172.21.15.6:0/3216903772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080557830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf73fff640 1 --2- 172.21.15.6:0/3216903772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080557830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf73fff640 1 -- 172.21.15.6:0/3216903772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56508054f9a0 msgr2=0x56508054fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf73fff640 1 --2- 172.21.15.6:0/3216903772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56508054f9a0 0x56508054fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf73fff640 1 -- 172.21.15.6:0/3216903772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56508045a340 con 0x5650805502e0 2024-09-11T23:59:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf78cae640 1 --2- 172.21.15.6:0/3216903772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56508054f9a0 0x56508054fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf737fe640 1 --2- 172.21.15.6:0/3216903772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080557830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf73fff640 1 --2- 172.21.15.6:0/3216903772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 0x565080554da0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009900 tx=0x7fdf64005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60509b931718405 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.441+0000 7fdf78cae640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdf5c0a2c10 0x7fdf5c0a50d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009fd0 tx=0x7fdf6c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.442+0000 7fdf5a7fc640 1 -- 172.21.15.6:0/3216903772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf64035030 con 0x5650805502e0 2024-09-11T23:59:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.442+0000 7fdf5a7fc640 1 -- 172.21.15.6:0/3216903772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf64040070 con 0x5650805502e0 2024-09-11T23:59:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.442+0000 7fdf5a7fc640 1 -- 172.21.15.6:0/3216903772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf640039f0 con 0x5650805502e0 2024-09-11T23:59:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.442+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/3216903772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 msgr2=0x565080554da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.442+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/3216903772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 0x565080554da0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009900 tx=0x7fdf64005c00 comp rx=0 tx=0).stop 2024-09-11T23:59:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.442+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/3216903772 shutdown_connections 2024-09-11T23:59:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.442+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/3216903772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080557830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.442+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/3216903772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 0x565080554da0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.442+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/3216903772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56508054f9a0 0x56508054fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.442+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/3216903772 >> 172.21.15.6:0/3216903772 conn(0x56508054b010 msgr2=0x56508054b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.442+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/3216903772 shutdown_connections 2024-09-11T23:59:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.442+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/3216903772 wait complete. 2024-09-11T23:59:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.443+0000 7fdf7d4ab740 1 -- start start 2024-09-11T23:59:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.443+0000 7fdf7d4ab740 1 Processor -- start 2024-09-11T23:59:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.443+0000 7fdf7d4ab740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56508054f9a0 0x565080562400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.443+0000 7fdf7d4ab740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5650805502e0 0x565080562940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.443+0000 7fdf7d4ab740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565080555370 0x565080569980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.443+0000 7fdf7d4ab740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5650805582e0 con 0x565080555370 2024-09-11T23:59:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.443+0000 7fdf7d4ab740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56508043c290 con 0x5650805502e0 2024-09-11T23:59:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.443+0000 7fdf7d4ab740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x565080558460 con 0x56508054f9a0 2024-09-11T23:59:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.443+0000 7fdf7d4ab740 10 client.0 _ll_register_callbacks cb 0x56508046d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.443+0000 7fdf78cae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565080555370 0x565080569980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.443+0000 7fdf78cae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565080555370 0x565080569980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54416/0 (socket says 172.21.15.6:54416) 2024-09-11T23:59:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.443+0000 7fdf78cae640 1 -- 172.21.15.6:0/97096000 learned_addr learned my addr 172.21.15.6:0/97096000 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf737fe640 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5650805502e0 0x565080562940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf73fff640 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56508054f9a0 0x565080562400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf78cae640 1 -- 172.21.15.6:0/97096000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56508054f9a0 msgr2=0x565080562400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf78cae640 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56508054f9a0 0x565080562400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf78cae640 1 -- 172.21.15.6:0/97096000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5650805502e0 msgr2=0x565080562940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf78cae640 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5650805502e0 0x565080562940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf78cae640 1 -- 172.21.15.6:0/97096000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650801c6210 con 0x565080555370 2024-09-11T23:59:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf78cae640 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565080555370 0x565080569980 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c012fd0 tx=0x7fdf6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43791f367bfd3510 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf537fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf537fe640 1 -- 172.21.15.6:0/97096000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c024030 con 0x565080555370 2024-09-11T23:59:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf537fe640 1 -- 172.21.15.6:0/97096000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fdf6c004b20 con 0x565080555370 2024-09-11T23:59:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/97096000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf64040070 con 0x565080555370 2024-09-11T23:59:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf537fe640 1 -- 172.21.15.6:0/97096000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdf6c030050 con 0x565080555370 2024-09-11T23:59:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf7d4ab740 10 client.15375 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.444+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/97096000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565080292620 con 0x565080555370 2024-09-11T23:59:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.445+0000 7fdf537fe640 1 -- 172.21.15.6:0/97096000 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf64040070 con 0x565080555370 2024-09-11T23:59:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.445+0000 7fdf537fe640 1 -- 172.21.15.6:0/97096000 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fdf6c01e040 con 0x565080555370 2024-09-11T23:59:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.445+0000 7fdf7d4ab740 10 client.15375 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.445+0000 7fdf7d4ab740 10 client.15375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T23:59:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.445+0000 7fdf7d4ab740 20 client.15375 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.445+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56508056e0d0 0x565080570500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.445+0000 7fdf7d4ab740 4 client.15375 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.445+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/97096000 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650804c0a20 con 0x56508056e0d0 2024-09-11T23:59:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.445+0000 7fdf73fff640 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56508056e0d0 0x565080570500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.445+0000 7fdf537fe640 10 client.15375 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-11T23:59:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.445+0000 7fdf73fff640 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56508056e0d0 0x565080570500 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cd00bec8a3f4022 server_cookie=34160199d12efd3e in_seq=0 out_seq=0 2024-09-11T23:59:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf537fe640 1 -- 172.21.15.6:0/97096000 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5650804c0a20 con 0x56508056e0d0 2024-09-11T23:59:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf537fe640 10 client.15375 handle_command_reply: tid=0 2024-09-11T23:59:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf7d4ab740 1 client.15375 shutdown 2024-09-11T23:59:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/97096000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565080555370 msgr2=0x565080569980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565080555370 0x565080569980 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c012fd0 tx=0x7fdf6c004a40 comp rx=0 tx=0).stop 2024-09-11T23:59:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/97096000 shutdown_connections 2024-09-11T23:59:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565080555370 0x565080569980 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5650805502e0 0x565080562940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56508056e0d0 0x565080570500 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/97096000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56508054f9a0 0x565080562400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf537fe640 0 client.15375 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-11T23:59:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/97096000 >> 172.21.15.6:0/97096000 conn(0x56508054b010 msgr2=0x56508054c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/97096000 shutdown_connections 2024-09-11T23:59:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.446+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/97096000 wait complete. 2024-09-11T23:59:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.447+0000 7fdf7d4ab740 20 client.15375 trim_cache size 0 max 16384 2024-09-11T23:59:52.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf7d4ab740 1 Processor -- start 2024-09-11T23:59:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf7d4ab740 1 -- start start 2024-09-11T23:59:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf7d4ab740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56508054f9a0 0x56508054a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf7d4ab740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 0x565080569940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf7d4ab740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080574d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf7d4ab740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdf741a84c0 con 0x5650805502e0 2024-09-11T23:59:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf7d4ab740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdf741aa000 con 0x56508054f9a0 2024-09-11T23:59:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf7d4ab740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf741a8b90 con 0x565080555370 2024-09-11T23:59:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 0x565080569940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 0x565080569940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54420/0 (socket says 172.21.15.6:54420) 2024-09-11T23:59:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf737fe640 1 -- 172.21.15.6:0/1686578764 learned_addr learned my addr 172.21.15.6:0/1686578764 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf73fff640 1 --2- 172.21.15.6:0/1686578764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56508054f9a0 0x56508054a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf78cae640 1 --2- 172.21.15.6:0/1686578764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080574d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf737fe640 1 -- 172.21.15.6:0/1686578764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 msgr2=0x565080574d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf737fe640 1 --2- 172.21.15.6:0/1686578764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080574d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf737fe640 1 -- 172.21.15.6:0/1686578764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56508054f9a0 msgr2=0x56508054a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.461+0000 7fdf737fe640 1 --2- 172.21.15.6:0/1686578764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56508054f9a0 0x56508054a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.462+0000 7fdf737fe640 1 -- 172.21.15.6:0/1686578764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565080550b40 con 0x5650805502e0 2024-09-11T23:59:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.462+0000 7fdf78cae640 1 --2- 172.21.15.6:0/1686578764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080574d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.462+0000 7fdf737fe640 1 --2- 172.21.15.6:0/1686578764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 0x565080569940 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdf680a3c60 tx=0x7fdf6809b0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ab378c18ebfc6d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.462+0000 7fdf59ffb640 1 -- 172.21.15.6:0/1686578764 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68020040 con 0x5650805502e0 2024-09-11T23:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.462+0000 7fdf59ffb640 1 -- 172.21.15.6:0/1686578764 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf6809b520 con 0x5650805502e0 2024-09-11T23:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.462+0000 7fdf59ffb640 1 -- 172.21.15.6:0/1686578764 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68097270 con 0x5650805502e0 2024-09-11T23:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/1686578764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 msgr2=0x565080569940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/1686578764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 0x565080569940 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdf680a3c60 tx=0x7fdf6809b0e0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/1686578764 shutdown_connections 2024-09-11T23:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/1686578764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080574d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/1686578764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650805502e0 0x565080569940 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/1686578764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56508054f9a0 0x56508054a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/1686578764 >> 172.21.15.6:0/1686578764 conn(0x56508054b010 msgr2=0x5650805499a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/1686578764 shutdown_connections 2024-09-11T23:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/1686578764 wait complete. 2024-09-11T23:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 -- start start 2024-09-11T23:59:52.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 Processor -- start 2024-09-11T23:59:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56508054f9a0 0x565080569220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5650805502e0 0x565080569760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080567830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdf741a9930 con 0x56508054f9a0 2024-09-11T23:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdf741a9260 con 0x5650805502e0 2024-09-11T23:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.463+0000 7fdf7d4ab740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf741a64a0 con 0x565080555370 2024-09-11T23:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf7d4ab740 10 client.0 _ll_register_callbacks cb 0x7fdf6c009bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf73fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56508054f9a0 0x565080569220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf73fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56508054f9a0 0x565080569220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54434/0 (socket says 172.21.15.6:54434) 2024-09-11T23:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf73fff640 1 -- 172.21.15.6:0/2341366328 learned_addr learned my addr 172.21.15.6:0/2341366328 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-11T23:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf737fe640 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5650805502e0 0x565080569760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf78cae640 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080567830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf73fff640 1 -- 172.21.15.6:0/2341366328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 msgr2=0x565080567830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf73fff640 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080567830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf73fff640 1 -- 172.21.15.6:0/2341366328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5650805502e0 msgr2=0x565080569760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf73fff640 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5650805502e0 0x565080569760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf73fff640 1 -- 172.21.15.6:0/2341366328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565080567fa0 con 0x56508054f9a0 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf737fe640 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5650805502e0 0x565080569760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf73fff640 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56508054f9a0 0x565080569220 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x565080550d10 tx=0x7fdf640314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf49e9983de9b30d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf537fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf537fe640 1 -- 172.21.15.6:0/2341366328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf64035040 con 0x56508054f9a0 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf537fe640 1 -- 172.21.15.6:0/2341366328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fdf6403c640 con 0x56508054f9a0 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.464+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/2341366328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf6809b520 con 0x56508054f9a0 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.465+0000 7fdf537fe640 1 -- 172.21.15.6:0/2341366328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdf64062050 con 0x56508054f9a0 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.465+0000 7fdf7d4ab740 10 client.15381 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.465+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/2341366328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5650805d97c0 con 0x56508054f9a0 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.465+0000 7fdf537fe640 1 -- 172.21.15.6:0/2341366328 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf6809b520 con 0x56508054f9a0 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.465+0000 7fdf537fe640 1 -- 172.21.15.6:0/2341366328 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fdf6405a9b0 con 0x56508054f9a0 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.465+0000 7fdf7d4ab740 10 client.15381 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.465+0000 7fdf7d4ab740 10 client.15381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T23:59:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.465+0000 7fdf7d4ab740 20 client.15381 populate_metadata read hostname 'smithi006' 2024-09-11T23:59:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.465+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5650805d9df0 0x5650805dc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.465+0000 7fdf7d4ab740 4 client.15381 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T23:59:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.465+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/2341366328 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5650804bad70 con 0x5650805d9df0 2024-09-11T23:59:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.465+0000 7fdf737fe640 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5650805d9df0 0x5650805dc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.466+0000 7fdf537fe640 10 client.15381 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-11T23:59:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.466+0000 7fdf737fe640 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5650805d9df0 0x5650805dc1e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6fa7a5f91232f2 server_cookie=5ce3bf60e4c55aeb in_seq=0 out_seq=0 2024-09-11T23:59:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.471+0000 7fdf537fe640 1 -- 172.21.15.6:0/2341366328 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5650804bad70 con 0x5650805d9df0 2024-09-11T23:59:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.471+0000 7fdf537fe640 10 client.15381 handle_command_reply: tid=0 2024-09-11T23:59:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.471+0000 7fdf7d4ab740 1 client.15381 shutdown 2024-09-11T23:59:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/2341366328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56508054f9a0 msgr2=0x565080569220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56508054f9a0 0x565080569220 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x565080550d10 tx=0x7fdf640314a0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/2341366328 shutdown_connections 2024-09-11T23:59:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5650805d9df0 0x5650805dc1e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x565080555370 0x565080567830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5650805502e0 0x565080569760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7d4ab740 1 --2- 172.21.15.6:0/2341366328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56508054f9a0 0x565080569220 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/2341366328 >> 172.21.15.6:0/2341366328 conn(0x56508054b010 msgr2=0x56508054a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf537fe640 0 client.15381 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-11T23:59:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/2341366328 shutdown_connections 2024-09-11T23:59:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7d4ab740 1 -- 172.21.15.6:0/2341366328 wait complete. 2024-09-11T23:59:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7d4ab740 20 client.15381 trim_cache size 0 max 16384 2024-09-11T23:59:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-11T23:59:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-11T23:59:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-11T23:59:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-11T23:59:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7a711640 1 -- 172.21.15.6:0/1499259589 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdf5c0a2c10 msgr2=0x7fdf5c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7a711640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdf5c0a2c10 0x7fdf5c0a50d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009fd0 tx=0x7fdf6c004ab0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7a711640 1 -- 172.21.15.6:0/1499259589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf74101c30 msgr2=0x7fdf7419cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.472+0000 7fdf7a711640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf74101c30 0x7fdf7419cae0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800d950 tx=0x7fdf6800de10 comp rx=0 tx=0).stop 2024-09-11T23:59:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.473+0000 7fdf7a711640 1 -- 172.21.15.6:0/1499259589 shutdown_connections 2024-09-11T23:59:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.473+0000 7fdf7a711640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdf5c0a2c10 0x7fdf5c0a50d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.473+0000 7fdf7a711640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf741025f0 0x7fdf7419f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.473+0000 7fdf7a711640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf74101c30 0x7fdf7419cae0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.473+0000 7fdf7a711640 1 --2- 172.21.15.6:0/1499259589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf74100a40 0x7fdf7406a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.473+0000 7fdf7a711640 1 -- 172.21.15.6:0/1499259589 >> 172.21.15.6:0/1499259589 conn(0x7fdf740fc1c0 msgr2=0x7fdf741050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.473+0000 7fdf7a711640 1 -- 172.21.15.6:0/1499259589 shutdown_connections 2024-09-11T23:59:52.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-11T23:59:52.473+0000 7fdf7a711640 1 -- 172.21.15.6:0/1499259589 wait complete. 2024-09-11T23:59:53.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:52 smithi039 ceph-mon[34543]: pgmap v373: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-11T23:59:53.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:52 smithi006 ceph-mon[30947]: pgmap v373: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-11T23:59:53.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:52 smithi134 ceph-mon[34893]: pgmap v373: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-11T23:59:55.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:54 smithi039 ceph-mon[34543]: pgmap v374: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-11T23:59:55.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:54 smithi006 ceph-mon[30947]: pgmap v374: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-11T23:59:55.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:54 smithi134 ceph-mon[34893]: pgmap v374: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-11T23:59:57.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:56 smithi039 ceph-mon[34543]: pgmap v375: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-11T23:59:57.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:56 smithi006 ceph-mon[30947]: pgmap v375: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-11T23:59:57.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:56 smithi134 ceph-mon[34893]: pgmap v375: 129 pgs: 129 active+clean; 668 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-11T23:59:59.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 11 23:59:58 smithi039 ceph-mon[34543]: pgmap v376: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-11T23:59:59.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 11 23:59:58 smithi006 ceph-mon[30947]: pgmap v376: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-11T23:59:59.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 11 23:59:58 smithi134 ceph-mon[34893]: pgmap v376: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T00:00:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:00 smithi039 ceph-mon[34543]: pgmap v377: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-12T00:00:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:00 smithi039 ceph-mon[34543]: overall HEALTH_OK 2024-09-12T00:00:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:00:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:00:01.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:00 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:00:01.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:00 smithi006 ceph-mon[30947]: pgmap v377: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-12T00:00:01.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:00 smithi006 ceph-mon[30947]: overall HEALTH_OK 2024-09-12T00:00:01.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:00:01.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:00:01.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:00 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:00:01.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:00 smithi134 ceph-mon[34893]: pgmap v377: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-12T00:00:01.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:00 smithi134 ceph-mon[34893]: overall HEALTH_OK 2024-09-12T00:00:01.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:00:01.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:00:01.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:00 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:00:02.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:00:02.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:00:02.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:00:02.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:00:02.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:00:02.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:00:02.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:00:02.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:00:02.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:00:02.775 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:02 smithi006 ceph-mon[30947]: pgmap v378: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T00:00:02.775 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 7]}]: dispatch 2024-09-12T00:00:02.776 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-12T00:00:02.776 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-12T00:00:02.776 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-12T00:00:02.776 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]: dispatch 2024-09-12T00:00:03.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:02 smithi039 ceph-mon[34543]: pgmap v378: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T00:00:03.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 7]}]: dispatch 2024-09-12T00:00:03.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-12T00:00:03.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-12T00:00:03.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-12T00:00:03.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]: dispatch 2024-09-12T00:00:03.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:02 smithi134 ceph-mon[34893]: pgmap v378: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T00:00:03.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 7]}]: dispatch 2024-09-12T00:00:03.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-12T00:00:03.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-12T00:00:03.130 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-12T00:00:03.130 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]: dispatch 2024-09-12T00:00:04.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 7]}]': finished 2024-09-12T00:00:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-12T00:00:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-12T00:00:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-12T00:00:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-09-12T00:00:04.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:03 smithi006 ceph-mon[30947]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T00:00:04.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 7]}]': finished 2024-09-12T00:00:04.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-12T00:00:04.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-12T00:00:04.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-12T00:00:04.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-09-12T00:00:04.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:03 smithi134 ceph-mon[34893]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T00:00:04.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 7]}]': finished 2024-09-12T00:00:04.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-12T00:00:04.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-12T00:00:04.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-12T00:00:04.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-09-12T00:00:04.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:03 smithi039 ceph-mon[34543]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T00:00:05.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:04 smithi039 ceph-mon[34543]: pgmap v380: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2024-09-12T00:00:05.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:04 smithi039 ceph-mon[34543]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T00:00:05.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:04 smithi134 ceph-mon[34893]: pgmap v380: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2024-09-12T00:00:05.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:04 smithi134 ceph-mon[34893]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T00:00:05.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:04 smithi006 ceph-mon[30947]: pgmap v380: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2024-09-12T00:00:05.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:04 smithi006 ceph-mon[30947]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T00:00:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.610+0000 7fabc77e8640 1 -- 172.21.15.6:0/3538021105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc0101b60 msgr2=0x7fabc0101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.610+0000 7fabc77e8640 1 --2- 172.21.15.6:0/3538021105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc0101b60 0x7fabc0101f60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009900 tx=0x7fabbc02a410 comp rx=0 tx=0).stop 2024-09-12T00:00:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.610+0000 7fabc77e8640 1 -- 172.21.15.6:0/3538021105 shutdown_connections 2024-09-12T00:00:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.610+0000 7fabc77e8640 1 --2- 172.21.15.6:0/3538021105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc0103710 0x7fabc0109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.610+0000 7fabc77e8640 1 --2- 172.21.15.6:0/3538021105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc0102d50 0x7fabc01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.610+0000 7fabc77e8640 1 --2- 172.21.15.6:0/3538021105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc0101b60 0x7fabc0101f60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.610+0000 7fabc77e8640 1 -- 172.21.15.6:0/3538021105 >> 172.21.15.6:0/3538021105 conn(0x7fabc00fd2e0 msgr2=0x7fabc00ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.610+0000 7fabc77e8640 1 -- 172.21.15.6:0/3538021105 shutdown_connections 2024-09-12T00:00:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.610+0000 7fabc77e8640 1 -- 172.21.15.6:0/3538021105 wait complete. 2024-09-12T00:00:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.611+0000 7fabc77e8640 1 Processor -- start 2024-09-12T00:00:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.611+0000 7fabc77e8640 1 -- start start 2024-09-12T00:00:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.611+0000 7fabc77e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc0101b60 0x7fabc0197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.611+0000 7fabc77e8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc0102d50 0x7fabc0198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc77e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc0103710 0x7fabc019f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc77e8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fabc010d6e0 con 0x7fabc0102d50 2024-09-12T00:00:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc77e8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fabc010d560 con 0x7fabc0103710 2024-09-12T00:00:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc5584640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc0101b60 0x7fabc0197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc77e8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fabc010d860 con 0x7fabc0101b60 2024-09-12T00:00:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc5584640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc0101b60 0x7fabc0197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:49614/0 (socket says 172.21.15.6:49614) 2024-09-12T00:00:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc5584640 1 -- 172.21.15.6:0/1902093575 learned_addr learned my addr 172.21.15.6:0/1902093575 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc4d83640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc0102d50 0x7fabc0198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc5d85640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc0103710 0x7fabc019f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc5584640 1 -- 172.21.15.6:0/1902093575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc0103710 msgr2=0x7fabc019f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc5584640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc0103710 0x7fabc019f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc5584640 1 -- 172.21.15.6:0/1902093575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc0102d50 msgr2=0x7fabc0198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc5584640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc0102d50 0x7fabc0198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc5584640 1 -- 172.21.15.6:0/1902093575 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc019fa10 con 0x7fabc0101b60 2024-09-12T00:00:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.612+0000 7fabc4d83640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc0102d50 0x7fabc0198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.613+0000 7fabc5584640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc0101b60 0x7fabc0197df0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0314e0 tx=0x7fabbc003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.613+0000 7fabb67fc640 1 -- 172.21.15.6:0/1902093575 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc03f070 con 0x7fabc0101b60 2024-09-12T00:00:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.613+0000 7fabb67fc640 1 -- 172.21.15.6:0/1902093575 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabbc031c40 con 0x7fabc0101b60 2024-09-12T00:00:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.614+0000 7fabb67fc640 1 -- 172.21.15.6:0/1902093575 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc035030 con 0x7fabc0101b60 2024-09-12T00:00:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.614+0000 7fabc77e8640 1 -- 172.21.15.6:0/1902093575 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc019fca0 con 0x7fabc0101b60 2024-09-12T00:00:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.614+0000 7fabc77e8640 1 -- 172.21.15.6:0/1902093575 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc01a0160 con 0x7fabc0101b60 2024-09-12T00:00:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.617+0000 7fabb67fc640 1 -- 172.21.15.6:0/1902093575 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 137883+0+0 (secure 0 0 0) 0x7fabbc042070 con 0x7fabc0101b60 2024-09-12T00:00:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.617+0000 7fabca660740 1 Processor -- start 2024-09-12T00:00:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.618+0000 7fabca660740 1 -- start start 2024-09-12T00:00:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.618+0000 7fabca660740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b210da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.618+0000 7fabca660740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2112e0 0x55cd7b215da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.618+0000 7fabca660740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b218830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.618+0000 7fabca660740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55cd7b1742f0 con 0x55cd7b2109a0 2024-09-12T00:00:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.618+0000 7fabca660740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55cd7b11c270 con 0x55cd7b2112e0 2024-09-12T00:00:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.618+0000 7fabca660740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cd7b1702b0 con 0x55cd7b216370 2024-09-12T00:00:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.618+0000 7fabc5584640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2112e0 0x55cd7b215da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.618+0000 7fabc5d85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b210da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.618+0000 7fabc4d83640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b218830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.618+0000 7fabc5584640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2112e0 0x55cd7b215da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:53126/0 (socket says 172.21.15.6:53126) 2024-09-12T00:00:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.618+0000 7fabc5584640 1 -- 172.21.15.6:0/4150479219 learned_addr learned my addr 172.21.15.6:0/4150479219 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.619+0000 7fabc4d83640 1 -- 172.21.15.6:0/4150479219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2112e0 msgr2=0x55cd7b215da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.619+0000 7fabc4d83640 1 --2- 172.21.15.6:0/4150479219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2112e0 0x55cd7b215da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.619+0000 7fabc4d83640 1 -- 172.21.15.6:0/4150479219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 msgr2=0x55cd7b210da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.619+0000 7fabc4d83640 1 --2- 172.21.15.6:0/4150479219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b210da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.619+0000 7fabc4d83640 1 -- 172.21.15.6:0/4150479219 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd7b11b340 con 0x55cd7b216370 2024-09-12T00:00:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.619+0000 7fabc5d85640 1 --2- 172.21.15.6:0/4150479219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b210da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.619+0000 7fabc4d83640 1 --2- 172.21.15.6:0/4150479219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b218830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009fa0 tx=0x7fabb00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bff29e3423196ac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.619+0000 7fabab7fe640 1 -- 172.21.15.6:0/4150479219 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0004030 con 0x55cd7b216370 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.619+0000 7fabab7fe640 1 -- 172.21.15.6:0/4150479219 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabb00054d0 con 0x55cd7b216370 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.619+0000 7fabab7fe640 1 -- 172.21.15.6:0/4150479219 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0004ce0 con 0x55cd7b216370 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.619+0000 7fabb67fc640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fabac0a2c10 0x7fabac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.620+0000 7fabc5d85640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fabac0a2c10 0x7fabac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.620+0000 7fabb67fc640 1 -- 172.21.15.6:0/1902093575 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fabbc0eff90 con 0x7fabc0101b60 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.620+0000 7fabca660740 1 -- 172.21.15.6:0/4150479219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 msgr2=0x55cd7b218830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.620+0000 7fabc5d85640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fabac0a2c10 0x7fabac0a50d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009fd0 tx=0x7fabb8015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.620+0000 7fabca660740 1 --2- 172.21.15.6:0/4150479219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b218830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009fa0 tx=0x7fabb00118d0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.620+0000 7fabca660740 1 -- 172.21.15.6:0/4150479219 shutdown_connections 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.620+0000 7fabca660740 1 --2- 172.21.15.6:0/4150479219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b218830 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.620+0000 7fabca660740 1 --2- 172.21.15.6:0/4150479219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2112e0 0x55cd7b215da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.620+0000 7fabca660740 1 --2- 172.21.15.6:0/4150479219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b210da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.620+0000 7fabca660740 1 -- 172.21.15.6:0/4150479219 >> 172.21.15.6:0/4150479219 conn(0x55cd7b20c010 msgr2=0x55cd7b20c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.620+0000 7fabca660740 1 -- 172.21.15.6:0/4150479219 shutdown_connections 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.620+0000 7fabca660740 1 -- 172.21.15.6:0/4150479219 wait complete. 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.621+0000 7fabca660740 1 -- start start 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.621+0000 7fabca660740 1 Processor -- start 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.621+0000 7fabca660740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b21ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.621+0000 7fabca660740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b2112e0 0x55cd7b21b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.621+0000 7fabca660740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b216370 0x55cd7b222180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabca660740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55cd7b219340 con 0x55cd7b2109a0 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabca660740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55cd7b0fd290 con 0x55cd7b216370 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabca660740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cd7b2194c0 con 0x55cd7b2112e0 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabc5584640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b21ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabc5584640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b21ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34874/0 (socket says 172.21.15.6:34874) 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabc5584640 1 -- 172.21.15.6:0/1007214958 learned_addr learned my addr 172.21.15.6:0/1007214958 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabc4d83640 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b2112e0 0x55cd7b21b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabc5d85640 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b216370 0x55cd7b222180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabca660740 10 client.0 _ll_register_callbacks cb 0x55cd7b12e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabc4d83640 1 -- 172.21.15.6:0/1007214958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b216370 msgr2=0x55cd7b222180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabc4d83640 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b216370 0x55cd7b222180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabc4d83640 1 -- 172.21.15.6:0/1007214958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 msgr2=0x55cd7b21ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabc4d83640 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b21ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabc4d83640 1 -- 172.21.15.6:0/1007214958 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd7ae87210 con 0x55cd7b2112e0 2024-09-12T00:00:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabc5584640 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b21ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7fabc4d83640 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b2112e0 0x55cd7b21b140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55cd7b20ce90 tx=0x7fabb0003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5da2133280adcabd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.622+0000 7faba8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:00:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.623+0000 7faba8ff9640 1 -- 172.21.15.6:0/1007214958 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb001d050 con 0x55cd7b2112e0 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.623+0000 7faba8ff9640 1 -- 172.21.15.6:0/1007214958 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fabb0003c20 con 0x55cd7b2112e0 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.623+0000 7fabca660740 1 -- 172.21.15.6:0/1007214958 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabb00054d0 con 0x55cd7b2112e0 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.623+0000 7faba8ff9640 1 -- 172.21.15.6:0/1007214958 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fabb0032050 con 0x55cd7b2112e0 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.623+0000 7fabca660740 10 client.25051 fetch_fsmap learned FSMap version 28 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.623+0000 7fabca660740 1 -- 172.21.15.6:0/1007214958 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd7af53620 con 0x55cd7b2112e0 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.623+0000 7faba8ff9640 1 -- 172.21.15.6:0/1007214958 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabb00054d0 con 0x55cd7b2112e0 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.624+0000 7faba8ff9640 1 -- 172.21.15.6:0/1007214958 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fabb00049e0 con 0x55cd7b2112e0 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.624+0000 7fabca660740 10 client.25051 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.624+0000 7fabca660740 10 client.25051 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.624+0000 7fabca660740 20 client.25051 populate_metadata read hostname 'smithi006' 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.624+0000 7fabca660740 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd7b2265c0 0x55cd7b2289b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.624+0000 7fabca660740 4 client.25051 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.624+0000 7fabca660740 1 -- 172.21.15.6:0/1007214958 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd7b181a20 con 0x55cd7b2265c0 2024-09-12T00:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.625+0000 7fabc5584640 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd7b2265c0 0x55cd7b2289b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.625+0000 7fabc5584640 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd7b2265c0 0x55cd7b2289b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d44440ba48f9835 server_cookie=3798d97f497bd9af in_seq=0 out_seq=0 2024-09-12T00:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.625+0000 7faba8ff9640 10 client.25051 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.626+0000 7faba8ff9640 1 -- 172.21.15.6:0/1007214958 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd7b181a20 con 0x55cd7b2265c0 2024-09-12T00:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.626+0000 7faba8ff9640 10 client.25051 handle_command_reply: tid=0 2024-09-12T00:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.626+0000 7fabca660740 1 client.25051 shutdown 2024-09-12T00:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.626+0000 7fabca660740 1 -- 172.21.15.6:0/1007214958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b2112e0 msgr2=0x55cd7b21b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.626+0000 7fabca660740 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b2112e0 0x55cd7b21b140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55cd7b20ce90 tx=0x7fabb0003820 comp rx=0 tx=0).stop 2024-09-12T00:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.626+0000 7fabca660740 1 -- 172.21.15.6:0/1007214958 shutdown_connections 2024-09-12T00:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.626+0000 7fabca660740 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b216370 0x55cd7b222180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.626+0000 7fabca660740 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd7b2265c0 0x55cd7b2289b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.626+0000 7fabca660740 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b2112e0 0x55cd7b21b140 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.626+0000 7fabca660740 1 --2- 172.21.15.6:0/1007214958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b21ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.626+0000 7faba8ff9640 0 client.25051 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.626+0000 7fabca660740 1 -- 172.21.15.6:0/1007214958 >> 172.21.15.6:0/1007214958 conn(0x55cd7b20c010 msgr2=0x55cd7b20d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.627+0000 7fabca660740 1 -- 172.21.15.6:0/1007214958 shutdown_connections 2024-09-12T00:00:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.627+0000 7fabca660740 1 -- 172.21.15.6:0/1007214958 wait complete. 2024-09-12T00:00:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.627+0000 7fabca660740 20 client.25051 trim_cache size 0 max 16384 2024-09-12T00:00:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.655+0000 7fabca660740 1 Processor -- start 2024-09-12T00:00:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.655+0000 7fabca660740 1 -- start start 2024-09-12T00:00:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabca660740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2109a0 0x55cd7b20cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabca660740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2112e0 0x55cd7b222140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabca660740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b20d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabca660740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01a85a0 con 0x55cd7b2112e0 2024-09-12T00:00:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabc4d83640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2112e0 0x55cd7b222140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabca660740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01aa0e0 con 0x55cd7b2109a0 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabca660740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01a8c70 con 0x55cd7b216370 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabc4d83640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2112e0 0x55cd7b222140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34890/0 (socket says 172.21.15.6:34890) 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabc4d83640 1 -- 172.21.15.6:0/2225604115 learned_addr learned my addr 172.21.15.6:0/2225604115 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabc5d85640 1 --2- 172.21.15.6:0/2225604115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b20d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabc5584640 1 --2- 172.21.15.6:0/2225604115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2109a0 0x55cd7b20cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabc4d83640 1 -- 172.21.15.6:0/2225604115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 msgr2=0x55cd7b20d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabc4d83640 1 --2- 172.21.15.6:0/2225604115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b20d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabc4d83640 1 -- 172.21.15.6:0/2225604115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2109a0 msgr2=0x55cd7b20cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabc4d83640 1 --2- 172.21.15.6:0/2225604115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2109a0 0x55cd7b20cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabc4d83640 1 -- 172.21.15.6:0/2225604115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd7b20be30 con 0x55cd7b2112e0 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabc5d85640 1 --2- 172.21.15.6:0/2225604115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b20d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.656+0000 7fabc5584640 1 --2- 172.21.15.6:0/2225604115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2109a0 0x55cd7b20cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.657+0000 7fabc4d83640 1 --2- 172.21.15.6:0/2225604115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2112e0 0x55cd7b222140 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009380 tx=0x7fabb00096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a02d6c318b88bc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.657+0000 7fabaaffd640 1 -- 172.21.15.6:0/2225604115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb003b070 con 0x55cd7b2112e0 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.657+0000 7fabaaffd640 1 -- 172.21.15.6:0/2225604115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabb0029070 con 0x55cd7b2112e0 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.657+0000 7fabaaffd640 1 -- 172.21.15.6:0/2225604115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb001d040 con 0x55cd7b2112e0 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.658+0000 7fabca660740 1 -- 172.21.15.6:0/2225604115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2112e0 msgr2=0x55cd7b222140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.658+0000 7fabca660740 1 --2- 172.21.15.6:0/2225604115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2112e0 0x55cd7b222140 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009380 tx=0x7fabb00096c0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.658+0000 7fabca660740 1 -- 172.21.15.6:0/2225604115 shutdown_connections 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.658+0000 7fabca660740 1 --2- 172.21.15.6:0/2225604115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b20d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.658+0000 7fabca660740 1 --2- 172.21.15.6:0/2225604115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2112e0 0x55cd7b222140 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.658+0000 7fabca660740 1 --2- 172.21.15.6:0/2225604115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2109a0 0x55cd7b20cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.658+0000 7fabca660740 1 -- 172.21.15.6:0/2225604115 >> 172.21.15.6:0/2225604115 conn(0x55cd7b20c010 msgr2=0x55cd7b212480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.658+0000 7fabca660740 1 -- 172.21.15.6:0/2225604115 shutdown_connections 2024-09-12T00:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.658+0000 7fabca660740 1 -- 172.21.15.6:0/2225604115 wait complete. 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.659+0000 7fabca660740 1 -- start start 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.659+0000 7fabca660740 1 Processor -- start 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.659+0000 7fabca660740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b221ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.659+0000 7fabc5584640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b221ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabc5584640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b221ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34906/0 (socket says 172.21.15.6:34906) 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabc5584640 1 -- 172.21.15.6:0/3897021991 learned_addr learned my addr 172.21.15.6:0/3897021991 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabca660740 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2112e0 0x55cd7b21e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabca660740 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b21ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabca660740 1 -- 172.21.15.6:0/3897021991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01a9a10 con 0x55cd7b2109a0 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabca660740 1 -- 172.21.15.6:0/3897021991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01a9340 con 0x55cd7b2112e0 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabca660740 1 -- 172.21.15.6:0/3897021991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01a6630 con 0x55cd7b216370 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabc4d83640 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2112e0 0x55cd7b21e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabc5d85640 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b21ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabc5584640 1 -- 172.21.15.6:0/3897021991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 msgr2=0x55cd7b21ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabc5584640 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b21ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabc5584640 1 -- 172.21.15.6:0/3897021991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2112e0 msgr2=0x55cd7b21e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabc5584640 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2112e0 0x55cd7b21e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.660+0000 7fabc5584640 1 -- 172.21.15.6:0/3897021991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd7b222300 con 0x55cd7b2109a0 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.661+0000 7fabc5584640 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b221ca0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0b8c10 tx=0x7fabbc0f3a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490e2883dcd493b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.661+0000 7fabca660740 10 client.0 _ll_register_callbacks cb 0x7fabb8009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.661+0000 7faba8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.661+0000 7fabca660740 1 -- 172.21.15.6:0/3897021991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabb0029070 con 0x55cd7b2109a0 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.661+0000 7faba8ff9640 1 -- 172.21.15.6:0/3897021991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc0bbd80 con 0x55cd7b2109a0 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.661+0000 7faba8ff9640 1 -- 172.21.15.6:0/3897021991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fabbc0ed740 con 0x55cd7b2109a0 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.661+0000 7faba8ff9640 1 -- 172.21.15.6:0/3897021991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fabbc0bbba0 con 0x55cd7b2109a0 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.661+0000 7fabca660740 10 client.15399 fetch_fsmap learned FSMap version 28 2024-09-12T00:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.661+0000 7fabca660740 1 -- 172.21.15.6:0/3897021991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55cd7b2900b0 con 0x55cd7b2109a0 2024-09-12T00:00:05.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.662+0000 7faba8ff9640 1 -- 172.21.15.6:0/3897021991 <== mon.0 v2:172.21.15.6:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fabbc03b4f0 con 0x55cd7b2109a0 2024-09-12T00:00:05.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.662+0000 7fabca660740 10 client.15399 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T00:00:05.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.662+0000 7fabca660740 10 client.15399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:00:05.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.662+0000 7fabca660740 20 client.15399 populate_metadata read hostname 'smithi006' 2024-09-12T00:00:05.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.662+0000 7fabca660740 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd7b290960 0x55cd7b292da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:05.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.662+0000 7fabca660740 4 client.15399 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:00:05.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.662+0000 7fabca660740 1 -- 172.21.15.6:0/3897021991 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd7b17bd70 con 0x55cd7b290960 2024-09-12T00:00:05.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.662+0000 7fabc4d83640 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd7b290960 0x55cd7b292da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:05.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.662+0000 7faba8ff9640 10 client.15399 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:05.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.662+0000 7fabc4d83640 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd7b290960 0x55cd7b292da0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a370f1cc0a79885 server_cookie=67909ea470fdbb87 in_seq=0 out_seq=0 2024-09-12T00:00:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7faba8ff9640 1 -- 172.21.15.6:0/3897021991 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cd7b17bd70 con 0x55cd7b290960 2024-09-12T00:00:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7faba8ff9640 10 client.15399 handle_command_reply: tid=0 2024-09-12T00:00:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7fabca660740 1 client.15399 shutdown 2024-09-12T00:00:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7fabca660740 1 -- 172.21.15.6:0/3897021991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 msgr2=0x55cd7b221ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7fabca660740 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b221ca0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0b8c10 tx=0x7fabbc0f3a40 comp rx=0 tx=0).stop 2024-09-12T00:00:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7fabca660740 1 -- 172.21.15.6:0/3897021991 shutdown_connections 2024-09-12T00:00:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7fabca660740 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd7b290960 0x55cd7b292da0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7faba8ff9640 0 client.15399 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7fabca660740 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd7b216370 0x55cd7b21ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7fabca660740 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd7b2112e0 0x55cd7b21e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7fabca660740 1 --2- 172.21.15.6:0/3897021991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd7b2109a0 0x55cd7b221ca0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7fabca660740 1 -- 172.21.15.6:0/3897021991 >> 172.21.15.6:0/3897021991 conn(0x55cd7b20c010 msgr2=0x55cd7b20a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7fabca660740 1 -- 172.21.15.6:0/3897021991 shutdown_connections 2024-09-12T00:00:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7fabca660740 1 -- 172.21.15.6:0/3897021991 wait complete. 2024-09-12T00:00:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.668+0000 7fabca660740 20 client.15399 trim_cache size 0 max 16384 2024-09-12T00:00:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:00:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:00:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:00:05.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:00:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.669+0000 7fabc77e8640 1 -- 172.21.15.6:0/1902093575 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fabac0a2c10 msgr2=0x7fabac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.669+0000 7fabc77e8640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fabac0a2c10 0x7fabac0a50d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009fd0 tx=0x7fabb8015040 comp rx=0 tx=0).stop 2024-09-12T00:00:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.669+0000 7fabc77e8640 1 -- 172.21.15.6:0/1902093575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc0101b60 msgr2=0x7fabc0197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.669+0000 7fabc77e8640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc0101b60 0x7fabc0197df0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0314e0 tx=0x7fabbc003c10 comp rx=0 tx=0).stop 2024-09-12T00:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.669+0000 7fabc77e8640 1 -- 172.21.15.6:0/1902093575 shutdown_connections 2024-09-12T00:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.669+0000 7fabc77e8640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fabac0a2c10 0x7fabac0a50d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.669+0000 7fabc77e8640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc0103710 0x7fabc019f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.669+0000 7fabc77e8640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc0102d50 0x7fabc0198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.669+0000 7fabc77e8640 1 --2- 172.21.15.6:0/1902093575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc0101b60 0x7fabc0197df0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.669+0000 7fabc77e8640 1 -- 172.21.15.6:0/1902093575 >> 172.21.15.6:0/1902093575 conn(0x7fabc00fd2e0 msgr2=0x7fabc01061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.669+0000 7fabc77e8640 1 -- 172.21.15.6:0/1902093575 shutdown_connections 2024-09-12T00:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:05.669+0000 7fabc77e8640 1 -- 172.21.15.6:0/1902093575 wait complete. 2024-09-12T00:00:07.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:06 smithi006 ceph-mon[30947]: pgmap v382: 129 pgs: 2 peering, 127 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-12T00:00:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:06 smithi134 ceph-mon[34893]: pgmap v382: 129 pgs: 2 peering, 127 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-12T00:00:07.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:06 smithi039 ceph-mon[34543]: pgmap v382: 129 pgs: 2 peering, 127 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-12T00:00:09.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:08 smithi006 ceph-mon[30947]: pgmap v383: 129 pgs: 2 peering, 127 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-12T00:00:09.153 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:08 smithi039 ceph-mon[34543]: pgmap v383: 129 pgs: 2 peering, 127 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-12T00:00:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:08 smithi134 ceph-mon[34893]: pgmap v383: 129 pgs: 2 peering, 127 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-12T00:00:11.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:10 smithi006 ceph-mon[30947]: pgmap v384: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:10 smithi134 ceph-mon[34893]: pgmap v384: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:11.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:10 smithi039 ceph-mon[34543]: pgmap v384: 129 pgs: 129 active+clean; 669 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:13.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:12 smithi006 ceph-mon[30947]: pgmap v385: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 499 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:12 smithi134 ceph-mon[34893]: pgmap v385: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 499 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:13.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:12 smithi039 ceph-mon[34543]: pgmap v385: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 499 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:15.104 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:14 smithi039 ceph-mon[34543]: pgmap v386: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:15.126 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:14 smithi006 ceph-mon[30947]: pgmap v386: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:15.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:14 smithi134 ceph-mon[34893]: pgmap v386: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:16 smithi134 ceph-mon[34893]: pgmap v387: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 366 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:17.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:16 smithi006 ceph-mon[30947]: pgmap v387: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 366 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:17.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:16 smithi039 ceph-mon[34543]: pgmap v387: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 366 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:18.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.784+0000 7f12762e6640 1 -- 172.21.15.6:0/515331075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1270107820 msgr2=0x7f1270109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.784+0000 7f12762e6640 1 --2- 172.21.15.6:0/515331075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1270107820 0x7f1270109c90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1268009ca0 tx=0x7f126802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.784+0000 7f12762e6640 1 -- 172.21.15.6:0/515331075 shutdown_connections 2024-09-12T00:00:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.784+0000 7f12762e6640 1 --2- 172.21.15.6:0/515331075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1270107820 0x7f1270109c90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.784+0000 7f12762e6640 1 --2- 172.21.15.6:0/515331075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1270104ef0 0x7f12701072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.784+0000 7f12762e6640 1 --2- 172.21.15.6:0/515331075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12701025c0 0x7f12701049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.784+0000 7f12762e6640 1 -- 172.21.15.6:0/515331075 >> 172.21.15.6:0/515331075 conn(0x7f12700fc1c0 msgr2=0x7f12700fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.785+0000 7f12762e6640 1 -- 172.21.15.6:0/515331075 shutdown_connections 2024-09-12T00:00:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.785+0000 7f12762e6640 1 -- 172.21.15.6:0/515331075 wait complete. 2024-09-12T00:00:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.785+0000 7f12762e6640 1 Processor -- start 2024-09-12T00:00:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.785+0000 7f12762e6640 1 -- start start 2024-09-12T00:00:18.787 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.785+0000 7f12762e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12701025c0 0x7f1270197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.787 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.785+0000 7f12762e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1270104ef0 0x7f1270198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.787 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f12762e6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1270107820 0x7f127019f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.787 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f12762e6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f127010d6b0 con 0x7f12701025c0 2024-09-12T00:00:18.787 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f12762e6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f127010d530 con 0x7f1270107820 2024-09-12T00:00:18.787 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f12762e6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f127010d830 con 0x7f1270104ef0 2024-09-12T00:00:18.787 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f126ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12701025c0 0x7f1270197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.787 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f126ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12701025c0 0x7f1270197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45288/0 (socket says 172.21.15.6:45288) 2024-09-12T00:00:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f126ffff640 1 -- 172.21.15.6:0/299828768 learned_addr learned my addr 172.21.15.6:0/299828768 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f126f7fe640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1270104ef0 0x7f1270198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f1274883640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1270107820 0x7f127019f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f126ffff640 1 -- 172.21.15.6:0/299828768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1270104ef0 msgr2=0x7f1270198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f126ffff640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1270104ef0 0x7f1270198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f126ffff640 1 -- 172.21.15.6:0/299828768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1270107820 msgr2=0x7f127019f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f126ffff640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1270107820 0x7f127019f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f126ffff640 1 -- 172.21.15.6:0/299828768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127019fa10 con 0x7f12701025c0 2024-09-12T00:00:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f1274883640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1270107820 0x7f127019f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.786+0000 7f126ffff640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12701025c0 0x7f1270197df0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f126000e9f0 tx=0x7f126000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.787+0000 7f126d7fa640 1 -- 172.21.15.6:0/299828768 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126000cd80 con 0x7f12701025c0 2024-09-12T00:00:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.787+0000 7f12762e6640 1 -- 172.21.15.6:0/299828768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127019fd00 con 0x7f12701025c0 2024-09-12T00:00:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.787+0000 7f126d7fa640 1 -- 172.21.15.6:0/299828768 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12600054d0 con 0x7f12701025c0 2024-09-12T00:00:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.787+0000 7f126d7fa640 1 -- 172.21.15.6:0/299828768 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260010490 con 0x7f12701025c0 2024-09-12T00:00:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.787+0000 7f12762e6640 1 -- 172.21.15.6:0/299828768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12701a01a0 con 0x7f12701025c0 2024-09-12T00:00:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.790+0000 7f127907e740 1 Processor -- start 2024-09-12T00:00:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.790+0000 7f127907e740 1 -- start start 2024-09-12T00:00:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.790+0000 7f126d7fa640 1 -- 172.21.15.6:0/299828768 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 137883+0+0 (secure 0 0 0) 0x7f1260005020 con 0x7f12701025c0 2024-09-12T00:00:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.790+0000 7f127907e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be09a0 0x564e78be0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.790+0000 7f127907e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78be5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.790+0000 7f127907e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 0x564e78be8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.790+0000 7f127907e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564e78b442f0 con 0x564e78be6370 2024-09-12T00:00:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.790+0000 7f127907e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564e78aec270 con 0x564e78be09a0 2024-09-12T00:00:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.790+0000 7f127907e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564e78b402b0 con 0x564e78be12e0 2024-09-12T00:00:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.790+0000 7f126f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 0x564e78be8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.790+0000 7f126f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 0x564e78be8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45292/0 (socket says 172.21.15.6:45292) 2024-09-12T00:00:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.791+0000 7f126f7fe640 1 -- 172.21.15.6:0/3904084815 learned_addr learned my addr 172.21.15.6:0/3904084815 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.791+0000 7f126ffff640 1 --2- 172.21.15.6:0/3904084815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78be5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.791+0000 7f1274883640 1 --2- 172.21.15.6:0/3904084815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be09a0 0x564e78be0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.791+0000 7f126f7fe640 1 -- 172.21.15.6:0/3904084815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 msgr2=0x564e78be5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.791+0000 7f126f7fe640 1 --2- 172.21.15.6:0/3904084815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78be5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.791+0000 7f126f7fe640 1 -- 172.21.15.6:0/3904084815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be09a0 msgr2=0x564e78be0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.791+0000 7f126f7fe640 1 --2- 172.21.15.6:0/3904084815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be09a0 0x564e78be0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.791+0000 7f126f7fe640 1 -- 172.21.15.6:0/3904084815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e78aeb340 con 0x564e78be6370 2024-09-12T00:00:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.791+0000 7f126f7fe640 1 --2- 172.21.15.6:0/3904084815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 0x564e78be8830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f126400bc90 tx=0x7f12640107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cf8c2396b71406 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.791+0000 7f126d7fa640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f12580a2c90 0x7f12580a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.792+0000 7f126d7fa640 1 -- 172.21.15.6:0/299828768 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f12600cf970 con 0x7f12701025c0 2024-09-12T00:00:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.792+0000 7f12567fc640 1 -- 172.21.15.6:0/3904084815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126401c480 con 0x564e78be6370 2024-09-12T00:00:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.792+0000 7f12567fc640 1 -- 172.21.15.6:0/3904084815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f126401cad0 con 0x564e78be6370 2024-09-12T00:00:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.792+0000 7f12567fc640 1 -- 172.21.15.6:0/3904084815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1264011c30 con 0x564e78be6370 2024-09-12T00:00:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.792+0000 7f1274883640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f12580a2c90 0x7f12580a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.793+0000 7f127907e740 1 -- 172.21.15.6:0/3904084815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 msgr2=0x564e78be8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.793+0000 7f1274883640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f12580a2c90 0x7f12580a5150 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1268005e30 tx=0x7f1268031a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.793+0000 7f127907e740 1 --2- 172.21.15.6:0/3904084815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 0x564e78be8830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f126400bc90 tx=0x7f12640107a0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.793+0000 7f127907e740 1 -- 172.21.15.6:0/3904084815 shutdown_connections 2024-09-12T00:00:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.793+0000 7f127907e740 1 --2- 172.21.15.6:0/3904084815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 0x564e78be8830 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.793+0000 7f127907e740 1 --2- 172.21.15.6:0/3904084815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78be5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.793+0000 7f127907e740 1 --2- 172.21.15.6:0/3904084815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be09a0 0x564e78be0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.793+0000 7f127907e740 1 -- 172.21.15.6:0/3904084815 >> 172.21.15.6:0/3904084815 conn(0x564e78bdc010 msgr2=0x564e78bdc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.793+0000 7f127907e740 1 -- 172.21.15.6:0/3904084815 shutdown_connections 2024-09-12T00:00:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.793+0000 7f127907e740 1 -- 172.21.15.6:0/3904084815 wait complete. 2024-09-12T00:00:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.793+0000 7f127907e740 1 -- start start 2024-09-12T00:00:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f127907e740 1 Processor -- start 2024-09-12T00:00:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f127907e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be09a0 0x564e78beacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f127907e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78beb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f127907e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be6370 0x564e78bf2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f127907e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564e78be9340 con 0x564e78be09a0 2024-09-12T00:00:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f127907e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564e78acd290 con 0x564e78be6370 2024-09-12T00:00:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f127907e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564e78be94c0 con 0x564e78be12e0 2024-09-12T00:00:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f127907e740 10 client.0 _ll_register_callbacks cb 0x564e78afe140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f126ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be09a0 0x564e78beacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f126ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be09a0 0x564e78beacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45302/0 (socket says 172.21.15.6:45302) 2024-09-12T00:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f126ffff640 1 -- 172.21.15.6:0/3261686624 learned_addr learned my addr 172.21.15.6:0/3261686624 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f126f7fe640 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78beb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f1274883640 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be6370 0x564e78bf2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f126ffff640 1 -- 172.21.15.6:0/3261686624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 msgr2=0x564e78beb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f126ffff640 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78beb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f126ffff640 1 -- 172.21.15.6:0/3261686624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be6370 msgr2=0x564e78bf2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.794+0000 7f126ffff640 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be6370 0x564e78bf2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.795+0000 7f126ffff640 1 -- 172.21.15.6:0/3261686624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e78857210 con 0x564e78be09a0 2024-09-12T00:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.795+0000 7f126f7fe640 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78beb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.795+0000 7f126ffff640 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be09a0 0x564e78beacc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f126000e9c0 tx=0x7f126009bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3450ba806ef0b3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.795+0000 7f124f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.795+0000 7f124f7fe640 1 -- 172.21.15.6:0/3261686624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260005680 con 0x564e78be09a0 2024-09-12T00:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.795+0000 7f127907e740 1 -- 172.21.15.6:0/3261686624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f126401cad0 con 0x564e78be09a0 2024-09-12T00:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.795+0000 7f124f7fe640 1 -- 172.21.15.6:0/3261686624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f12600a4460 con 0x564e78be09a0 2024-09-12T00:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.795+0000 7f124f7fe640 1 -- 172.21.15.6:0/3261686624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f126009c380 con 0x564e78be09a0 2024-09-12T00:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.795+0000 7f127907e740 10 client.15411 fetch_fsmap learned FSMap version 28 2024-09-12T00:00:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.795+0000 7f127907e740 1 -- 172.21.15.6:0/3261686624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564e78923620 con 0x564e78be09a0 2024-09-12T00:00:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.795+0000 7f124f7fe640 1 -- 172.21.15.6:0/3261686624 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f126401cad0 con 0x564e78be09a0 2024-09-12T00:00:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.796+0000 7f124f7fe640 1 -- 172.21.15.6:0/3261686624 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f12600979d0 con 0x564e78be09a0 2024-09-12T00:00:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.796+0000 7f127907e740 10 client.15411 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T00:00:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.796+0000 7f127907e740 10 client.15411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:00:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.796+0000 7f127907e740 20 client.15411 populate_metadata read hostname 'smithi006' 2024-09-12T00:00:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.796+0000 7f127907e740 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e78bf68e0 0x564e78bf8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.796+0000 7f127907e740 4 client.15411 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.796+0000 7f127907e740 1 -- 172.21.15.6:0/3261686624 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e78b51a20 con 0x564e78bf68e0 2024-09-12T00:00:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.797+0000 7f126f7fe640 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e78bf68e0 0x564e78bf8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.797+0000 7f124f7fe640 10 client.15411 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.797+0000 7f126f7fe640 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e78bf68e0 0x564e78bf8cf0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3ae81e29ceb280f server_cookie=8bd0c3253e36b2a7 in_seq=0 out_seq=0 2024-09-12T00:00:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f124f7fe640 1 -- 172.21.15.6:0/3261686624 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e78b51a20 con 0x564e78bf68e0 2024-09-12T00:00:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f124f7fe640 10 client.15411 handle_command_reply: tid=0 2024-09-12T00:00:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f127907e740 1 client.15411 shutdown 2024-09-12T00:00:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f127907e740 1 -- 172.21.15.6:0/3261686624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be09a0 msgr2=0x564e78beacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f127907e740 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be09a0 0x564e78beacc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f126000e9c0 tx=0x7f126009bb10 comp rx=0 tx=0).stop 2024-09-12T00:00:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f127907e740 1 -- 172.21.15.6:0/3261686624 shutdown_connections 2024-09-12T00:00:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f127907e740 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be6370 0x564e78bf2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f127907e740 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e78bf68e0 0x564e78bf8cf0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f127907e740 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78beb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f127907e740 1 --2- 172.21.15.6:0/3261686624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be09a0 0x564e78beacc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f127907e740 1 -- 172.21.15.6:0/3261686624 >> 172.21.15.6:0/3261686624 conn(0x564e78bdc010 msgr2=0x564e78bdd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f124f7fe640 0 client.15411 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f127907e740 1 -- 172.21.15.6:0/3261686624 shutdown_connections 2024-09-12T00:00:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.798+0000 7f127907e740 1 -- 172.21.15.6:0/3261686624 wait complete. 2024-09-12T00:00:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.799+0000 7f127907e740 20 client.15411 trim_cache size 0 max 16384 2024-09-12T00:00:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.827+0000 7f127907e740 1 Processor -- start 2024-09-12T00:00:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.827+0000 7f127907e740 1 -- start start 2024-09-12T00:00:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f127907e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be09a0 0x564e78beb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f127907e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be12e0 0x564e78bf21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f127907e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be6370 0x564e78bdb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f127907e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f12701aa900 con 0x564e78be12e0 2024-09-12T00:00:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f127907e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f12701ac440 con 0x564e78be6370 2024-09-12T00:00:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f127907e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12701aafd0 con 0x564e78be09a0 2024-09-12T00:00:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f126f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be12e0 0x564e78bf21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f126f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be12e0 0x564e78bf21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45306/0 (socket says 172.21.15.6:45306) 2024-09-12T00:00:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f126f7fe640 1 -- 172.21.15.6:0/820140367 learned_addr learned my addr 172.21.15.6:0/820140367 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f126ffff640 1 --2- 172.21.15.6:0/820140367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be09a0 0x564e78beb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f1274883640 1 --2- 172.21.15.6:0/820140367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be6370 0x564e78bdb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f126f7fe640 1 -- 172.21.15.6:0/820140367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be09a0 msgr2=0x564e78beb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f126f7fe640 1 --2- 172.21.15.6:0/820140367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be09a0 0x564e78beb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f126f7fe640 1 -- 172.21.15.6:0/820140367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be6370 msgr2=0x564e78bdb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f126f7fe640 1 --2- 172.21.15.6:0/820140367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be6370 0x564e78bdb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f126f7fe640 1 -- 172.21.15.6:0/820140367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e78bea800 con 0x564e78be12e0 2024-09-12T00:00:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f126ffff640 1 --2- 172.21.15.6:0/820140367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be09a0 0x564e78beb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.828+0000 7f126f7fe640 1 --2- 172.21.15.6:0/820140367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be12e0 0x564e78bf21d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1264000c00 tx=0x7f1264013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b049f712cef95dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.829+0000 7f1255ffb640 1 -- 172.21.15.6:0/820140367 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12640052d0 con 0x564e78be12e0 2024-09-12T00:00:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.829+0000 7f1255ffb640 1 -- 172.21.15.6:0/820140367 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f126401c930 con 0x564e78be12e0 2024-09-12T00:00:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.829+0000 7f1255ffb640 1 -- 172.21.15.6:0/820140367 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12640048c0 con 0x564e78be12e0 2024-09-12T00:00:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.830+0000 7f127907e740 1 -- 172.21.15.6:0/820140367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be12e0 msgr2=0x564e78bf21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.830+0000 7f127907e740 1 --2- 172.21.15.6:0/820140367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be12e0 0x564e78bf21d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1264000c00 tx=0x7f1264013040 comp rx=0 tx=0).stop 2024-09-12T00:00:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.830+0000 7f127907e740 1 -- 172.21.15.6:0/820140367 shutdown_connections 2024-09-12T00:00:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.830+0000 7f127907e740 1 --2- 172.21.15.6:0/820140367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be6370 0x564e78bdb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.830+0000 7f127907e740 1 --2- 172.21.15.6:0/820140367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be12e0 0x564e78bf21d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.830+0000 7f127907e740 1 --2- 172.21.15.6:0/820140367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be09a0 0x564e78beb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.830+0000 7f127907e740 1 -- 172.21.15.6:0/820140367 >> 172.21.15.6:0/820140367 conn(0x564e78bdc010 msgr2=0x564e78bda9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.830+0000 7f127907e740 1 -- 172.21.15.6:0/820140367 shutdown_connections 2024-09-12T00:00:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.830+0000 7f127907e740 1 -- 172.21.15.6:0/820140367 wait complete. 2024-09-12T00:00:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.830+0000 7f127907e740 1 -- start start 2024-09-12T00:00:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.830+0000 7f127907e740 1 Processor -- start 2024-09-12T00:00:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f127907e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be09a0 0x564e78bf00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f127907e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78bf0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f127907e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 0x564e78bf1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f127907e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f12701abd70 con 0x564e78be6370 2024-09-12T00:00:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f127907e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f12701ab6a0 con 0x564e78be09a0 2024-09-12T00:00:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f127907e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12701a88e0 con 0x564e78be12e0 2024-09-12T00:00:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f127907e740 10 client.0 _ll_register_callbacks cb 0x7f12600d7040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f126ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be09a0 0x564e78bf00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f1274883640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 0x564e78bf1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f1274883640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 0x564e78bf1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45322/0 (socket says 172.21.15.6:45322) 2024-09-12T00:00:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f1274883640 1 -- 172.21.15.6:0/1066402756 learned_addr learned my addr 172.21.15.6:0/1066402756 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f126f7fe640 1 --2- 172.21.15.6:0/1066402756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78bf0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f1274883640 1 -- 172.21.15.6:0/1066402756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 msgr2=0x564e78bf0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f1274883640 1 --2- 172.21.15.6:0/1066402756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78bf0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f1274883640 1 -- 172.21.15.6:0/1066402756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be09a0 msgr2=0x564e78bf00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f1274883640 1 --2- 172.21.15.6:0/1066402756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be09a0 0x564e78bf00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.831+0000 7f1274883640 1 -- 172.21.15.6:0/1066402756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e78bf1c30 con 0x564e78be6370 2024-09-12T00:00:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.832+0000 7f1274883640 1 --2- 172.21.15.6:0/1066402756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 0x564e78bf1620 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1268009ca0 tx=0x7f126802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8fcaf842714603 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.832+0000 7f124f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:00:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.832+0000 7f124f7fe640 1 -- 172.21.15.6:0/1066402756 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268058060 con 0x564e78be6370 2024-09-12T00:00:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.832+0000 7f127907e740 1 -- 172.21.15.6:0/1066402756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f126401c930 con 0x564e78be6370 2024-09-12T00:00:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.832+0000 7f124f7fe640 1 -- 172.21.15.6:0/1066402756 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f1268042030 con 0x564e78be6370 2024-09-12T00:00:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.832+0000 7f124f7fe640 1 -- 172.21.15.6:0/1066402756 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f126805f050 con 0x564e78be6370 2024-09-12T00:00:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.832+0000 7f127907e740 10 client.15417 fetch_fsmap learned FSMap version 28 2024-09-12T00:00:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.832+0000 7f127907e740 1 -- 172.21.15.6:0/1066402756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564e78c61d80 con 0x564e78be6370 2024-09-12T00:00:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.832+0000 7f124f7fe640 1 -- 172.21.15.6:0/1066402756 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f126401c930 con 0x564e78be6370 2024-09-12T00:00:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.833+0000 7f124f7fe640 1 -- 172.21.15.6:0/1066402756 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1268030920 con 0x564e78be6370 2024-09-12T00:00:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.833+0000 7f127907e740 10 client.15417 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T00:00:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.833+0000 7f127907e740 10 client.15417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:00:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.833+0000 7f127907e740 20 client.15417 populate_metadata read hostname 'smithi006' 2024-09-12T00:00:18.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.833+0000 7f127907e740 1 --2- 172.21.15.6:0/1066402756 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e78c626b0 0x564e78c64ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.834+0000 7f127907e740 4 client.15417 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:00:18.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.834+0000 7f127907e740 1 -- 172.21.15.6:0/1066402756 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e78b4bd70 con 0x564e78c626b0 2024-09-12T00:00:18.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.834+0000 7f126ffff640 1 --2- 172.21.15.6:0/1066402756 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e78c626b0 0x564e78c64ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.834+0000 7f126ffff640 1 --2- 172.21.15.6:0/1066402756 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e78c626b0 0x564e78c64ad0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=736337361ff05636 server_cookie=e2ad56f1399c2f50 in_seq=0 out_seq=0 2024-09-12T00:00:18.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.834+0000 7f124f7fe640 10 client.15417 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f124f7fe640 1 -- 172.21.15.6:0/1066402756 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e78b4bd70 con 0x564e78c626b0 2024-09-12T00:00:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f124f7fe640 10 client.15417 handle_command_reply: tid=0 2024-09-12T00:00:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f127907e740 1 client.15417 shutdown 2024-09-12T00:00:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f127907e740 1 -- 172.21.15.6:0/1066402756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 msgr2=0x564e78bf1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f127907e740 1 --2- 172.21.15.6:0/1066402756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 0x564e78bf1620 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1268009ca0 tx=0x7f126802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f127907e740 1 -- 172.21.15.6:0/1066402756 shutdown_connections 2024-09-12T00:00:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f127907e740 1 --2- 172.21.15.6:0/1066402756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e78be6370 0x564e78bf1620 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f127907e740 1 --2- 172.21.15.6:0/1066402756 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e78c626b0 0x564e78c64ad0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f127907e740 1 --2- 172.21.15.6:0/1066402756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e78be12e0 0x564e78bf0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f124f7fe640 0 client.15417 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f127907e740 1 --2- 172.21.15.6:0/1066402756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e78be09a0 0x564e78bf00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f127907e740 1 -- 172.21.15.6:0/1066402756 >> 172.21.15.6:0/1066402756 conn(0x564e78bdc010 msgr2=0x564e78bdb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f127907e740 1 -- 172.21.15.6:0/1066402756 shutdown_connections 2024-09-12T00:00:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.838+0000 7f127907e740 1 -- 172.21.15.6:0/1066402756 wait complete. 2024-09-12T00:00:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.839+0000 7f127907e740 20 client.15417 trim_cache size 0 max 16384 2024-09-12T00:00:18.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:00:18.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:00:18.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:00:18.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:00:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.839+0000 7f12762e6640 1 -- 172.21.15.6:0/299828768 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f12580a2c90 msgr2=0x7f12580a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.839+0000 7f12762e6640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f12580a2c90 0x7f12580a5150 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1268005e30 tx=0x7f1268031a40 comp rx=0 tx=0).stop 2024-09-12T00:00:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.839+0000 7f12762e6640 1 -- 172.21.15.6:0/299828768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12701025c0 msgr2=0x7f1270197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.839+0000 7f12762e6640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12701025c0 0x7f1270197df0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f126000e9f0 tx=0x7f126000edf0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.839+0000 7f12762e6640 1 -- 172.21.15.6:0/299828768 shutdown_connections 2024-09-12T00:00:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.839+0000 7f12762e6640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f12580a2c90 0x7f12580a5150 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.839+0000 7f12762e6640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1270107820 0x7f127019f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.839+0000 7f12762e6640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1270104ef0 0x7f1270198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.839+0000 7f12762e6640 1 --2- 172.21.15.6:0/299828768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12701025c0 0x7f1270197df0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.839+0000 7f12762e6640 1 -- 172.21.15.6:0/299828768 >> 172.21.15.6:0/299828768 conn(0x7f12700fc1c0 msgr2=0x7f1270102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.840+0000 7f12762e6640 1 -- 172.21.15.6:0/299828768 shutdown_connections 2024-09-12T00:00:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:18.840+0000 7f12762e6640 1 -- 172.21.15.6:0/299828768 wait complete. 2024-09-12T00:00:19.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:18 smithi006 ceph-mon[30947]: pgmap v388: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:19.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:18 smithi134 ceph-mon[34893]: pgmap v388: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:19.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:18 smithi039 ceph-mon[34543]: pgmap v388: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:21.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:20 smithi006 ceph-mon[30947]: pgmap v389: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:21.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:20 smithi134 ceph-mon[34893]: pgmap v389: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:21.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:20 smithi039 ceph-mon[34543]: pgmap v389: 129 pgs: 129 active+clean; 670 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T00:00:23.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:22 smithi006 ceph-mon[30947]: pgmap v390: 129 pgs: 129 active+clean; 671 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T00:00:23.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:22 smithi134 ceph-mon[34893]: pgmap v390: 129 pgs: 129 active+clean; 671 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T00:00:23.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:22 smithi039 ceph-mon[34543]: pgmap v390: 129 pgs: 129 active+clean; 671 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T00:00:24.466 INFO:tasks.workunit.client.0.smithi006.stderr:Updating files: 93% (12119/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T00:00:25.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:24 smithi006 ceph-mon[30947]: pgmap v391: 129 pgs: 129 active+clean; 671 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T00:00:25.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:24 smithi134 ceph-mon[34893]: pgmap v391: 129 pgs: 129 active+clean; 671 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T00:00:25.208 INFO:tasks.workunit.client.0.smithi006.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T00:00:25.208 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-09-12T00:00:25.208 INFO:tasks.workunit.client.0.smithi006.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:00:25.208 INFO:tasks.workunit.client.0.smithi006.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:00:25.208 INFO:tasks.workunit.client.0.smithi006.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr: git switch -c 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr:Or undo this operation with: 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr: git switch - 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-09-12T00:00:25.209 INFO:tasks.workunit.client.0.smithi006.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T00:00:25.213 DEBUG:teuthology.orchestra.run.smithi006:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:00:25.280 INFO:tasks.workunit.client.0.smithi006.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:00:25.282 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:00:25.282 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:00:25.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:24 smithi039 ceph-mon[34543]: pgmap v391: 129 pgs: 129 active+clean; 671 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T00:00:25.939 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:00:26.003 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:00:26.044 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:00:26.045 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:00:26.045 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:00:26.086 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:00:26.089 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-12T00:00:26.089 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:00:26.146 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-12T00:00:26.148 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-12T00:00:26.148 DEBUG:teuthology.orchestra.run.smithi006:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-12T00:00:26.214 INFO:tasks.workunit.client.0.smithi006.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-12T00:00:26.215 INFO:tasks.workunit.client.0.smithi006.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-12T00:00:26.215 INFO:tasks.workunit.client.0.smithi006.stderr:+ trap -- retry EXIT 2024-09-12T00:00:26.215 INFO:tasks.workunit.client.0.smithi006.stderr:+ rm -rf ffsb 2024-09-12T00:00:26.216 INFO:tasks.workunit.client.0.smithi006.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-12T00:00:26.220 INFO:tasks.workunit.client.0.smithi006.stderr:Cloning into 'ffsb'... 2024-09-12T00:00:27.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:26 smithi006 ceph-mon[30947]: pgmap v392: 129 pgs: 129 active+clean; 671 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T00:00:27.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:26 smithi134 ceph-mon[34893]: pgmap v392: 129 pgs: 129 active+clean; 671 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T00:00:27.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:26 smithi039 ceph-mon[34543]: pgmap v392: 129 pgs: 129 active+clean; 671 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T00:00:28.239 INFO:tasks.workunit.client.0.smithi006.stderr:+ trap - EXIT 2024-09-12T00:00:28.239 INFO:tasks.workunit.client.0.smithi006.stderr:+ cd ffsb 2024-09-12T00:00:28.239 INFO:tasks.workunit.client.0.smithi006.stderr:+ ./configure 2024-09-12T00:00:28.375 INFO:tasks.workunit.client.0.smithi006.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-12T00:00:29.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:28 smithi006 ceph-mon[30947]: pgmap v393: 129 pgs: 129 active+clean; 678 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-12T00:00:29.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:28 smithi006 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:00:29.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:28 smithi134 ceph-mon[34893]: pgmap v393: 129 pgs: 129 active+clean; 678 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-12T00:00:29.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:28 smithi134 ceph-mon[34893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:00:29.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:28 smithi039 ceph-mon[34543]: pgmap v393: 129 pgs: 129 active+clean; 678 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-12T00:00:29.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:28 smithi039 ceph-mon[34543]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:00:29.386 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether build environment is sane... yes 2024-09-12T00:00:29.404 INFO:tasks.workunit.client.0.smithi006.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-12T00:00:29.405 INFO:tasks.workunit.client.0.smithi006.stdout:checking for gawk... gawk 2024-09-12T00:00:29.431 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether make sets $(MAKE)... yes 2024-09-12T00:00:29.480 INFO:tasks.workunit.client.0.smithi006.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-12T00:00:29.480 INFO:tasks.workunit.client.0.smithi006.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-12T00:00:29.505 INFO:tasks.workunit.client.0.smithi006.stdout:checking for style of include used by make... GNU 2024-09-12T00:00:29.509 INFO:tasks.workunit.client.0.smithi006.stdout:checking for gcc... gcc 2024-09-12T00:00:29.597 INFO:tasks.workunit.client.0.smithi006.stdout:checking for C compiler default output file name... a.out 2024-09-12T00:00:29.600 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether the C compiler works... yes 2024-09-12T00:00:29.603 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether we are cross compiling... no 2024-09-12T00:00:29.655 INFO:tasks.workunit.client.0.smithi006.stdout:checking for suffix of executables... 2024-09-12T00:00:29.699 INFO:tasks.workunit.client.0.smithi006.stdout:checking for suffix of object files... o 2024-09-12T00:00:29.741 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether we are using the GNU C compiler... yes 2024-09-12T00:00:29.785 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether gcc accepts -g... yes 2024-09-12T00:00:29.874 INFO:tasks.workunit.client.0.smithi006.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-12T00:00:30.023 INFO:tasks.workunit.client.0.smithi006.stdout:checking dependency style of gcc... gcc3 2024-09-12T00:00:30.111 INFO:tasks.workunit.client.0.smithi006.stdout:checking how to run the C preprocessor... gcc -E 2024-09-12T00:00:30.173 INFO:tasks.workunit.client.0.smithi006.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-12T00:00:30.174 INFO:tasks.workunit.client.0.smithi006.stdout:checking for egrep... /usr/bin/grep -E 2024-09-12T00:00:30.187 INFO:tasks.workunit.client.0.smithi006.stdout:checking for AIX... no 2024-09-12T00:00:30.211 INFO:tasks.workunit.client.0.smithi006.stdout:checking for gcc... (cached) gcc 2024-09-12T00:00:30.224 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-12T00:00:30.226 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-12T00:00:30.226 INFO:tasks.workunit.client.0.smithi006.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-12T00:00:30.226 INFO:tasks.workunit.client.0.smithi006.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-12T00:00:30.304 INFO:tasks.workunit.client.0.smithi006.stdout:checking for main in -lm... yes 2024-09-12T00:00:30.376 INFO:tasks.workunit.client.0.smithi006.stdout:checking for main in -lpthread... yes 2024-09-12T00:00:30.618 INFO:tasks.workunit.client.0.smithi006.stdout:checking for ANSI C header files... yes 2024-09-12T00:00:30.704 INFO:tasks.workunit.client.0.smithi006.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-12T00:00:30.764 INFO:tasks.workunit.client.0.smithi006.stdout:checking for sys/types.h... yes 2024-09-12T00:00:30.835 INFO:tasks.workunit.client.0.smithi006.stdout:checking for sys/stat.h... yes 2024-09-12T00:00:30.899 INFO:tasks.workunit.client.0.smithi006.stdout:checking for stdlib.h... yes 2024-09-12T00:00:30.972 INFO:tasks.workunit.client.0.smithi006.stdout:checking for string.h... yes 2024-09-12T00:00:31.039 INFO:tasks.workunit.client.0.smithi006.stdout:checking for memory.h... yes 2024-09-12T00:00:31.104 INFO:tasks.workunit.client.0.smithi006.stdout:checking for strings.h... yes 2024-09-12T00:00:31.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:30 smithi006 ceph-mon[30947]: pgmap v394: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 45 KiB/s wr, 16 op/s 2024-09-12T00:00:31.169 INFO:tasks.workunit.client.0.smithi006.stdout:checking for inttypes.h... yes 2024-09-12T00:00:31.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:30 smithi134 ceph-mon[34893]: pgmap v394: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 45 KiB/s wr, 16 op/s 2024-09-12T00:00:31.236 INFO:tasks.workunit.client.0.smithi006.stdout:checking for stdint.h... yes 2024-09-12T00:00:31.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:30 smithi039 ceph-mon[34543]: pgmap v394: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 45 KiB/s wr, 16 op/s 2024-09-12T00:00:31.310 INFO:tasks.workunit.client.0.smithi006.stdout:checking for unistd.h... yes 2024-09-12T00:00:31.399 INFO:tasks.workunit.client.0.smithi006.stdout:checking pthread.h usability... yes 2024-09-12T00:00:31.433 INFO:tasks.workunit.client.0.smithi006.stdout:checking pthread.h presence... yes 2024-09-12T00:00:31.434 INFO:tasks.workunit.client.0.smithi006.stdout:checking for pthread.h... yes 2024-09-12T00:00:31.516 INFO:tasks.workunit.client.0.smithi006.stdout:checking fcntl.h usability... yes 2024-09-12T00:00:31.543 INFO:tasks.workunit.client.0.smithi006.stdout:checking fcntl.h presence... yes 2024-09-12T00:00:31.543 INFO:tasks.workunit.client.0.smithi006.stdout:checking for fcntl.h... yes 2024-09-12T00:00:31.626 INFO:tasks.workunit.client.0.smithi006.stdout:checking limits.h usability... yes 2024-09-12T00:00:31.653 INFO:tasks.workunit.client.0.smithi006.stdout:checking limits.h presence... yes 2024-09-12T00:00:31.654 INFO:tasks.workunit.client.0.smithi006.stdout:checking for limits.h... yes 2024-09-12T00:00:31.677 INFO:tasks.workunit.client.0.smithi006.stdout:checking for stdint.h... (cached) yes 2024-09-12T00:00:31.740 INFO:tasks.workunit.client.0.smithi006.stdout:checking sys/time.h usability... yes 2024-09-12T00:00:31.776 INFO:tasks.workunit.client.0.smithi006.stdout:checking sys/time.h presence... yes 2024-09-12T00:00:31.776 INFO:tasks.workunit.client.0.smithi006.stdout:checking for sys/time.h... yes 2024-09-12T00:00:31.800 INFO:tasks.workunit.client.0.smithi006.stdout:checking for unistd.h... (cached) yes 2024-09-12T00:00:31.868 INFO:tasks.workunit.client.0.smithi006.stdout:checking sys/vfs.h usability... yes 2024-09-12T00:00:31.897 INFO:tasks.workunit.client.0.smithi006.stdout:checking sys/vfs.h presence... yes 2024-09-12T00:00:31.898 INFO:tasks.workunit.client.0.smithi006.stdout:checking for sys/vfs.h... yes 2024-09-12T00:00:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.942+0000 7f9f27a01640 1 -- 172.21.15.6:0/776382924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f20107820 msgr2=0x7f9f20109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.942+0000 7f9f27a01640 1 --2- 172.21.15.6:0/776382924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f20107820 0x7f9f20109c90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009ca0 tx=0x7f9f1802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.942+0000 7f9f27a01640 1 -- 172.21.15.6:0/776382924 shutdown_connections 2024-09-12T00:00:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.942+0000 7f9f27a01640 1 --2- 172.21.15.6:0/776382924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f20107820 0x7f9f20109c90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.942+0000 7f9f27a01640 1 --2- 172.21.15.6:0/776382924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f20104ef0 0x7f9f201072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.942+0000 7f9f27a01640 1 --2- 172.21.15.6:0/776382924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f201025c0 0x7f9f201049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.942+0000 7f9f27a01640 1 -- 172.21.15.6:0/776382924 >> 172.21.15.6:0/776382924 conn(0x7f9f200fc1c0 msgr2=0x7f9f200fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.942+0000 7f9f27a01640 1 -- 172.21.15.6:0/776382924 shutdown_connections 2024-09-12T00:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.942+0000 7f9f27a01640 1 -- 172.21.15.6:0/776382924 wait complete. 2024-09-12T00:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f27a01640 1 Processor -- start 2024-09-12T00:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f27a01640 1 -- start start 2024-09-12T00:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f27a01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f201025c0 0x7f9f20197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f27a01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f20104ef0 0x7f9f20198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f27a01640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f20107820 0x7f9f2019f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f27a01640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2010d6b0 con 0x7f9f20104ef0 2024-09-12T00:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f27a01640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2010d530 con 0x7f9f20107820 2024-09-12T00:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f27a01640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2010d830 con 0x7f9f201025c0 2024-09-12T00:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f24f9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f20104ef0 0x7f9f20198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f2579d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f201025c0 0x7f9f20197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f24f9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f20104ef0 0x7f9f20198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44640/0 (socket says 172.21.15.6:44640) 2024-09-12T00:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f24f9c640 1 -- 172.21.15.6:0/4284574379 learned_addr learned my addr 172.21.15.6:0/4284574379 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f25f9e640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f20107820 0x7f9f2019f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f2579d640 1 -- 172.21.15.6:0/4284574379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f20107820 msgr2=0x7f9f2019f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f2579d640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f20107820 0x7f9f2019f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f2579d640 1 -- 172.21.15.6:0/4284574379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f20104ef0 msgr2=0x7f9f20198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f2579d640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f20104ef0 0x7f9f20198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f2579d640 1 -- 172.21.15.6:0/4284574379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2019fa10 con 0x7f9f201025c0 2024-09-12T00:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.943+0000 7f9f24f9c640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f20104ef0 0x7f9f20198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.944+0000 7f9f2579d640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f201025c0 0x7f9f20197df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00e9f0 tx=0x7f9f1c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.944+0000 7f9f167fc640 1 -- 172.21.15.6:0/4284574379 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c00ccc0 con 0x7f9f201025c0 2024-09-12T00:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.944+0000 7f9f167fc640 1 -- 172.21.15.6:0/4284574379 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f1c0108e0 con 0x7f9f201025c0 2024-09-12T00:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.944+0000 7f9f27a01640 1 -- 172.21.15.6:0/4284574379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2019fd00 con 0x7f9f201025c0 2024-09-12T00:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.944+0000 7f9f167fc640 1 -- 172.21.15.6:0/4284574379 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c018880 con 0x7f9f201025c0 2024-09-12T00:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.944+0000 7f9f27a01640 1 -- 172.21.15.6:0/4284574379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f201a01a0 con 0x7f9f201025c0 2024-09-12T00:00:31.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.946+0000 7f9f167fc640 1 -- 172.21.15.6:0/4284574379 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f9f1c010a90 con 0x7f9f201025c0 2024-09-12T00:00:31.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2a874740 1 Processor -- start 2024-09-12T00:00:31.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2a874740 1 -- start start 2024-09-12T00:00:31.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2a874740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 0x55e23726c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2a874740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726c6f0 0x55e2372711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2a874740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e237273c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2a874740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e2371cb2f0 con 0x55e23726bdb0 2024-09-12T00:00:31.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2a874740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e237173270 con 0x55e237271780 2024-09-12T00:00:31.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2a874740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e2371c72b0 con 0x55e23726c6f0 2024-09-12T00:00:31.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f167fc640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9f0c0a2b80 0x7f9f0c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2579d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726c6f0 0x55e2372711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f25f9e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 0x55e23726c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f25f9e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 0x55e23726c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44656/0 (socket says 172.21.15.6:44656) 2024-09-12T00:00:31.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f25f9e640 1 -- 172.21.15.6:0/1709575508 learned_addr learned my addr 172.21.15.6:0/1709575508 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:31.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f25f9e640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9f0c0a2b80 0x7f9f0c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f24f9c640 1 --2- 172.21.15.6:0/1709575508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e237273c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f167fc640 1 -- 172.21.15.6:0/4284574379 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f9f1c0cf7e0 con 0x7f9f201025c0 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2579d640 1 -- 172.21.15.6:0/1709575508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 msgr2=0x55e237273c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2579d640 1 --2- 172.21.15.6:0/1709575508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e237273c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2579d640 1 -- 172.21.15.6:0/1709575508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 msgr2=0x55e23726c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2579d640 1 --2- 172.21.15.6:0/1709575508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 0x55e23726c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f2579d640 1 -- 172.21.15.6:0/1709575508 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e237172340 con 0x55e23726c6f0 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.947+0000 7f9f24f9c640 1 --2- 172.21.15.6:0/1709575508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e237273c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.948+0000 7f9f25f9e640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9f0c0a2b80 0x7f9f0c0a5040 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f18004af0 tx=0x7f9f18004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.948+0000 7f9f2579d640 1 --2- 172.21.15.6:0/1709575508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726c6f0 0x55e2372711b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c098670 tx=0x7f9f1c010ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=917a8c33c32d83cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.948+0000 7f9f0b7fe640 1 -- 172.21.15.6:0/1709575508 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c0a4860 con 0x55e23726c6f0 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.948+0000 7f9f0b7fe640 1 -- 172.21.15.6:0/1709575508 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f1c0ccfa0 con 0x55e23726c6f0 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.948+0000 7f9f0b7fe640 1 -- 172.21.15.6:0/1709575508 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c0cfe30 con 0x55e23726c6f0 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.949+0000 7f9f2a874740 1 -- 172.21.15.6:0/1709575508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726c6f0 msgr2=0x55e2372711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:31.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.949+0000 7f9f2a874740 1 --2- 172.21.15.6:0/1709575508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726c6f0 0x55e2372711b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c098670 tx=0x7f9f1c010ec0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.949+0000 7f9f2a874740 1 -- 172.21.15.6:0/1709575508 shutdown_connections 2024-09-12T00:00:31.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.949+0000 7f9f2a874740 1 --2- 172.21.15.6:0/1709575508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e237273c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.949+0000 7f9f2a874740 1 --2- 172.21.15.6:0/1709575508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726c6f0 0x55e2372711b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.949+0000 7f9f2a874740 1 --2- 172.21.15.6:0/1709575508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 0x55e23726c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.949+0000 7f9f2a874740 1 -- 172.21.15.6:0/1709575508 >> 172.21.15.6:0/1709575508 conn(0x55e237263010 msgr2=0x55e237263410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:31.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.949+0000 7f9f2a874740 1 -- 172.21.15.6:0/1709575508 shutdown_connections 2024-09-12T00:00:31.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.949+0000 7f9f2a874740 1 -- 172.21.15.6:0/1709575508 wait complete. 2024-09-12T00:00:31.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.949+0000 7f9f2a874740 1 -- start start 2024-09-12T00:00:31.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.949+0000 7f9f2a874740 1 Processor -- start 2024-09-12T00:00:31.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f2a874740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726bdb0 0x55e237276090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f2a874740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 0x55e2372765d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f2a874740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e23727d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f2a874740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e2372746f0 con 0x55e23726c6f0 2024-09-12T00:00:31.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f2a874740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e237154290 con 0x55e237271780 2024-09-12T00:00:31.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f2a874740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e237274870 con 0x55e23726bdb0 2024-09-12T00:00:31.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f2a874740 10 client.0 _ll_register_callbacks cb 0x55e237185140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:31.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f24f9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 0x55e2372765d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f24f9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 0x55e2372765d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44660/0 (socket says 172.21.15.6:44660) 2024-09-12T00:00:31.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f24f9c640 1 -- 172.21.15.6:0/3176410350 learned_addr learned my addr 172.21.15.6:0/3176410350 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:31.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f25f9e640 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e23727d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f2579d640 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726bdb0 0x55e237276090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f24f9c640 1 -- 172.21.15.6:0/3176410350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726bdb0 msgr2=0x55e237276090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:31.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f24f9c640 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726bdb0 0x55e237276090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f24f9c640 1 -- 172.21.15.6:0/3176410350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 msgr2=0x55e23727d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:31.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f24f9c640 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e23727d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f24f9c640 1 -- 172.21.15.6:0/3176410350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e236ede210 con 0x55e23726c6f0 2024-09-12T00:00:31.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f25f9e640 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e23727d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:31.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f24f9c640 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 0x55e2372765d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9f10012d20 tx=0x7f9f1000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd789fe3beb35792 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:31.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.950+0000 7f9f08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:00:31.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f08ff9640 1 -- 172.21.15.6:0/3176410350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f100120d0 con 0x55e23726c6f0 2024-09-12T00:00:31.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f2a874740 1 -- 172.21.15.6:0/3176410350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f1c0ccfa0 con 0x55e23726c6f0 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f08ff9640 1 -- 172.21.15.6:0/3176410350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f9f10005020 con 0x55e23726c6f0 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f08ff9640 1 -- 172.21.15.6:0/3176410350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9f10025050 con 0x55e23726c6f0 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f2a874740 10 client.15429 fetch_fsmap learned FSMap version 30 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f2a874740 1 -- 172.21.15.6:0/3176410350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e236faa620 con 0x55e23726c6f0 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f08ff9640 1 -- 172.21.15.6:0/3176410350 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f1c0ccfa0 con 0x55e23726c6f0 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f08ff9640 1 -- 172.21.15.6:0/3176410350 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f9f10004cd0 con 0x55e23726c6f0 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f2a874740 10 client.15429 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f2a874740 10 client.15429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f2a874740 20 client.15429 populate_metadata read hostname 'smithi006' 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f2a874740 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e237281d60 0x55e2372841a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f2a874740 4 client.15429 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f2a874740 1 -- 172.21.15.6:0/3176410350 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2371d8a20 con 0x55e237281d60 2024-09-12T00:00:31.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.951+0000 7f9f2579d640 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e237281d60 0x55e2372841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.952+0000 7f9f08ff9640 10 client.15429 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:31.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.952+0000 7f9f2579d640 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e237281d60 0x55e2372841a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bed396076ef55b1 server_cookie=9add7b471a1da391 in_seq=0 out_seq=0 2024-09-12T00:00:31.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.952+0000 7f9f08ff9640 1 -- 172.21.15.6:0/3176410350 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e2371d8a20 con 0x55e237281d60 2024-09-12T00:00:31.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.952+0000 7f9f08ff9640 10 client.15429 handle_command_reply: tid=0 2024-09-12T00:00:31.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.952+0000 7f9f2a874740 1 client.15429 shutdown 2024-09-12T00:00:31.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.953+0000 7f9f2a874740 1 -- 172.21.15.6:0/3176410350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 msgr2=0x55e2372765d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:31.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.953+0000 7f9f2a874740 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 0x55e2372765d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9f10012d20 tx=0x7f9f1000f790 comp rx=0 tx=0).stop 2024-09-12T00:00:31.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.953+0000 7f9f2a874740 1 -- 172.21.15.6:0/3176410350 shutdown_connections 2024-09-12T00:00:31.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.953+0000 7f9f2a874740 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e23727d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.953+0000 7f9f2a874740 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 0x55e2372765d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.953+0000 7f9f2a874740 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e237281d60 0x55e2372841a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.953+0000 7f9f2a874740 1 --2- 172.21.15.6:0/3176410350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726bdb0 0x55e237276090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.953+0000 7f9f2a874740 1 -- 172.21.15.6:0/3176410350 >> 172.21.15.6:0/3176410350 conn(0x55e237263010 msgr2=0x55e237264820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:31.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.953+0000 7f9f08ff9640 0 client.15429 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:31.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.953+0000 7f9f2a874740 1 -- 172.21.15.6:0/3176410350 shutdown_connections 2024-09-12T00:00:31.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.953+0000 7f9f2a874740 1 -- 172.21.15.6:0/3176410350 wait complete. 2024-09-12T00:00:31.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.953+0000 7f9f2a874740 20 client.15429 trim_cache size 0 max 16384 2024-09-12T00:00:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f2a874740 1 Processor -- start 2024-09-12T00:00:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f2a874740 1 -- start start 2024-09-12T00:00:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f2a874740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726bdb0 0x55e2372633f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f2a874740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 0x55e23727d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f2a874740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e237263930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f2a874740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201a8750 con 0x55e23726c6f0 2024-09-12T00:00:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f2a874740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201aa320 con 0x55e237271780 2024-09-12T00:00:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f2a874740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201a8e20 con 0x55e23726bdb0 2024-09-12T00:00:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f24f9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 0x55e23727d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f24f9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 0x55e23727d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44668/0 (socket says 172.21.15.6:44668) 2024-09-12T00:00:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f24f9c640 1 -- 172.21.15.6:0/1816133594 learned_addr learned my addr 172.21.15.6:0/1816133594 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f2579d640 1 --2- 172.21.15.6:0/1816133594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726bdb0 0x55e2372633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f25f9e640 1 --2- 172.21.15.6:0/1816133594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e237263930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f24f9c640 1 -- 172.21.15.6:0/1816133594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726bdb0 msgr2=0x55e2372633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f24f9c640 1 --2- 172.21.15.6:0/1816133594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726bdb0 0x55e2372633f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f24f9c640 1 -- 172.21.15.6:0/1816133594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 msgr2=0x55e237263930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f24f9c640 1 --2- 172.21.15.6:0/1816133594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e237263930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f24f9c640 1 -- 172.21.15.6:0/1816133594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2372714b0 con 0x55e23726c6f0 2024-09-12T00:00:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.970+0000 7f9f24f9c640 1 --2- 172.21.15.6:0/1816133594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 0x55e23727d560 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9f10000c00 tx=0x7f9f10009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5d972f236e831f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.971+0000 7f9f0affd640 1 -- 172.21.15.6:0/1816133594 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1002e070 con 0x55e23726c6f0 2024-09-12T00:00:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.971+0000 7f9f0affd640 1 -- 172.21.15.6:0/1816133594 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f100120d0 con 0x55e23726c6f0 2024-09-12T00:00:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.971+0000 7f9f0affd640 1 -- 172.21.15.6:0/1816133594 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10022040 con 0x55e23726c6f0 2024-09-12T00:00:31.972 INFO:tasks.workunit.client.0.smithi006.stdout:checking sys/limits.h usability... no 2024-09-12T00:00:31.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.971+0000 7f9f2a874740 1 -- 172.21.15.6:0/1816133594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 msgr2=0x55e23727d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:31.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.971+0000 7f9f2a874740 1 --2- 172.21.15.6:0/1816133594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 0x55e23727d560 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9f10000c00 tx=0x7f9f10009530 comp rx=0 tx=0).stop 2024-09-12T00:00:31.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.971+0000 7f9f2a874740 1 -- 172.21.15.6:0/1816133594 shutdown_connections 2024-09-12T00:00:31.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.971+0000 7f9f2a874740 1 --2- 172.21.15.6:0/1816133594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e237271780 0x55e237263930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 --2- 172.21.15.6:0/1816133594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726c6f0 0x55e23727d560 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 --2- 172.21.15.6:0/1816133594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e23726bdb0 0x55e2372633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 -- 172.21.15.6:0/1816133594 >> 172.21.15.6:0/1816133594 conn(0x55e237263010 msgr2=0x55e237283b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 -- 172.21.15.6:0/1816133594 shutdown_connections 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 -- 172.21.15.6:0/1816133594 wait complete. 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 -- start start 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 Processor -- start 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 0x55e23727a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e23726c6f0 0x55e23727a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e237271780 0x55e2372eaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201a9bc0 con 0x55e23726bdb0 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201a94f0 con 0x55e23726c6f0 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201a6730 con 0x55e237271780 2024-09-12T00:00:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2a874740 10 client.0 _ll_register_callbacks cb 0x7f9f10009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:31.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2579d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 0x55e23727a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2579d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 0x55e23727a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44674/0 (socket says 172.21.15.6:44674) 2024-09-12T00:00:31.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.972+0000 7f9f2579d640 1 -- 172.21.15.6:0/2527110875 learned_addr learned my addr 172.21.15.6:0/2527110875 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:31.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f24f9c640 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e23726c6f0 0x55e23727a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f25f9e640 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e237271780 0x55e2372eaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f2579d640 1 -- 172.21.15.6:0/2527110875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e237271780 msgr2=0x55e2372eaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:31.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f2579d640 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e237271780 0x55e2372eaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f2579d640 1 -- 172.21.15.6:0/2527110875 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e23726c6f0 msgr2=0x55e23727a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:31.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f2579d640 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e23726c6f0 0x55e23727a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:31.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f2579d640 1 -- 172.21.15.6:0/2527110875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2372eafb0 con 0x55e23726bdb0 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f2579d640 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 0x55e23727a340 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c09bc30 tx=0x7f9f1c0cd150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caa44992a532266 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f08ff9640 1 -- 172.21.15.6:0/2527110875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c097f40 con 0x55e23726bdb0 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f08ff9640 1 -- 172.21.15.6:0/2527110875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f9f1c099fa0 con 0x55e23726bdb0 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f2a874740 1 -- 172.21.15.6:0/2527110875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f100120d0 con 0x55e23726bdb0 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f08ff9640 1 -- 172.21.15.6:0/2527110875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9f1c0ccf10 con 0x55e23726bdb0 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f2a874740 10 client.15435 fetch_fsmap learned FSMap version 30 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.973+0000 7f9f2a874740 1 -- 172.21.15.6:0/2527110875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e2372ec1b0 con 0x55e23726bdb0 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.974+0000 7f9f08ff9640 1 -- 172.21.15.6:0/2527110875 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f100120d0 con 0x55e23726bdb0 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.974+0000 7f9f08ff9640 1 -- 172.21.15.6:0/2527110875 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f9f1c0a43d0 con 0x55e23726bdb0 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.974+0000 7f9f2a874740 10 client.15435 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.974+0000 7f9f2a874740 10 client.15435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.974+0000 7f9f2a874740 20 client.15435 populate_metadata read hostname 'smithi006' 2024-09-12T00:00:31.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.974+0000 7f9f2a874740 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e2372ec770 0x55e2372eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:31.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.974+0000 7f9f2a874740 4 client.15435 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:00:31.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.974+0000 7f9f2a874740 1 -- 172.21.15.6:0/2527110875 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e2371d2d70 con 0x55e2372ec770 2024-09-12T00:00:31.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.974+0000 7f9f24f9c640 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e2372ec770 0x55e2372eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:31.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.974+0000 7f9f08ff9640 10 client.15435 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:31.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:31.974+0000 7f9f24f9c640 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e2372ec770 0x55e2372eeb90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86cdc10241416eb server_cookie=4c353cd0458358e4 in_seq=0 out_seq=0 2024-09-12T00:00:32.002 INFO:tasks.workunit.client.0.smithi006.stdout:checking sys/limits.h presence... no 2024-09-12T00:00:32.002 INFO:tasks.workunit.client.0.smithi006.stdout:checking for sys/limits.h... no 2024-09-12T00:00:32.047 INFO:tasks.workunit.client.0.smithi006.stdout:checking for an ANSI C-conforming const... yes 2024-09-12T00:00:32.097 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-12T00:00:32.100 INFO:tasks.workunit.client.0.smithi006.stdout:checking for function prototypes... yes 2024-09-12T00:00:32.146 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether setvbuf arguments are reversed... no 2024-09-12T00:00:32.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f08ff9640 1 -- 172.21.15.6:0/2527110875 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e2371d2d70 con 0x55e2372ec770 2024-09-12T00:00:32.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f08ff9640 10 client.15435 handle_command_reply: tid=0 2024-09-12T00:00:32.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f2a874740 1 client.15435 shutdown 2024-09-12T00:00:32.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f2a874740 1 -- 172.21.15.6:0/2527110875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 msgr2=0x55e23727a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f2a874740 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 0x55e23727a340 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c09bc30 tx=0x7f9f1c0cd150 comp rx=0 tx=0).stop 2024-09-12T00:00:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f2a874740 1 -- 172.21.15.6:0/2527110875 shutdown_connections 2024-09-12T00:00:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f2a874740 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e2372ec770 0x55e2372eeb90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f2a874740 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e237271780 0x55e2372eaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f2a874740 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e23726c6f0 0x55e23727a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f2a874740 1 --2- 172.21.15.6:0/2527110875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23726bdb0 0x55e23727a340 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f08ff9640 0 client.15435 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f2a874740 1 -- 172.21.15.6:0/2527110875 >> 172.21.15.6:0/2527110875 conn(0x55e237263010 msgr2=0x55e2372619a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f2a874740 1 -- 172.21.15.6:0/2527110875 shutdown_connections 2024-09-12T00:00:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f2a874740 1 -- 172.21.15.6:0/2527110875 wait complete. 2024-09-12T00:00:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.266+0000 7f9f2a874740 20 client.15435 trim_cache size 0 max 16384 2024-09-12T00:00:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:00:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:00:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:00:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:00:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.267+0000 7f9f27a01640 1 -- 172.21.15.6:0/4284574379 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9f0c0a2b80 msgr2=0x7f9f0c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.267+0000 7f9f27a01640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9f0c0a2b80 0x7f9f0c0a5040 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f18004af0 tx=0x7f9f18004a40 comp rx=0 tx=0).stop 2024-09-12T00:00:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.267+0000 7f9f27a01640 1 -- 172.21.15.6:0/4284574379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f201025c0 msgr2=0x7f9f20197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.267+0000 7f9f27a01640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f201025c0 0x7f9f20197df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00e9f0 tx=0x7f9f1c00eeb0 comp rx=0 tx=0).stop 2024-09-12T00:00:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.267+0000 7f9f27a01640 1 -- 172.21.15.6:0/4284574379 shutdown_connections 2024-09-12T00:00:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.267+0000 7f9f27a01640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9f0c0a2b80 0x7f9f0c0a5040 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.267+0000 7f9f27a01640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f20107820 0x7f9f2019f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.267+0000 7f9f27a01640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f20104ef0 0x7f9f20198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.267+0000 7f9f27a01640 1 --2- 172.21.15.6:0/4284574379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f201025c0 0x7f9f20197df0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.267+0000 7f9f27a01640 1 -- 172.21.15.6:0/4284574379 >> 172.21.15.6:0/4284574379 conn(0x7f9f200fc1c0 msgr2=0x7f9f20102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.267+0000 7f9f27a01640 1 -- 172.21.15.6:0/4284574379 shutdown_connections 2024-09-12T00:00:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:32.267+0000 7f9f27a01640 1 -- 172.21.15.6:0/4284574379 wait complete. 2024-09-12T00:00:32.327 INFO:tasks.workunit.client.0.smithi006.stdout:checking for system... yes 2024-09-12T00:00:32.424 INFO:tasks.workunit.client.0.smithi006.stdout:checking for gettimeofday... yes 2024-09-12T00:00:32.543 INFO:tasks.workunit.client.0.smithi006.stdout:checking for mkdir... yes 2024-09-12T00:00:32.660 INFO:tasks.workunit.client.0.smithi006.stdout:checking for strerror... yes 2024-09-12T00:00:32.773 INFO:tasks.workunit.client.0.smithi006.stdout:checking for open64... yes 2024-09-12T00:00:32.870 INFO:tasks.workunit.client.0.smithi006.stdout:checking for stat64... yes 2024-09-12T00:00:32.971 INFO:tasks.workunit.client.0.smithi006.stdout:checking for fseeko64... yes 2024-09-12T00:00:33.067 INFO:tasks.workunit.client.0.smithi006.stdout:checking for lrand48_r... yes 2024-09-12T00:00:33.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:32 smithi006 ceph-mon[30947]: pgmap v395: 129 pgs: 129 active+clean; 3.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 285 KiB/s wr, 40 op/s 2024-09-12T00:00:33.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:32 smithi006 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:00:33.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:32 smithi006 ceph-mon[30947]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-12T00:00:33.168 INFO:tasks.workunit.client.0.smithi006.stdout:checking for srand48_r... yes 2024-09-12T00:00:33.198 INFO:tasks.workunit.client.0.smithi006.stdout:configure: creating ./config.status 2024-09-12T00:00:33.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:32 smithi134 ceph-mon[34893]: pgmap v395: 129 pgs: 129 active+clean; 3.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 285 KiB/s wr, 40 op/s 2024-09-12T00:00:33.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:32 smithi134 ceph-mon[34893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:00:33.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:32 smithi134 ceph-mon[34893]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-12T00:00:33.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:32 smithi039 ceph-mon[34543]: pgmap v395: 129 pgs: 129 active+clean; 3.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 285 KiB/s wr, 40 op/s 2024-09-12T00:00:33.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:32 smithi039 ceph-mon[34543]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:00:33.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:32 smithi039 ceph-mon[34543]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-12T00:00:33.354 INFO:tasks.workunit.client.0.smithi006.stdout:config.status: creating Makefile 2024-09-12T00:00:33.376 INFO:tasks.workunit.client.0.smithi006.stdout:config.status: creating config.h 2024-09-12T00:00:33.407 INFO:tasks.workunit.client.0.smithi006.stdout:config.status: executing depfiles commands 2024-09-12T00:00:33.486 INFO:tasks.workunit.client.0.smithi006.stdout:config.status: executing default commands 2024-09-12T00:00:33.558 INFO:tasks.workunit.client.0.smithi006.stderr:+ make 2024-09-12T00:00:33.587 INFO:tasks.workunit.client.0.smithi006.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-12T00:00:33.594 INFO:tasks.workunit.client.0.smithi006.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-12T00:00:33.595 INFO:tasks.workunit.client.0.smithi006.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-12T00:00:33.595 INFO:tasks.workunit.client.0.smithi006.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-12T00:00:33.595 INFO:tasks.workunit.client.0.smithi006.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-12T00:00:33.595 INFO:tasks.workunit.client.0.smithi006.stderr: any GNU archive site. 2024-09-12T00:00:33.601 INFO:tasks.workunit.client.0.smithi006.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-12T00:00:33.605 INFO:tasks.workunit.client.0.smithi006.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-12T00:00:33.606 INFO:tasks.workunit.client.0.smithi006.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-12T00:00:33.607 INFO:tasks.workunit.client.0.smithi006.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-12T00:00:33.607 INFO:tasks.workunit.client.0.smithi006.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-12T00:00:33.607 INFO:tasks.workunit.client.0.smithi006.stderr: Grab them from any GNU archive site. 2024-09-12T00:00:33.810 INFO:tasks.workunit.client.0.smithi006.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-12T00:00:34.100 INFO:tasks.workunit.client.0.smithi006.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-12T00:00:34.101 INFO:tasks.workunit.client.0.smithi006.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-12T00:00:34.101 INFO:tasks.workunit.client.0.smithi006.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-12T00:00:34.101 INFO:tasks.workunit.client.0.smithi006.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-12T00:00:34.242 INFO:tasks.workunit.client.0.smithi006.stdout:/bin/sh ./config.status --recheck 2024-09-12T00:00:34.311 INFO:tasks.workunit.client.0.smithi006.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-12T00:00:34.471 INFO:tasks.workunit.client.0.smithi006.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-12T00:00:35.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:34 smithi006 ceph-mon[30947]: pgmap v396: 129 pgs: 129 active+clean; 4.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 373 KiB/s wr, 74 op/s 2024-09-12T00:00:35.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:34 smithi134 ceph-mon[34893]: pgmap v396: 129 pgs: 129 active+clean; 4.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 373 KiB/s wr, 74 op/s 2024-09-12T00:00:35.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:34 smithi039 ceph-mon[34543]: pgmap v396: 129 pgs: 129 active+clean; 4.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 373 KiB/s wr, 74 op/s 2024-09-12T00:00:35.491 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether build environment is sane... yes 2024-09-12T00:00:35.508 INFO:tasks.workunit.client.0.smithi006.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-12T00:00:35.509 INFO:tasks.workunit.client.0.smithi006.stdout:checking for gawk... gawk 2024-09-12T00:00:35.540 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether make sets $(MAKE)... yes 2024-09-12T00:00:35.592 INFO:tasks.workunit.client.0.smithi006.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-12T00:00:35.592 INFO:tasks.workunit.client.0.smithi006.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-12T00:00:35.612 INFO:tasks.workunit.client.0.smithi006.stdout:checking for style of include used by make... GNU 2024-09-12T00:00:35.618 INFO:tasks.workunit.client.0.smithi006.stdout:checking for gcc... gcc 2024-09-12T00:00:35.747 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether the C compiler works... yes 2024-09-12T00:00:35.747 INFO:tasks.workunit.client.0.smithi006.stdout:checking for C compiler default output file name... a.out 2024-09-12T00:00:35.809 INFO:tasks.workunit.client.0.smithi006.stdout:checking for suffix of executables... 2024-09-12T00:00:35.869 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether we are cross compiling... no 2024-09-12T00:00:35.929 INFO:tasks.workunit.client.0.smithi006.stdout:checking for suffix of object files... o 2024-09-12T00:00:35.967 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether we are using the GNU C compiler... yes 2024-09-12T00:00:36.001 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether gcc accepts -g... yes 2024-09-12T00:00:36.047 INFO:tasks.workunit.client.0.smithi006.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-12T00:00:36.194 INFO:tasks.workunit.client.0.smithi006.stdout:checking dependency style of gcc... gcc3 2024-09-12T00:00:36.265 INFO:tasks.workunit.client.0.smithi006.stdout:checking how to run the C preprocessor... gcc -E 2024-09-12T00:00:36.333 INFO:tasks.workunit.client.0.smithi006.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-12T00:00:36.335 INFO:tasks.workunit.client.0.smithi006.stdout:checking for egrep... /usr/bin/grep -E 2024-09-12T00:00:36.517 INFO:tasks.workunit.client.0.smithi006.stdout:checking for ANSI C header files... yes 2024-09-12T00:00:36.573 INFO:tasks.workunit.client.0.smithi006.stdout:checking for sys/types.h... yes 2024-09-12T00:00:36.631 INFO:tasks.workunit.client.0.smithi006.stdout:checking for sys/stat.h... yes 2024-09-12T00:00:36.690 INFO:tasks.workunit.client.0.smithi006.stdout:checking for stdlib.h... yes 2024-09-12T00:00:36.750 INFO:tasks.workunit.client.0.smithi006.stdout:checking for string.h... yes 2024-09-12T00:00:36.811 INFO:tasks.workunit.client.0.smithi006.stdout:checking for memory.h... yes 2024-09-12T00:00:36.872 INFO:tasks.workunit.client.0.smithi006.stdout:checking for strings.h... yes 2024-09-12T00:00:36.931 INFO:tasks.workunit.client.0.smithi006.stdout:checking for inttypes.h... yes 2024-09-12T00:00:36.992 INFO:tasks.workunit.client.0.smithi006.stdout:checking for stdint.h... yes 2024-09-12T00:00:37.054 INFO:tasks.workunit.client.0.smithi006.stdout:checking for unistd.h... yes 2024-09-12T00:00:37.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:36 smithi006 ceph-mon[30947]: pgmap v397: 129 pgs: 129 active+clean; 4.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 411 KiB/s wr, 133 op/s 2024-09-12T00:00:37.120 INFO:tasks.workunit.client.0.smithi006.stdout:checking minix/config.h usability... no 2024-09-12T00:00:37.162 INFO:tasks.workunit.client.0.smithi006.stdout:checking minix/config.h presence... no 2024-09-12T00:00:37.163 INFO:tasks.workunit.client.0.smithi006.stdout:checking for minix/config.h... no 2024-09-12T00:00:37.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:36 smithi134 ceph-mon[34893]: pgmap v397: 129 pgs: 129 active+clean; 4.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 411 KiB/s wr, 133 op/s 2024-09-12T00:00:37.211 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-12T00:00:37.221 INFO:tasks.workunit.client.0.smithi006.stdout:checking for gcc... (cached) gcc 2024-09-12T00:00:37.275 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-12T00:00:37.275 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-12T00:00:37.275 INFO:tasks.workunit.client.0.smithi006.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-12T00:00:37.276 INFO:tasks.workunit.client.0.smithi006.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-12T00:00:37.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:36 smithi039 ceph-mon[34543]: pgmap v397: 129 pgs: 129 active+clean; 4.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 411 KiB/s wr, 133 op/s 2024-09-12T00:00:37.342 INFO:tasks.workunit.client.0.smithi006.stdout:checking for main in -lm... yes 2024-09-12T00:00:37.411 INFO:tasks.workunit.client.0.smithi006.stdout:checking for main in -lpthread... yes 2024-09-12T00:00:37.416 INFO:tasks.workunit.client.0.smithi006.stdout:checking for ANSI C header files... (cached) yes 2024-09-12T00:00:37.461 INFO:tasks.workunit.client.0.smithi006.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-12T00:00:37.536 INFO:tasks.workunit.client.0.smithi006.stdout:checking pthread.h usability... yes 2024-09-12T00:00:37.562 INFO:tasks.workunit.client.0.smithi006.stdout:checking pthread.h presence... yes 2024-09-12T00:00:37.562 INFO:tasks.workunit.client.0.smithi006.stdout:checking for pthread.h... yes 2024-09-12T00:00:37.637 INFO:tasks.workunit.client.0.smithi006.stdout:checking fcntl.h usability... yes 2024-09-12T00:00:37.662 INFO:tasks.workunit.client.0.smithi006.stdout:checking fcntl.h presence... yes 2024-09-12T00:00:37.662 INFO:tasks.workunit.client.0.smithi006.stdout:checking for fcntl.h... yes 2024-09-12T00:00:37.730 INFO:tasks.workunit.client.0.smithi006.stdout:checking limits.h usability... yes 2024-09-12T00:00:37.754 INFO:tasks.workunit.client.0.smithi006.stdout:checking limits.h presence... yes 2024-09-12T00:00:37.754 INFO:tasks.workunit.client.0.smithi006.stdout:checking for limits.h... yes 2024-09-12T00:00:37.777 INFO:tasks.workunit.client.0.smithi006.stdout:checking for stdint.h... (cached) yes 2024-09-12T00:00:37.837 INFO:tasks.workunit.client.0.smithi006.stdout:checking sys/time.h usability... yes 2024-09-12T00:00:37.861 INFO:tasks.workunit.client.0.smithi006.stdout:checking sys/time.h presence... yes 2024-09-12T00:00:37.862 INFO:tasks.workunit.client.0.smithi006.stdout:checking for sys/time.h... yes 2024-09-12T00:00:37.882 INFO:tasks.workunit.client.0.smithi006.stdout:checking for unistd.h... (cached) yes 2024-09-12T00:00:37.943 INFO:tasks.workunit.client.0.smithi006.stdout:checking sys/vfs.h usability... yes 2024-09-12T00:00:37.966 INFO:tasks.workunit.client.0.smithi006.stdout:checking sys/vfs.h presence... yes 2024-09-12T00:00:37.967 INFO:tasks.workunit.client.0.smithi006.stdout:checking for sys/vfs.h... yes 2024-09-12T00:00:38.041 INFO:tasks.workunit.client.0.smithi006.stdout:checking sys/limits.h usability... no 2024-09-12T00:00:38.082 INFO:tasks.workunit.client.0.smithi006.stdout:checking sys/limits.h presence... no 2024-09-12T00:00:38.082 INFO:tasks.workunit.client.0.smithi006.stdout:checking for sys/limits.h... no 2024-09-12T00:00:38.121 INFO:tasks.workunit.client.0.smithi006.stdout:checking for an ANSI C-conforming const... yes 2024-09-12T00:00:38.162 INFO:tasks.workunit.client.0.smithi006.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-12T00:00:38.257 INFO:tasks.workunit.client.0.smithi006.stdout:checking for system... yes 2024-09-12T00:00:38.347 INFO:tasks.workunit.client.0.smithi006.stdout:checking for gettimeofday... yes 2024-09-12T00:00:38.436 INFO:tasks.workunit.client.0.smithi006.stdout:checking for mkdir... yes 2024-09-12T00:00:38.540 INFO:tasks.workunit.client.0.smithi006.stdout:checking for strerror... yes 2024-09-12T00:00:38.638 INFO:tasks.workunit.client.0.smithi006.stdout:checking for open64... yes 2024-09-12T00:00:38.734 INFO:tasks.workunit.client.0.smithi006.stdout:checking for stat64... yes 2024-09-12T00:00:38.822 INFO:tasks.workunit.client.0.smithi006.stdout:checking for fseeko64... yes 2024-09-12T00:00:38.917 INFO:tasks.workunit.client.0.smithi006.stdout:checking for lrand48_r... yes 2024-09-12T00:00:39.015 INFO:tasks.workunit.client.0.smithi006.stdout:checking for srand48_r... yes 2024-09-12T00:00:39.045 INFO:tasks.workunit.client.0.smithi006.stdout:configure: creating ./config.status 2024-09-12T00:00:39.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:38 smithi006 ceph-mon[30947]: pgmap v398: 129 pgs: 129 active+clean; 6.5 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 584 KiB/s wr, 202 op/s 2024-09-12T00:00:39.160 INFO:tasks.workunit.client.0.smithi006.stdout: /bin/sh ./config.status 2024-09-12T00:00:39.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:38 smithi134 ceph-mon[34893]: pgmap v398: 129 pgs: 129 active+clean; 6.5 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 584 KiB/s wr, 202 op/s 2024-09-12T00:00:39.234 INFO:tasks.workunit.client.0.smithi006.stdout:config.status: creating Makefile 2024-09-12T00:00:39.253 INFO:tasks.workunit.client.0.smithi006.stdout:config.status: creating config.h 2024-09-12T00:00:39.283 INFO:tasks.workunit.client.0.smithi006.stdout:config.status: executing depfiles commands 2024-09-12T00:00:39.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:38 smithi039 ceph-mon[34543]: pgmap v398: 129 pgs: 129 active+clean; 6.5 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 584 KiB/s wr, 202 op/s 2024-09-12T00:00:39.302 INFO:tasks.workunit.client.0.smithi006.stdout:config.status: executing default commands 2024-09-12T00:00:39.354 INFO:tasks.workunit.client.0.smithi006.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-12T00:00:39.556 INFO:tasks.workunit.client.0.smithi006.stdout:rm -f stamp-h1 2024-09-12T00:00:39.560 INFO:tasks.workunit.client.0.smithi006.stdout:touch config.h.in 2024-09-12T00:00:39.564 INFO:tasks.workunit.client.0.smithi006.stdout:cd . && /bin/sh ./config.status config.h 2024-09-12T00:00:39.630 INFO:tasks.workunit.client.0.smithi006.stdout:config.status: creating config.h 2024-09-12T00:00:39.667 INFO:tasks.workunit.client.0.smithi006.stdout:make all-am 2024-09-12T00:00:39.693 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-12T00:00:39.693 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-12T00:00:39.871 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-12T00:00:39.878 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-12T00:00:40.041 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-12T00:00:40.046 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-12T00:00:40.207 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-12T00:00:40.213 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-12T00:00:40.374 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-12T00:00:40.381 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-12T00:00:40.592 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-12T00:00:40.599 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-12T00:00:40.717 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-12T00:00:40.725 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-12T00:00:40.819 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-12T00:00:40.827 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-12T00:00:40.930 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-12T00:00:40.936 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-12T00:00:41.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:40 smithi006 ceph-mon[30947]: pgmap v399: 129 pgs: 129 active+clean; 8.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 791 KiB/s wr, 231 op/s 2024-09-12T00:00:41.192 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-12T00:00:41.198 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-12T00:00:41.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:40 smithi134 ceph-mon[34893]: pgmap v399: 129 pgs: 129 active+clean; 8.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 791 KiB/s wr, 231 op/s 2024-09-12T00:00:41.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:40 smithi039 ceph-mon[34543]: pgmap v399: 129 pgs: 129 active+clean; 8.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 791 KiB/s wr, 231 op/s 2024-09-12T00:00:41.393 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-12T00:00:41.401 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-12T00:00:41.671 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-12T00:00:41.678 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-12T00:00:41.808 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-12T00:00:41.815 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-12T00:00:41.946 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-12T00:00:41.952 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-12T00:00:42.138 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-12T00:00:42.145 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-12T00:00:42.229 INFO:tasks.workunit.client.0.smithi006.stderr:In file included from parser.h:22, 2024-09-12T00:00:42.229 INFO:tasks.workunit.client.0.smithi006.stderr: from parser.c:25: 2024-09-12T00:00:42.229 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c: In function ‘init_filesys’: 2024-09-12T00:00:42.231 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T00:00:42.231 INFO:tasks.workunit.client.0.smithi006.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T00:00:42.231 INFO:tasks.workunit.client.0.smithi006.stderr: | ^ 2024-09-12T00:00:42.231 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T00:00:42.231 INFO:tasks.workunit.client.0.smithi006.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T00:00:42.231 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~ 2024-09-12T00:00:42.231 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T00:00:42.231 INFO:tasks.workunit.client.0.smithi006.stderr: 36 | container_of(ptr, type, member) 2024-09-12T00:00:42.232 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~ 2024-09-12T00:00:42.232 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-12T00:00:42.232 INFO:tasks.workunit.client.0.smithi006.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-12T00:00:42.232 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~ 2024-09-12T00:00:42.232 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T00:00:42.232 INFO:tasks.workunit.client.0.smithi006.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-12T00:00:42.232 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T00:00:42.232 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T00:00:42.232 INFO:tasks.workunit.client.0.smithi006.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T00:00:42.232 INFO:tasks.workunit.client.0.smithi006.stderr: | ^ 2024-09-12T00:00:42.232 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T00:00:42.233 INFO:tasks.workunit.client.0.smithi006.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T00:00:42.233 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~ 2024-09-12T00:00:42.233 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T00:00:42.233 INFO:tasks.workunit.client.0.smithi006.stderr: 36 | container_of(ptr, type, member) 2024-09-12T00:00:42.233 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~ 2024-09-12T00:00:42.233 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-12T00:00:42.233 INFO:tasks.workunit.client.0.smithi006.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-12T00:00:42.233 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~ 2024-09-12T00:00:42.233 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T00:00:42.233 INFO:tasks.workunit.client.0.smithi006.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-12T00:00:42.233 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T00:00:42.233 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T00:00:42.234 INFO:tasks.workunit.client.0.smithi006.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T00:00:42.234 INFO:tasks.workunit.client.0.smithi006.stderr: | ^ 2024-09-12T00:00:42.234 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T00:00:42.234 INFO:tasks.workunit.client.0.smithi006.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T00:00:42.234 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~ 2024-09-12T00:00:42.234 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T00:00:42.234 INFO:tasks.workunit.client.0.smithi006.stderr: 36 | container_of(ptr, type, member) 2024-09-12T00:00:42.234 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~ 2024-09-12T00:00:42.234 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-12T00:00:42.234 INFO:tasks.workunit.client.0.smithi006.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-12T00:00:42.234 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~ 2024-09-12T00:00:42.235 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T00:00:42.235 INFO:tasks.workunit.client.0.smithi006.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-12T00:00:42.235 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T00:00:42.235 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T00:00:42.235 INFO:tasks.workunit.client.0.smithi006.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T00:00:42.235 INFO:tasks.workunit.client.0.smithi006.stderr: | ^ 2024-09-12T00:00:42.235 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T00:00:42.235 INFO:tasks.workunit.client.0.smithi006.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T00:00:42.235 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~ 2024-09-12T00:00:42.235 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T00:00:42.235 INFO:tasks.workunit.client.0.smithi006.stderr: 36 | container_of(ptr, type, member) 2024-09-12T00:00:42.235 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~ 2024-09-12T00:00:42.236 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-12T00:00:42.236 INFO:tasks.workunit.client.0.smithi006.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-12T00:00:42.236 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~ 2024-09-12T00:00:42.236 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T00:00:42.236 INFO:tasks.workunit.client.0.smithi006.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-12T00:00:42.236 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T00:00:42.236 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-12T00:00:42.236 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T00:00:42.236 INFO:tasks.workunit.client.0.smithi006.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T00:00:42.236 INFO:tasks.workunit.client.0.smithi006.stderr: | ^ 2024-09-12T00:00:42.236 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T00:00:42.237 INFO:tasks.workunit.client.0.smithi006.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T00:00:42.237 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~ 2024-09-12T00:00:42.237 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T00:00:42.237 INFO:tasks.workunit.client.0.smithi006.stderr: 36 | container_of(ptr, type, member) 2024-09-12T00:00:42.237 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~ 2024-09-12T00:00:42.237 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-12T00:00:42.237 INFO:tasks.workunit.client.0.smithi006.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-12T00:00:42.237 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~ 2024-09-12T00:00:42.237 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T00:00:42.237 INFO:tasks.workunit.client.0.smithi006.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-12T00:00:42.237 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T00:00:42.238 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T00:00:42.238 INFO:tasks.workunit.client.0.smithi006.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T00:00:42.238 INFO:tasks.workunit.client.0.smithi006.stderr: | ^ 2024-09-12T00:00:42.238 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T00:00:42.238 INFO:tasks.workunit.client.0.smithi006.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T00:00:42.238 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~ 2024-09-12T00:00:42.238 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T00:00:42.238 INFO:tasks.workunit.client.0.smithi006.stderr: 36 | container_of(ptr, type, member) 2024-09-12T00:00:42.238 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~ 2024-09-12T00:00:42.238 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-12T00:00:42.238 INFO:tasks.workunit.client.0.smithi006.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-12T00:00:42.239 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~ 2024-09-12T00:00:42.239 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T00:00:42.239 INFO:tasks.workunit.client.0.smithi006.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-12T00:00:42.239 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T00:00:42.239 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T00:00:42.239 INFO:tasks.workunit.client.0.smithi006.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T00:00:42.239 INFO:tasks.workunit.client.0.smithi006.stderr: | ^ 2024-09-12T00:00:42.239 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T00:00:42.240 INFO:tasks.workunit.client.0.smithi006.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T00:00:42.240 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~ 2024-09-12T00:00:42.240 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T00:00:42.240 INFO:tasks.workunit.client.0.smithi006.stderr: 36 | container_of(ptr, type, member) 2024-09-12T00:00:42.240 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~ 2024-09-12T00:00:42.240 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-12T00:00:42.240 INFO:tasks.workunit.client.0.smithi006.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-12T00:00:42.240 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~ 2024-09-12T00:00:42.240 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T00:00:42.240 INFO:tasks.workunit.client.0.smithi006.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-12T00:00:42.241 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T00:00:42.241 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T00:00:42.241 INFO:tasks.workunit.client.0.smithi006.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T00:00:42.241 INFO:tasks.workunit.client.0.smithi006.stderr: | ^ 2024-09-12T00:00:42.241 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T00:00:42.241 INFO:tasks.workunit.client.0.smithi006.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T00:00:42.241 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~ 2024-09-12T00:00:42.241 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T00:00:42.241 INFO:tasks.workunit.client.0.smithi006.stderr: 36 | container_of(ptr, type, member) 2024-09-12T00:00:42.241 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~ 2024-09-12T00:00:42.241 INFO:tasks.workunit.client.0.smithi006.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-12T00:00:42.242 INFO:tasks.workunit.client.0.smithi006.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-12T00:00:42.242 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~ 2024-09-12T00:00:42.242 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T00:00:42.242 INFO:tasks.workunit.client.0.smithi006.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-12T00:00:42.242 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T00:00:42.298 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c: In function ‘get_optstr’: 2024-09-12T00:00:42.298 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-12T00:00:42.298 INFO:tasks.workunit.client.0.smithi006.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-12T00:00:42.298 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T00:00:42.298 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c:200:14: note: source object declared here 2024-09-12T00:00:42.298 INFO:tasks.workunit.client.0.smithi006.stderr: 200 | char temp[BUFSIZE]; 2024-09-12T00:00:42.298 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~ 2024-09-12T00:00:42.305 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c: In function ‘size64_convert’: 2024-09-12T00:00:42.305 INFO:tasks.workunit.client.0.smithi006.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-12T00:00:42.305 INFO:tasks.workunit.client.0.smithi006.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-12T00:00:42.305 INFO:tasks.workunit.client.0.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:00:42.612 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-12T00:00:42.618 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-12T00:00:42.733 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-12T00:00:42.739 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-12T00:00:42.891 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-12T00:00:42.897 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-12T00:00:42.956 INFO:tasks.workunit.client.0.smithi006.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-12T00:00:42.963 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-12T00:00:43.084 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-12T00:00:43.085 INFO:tasks.workunit.client.0.smithi006.stderr:+ cd .. 2024-09-12T00:00:43.086 INFO:tasks.workunit.client.0.smithi006.stderr:+ mkdir tmp 2024-09-12T00:00:43.088 INFO:tasks.workunit.client.0.smithi006.stderr:+ cd tmp 2024-09-12T00:00:43.090 INFO:tasks.workunit.client.0.smithi006.stderr:+ for f in $mydir/*.ffsb 2024-09-12T00:00:43.090 INFO:tasks.workunit.client.0.smithi006.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-12T00:00:43.090 INFO:tasks.workunit.client.0.smithi006.stdout:FFSB version 6.0-RC2 started 2024-09-12T00:00:43.091 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:00:43.094 INFO:tasks.workunit.client.0.smithi006.stdout:benchmark time = 300 2024-09-12T00:00:43.094 INFO:tasks.workunit.client.0.smithi006.stdout:ThreadGroup 0 2024-09-12T00:00:43.094 INFO:tasks.workunit.client.0.smithi006.stdout:================ 2024-09-12T00:00:43.094 INFO:tasks.workunit.client.0.smithi006.stdout: num_threads = 32 2024-09-12T00:00:43.094 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:00:43.094 INFO:tasks.workunit.client.0.smithi006.stdout: read_random = off 2024-09-12T00:00:43.094 INFO:tasks.workunit.client.0.smithi006.stdout: read_size = 0 (0B) 2024-09-12T00:00:43.094 INFO:tasks.workunit.client.0.smithi006.stdout: read_blocksize = 0 (0B) 2024-09-12T00:00:43.095 INFO:tasks.workunit.client.0.smithi006.stdout: read_skip = off 2024-09-12T00:00:43.095 INFO:tasks.workunit.client.0.smithi006.stdout: read_skipsize = 0 (0B) 2024-09-12T00:00:43.095 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:00:43.095 INFO:tasks.workunit.client.0.smithi006.stdout: write_random = on 2024-09-12T00:00:43.095 INFO:tasks.workunit.client.0.smithi006.stdout: write_size = 5242880 (5MB) 2024-09-12T00:00:43.095 INFO:tasks.workunit.client.0.smithi006.stdout: fsync_file = 0 2024-09-12T00:00:43.095 INFO:tasks.workunit.client.0.smithi006.stdout: write_blocksize = 4096 (4KB) 2024-09-12T00:00:43.095 INFO:tasks.workunit.client.0.smithi006.stdout: wait time = 0 2024-09-12T00:00:43.095 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:00:43.095 INFO:tasks.workunit.client.0.smithi006.stdout: op weights 2024-09-12T00:00:43.096 INFO:tasks.workunit.client.0.smithi006.stdout: read = 0 (0.00%) 2024-09-12T00:00:43.096 INFO:tasks.workunit.client.0.smithi006.stdout: readall = 0 (0.00%) 2024-09-12T00:00:43.096 INFO:tasks.workunit.client.0.smithi006.stdout: write = 1 (100.00%) 2024-09-12T00:00:43.096 INFO:tasks.workunit.client.0.smithi006.stdout: create = 0 (0.00%) 2024-09-12T00:00:43.096 INFO:tasks.workunit.client.0.smithi006.stdout: append = 0 (0.00%) 2024-09-12T00:00:43.096 INFO:tasks.workunit.client.0.smithi006.stdout: delete = 0 (0.00%) 2024-09-12T00:00:43.096 INFO:tasks.workunit.client.0.smithi006.stdout: metaop = 0 (0.00%) 2024-09-12T00:00:43.096 INFO:tasks.workunit.client.0.smithi006.stdout: createdir = 0 (0.00%) 2024-09-12T00:00:43.097 INFO:tasks.workunit.client.0.smithi006.stdout: stat = 0 (0.00%) 2024-09-12T00:00:43.097 INFO:tasks.workunit.client.0.smithi006.stdout: writeall = 0 (0.00%) 2024-09-12T00:00:43.097 INFO:tasks.workunit.client.0.smithi006.stdout: writeall_fsync = 0 (0.00%) 2024-09-12T00:00:43.097 INFO:tasks.workunit.client.0.smithi006.stdout: open_close = 0 (0.00%) 2024-09-12T00:00:43.097 INFO:tasks.workunit.client.0.smithi006.stdout: write_fsync = 0 (0.00%) 2024-09-12T00:00:43.097 INFO:tasks.workunit.client.0.smithi006.stdout: create_fsync = 0 (0.00%) 2024-09-12T00:00:43.097 INFO:tasks.workunit.client.0.smithi006.stdout: append_fsync = 0 (0.00%) 2024-09-12T00:00:43.097 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:00:43.097 INFO:tasks.workunit.client.0.smithi006.stdout:FileSystem . 2024-09-12T00:00:43.097 INFO:tasks.workunit.client.0.smithi006.stdout:========== 2024-09-12T00:00:43.097 INFO:tasks.workunit.client.0.smithi006.stdout: num_dirs = 0 2024-09-12T00:00:43.097 INFO:tasks.workunit.client.0.smithi006.stdout: starting files = 128 2024-09-12T00:00:43.098 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:00:43.098 INFO:tasks.workunit.client.0.smithi006.stdout: min file size = 104857600 (100MB) 2024-09-12T00:00:43.098 INFO:tasks.workunit.client.0.smithi006.stdout: max file size = 104857600 (100MB) 2024-09-12T00:00:43.098 INFO:tasks.workunit.client.0.smithi006.stdout: directio = off 2024-09-12T00:00:43.098 INFO:tasks.workunit.client.0.smithi006.stdout: alignedio = on 2024-09-12T00:00:43.098 INFO:tasks.workunit.client.0.smithi006.stdout: bufferedio = off 2024-09-12T00:00:43.098 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:00:43.098 INFO:tasks.workunit.client.0.smithi006.stdout: aging is off 2024-09-12T00:00:43.098 INFO:tasks.workunit.client.0.smithi006.stdout: current utilization = 0.04% 2024-09-12T00:00:43.098 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:00:43.098 INFO:tasks.workunit.client.0.smithi006.stdout:checking existing fs: . 2024-09-12T00:00:43.099 INFO:tasks.workunit.client.0.smithi006.stdout:recreating new fileset 2024-09-12T00:00:43.099 INFO:tasks.workunit.client.0.smithi006.stderr:opendir: No such file or directory 2024-09-12T00:00:43.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:42 smithi006 ceph-mon[30947]: pgmap v400: 129 pgs: 129 active+clean; 8.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 765 KiB/s wr, 242 op/s 2024-09-12T00:00:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:42 smithi134 ceph-mon[34893]: pgmap v400: 129 pgs: 129 active+clean; 8.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 765 KiB/s wr, 242 op/s 2024-09-12T00:00:43.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:42 smithi039 ceph-mon[34543]: pgmap v400: 129 pgs: 129 active+clean; 8.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 765 KiB/s wr, 242 op/s 2024-09-12T00:00:45.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:44 smithi006 ceph-mon[30947]: pgmap v401: 129 pgs: 129 active+clean; 9.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 670 KiB/s wr, 242 op/s 2024-09-12T00:00:45.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:44 smithi134 ceph-mon[34893]: pgmap v401: 129 pgs: 129 active+clean; 9.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 670 KiB/s wr, 242 op/s 2024-09-12T00:00:45.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:44 smithi039 ceph-mon[34543]: pgmap v401: 129 pgs: 129 active+clean; 9.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 670 KiB/s wr, 242 op/s 2024-09-12T00:00:45.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.361+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/1767511048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ff0100d50 msgr2=0x7f8ff01011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:45.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.361+0000 7f8ff7a7b640 1 --2- 172.21.15.6:0/1767511048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ff0100d50 0x7f8ff01011b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009900 tx=0x7f8fe002a410 comp rx=0 tx=0).stop 2024-09-12T00:00:45.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.361+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/1767511048 shutdown_connections 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.361+0000 7f8ff7a7b640 1 --2- 172.21.15.6:0/1767511048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff01016f0 0x7f8ff0101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.361+0000 7f8ff7a7b640 1 --2- 172.21.15.6:0/1767511048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ff0100d50 0x7f8ff01011b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.361+0000 7f8ff7a7b640 1 --2- 172.21.15.6:0/1767511048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff0100410 0x7f8ff0100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.361+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/1767511048 >> 172.21.15.6:0/1767511048 conn(0x7f8ff00fc1c0 msgr2=0x7f8ff00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.361+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/1767511048 shutdown_connections 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.361+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/1767511048 wait complete. 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.362+0000 7f8ff7a7b640 1 Processor -- start 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.362+0000 7f8ff7a7b640 1 -- start start 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.362+0000 7f8ff7a7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff0100410 0x7f8ff0199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.362+0000 7f8ff7a7b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ff0100d50 0x7f8ff019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.362+0000 7f8ff7a7b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff01016f0 0x7f8ff01a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.362+0000 7f8ff7a7b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff010f830 con 0x7f8ff0100d50 2024-09-12T00:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.362+0000 7f8ff7a7b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff010f6b0 con 0x7f8ff01016f0 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.362+0000 7f8ff7a7b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff010f9b0 con 0x7f8ff0100410 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.362+0000 7f8ff5016640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ff0100d50 0x7f8ff019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.362+0000 7f8ff5016640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ff0100d50 0x7f8ff019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55590/0 (socket says 172.21.15.6:55590) 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8ff5016640 1 -- 172.21.15.6:0/2998123817 learned_addr learned my addr 172.21.15.6:0/2998123817 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8ff6018640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff01016f0 0x7f8ff01a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8ff5817640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff0100410 0x7f8ff0199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8ff5016640 1 -- 172.21.15.6:0/2998123817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff0100410 msgr2=0x7f8ff0199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8ff5016640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff0100410 0x7f8ff0199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8ff5016640 1 -- 172.21.15.6:0/2998123817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff01016f0 msgr2=0x7f8ff01a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8ff5016640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff01016f0 0x7f8ff01a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8ff5016640 1 -- 172.21.15.6:0/2998123817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff01a1bc0 con 0x7f8ff0100d50 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8ff5817640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff0100410 0x7f8ff0199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8ff5016640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ff0100d50 0x7f8ff019a4e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00314e0 tx=0x7f8fe0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8fe6ffd640 1 -- 172.21.15.6:0/2998123817 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe003f070 con 0x7f8ff0100d50 2024-09-12T00:00:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8fe6ffd640 1 -- 172.21.15.6:0/2998123817 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fe0031e40 con 0x7f8ff0100d50 2024-09-12T00:00:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/2998123817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff01a1eb0 con 0x7f8ff0100d50 2024-09-12T00:00:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8fe6ffd640 1 -- 172.21.15.6:0/2998123817 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0035030 con 0x7f8ff0100d50 2024-09-12T00:00:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.363+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/2998123817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff01a2370 con 0x7f8ff0100d50 2024-09-12T00:00:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.366+0000 7f8fe6ffd640 1 -- 172.21.15.6:0/2998123817 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f8fe0042070 con 0x7f8ff0100d50 2024-09-12T00:00:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.367+0000 7f8ffa818740 1 Processor -- start 2024-09-12T00:00:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.367+0000 7f8ffa818740 1 -- start start 2024-09-12T00:00:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.367+0000 7f8fe6ffd640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8fdc0a2b80 0x7f8fdc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.367+0000 7f8ffa818740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cd99a0 0x555d01cd9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.367+0000 7f8ffa818740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cda2e0 0x555d01cdeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.367+0000 7f8ffa818740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 0x555d01ce1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.367+0000 7f8ffa818740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555d01c3d2f0 con 0x555d01cdf370 2024-09-12T00:00:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.367+0000 7f8ffa818740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555d01be5270 con 0x555d01cd99a0 2024-09-12T00:00:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.367+0000 7f8ffa818740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555d01c392b0 con 0x555d01cda2e0 2024-09-12T00:00:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.367+0000 7f8fe6ffd640 1 -- 172.21.15.6:0/2998123817 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f8fe00efd30 con 0x7f8ff0100d50 2024-09-12T00:00:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.367+0000 7f8ff5817640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cd99a0 0x555d01cd9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.367+0000 7f8ff6018640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 0x555d01ce1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff5817640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cd99a0 0x555d01cd9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:35554/0 (socket says 172.21.15.6:35554) 2024-09-12T00:00:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff6018640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 0x555d01ce1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55606/0 (socket says 172.21.15.6:55606) 2024-09-12T00:00:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff5817640 1 -- 172.21.15.6:0/4054916972 learned_addr learned my addr 172.21.15.6:0/4054916972 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff5016640 1 --2- 172.21.15.6:0/4054916972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cda2e0 0x555d01cdeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff6018640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8fdc0a2b80 0x7f8fdc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff5817640 1 -- 172.21.15.6:0/4054916972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cda2e0 msgr2=0x555d01cdeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff5817640 1 --2- 172.21.15.6:0/4054916972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cda2e0 0x555d01cdeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff5817640 1 -- 172.21.15.6:0/4054916972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 msgr2=0x555d01ce1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff5817640 1 --2- 172.21.15.6:0/4054916972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 0x555d01ce1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff5817640 1 -- 172.21.15.6:0/4054916972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d01be4340 con 0x555d01cd99a0 2024-09-12T00:00:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff5016640 1 --2- 172.21.15.6:0/4054916972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cda2e0 0x555d01cdeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff6018640 1 --2- 172.21.15.6:0/4054916972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 0x555d01ce1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff6018640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8fdc0a2b80 0x7f8fdc0a5040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009990 tx=0x7f8fe8009b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8ff5817640 1 --2- 172.21.15.6:0/4054916972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cd99a0 0x555d01cd9da0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00bd40 tx=0x7f8fec00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a838019749037463 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8fdbfff640 1 -- 172.21.15.6:0/4054916972 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec015070 con 0x555d01cd99a0 2024-09-12T00:00:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8fdbfff640 1 -- 172.21.15.6:0/4054916972 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fec00be30 con 0x555d01cd99a0 2024-09-12T00:00:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.368+0000 7f8fdbfff640 1 -- 172.21.15.6:0/4054916972 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec010630 con 0x555d01cd99a0 2024-09-12T00:00:45.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.369+0000 7f8ffa818740 1 -- 172.21.15.6:0/4054916972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cd99a0 msgr2=0x555d01cd9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:45.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.369+0000 7f8ffa818740 1 --2- 172.21.15.6:0/4054916972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cd99a0 0x555d01cd9da0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00bd40 tx=0x7f8fec00f730 comp rx=0 tx=0).stop 2024-09-12T00:00:45.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.369+0000 7f8ffa818740 1 -- 172.21.15.6:0/4054916972 shutdown_connections 2024-09-12T00:00:45.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.369+0000 7f8ffa818740 1 --2- 172.21.15.6:0/4054916972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 0x555d01ce1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.369+0000 7f8ffa818740 1 --2- 172.21.15.6:0/4054916972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cda2e0 0x555d01cdeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.369+0000 7f8ffa818740 1 --2- 172.21.15.6:0/4054916972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cd99a0 0x555d01cd9da0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.369+0000 7f8ffa818740 1 -- 172.21.15.6:0/4054916972 >> 172.21.15.6:0/4054916972 conn(0x555d01cd5010 msgr2=0x555d01cd5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.369+0000 7f8ffa818740 1 -- 172.21.15.6:0/4054916972 shutdown_connections 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.369+0000 7f8ffa818740 1 -- 172.21.15.6:0/4054916972 wait complete. 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ffa818740 1 -- start start 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ffa818740 1 Processor -- start 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ffa818740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cd99a0 0x555d01ce3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ffa818740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cda2e0 0x555d01ce4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ffa818740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cdf370 0x555d01ceb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ffa818740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555d01ce2340 con 0x555d01cda2e0 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ffa818740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555d01bc6290 con 0x555d01cd99a0 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ffa818740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555d01ce24c0 con 0x555d01cdf370 2024-09-12T00:00:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ffa818740 10 client.0 _ll_register_callbacks cb 0x555d01bf7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ff5016640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cda2e0 0x555d01ce4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ff5016640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cda2e0 0x555d01ce4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55612/0 (socket says 172.21.15.6:55612) 2024-09-12T00:00:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ff5016640 1 -- 172.21.15.6:0/3893240261 learned_addr learned my addr 172.21.15.6:0/3893240261 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ff5817640 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cd99a0 0x555d01ce3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.370+0000 7f8ff6018640 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cdf370 0x555d01ceb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8ff5016640 1 -- 172.21.15.6:0/3893240261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cdf370 msgr2=0x555d01ceb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8ff5016640 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cdf370 0x555d01ceb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8ff5016640 1 -- 172.21.15.6:0/3893240261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cd99a0 msgr2=0x555d01ce3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8ff5016640 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cd99a0 0x555d01ce3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8ff5016640 1 -- 172.21.15.6:0/3893240261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d01950210 con 0x555d01cda2e0 2024-09-12T00:00:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8ff6018640 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cdf370 0x555d01ceb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8ff5016640 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cda2e0 0x555d01ce4070 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00ed440 tx=0x7f8fe00bc030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf879b04e189c3cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8fd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:00:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8fd97fa640 1 -- 172.21.15.6:0/3893240261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0049040 con 0x555d01cda2e0 2024-09-12T00:00:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8fd97fa640 1 -- 172.21.15.6:0/3893240261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f8fe004c590 con 0x555d01cda2e0 2024-09-12T00:00:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8ffa818740 1 -- 172.21.15.6:0/3893240261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fec00be30 con 0x555d01cda2e0 2024-09-12T00:00:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8fd97fa640 1 -- 172.21.15.6:0/3893240261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8fe00bc8a0 con 0x555d01cda2e0 2024-09-12T00:00:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8ffa818740 10 client.15447 fetch_fsmap learned FSMap version 30 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8ffa818740 1 -- 172.21.15.6:0/3893240261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555d01a1c620 con 0x555d01cda2e0 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.371+0000 7f8fd97fa640 1 -- 172.21.15.6:0/3893240261 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fec00be30 con 0x555d01cda2e0 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.372+0000 7f8fd97fa640 1 -- 172.21.15.6:0/3893240261 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f8fe00b8810 con 0x555d01cda2e0 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.372+0000 7f8ffa818740 10 client.15447 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.372+0000 7f8ffa818740 10 client.15447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.372+0000 7f8ffa818740 20 client.15447 populate_metadata read hostname 'smithi006' 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.372+0000 7f8ffa818740 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555d01cef890 0x555d01cf1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.372+0000 7f8ffa818740 4 client.15447 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.372+0000 7f8ffa818740 1 -- 172.21.15.6:0/3893240261 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d01c4aa20 con 0x555d01cef890 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.372+0000 7f8ff5817640 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555d01cef890 0x555d01cf1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.372+0000 7f8ff5817640 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555d01cef890 0x555d01cf1d10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f968196e5d27f2c server_cookie=51b0eea32743be82 in_seq=0 out_seq=0 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.372+0000 7f8fd97fa640 10 client.15447 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.373+0000 7f8fd97fa640 1 -- 172.21.15.6:0/3893240261 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d01c4aa20 con 0x555d01cef890 2024-09-12T00:00:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.373+0000 7f8fd97fa640 10 client.15447 handle_command_reply: tid=0 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.373+0000 7f8ffa818740 1 client.15447 shutdown 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.373+0000 7f8ffa818740 1 -- 172.21.15.6:0/3893240261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cda2e0 msgr2=0x555d01ce4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.373+0000 7f8ffa818740 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cda2e0 0x555d01ce4070 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00ed440 tx=0x7f8fe00bc030 comp rx=0 tx=0).stop 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.373+0000 7f8ffa818740 1 -- 172.21.15.6:0/3893240261 shutdown_connections 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.373+0000 7f8ffa818740 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555d01cef890 0x555d01cf1d10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.373+0000 7f8ffa818740 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cdf370 0x555d01ceb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.373+0000 7f8ffa818740 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cda2e0 0x555d01ce4070 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.373+0000 7f8ffa818740 1 --2- 172.21.15.6:0/3893240261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cd99a0 0x555d01ce3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.373+0000 7f8fd97fa640 0 client.15447 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.373+0000 7f8ffa818740 1 -- 172.21.15.6:0/3893240261 >> 172.21.15.6:0/3893240261 conn(0x555d01cd5010 msgr2=0x555d01cd6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.374+0000 7f8ffa818740 1 -- 172.21.15.6:0/3893240261 shutdown_connections 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.374+0000 7f8ffa818740 1 -- 172.21.15.6:0/3893240261 wait complete. 2024-09-12T00:00:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.374+0000 7f8ffa818740 20 client.15447 trim_cache size 0 max 16384 2024-09-12T00:00:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.392+0000 7f8ffa818740 1 Processor -- start 2024-09-12T00:00:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.392+0000 7f8ffa818740 1 -- start start 2024-09-12T00:00:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ffa818740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cd99a0 0x555d01ce2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ffa818740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cda2e0 0x555d01ceb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ffa818740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 0x555d01cd5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ffa818740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01aca10 con 0x555d01cdf370 2024-09-12T00:00:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ffa818740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01ae5e0 con 0x555d01cda2e0 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ffa818740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01ad0e0 con 0x555d01cd99a0 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ff6018640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 0x555d01cd5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ff6018640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 0x555d01cd5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55626/0 (socket says 172.21.15.6:55626) 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ff6018640 1 -- 172.21.15.6:0/610679101 learned_addr learned my addr 172.21.15.6:0/610679101 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ff5817640 1 --2- 172.21.15.6:0/610679101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cd99a0 0x555d01ce2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ff5016640 1 --2- 172.21.15.6:0/610679101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cda2e0 0x555d01ceb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ff6018640 1 -- 172.21.15.6:0/610679101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cd99a0 msgr2=0x555d01ce2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ff6018640 1 --2- 172.21.15.6:0/610679101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cd99a0 0x555d01ce2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ff6018640 1 -- 172.21.15.6:0/610679101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cda2e0 msgr2=0x555d01ceb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ff6018640 1 --2- 172.21.15.6:0/610679101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cda2e0 0x555d01ceb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.393+0000 7f8ff6018640 1 -- 172.21.15.6:0/610679101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d01cd4e30 con 0x555d01cdf370 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.394+0000 7f8ff6018640 1 --2- 172.21.15.6:0/610679101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 0x555d01cd5ec0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009ee0 tx=0x7f8fe801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc159a520c3a76e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.394+0000 7f8fdb7fe640 1 -- 172.21.15.6:0/610679101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe802e070 con 0x555d01cdf370 2024-09-12T00:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.394+0000 7f8fdb7fe640 1 -- 172.21.15.6:0/610679101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fe8012d90 con 0x555d01cdf370 2024-09-12T00:00:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.394+0000 7f8fdb7fe640 1 -- 172.21.15.6:0/610679101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8021e60 con 0x555d01cdf370 2024-09-12T00:00:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.395+0000 7f8ffa818740 1 -- 172.21.15.6:0/610679101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 msgr2=0x555d01cd5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.395+0000 7f8ffa818740 1 --2- 172.21.15.6:0/610679101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 0x555d01cd5ec0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009ee0 tx=0x7f8fe801f000 comp rx=0 tx=0).stop 2024-09-12T00:00:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.395+0000 7f8ffa818740 1 -- 172.21.15.6:0/610679101 shutdown_connections 2024-09-12T00:00:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.395+0000 7f8ffa818740 1 --2- 172.21.15.6:0/610679101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cdf370 0x555d01cd5ec0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.395+0000 7f8ffa818740 1 --2- 172.21.15.6:0/610679101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cda2e0 0x555d01ceb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.395+0000 7f8ffa818740 1 --2- 172.21.15.6:0/610679101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cd99a0 0x555d01ce2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.395+0000 7f8ffa818740 1 -- 172.21.15.6:0/610679101 >> 172.21.15.6:0/610679101 conn(0x555d01cd5010 msgr2=0x555d01ce2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.395+0000 7f8ffa818740 1 -- 172.21.15.6:0/610679101 shutdown_connections 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.395+0000 7f8ffa818740 1 -- 172.21.15.6:0/610679101 wait complete. 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ffa818740 1 -- start start 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ffa818740 1 Processor -- start 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ffa818740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cd99a0 0x555d01ce85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ffa818740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cda2e0 0x555d01ce8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ffa818740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cdf370 0x555d01ce9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ffa818740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01ade80 con 0x555d01cd99a0 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ffa818740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01ad7b0 con 0x555d01cdf370 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ffa818740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01aa9f0 con 0x555d01cda2e0 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ffa818740 10 client.0 _ll_register_callbacks cb 0x7f8fe0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ff5817640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cd99a0 0x555d01ce85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ff6018640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cdf370 0x555d01ce9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ff6018640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cdf370 0x555d01ce9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:35580/0 (socket says 172.21.15.6:35580) 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.396+0000 7f8ff6018640 1 -- 172.21.15.6:0/623637265 learned_addr learned my addr 172.21.15.6:0/623637265 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.397+0000 7f8ff5016640 1 --2- 172.21.15.6:0/623637265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cda2e0 0x555d01ce8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.397+0000 7f8ff6018640 1 -- 172.21.15.6:0/623637265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cda2e0 msgr2=0x555d01ce8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.397+0000 7f8ff6018640 1 --2- 172.21.15.6:0/623637265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cda2e0 0x555d01ce8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.397+0000 7f8ff6018640 1 -- 172.21.15.6:0/623637265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cd99a0 msgr2=0x555d01ce85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.397+0000 7f8ff6018640 1 --2- 172.21.15.6:0/623637265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cd99a0 0x555d01ce85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.397+0000 7f8ff6018640 1 -- 172.21.15.6:0/623637265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d01cea130 con 0x555d01cdf370 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.397+0000 7f8ff6018640 1 --2- 172.21.15.6:0/623637265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cdf370 0x555d01ce9b20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8029d20 tx=0x7f8fe8029d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5410f2c2f9215232 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.397+0000 7f8fd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.397+0000 7f8fd97fa640 1 -- 172.21.15.6:0/623637265 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe802e040 con 0x555d01cdf370 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.398+0000 7f8fd97fa640 1 -- 172.21.15.6:0/623637265 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f8fe8029800 con 0x555d01cdf370 2024-09-12T00:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.398+0000 7f8ffa818740 1 -- 172.21.15.6:0/623637265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe8012d90 con 0x555d01cdf370 2024-09-12T00:00:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.398+0000 7f8fd97fa640 1 -- 172.21.15.6:0/623637265 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8fe8021e60 con 0x555d01cdf370 2024-09-12T00:00:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.398+0000 7f8ffa818740 10 client.25088 fetch_fsmap learned FSMap version 30 2024-09-12T00:00:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.398+0000 7f8ffa818740 1 -- 172.21.15.6:0/623637265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555d01d5a5b0 con 0x555d01cdf370 2024-09-12T00:00:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.399+0000 7f8fd97fa640 1 -- 172.21.15.6:0/623637265 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fe8012d90 con 0x555d01cdf370 2024-09-12T00:00:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.399+0000 7f8fd97fa640 1 -- 172.21.15.6:0/623637265 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f8fe8028030 con 0x555d01cdf370 2024-09-12T00:00:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.399+0000 7f8ffa818740 10 client.25088 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:00:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.399+0000 7f8ffa818740 10 client.25088 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:00:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.399+0000 7f8ffa818740 20 client.25088 populate_metadata read hostname 'smithi006' 2024-09-12T00:00:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.399+0000 7f8ffa818740 1 --2- 172.21.15.6:0/623637265 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555d01d5ae50 0x555d01d5d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.399+0000 7f8ffa818740 4 client.25088 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:00:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.399+0000 7f8ffa818740 1 -- 172.21.15.6:0/623637265 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555d01c44d70 con 0x555d01d5ae50 2024-09-12T00:00:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.400+0000 7f8ff5817640 1 --2- 172.21.15.6:0/623637265 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555d01d5ae50 0x555d01d5d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.401+0000 7f8ff5817640 1 --2- 172.21.15.6:0/623637265 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555d01d5ae50 0x555d01d5d270 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a8c10eb392801f server_cookie=54fe121c14b6eddf in_seq=0 out_seq=0 2024-09-12T00:00:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.401+0000 7f8fd97fa640 10 client.25088 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.447+0000 7f8fd97fa640 1 -- 172.21.15.6:0/623637265 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555d01c44d70 con 0x555d01d5ae50 2024-09-12T00:00:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.447+0000 7f8fd97fa640 10 client.25088 handle_command_reply: tid=0 2024-09-12T00:00:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.447+0000 7f8ffa818740 1 client.25088 shutdown 2024-09-12T00:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.447+0000 7f8ffa818740 1 -- 172.21.15.6:0/623637265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cdf370 msgr2=0x555d01ce9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.447+0000 7f8ffa818740 1 --2- 172.21.15.6:0/623637265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cdf370 0x555d01ce9b20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8029d20 tx=0x7f8fe8029d50 comp rx=0 tx=0).stop 2024-09-12T00:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ffa818740 1 -- 172.21.15.6:0/623637265 shutdown_connections 2024-09-12T00:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ffa818740 1 --2- 172.21.15.6:0/623637265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555d01cdf370 0x555d01ce9b20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ffa818740 1 --2- 172.21.15.6:0/623637265 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555d01d5ae50 0x555d01d5d270 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ffa818740 1 --2- 172.21.15.6:0/623637265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d01cda2e0 0x555d01ce8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ffa818740 1 --2- 172.21.15.6:0/623637265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d01cd99a0 0x555d01ce85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8fd97fa640 0 client.25088 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ffa818740 1 -- 172.21.15.6:0/623637265 >> 172.21.15.6:0/623637265 conn(0x555d01cd5010 msgr2=0x555d01ce30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ffa818740 1 -- 172.21.15.6:0/623637265 shutdown_connections 2024-09-12T00:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ffa818740 1 -- 172.21.15.6:0/623637265 wait complete. 2024-09-12T00:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ffa818740 20 client.25088 trim_cache size 0 max 16384 2024-09-12T00:00:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:00:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:00:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:00:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:00:45.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/2998123817 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8fdc0a2b80 msgr2=0x7f8fdc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:45.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ff7a7b640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8fdc0a2b80 0x7f8fdc0a5040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009990 tx=0x7f8fe8009b00 comp rx=0 tx=0).stop 2024-09-12T00:00:45.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/2998123817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ff0100d50 msgr2=0x7f8ff019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.448+0000 7f8ff7a7b640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ff0100d50 0x7f8ff019a4e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00314e0 tx=0x7f8fe0003c80 comp rx=0 tx=0).stop 2024-09-12T00:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.449+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/2998123817 shutdown_connections 2024-09-12T00:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.449+0000 7f8ff7a7b640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8fdc0a2b80 0x7f8fdc0a5040 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.449+0000 7f8ff7a7b640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff01016f0 0x7f8ff01a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.449+0000 7f8ff7a7b640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ff0100d50 0x7f8ff019a4e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.449+0000 7f8ff7a7b640 1 --2- 172.21.15.6:0/2998123817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff0100410 0x7f8ff0199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.449+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/2998123817 >> 172.21.15.6:0/2998123817 conn(0x7f8ff00fc1c0 msgr2=0x7f8ff00fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.449+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/2998123817 shutdown_connections 2024-09-12T00:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:45.449+0000 7f8ff7a7b640 1 -- 172.21.15.6:0/2998123817 wait complete. 2024-09-12T00:00:47.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:46 smithi006 ceph-mon[30947]: pgmap v402: 129 pgs: 129 active+clean; 10 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 630 KiB/s wr, 220 op/s 2024-09-12T00:00:47.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:46 smithi134 ceph-mon[34893]: pgmap v402: 129 pgs: 129 active+clean; 10 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 630 KiB/s wr, 220 op/s 2024-09-12T00:00:47.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:46 smithi039 ceph-mon[34543]: pgmap v402: 129 pgs: 129 active+clean; 10 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 630 KiB/s wr, 220 op/s 2024-09-12T00:00:49.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:48 smithi006 ceph-mon[30947]: pgmap v403: 129 pgs: 129 active+clean; 55 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 4.3 MiB/s wr, 180 op/s 2024-09-12T00:00:49.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:48 smithi134 ceph-mon[34893]: pgmap v403: 129 pgs: 129 active+clean; 55 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 4.3 MiB/s wr, 180 op/s 2024-09-12T00:00:49.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:48 smithi039 ceph-mon[34543]: pgmap v403: 129 pgs: 129 active+clean; 55 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 4.3 MiB/s wr, 180 op/s 2024-09-12T00:00:51.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:50 smithi006 ceph-mon[30947]: pgmap v404: 129 pgs: 129 active+clean; 91 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 7.1 MiB/s wr, 122 op/s 2024-09-12T00:00:51.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:50 smithi134 ceph-mon[34893]: pgmap v404: 129 pgs: 129 active+clean; 91 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 7.1 MiB/s wr, 122 op/s 2024-09-12T00:00:51.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:50 smithi039 ceph-mon[34543]: pgmap v404: 129 pgs: 129 active+clean; 91 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 7.1 MiB/s wr, 122 op/s 2024-09-12T00:00:53.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:52 smithi006 ceph-mon[30947]: pgmap v405: 129 pgs: 129 active+clean; 143 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 12 MiB/s wr, 99 op/s 2024-09-12T00:00:53.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:52 smithi134 ceph-mon[34893]: pgmap v405: 129 pgs: 129 active+clean; 143 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 12 MiB/s wr, 99 op/s 2024-09-12T00:00:53.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:52 smithi039 ceph-mon[34543]: pgmap v405: 129 pgs: 129 active+clean; 143 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 12 MiB/s wr, 99 op/s 2024-09-12T00:00:55.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:54 smithi134 ceph-mon[34893]: pgmap v406: 129 pgs: 129 active+clean; 203 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 17 MiB/s wr, 86 op/s 2024-09-12T00:00:55.222 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:54 smithi006 ceph-mon[30947]: pgmap v406: 129 pgs: 129 active+clean; 203 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 17 MiB/s wr, 86 op/s 2024-09-12T00:00:55.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:54 smithi039 ceph-mon[34543]: pgmap v406: 129 pgs: 129 active+clean; 203 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 17 MiB/s wr, 86 op/s 2024-09-12T00:00:57.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:56 smithi134 ceph-mon[34893]: pgmap v407: 129 pgs: 129 active+clean; 243 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 62 op/s 2024-09-12T00:00:57.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:56 smithi039 ceph-mon[34543]: pgmap v407: 129 pgs: 129 active+clean; 243 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 62 op/s 2024-09-12T00:00:57.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:56 smithi006 ceph-mon[30947]: pgmap v407: 129 pgs: 129 active+clean; 243 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 62 op/s 2024-09-12T00:00:58.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.547+0000 7faba8f2a640 1 -- 172.21.15.6:0/1724861955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba4103710 msgr2=0x7faba4109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.547+0000 7faba8f2a640 1 --2- 172.21.15.6:0/1724861955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba4103710 0x7faba4109fa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009ca0 tx=0x7fab9c02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.547+0000 7faba8f2a640 1 -- 172.21.15.6:0/1724861955 shutdown_connections 2024-09-12T00:00:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.547+0000 7faba8f2a640 1 --2- 172.21.15.6:0/1724861955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba4103710 0x7faba4109fa0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.547+0000 7faba8f2a640 1 --2- 172.21.15.6:0/1724861955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faba4102d50 0x7faba41031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.547+0000 7faba8f2a640 1 --2- 172.21.15.6:0/1724861955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba4101b60 0x7faba4101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.547+0000 7faba8f2a640 1 -- 172.21.15.6:0/1724861955 >> 172.21.15.6:0/1724861955 conn(0x7faba40fd2e0 msgr2=0x7faba40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.547+0000 7faba8f2a640 1 -- 172.21.15.6:0/1724861955 shutdown_connections 2024-09-12T00:00:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.547+0000 7faba8f2a640 1 -- 172.21.15.6:0/1724861955 wait complete. 2024-09-12T00:00:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.548+0000 7faba8f2a640 1 Processor -- start 2024-09-12T00:00:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.548+0000 7faba8f2a640 1 -- start start 2024-09-12T00:00:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba8f2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba4101b60 0x7faba4197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba8f2a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faba4102d50 0x7faba4198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba8f2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba4103710 0x7faba419f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba8f2a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faba410d670 con 0x7faba4103710 2024-09-12T00:00:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba8f2a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7faba410d4f0 con 0x7faba4102d50 2024-09-12T00:00:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba8f2a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faba410d7f0 con 0x7faba4101b60 2024-09-12T00:00:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba4103710 0x7faba419f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba4103710 0x7faba419f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45502/0 (socket says 172.21.15.6:45502) 2024-09-12T00:00:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba2d9d640 1 -- 172.21.15.6:0/787333931 learned_addr learned my addr 172.21.15.6:0/787333931 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba1d9b640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faba4102d50 0x7faba4198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba259c640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba4101b60 0x7faba4197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba2d9d640 1 -- 172.21.15.6:0/787333931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba4101b60 msgr2=0x7faba4197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba2d9d640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba4101b60 0x7faba4197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba2d9d640 1 -- 172.21.15.6:0/787333931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faba4102d50 msgr2=0x7faba4198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba2d9d640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faba4102d50 0x7faba4198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba2d9d640 1 -- 172.21.15.6:0/787333931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba419f970 con 0x7faba4103710 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba259c640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba4101b60 0x7faba4197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba1d9b640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faba4102d50 0x7faba4198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.549+0000 7faba2d9d640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba4103710 0x7faba419f300 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fab9c031970 tx=0x7fab9c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.550+0000 7fab937fe640 1 -- 172.21.15.6:0/787333931 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c004040 con 0x7faba4103710 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.550+0000 7faba8f2a640 1 -- 172.21.15.6:0/787333931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba419fc00 con 0x7faba4103710 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.550+0000 7fab937fe640 1 -- 172.21.15.6:0/787333931 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab9c004690 con 0x7faba4103710 2024-09-12T00:00:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.550+0000 7fab937fe640 1 -- 172.21.15.6:0/787333931 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c030c60 con 0x7faba4103710 2024-09-12T00:00:58.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.550+0000 7faba8f2a640 1 -- 172.21.15.6:0/787333931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba41a01a0 con 0x7faba4103710 2024-09-12T00:00:58.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.552+0000 7fababcc6740 1 Processor -- start 2024-09-12T00:00:58.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7fab937fe640 1 -- 172.21.15.6:0/787333931 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fab9c0041e0 con 0x7faba4103710 2024-09-12T00:00:58.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7fababcc6740 1 -- start start 2024-09-12T00:00:58.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7fababcc6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d219a0 0x5601a1d21da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7fababcc6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 0x5601a1d26da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7fababcc6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d27370 0x5601a1d29830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7fababcc6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5601a1c852f0 con 0x5601a1d222e0 2024-09-12T00:00:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7fababcc6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5601a1c2d270 con 0x5601a1d219a0 2024-09-12T00:00:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7fababcc6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5601a1c812b0 con 0x5601a1d27370 2024-09-12T00:00:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7faba259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 0x5601a1d26da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7faba259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 0x5601a1d26da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45506/0 (socket says 172.21.15.6:45506) 2024-09-12T00:00:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7faba259c640 1 -- 172.21.15.6:0/3221560399 learned_addr learned my addr 172.21.15.6:0/3221560399 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7faba1d9b640 1 --2- 172.21.15.6:0/3221560399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d27370 0x5601a1d29830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.553+0000 7faba1d9b640 1 --2- 172.21.15.6:0/3221560399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d219a0 0x5601a1d21da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7faba259c640 1 -- 172.21.15.6:0/3221560399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d27370 msgr2=0x5601a1d29830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7faba259c640 1 --2- 172.21.15.6:0/3221560399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d27370 0x5601a1d29830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7faba259c640 1 -- 172.21.15.6:0/3221560399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d219a0 msgr2=0x5601a1d21da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7faba259c640 1 --2- 172.21.15.6:0/3221560399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d219a0 0x5601a1d21da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7faba259c640 1 -- 172.21.15.6:0/3221560399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a1c2c340 con 0x5601a1d222e0 2024-09-12T00:00:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7fab937fe640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fab8c0a2b80 0x7fab8c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7faba1d9b640 1 --2- 172.21.15.6:0/3221560399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d27370 0x5601a1d29830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7faba259c640 1 --2- 172.21.15.6:0/3221560399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 0x5601a1d26da0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fab9400bd30 tx=0x7fab9400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c30797a942d7d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7faba1d9b640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fab8c0a2b80 0x7fab8c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7fab937fe640 1 -- 172.21.15.6:0/787333931 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fab9c0f0950 con 0x7faba4103710 2024-09-12T00:00:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7fab90ff9640 1 -- 172.21.15.6:0/3221560399 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94015070 con 0x5601a1d222e0 2024-09-12T00:00:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7fab90ff9640 1 -- 172.21.15.6:0/3221560399 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab9400be20 con 0x5601a1d222e0 2024-09-12T00:00:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.554+0000 7fab90ff9640 1 -- 172.21.15.6:0/3221560399 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab940106c0 con 0x5601a1d222e0 2024-09-12T00:00:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.555+0000 7fababcc6740 1 -- 172.21.15.6:0/3221560399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 msgr2=0x5601a1d26da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.555+0000 7faba1d9b640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fab8c0a2b80 0x7fab8c0a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fab980058c0 tx=0x7fab98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.555+0000 7fababcc6740 1 --2- 172.21.15.6:0/3221560399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 0x5601a1d26da0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fab9400bd30 tx=0x7fab9400f730 comp rx=0 tx=0).stop 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.555+0000 7fababcc6740 1 -- 172.21.15.6:0/3221560399 shutdown_connections 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.555+0000 7fababcc6740 1 --2- 172.21.15.6:0/3221560399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d27370 0x5601a1d29830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.555+0000 7fababcc6740 1 --2- 172.21.15.6:0/3221560399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 0x5601a1d26da0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.555+0000 7fababcc6740 1 --2- 172.21.15.6:0/3221560399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d219a0 0x5601a1d21da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.555+0000 7fababcc6740 1 -- 172.21.15.6:0/3221560399 >> 172.21.15.6:0/3221560399 conn(0x5601a1d1d010 msgr2=0x5601a1d1d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.555+0000 7fababcc6740 1 -- 172.21.15.6:0/3221560399 shutdown_connections 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.555+0000 7fababcc6740 1 -- 172.21.15.6:0/3221560399 wait complete. 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.555+0000 7fababcc6740 1 -- start start 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.555+0000 7fababcc6740 1 Processor -- start 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7fababcc6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d219a0 0x5601a1d2bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7fababcc6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 0x5601a1d2c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7fababcc6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d27370 0x5601a1d33110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7fababcc6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5601a1d2a340 con 0x5601a1d222e0 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7fababcc6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5601a1c0e290 con 0x5601a1d27370 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7fababcc6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5601a1d2a4c0 con 0x5601a1d219a0 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7fababcc6740 10 client.0 _ll_register_callbacks cb 0x5601a1c3f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7faba1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 0x5601a1d2c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7faba259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d219a0 0x5601a1d2bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7faba259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d219a0 0x5601a1d2bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:33178/0 (socket says 172.21.15.6:33178) 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7faba259c640 1 -- 172.21.15.6:0/359638331 learned_addr learned my addr 172.21.15.6:0/359638331 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7faba2d9d640 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d27370 0x5601a1d33110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7faba259c640 1 -- 172.21.15.6:0/359638331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d27370 msgr2=0x5601a1d33110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7faba259c640 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d27370 0x5601a1d33110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7faba259c640 1 -- 172.21.15.6:0/359638331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 msgr2=0x5601a1d2c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7faba259c640 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 0x5601a1d2c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7faba259c640 1 -- 172.21.15.6:0/359638331 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601a1998210 con 0x5601a1d219a0 2024-09-12T00:00:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7faba2d9d640 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d27370 0x5601a1d33110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.556+0000 7faba1d9b640 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 0x5601a1d2c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.557+0000 7faba259c640 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d219a0 0x5601a1d2bb90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab9400bd00 tx=0x7fab94011670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2d703cdf91cec4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.557+0000 7fab89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:00:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.557+0000 7fab89ffb640 1 -- 172.21.15.6:0/359638331 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94015050 con 0x5601a1d219a0 2024-09-12T00:00:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.557+0000 7fab89ffb640 1 -- 172.21.15.6:0/359638331 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fab94011a70 con 0x5601a1d219a0 2024-09-12T00:00:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.557+0000 7fababcc6740 1 -- 172.21.15.6:0/359638331 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab9400be20 con 0x5601a1d219a0 2024-09-12T00:00:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.557+0000 7fab89ffb640 1 -- 172.21.15.6:0/359638331 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fab9402d050 con 0x5601a1d219a0 2024-09-12T00:00:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.557+0000 7fababcc6740 10 client.25123 fetch_fsmap learned FSMap version 30 2024-09-12T00:00:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.557+0000 7fababcc6740 1 -- 172.21.15.6:0/359638331 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5601a1a64620 con 0x5601a1d219a0 2024-09-12T00:00:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.557+0000 7fab89ffb640 1 -- 172.21.15.6:0/359638331 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab9400be20 con 0x5601a1d219a0 2024-09-12T00:00:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.558+0000 7fab89ffb640 1 -- 172.21.15.6:0/359638331 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fab94004c40 con 0x5601a1d219a0 2024-09-12T00:00:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.558+0000 7fababcc6740 10 client.25123 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:00:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.558+0000 7fababcc6740 10 client.25123 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:00:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.558+0000 7fababcc6740 20 client.25123 populate_metadata read hostname 'smithi006' 2024-09-12T00:00:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.558+0000 7fababcc6740 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5601a1d37520 0x5601a1d39980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.558+0000 7fababcc6740 4 client.25123 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.558+0000 7fababcc6740 1 -- 172.21.15.6:0/359638331 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601a1c92a20 con 0x5601a1d37520 2024-09-12T00:00:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.558+0000 7faba1d9b640 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5601a1d37520 0x5601a1d39980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.558+0000 7faba1d9b640 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5601a1d37520 0x5601a1d39980 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4752063b96e78f74 server_cookie=b3340702eca354e0 in_seq=0 out_seq=0 2024-09-12T00:00:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.558+0000 7fab89ffb640 10 client.25123 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fab89ffb640 1 -- 172.21.15.6:0/359638331 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601a1c92a20 con 0x5601a1d37520 2024-09-12T00:00:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fab89ffb640 10 client.25123 handle_command_reply: tid=0 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fababcc6740 1 client.25123 shutdown 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fababcc6740 1 -- 172.21.15.6:0/359638331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d219a0 msgr2=0x5601a1d2bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fababcc6740 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d219a0 0x5601a1d2bb90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab9400bd00 tx=0x7fab94011670 comp rx=0 tx=0).stop 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fababcc6740 1 -- 172.21.15.6:0/359638331 shutdown_connections 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fababcc6740 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d27370 0x5601a1d33110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fababcc6740 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d222e0 0x5601a1d2c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fababcc6740 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5601a1d37520 0x5601a1d39980 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fababcc6740 1 --2- 172.21.15.6:0/359638331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d219a0 0x5601a1d2bb90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fab89ffb640 0 client.25123 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fababcc6740 1 -- 172.21.15.6:0/359638331 >> 172.21.15.6:0/359638331 conn(0x5601a1d1d010 msgr2=0x5601a1d1e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fababcc6740 1 -- 172.21.15.6:0/359638331 shutdown_connections 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fababcc6740 1 -- 172.21.15.6:0/359638331 wait complete. 2024-09-12T00:00:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.559+0000 7fababcc6740 20 client.25123 trim_cache size 0 max 16384 2024-09-12T00:00:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7fababcc6740 1 Processor -- start 2024-09-12T00:00:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7fababcc6740 1 -- start start 2024-09-12T00:00:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7fababcc6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 0x5601a1d2c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7fababcc6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d222e0 0x5601a1d330d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7fababcc6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d27370 0x5601a1d26a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7fababcc6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faba41aa8b0 con 0x5601a1d219a0 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7fababcc6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7faba41ac480 con 0x5601a1d222e0 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7fababcc6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faba41aaf80 con 0x5601a1d27370 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7faba259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 0x5601a1d2c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7faba259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 0x5601a1d2c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45518/0 (socket says 172.21.15.6:45518) 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7faba259c640 1 -- 172.21.15.6:0/600196268 learned_addr learned my addr 172.21.15.6:0/600196268 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7faba1d9b640 1 --2- 172.21.15.6:0/600196268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d222e0 0x5601a1d330d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7faba2d9d640 1 --2- 172.21.15.6:0/600196268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d27370 0x5601a1d26a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7faba259c640 1 -- 172.21.15.6:0/600196268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d27370 msgr2=0x5601a1d26a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7faba259c640 1 --2- 172.21.15.6:0/600196268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d27370 0x5601a1d26a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7faba259c640 1 -- 172.21.15.6:0/600196268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d222e0 msgr2=0x5601a1d330d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7faba259c640 1 --2- 172.21.15.6:0/600196268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d222e0 0x5601a1d330d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7faba259c640 1 -- 172.21.15.6:0/600196268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a1d29ca0 con 0x5601a1d219a0 2024-09-12T00:00:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.580+0000 7faba259c640 1 --2- 172.21.15.6:0/600196268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 0x5601a1d2c160 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fab940058c0 tx=0x7fab9400b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94013ab06965abe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.581+0000 7fab8bfff640 1 -- 172.21.15.6:0/600196268 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94015070 con 0x5601a1d219a0 2024-09-12T00:00:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.581+0000 7fab8bfff640 1 -- 172.21.15.6:0/600196268 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab9400be20 con 0x5601a1d219a0 2024-09-12T00:00:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.581+0000 7fab8bfff640 1 -- 172.21.15.6:0/600196268 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab940052a0 con 0x5601a1d219a0 2024-09-12T00:00:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.581+0000 7fababcc6740 1 -- 172.21.15.6:0/600196268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 msgr2=0x5601a1d2c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.581+0000 7fababcc6740 1 --2- 172.21.15.6:0/600196268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 0x5601a1d2c160 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fab940058c0 tx=0x7fab9400b9e0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.581+0000 7fababcc6740 1 -- 172.21.15.6:0/600196268 shutdown_connections 2024-09-12T00:00:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.581+0000 7fababcc6740 1 --2- 172.21.15.6:0/600196268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d27370 0x5601a1d26a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.581+0000 7fababcc6740 1 --2- 172.21.15.6:0/600196268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d222e0 0x5601a1d330d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.581+0000 7fababcc6740 1 --2- 172.21.15.6:0/600196268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 0x5601a1d2c160 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.581+0000 7fababcc6740 1 -- 172.21.15.6:0/600196268 >> 172.21.15.6:0/600196268 conn(0x5601a1d1d010 msgr2=0x5601a1d2b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7fababcc6740 1 -- 172.21.15.6:0/600196268 shutdown_connections 2024-09-12T00:00:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7fababcc6740 1 -- 172.21.15.6:0/600196268 wait complete. 2024-09-12T00:00:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7fababcc6740 1 -- start start 2024-09-12T00:00:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7fababcc6740 1 Processor -- start 2024-09-12T00:00:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7fababcc6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 0x5601a1d2ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7fababcc6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d222e0 0x5601a1d304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7fababcc6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d27370 0x5601a1da0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7fababcc6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faba41abd20 con 0x5601a1d219a0 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7fababcc6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7faba41ab650 con 0x5601a1d27370 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7fababcc6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faba41a8890 con 0x5601a1d222e0 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7fababcc6740 10 client.0 _ll_register_callbacks cb 0x7fab9400bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7faba259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 0x5601a1d2ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7faba259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 0x5601a1d2ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45520/0 (socket says 172.21.15.6:45520) 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.582+0000 7faba259c640 1 -- 172.21.15.6:0/3520858118 learned_addr learned my addr 172.21.15.6:0/3520858118 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7faba1d9b640 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d222e0 0x5601a1d304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7faba2d9d640 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d27370 0x5601a1da0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7faba259c640 1 -- 172.21.15.6:0/3520858118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d222e0 msgr2=0x5601a1d304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7faba259c640 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d222e0 0x5601a1d304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7faba259c640 1 -- 172.21.15.6:0/3520858118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d27370 msgr2=0x5601a1da0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7faba259c640 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d27370 0x5601a1da0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7faba259c640 1 -- 172.21.15.6:0/3520858118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601a1da07a0 con 0x5601a1d219a0 2024-09-12T00:00:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7faba2d9d640 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d27370 0x5601a1da0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:00:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7faba259c640 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 0x5601a1d2ff60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fab9400c010 tx=0x7fab940245e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d93567af1da5dbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7fab89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:00:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7fab89ffb640 1 -- 172.21.15.6:0/3520858118 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94015030 con 0x5601a1d219a0 2024-09-12T00:00:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7fab89ffb640 1 -- 172.21.15.6:0/3520858118 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fab94024d60 con 0x5601a1d219a0 2024-09-12T00:00:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7fababcc6740 1 -- 172.21.15.6:0/3520858118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab9400be20 con 0x5601a1d219a0 2024-09-12T00:00:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7fab89ffb640 1 -- 172.21.15.6:0/3520858118 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fab94011e20 con 0x5601a1d219a0 2024-09-12T00:00:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7fababcc6740 10 client.15471 fetch_fsmap learned FSMap version 30 2024-09-12T00:00:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.583+0000 7fababcc6740 1 -- 172.21.15.6:0/3520858118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5601a1da1a30 con 0x5601a1d219a0 2024-09-12T00:00:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.584+0000 7fab89ffb640 1 -- 172.21.15.6:0/3520858118 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab9400be20 con 0x5601a1d219a0 2024-09-12T00:00:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.584+0000 7fab89ffb640 1 -- 172.21.15.6:0/3520858118 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fab94004a00 con 0x5601a1d219a0 2024-09-12T00:00:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.584+0000 7fababcc6740 10 client.15471 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:00:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.584+0000 7fababcc6740 10 client.15471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:00:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.584+0000 7fababcc6740 20 client.15471 populate_metadata read hostname 'smithi006' 2024-09-12T00:00:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.584+0000 7fababcc6740 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5601a1da24a0 0x5601a1da48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.584+0000 7fababcc6740 4 client.15471 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:00:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.584+0000 7fababcc6740 1 -- 172.21.15.6:0/3520858118 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5601a1c8cd70 con 0x5601a1da24a0 2024-09-12T00:00:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.584+0000 7faba1d9b640 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5601a1da24a0 0x5601a1da48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.585+0000 7faba1d9b640 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5601a1da24a0 0x5601a1da48c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7402287ea39b53 server_cookie=893bd490c913bb94 in_seq=0 out_seq=0 2024-09-12T00:00:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.585+0000 7fab89ffb640 10 client.15471 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fab89ffb640 1 -- 172.21.15.6:0/3520858118 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5601a1c8cd70 con 0x5601a1da24a0 2024-09-12T00:00:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fab89ffb640 10 client.15471 handle_command_reply: tid=0 2024-09-12T00:00:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fababcc6740 1 client.15471 shutdown 2024-09-12T00:00:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fababcc6740 1 -- 172.21.15.6:0/3520858118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 msgr2=0x5601a1d2ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fababcc6740 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 0x5601a1d2ff60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fab9400c010 tx=0x7fab940245e0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fababcc6740 1 -- 172.21.15.6:0/3520858118 shutdown_connections 2024-09-12T00:00:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fababcc6740 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601a1d27370 0x5601a1da0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fababcc6740 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5601a1da24a0 0x5601a1da48c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fababcc6740 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601a1d222e0 0x5601a1d304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fab89ffb640 0 client.15471 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:00:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fababcc6740 1 --2- 172.21.15.6:0/3520858118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601a1d219a0 0x5601a1d2ff60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fababcc6740 1 -- 172.21.15.6:0/3520858118 >> 172.21.15.6:0/3520858118 conn(0x5601a1d1d010 msgr2=0x5601a1d2b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fababcc6740 1 -- 172.21.15.6:0/3520858118 shutdown_connections 2024-09-12T00:00:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fababcc6740 1 -- 172.21.15.6:0/3520858118 wait complete. 2024-09-12T00:00:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.603+0000 7fababcc6740 20 client.15471 trim_cache size 0 max 16384 2024-09-12T00:00:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:00:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:00:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:00:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:00:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.604+0000 7faba8f2a640 1 -- 172.21.15.6:0/787333931 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fab8c0a2b80 msgr2=0x7fab8c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.604+0000 7faba8f2a640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fab8c0a2b80 0x7fab8c0a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fab980058c0 tx=0x7fab98005f90 comp rx=0 tx=0).stop 2024-09-12T00:00:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.604+0000 7faba8f2a640 1 -- 172.21.15.6:0/787333931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba4103710 msgr2=0x7faba419f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.604+0000 7faba8f2a640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba4103710 0x7faba419f300 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fab9c031970 tx=0x7fab9c003ba0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.604+0000 7faba8f2a640 1 -- 172.21.15.6:0/787333931 shutdown_connections 2024-09-12T00:00:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.604+0000 7faba8f2a640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fab8c0a2b80 0x7fab8c0a5040 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.604+0000 7faba8f2a640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba4103710 0x7faba419f300 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.604+0000 7faba8f2a640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faba4102d50 0x7faba4198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.604+0000 7faba8f2a640 1 --2- 172.21.15.6:0/787333931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba4101b60 0x7faba4197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.604+0000 7faba8f2a640 1 -- 172.21.15.6:0/787333931 >> 172.21.15.6:0/787333931 conn(0x7faba40fd2e0 msgr2=0x7faba41061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.604+0000 7faba8f2a640 1 -- 172.21.15.6:0/787333931 shutdown_connections 2024-09-12T00:00:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:00:58.604+0000 7faba8f2a640 1 -- 172.21.15.6:0/787333931 wait complete. 2024-09-12T00:00:59.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:00:58 smithi134 ceph-mon[34893]: pgmap v408: 129 pgs: 129 active+clean; 295 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 51 op/s 2024-09-12T00:00:59.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:00:58 smithi039 ceph-mon[34543]: pgmap v408: 129 pgs: 129 active+clean; 295 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 51 op/s 2024-09-12T00:00:59.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:00:58 smithi006 ceph-mon[30947]: pgmap v408: 129 pgs: 129 active+clean; 295 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 51 op/s 2024-09-12T00:01:01.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:00 smithi134 ceph-mon[34893]: pgmap v409: 129 pgs: 129 active+clean; 367 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 MiB/s wr, 36 op/s 2024-09-12T00:01:01.235 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:00 smithi039 ceph-mon[34543]: pgmap v409: 129 pgs: 129 active+clean; 367 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 MiB/s wr, 36 op/s 2024-09-12T00:01:01.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:00 smithi006 ceph-mon[30947]: pgmap v409: 129 pgs: 129 active+clean; 367 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 MiB/s wr, 36 op/s 2024-09-12T00:01:02.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:01:02.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:01:02.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:01:02.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:01 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:01:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:01:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:01:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:01 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:01:02.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:02.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:01:02.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:01:02.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:01 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:01:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:02 smithi134 ceph-mon[34893]: pgmap v410: 129 pgs: 129 active+clean; 391 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 29 op/s 2024-09-12T00:01:03.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:02 smithi039 ceph-mon[34543]: pgmap v410: 129 pgs: 129 active+clean; 391 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 29 op/s 2024-09-12T00:01:03.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:02 smithi006 ceph-mon[30947]: pgmap v410: 129 pgs: 129 active+clean; 391 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 29 op/s 2024-09-12T00:01:05.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:04 smithi134 ceph-mon[34893]: pgmap v411: 129 pgs: 129 active+clean; 459 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:01:05.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:04 smithi039 ceph-mon[34543]: pgmap v411: 129 pgs: 129 active+clean; 459 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:01:05.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:04 smithi006 ceph-mon[30947]: pgmap v411: 129 pgs: 129 active+clean; 459 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:01:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:06 smithi134 ceph-mon[34893]: pgmap v412: 129 pgs: 129 active+clean; 507 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:01:07.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:06 smithi039 ceph-mon[34543]: pgmap v412: 129 pgs: 129 active+clean; 507 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:01:07.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:06 smithi006 ceph-mon[30947]: pgmap v412: 129 pgs: 129 active+clean; 507 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:01:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:08 smithi134 ceph-mon[34893]: pgmap v413: 129 pgs: 129 active+clean; 571 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:01:09.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:08 smithi039 ceph-mon[34543]: pgmap v413: 129 pgs: 129 active+clean; 571 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:01:09.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:08 smithi006 ceph-mon[30947]: pgmap v413: 129 pgs: 129 active+clean; 571 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:01:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:10 smithi134 ceph-mon[34893]: pgmap v414: 129 pgs: 129 active+clean; 639 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 28 op/s 2024-09-12T00:01:11.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:10 smithi039 ceph-mon[34543]: pgmap v414: 129 pgs: 129 active+clean; 639 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 28 op/s 2024-09-12T00:01:11.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:10 smithi006 ceph-mon[30947]: pgmap v414: 129 pgs: 129 active+clean; 639 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 28 op/s 2024-09-12T00:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.700+0000 7f748af49640 1 -- 172.21.15.6:0/1588889493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7484101c50 msgr2=0x7f74841020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.700+0000 7f748af49640 1 --2- 172.21.15.6:0/1588889493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7484101c50 0x7f74841020d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7470009900 tx=0x7f747002a410 comp rx=0 tx=0).stop 2024-09-12T00:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.700+0000 7f748af49640 1 -- 172.21.15.6:0/1588889493 shutdown_connections 2024-09-12T00:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.700+0000 7f748af49640 1 --2- 172.21.15.6:0/1588889493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7484102610 0x7f7484108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.700+0000 7f748af49640 1 --2- 172.21.15.6:0/1588889493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7484101c50 0x7f74841020d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.700+0000 7f748af49640 1 --2- 172.21.15.6:0/1588889493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7484100a60 0x7f7484100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.700+0000 7f748af49640 1 -- 172.21.15.6:0/1588889493 >> 172.21.15.6:0/1588889493 conn(0x7f74840fc1c0 msgr2=0x7f74840fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.700+0000 7f748af49640 1 -- 172.21.15.6:0/1588889493 shutdown_connections 2024-09-12T00:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.700+0000 7f748af49640 1 -- 172.21.15.6:0/1588889493 wait complete. 2024-09-12T00:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.700+0000 7f748af49640 1 Processor -- start 2024-09-12T00:01:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.700+0000 7f748af49640 1 -- start start 2024-09-12T00:01:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.700+0000 7f748af49640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7484100a60 0x7f7484199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f748af49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7484101c50 0x7f748419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f748af49640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7484102610 0x7f74841a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f748af49640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f748410c570 con 0x7f7484100a60 2024-09-12T00:01:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f748af49640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f748410c3f0 con 0x7f7484102610 2024-09-12T00:01:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f748af49640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f748410c6f0 con 0x7f7484101c50 2024-09-12T00:01:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7488ce5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7484100a60 0x7f7484199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7488ce5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7484100a60 0x7f7484199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45004/0 (socket says 172.21.15.6:45004) 2024-09-12T00:01:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7488ce5640 1 -- 172.21.15.6:0/2198490746 learned_addr learned my addr 172.21.15.6:0/2198490746 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f74894e6640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7484102610 0x7f74841a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7483fff640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7484101c50 0x7f748419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7488ce5640 1 -- 172.21.15.6:0/2198490746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7484101c50 msgr2=0x7f748419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7488ce5640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7484101c50 0x7f748419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7488ce5640 1 -- 172.21.15.6:0/2198490746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7484102610 msgr2=0x7f74841a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7488ce5640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7484102610 0x7f74841a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7488ce5640 1 -- 172.21.15.6:0/2198490746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74841a1c00 con 0x7f7484100a60 2024-09-12T00:01:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7488ce5640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7484100a60 0x7f7484199fe0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f747800e9c0 tx=0x7f747800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7481ffb640 1 -- 172.21.15.6:0/2198490746 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747800cd80 con 0x7f7484100a60 2024-09-12T00:01:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7481ffb640 1 -- 172.21.15.6:0/2198490746 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74780035f0 con 0x7f7484100a60 2024-09-12T00:01:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f748af49640 1 -- 172.21.15.6:0/2198490746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74841a1ef0 con 0x7f7484100a60 2024-09-12T00:01:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.701+0000 7f7481ffb640 1 -- 172.21.15.6:0/2198490746 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478010690 con 0x7f7484100a60 2024-09-12T00:01:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.702+0000 7f748af49640 1 -- 172.21.15.6:0/2198490746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74841a2350 con 0x7f7484100a60 2024-09-12T00:01:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.704+0000 7f7481ffb640 1 -- 172.21.15.6:0/2198490746 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f74780037a0 con 0x7f7484100a60 2024-09-12T00:01:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.704+0000 7f748ddbe740 1 Processor -- start 2024-09-12T00:01:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.704+0000 7f748ddbe740 1 -- start start 2024-09-12T00:01:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f7481ffb640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f74740a2b80 0x7f74740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f748ddbe740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15806f9a0 0x55b15806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f748ddbe740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 0x55b158074da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f748ddbe740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b158075370 0x55b158077830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f748ddbe740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b157fd32f0 con 0x55b1580702e0 2024-09-12T00:01:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f748ddbe740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b157f7b270 con 0x55b158075370 2024-09-12T00:01:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f748ddbe740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b157fcf2b0 con 0x55b15806f9a0 2024-09-12T00:01:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f7481ffb640 1 -- 172.21.15.6:0/2198490746 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f74780cf7a0 con 0x7f7484100a60 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f7483fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 0x55b158074da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f74894e6640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f74740a2b80 0x7f74740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f7483fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 0x55b158074da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45020/0 (socket says 172.21.15.6:45020) 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f7483fff640 1 -- 172.21.15.6:0/4036998150 learned_addr learned my addr 172.21.15.6:0/4036998150 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f74894e6640 1 --2- 172.21.15.6:0/4036998150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b158075370 0x55b158077830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f7488ce5640 1 --2- 172.21.15.6:0/4036998150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15806f9a0 0x55b15806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f7483fff640 1 -- 172.21.15.6:0/4036998150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15806f9a0 msgr2=0x55b15806fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f7483fff640 1 --2- 172.21.15.6:0/4036998150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15806f9a0 0x55b15806fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f7483fff640 1 -- 172.21.15.6:0/4036998150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b158075370 msgr2=0x55b158077830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f7483fff640 1 --2- 172.21.15.6:0/4036998150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b158075370 0x55b158077830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f7483fff640 1 -- 172.21.15.6:0/4036998150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b157f7a340 con 0x55b1580702e0 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.705+0000 7f74894e6640 1 --2- 172.21.15.6:0/4036998150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b158075370 0x55b158077830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.706+0000 7f74894e6640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f74740a2b80 0x7f74740a5040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f747c0098b0 tx=0x7f747c009e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.706+0000 7f7483fff640 1 --2- 172.21.15.6:0/4036998150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 0x55b158074da0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7470009900 tx=0x7f7470005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84edb84212412a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.706+0000 7f746effd640 1 -- 172.21.15.6:0/4036998150 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470035030 con 0x55b1580702e0 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.706+0000 7f746effd640 1 -- 172.21.15.6:0/4036998150 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7470040070 con 0x55b1580702e0 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.706+0000 7f746effd640 1 -- 172.21.15.6:0/4036998150 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470003a50 con 0x55b1580702e0 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.707+0000 7f748ddbe740 1 -- 172.21.15.6:0/4036998150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 msgr2=0x55b158074da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.707+0000 7f748ddbe740 1 --2- 172.21.15.6:0/4036998150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 0x55b158074da0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7470009900 tx=0x7f7470005c00 comp rx=0 tx=0).stop 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.707+0000 7f748ddbe740 1 -- 172.21.15.6:0/4036998150 shutdown_connections 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.707+0000 7f748ddbe740 1 --2- 172.21.15.6:0/4036998150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b158075370 0x55b158077830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.707+0000 7f748ddbe740 1 --2- 172.21.15.6:0/4036998150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 0x55b158074da0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.707+0000 7f748ddbe740 1 --2- 172.21.15.6:0/4036998150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15806f9a0 0x55b15806fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.707+0000 7f748ddbe740 1 -- 172.21.15.6:0/4036998150 >> 172.21.15.6:0/4036998150 conn(0x55b15806b010 msgr2=0x55b15806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.707+0000 7f748ddbe740 1 -- 172.21.15.6:0/4036998150 shutdown_connections 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.707+0000 7f748ddbe740 1 -- 172.21.15.6:0/4036998150 wait complete. 2024-09-12T00:01:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.707+0000 7f748ddbe740 1 -- start start 2024-09-12T00:01:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.707+0000 7f748ddbe740 1 Processor -- start 2024-09-12T00:01:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f748ddbe740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b15806f9a0 0x55b158079b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f748ddbe740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b1580702e0 0x55b15807a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f748ddbe740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 0x55b158081100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f748ddbe740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b158078330 con 0x55b158075370 2024-09-12T00:01:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f748ddbe740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b157f5c290 con 0x55b15806f9a0 2024-09-12T00:01:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f748ddbe740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b1580784b0 con 0x55b1580702e0 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f748ddbe740 10 client.0 _ll_register_callbacks cb 0x55b157f8d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f74894e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 0x55b158081100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f74894e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 0x55b158081100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45028/0 (socket says 172.21.15.6:45028) 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f74894e6640 1 -- 172.21.15.6:0/3836824217 learned_addr learned my addr 172.21.15.6:0/3836824217 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f7488ce5640 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b15806f9a0 0x55b158079b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f7483fff640 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b1580702e0 0x55b15807a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f7488ce5640 1 -- 172.21.15.6:0/3836824217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b1580702e0 msgr2=0x55b15807a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f7488ce5640 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b1580702e0 0x55b15807a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f7488ce5640 1 -- 172.21.15.6:0/3836824217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 msgr2=0x55b158081100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f7488ce5640 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 0x55b158081100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f7488ce5640 1 -- 172.21.15.6:0/3836824217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b157ce6210 con 0x55b15806f9a0 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f74894e6640 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 0x55b158081100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f7488ce5640 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b15806f9a0 0x55b158079b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74780ccf00 tx=0x7f747809b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8fced9f46b7c77d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f7463fff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.708+0000 7f7463fff640 1 -- 172.21.15.6:0/3836824217 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478003b30 con 0x55b15806f9a0 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f7463fff640 1 -- 172.21.15.6:0/3836824217 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f74780b92f0 con 0x55b15806f9a0 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f748ddbe740 1 -- 172.21.15.6:0/3836824217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7470040070 con 0x55b15806f9a0 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f7463fff640 1 -- 172.21.15.6:0/3836824217 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f747809c310 con 0x55b15806f9a0 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f748ddbe740 10 client.25115 fetch_fsmap learned FSMap version 30 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f748ddbe740 1 -- 172.21.15.6:0/3836824217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b157db2620 con 0x55b15806f9a0 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f7463fff640 1 -- 172.21.15.6:0/3836824217 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7470040070 con 0x55b15806f9a0 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f7463fff640 1 -- 172.21.15.6:0/3836824217 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f74780a43f0 con 0x55b15806f9a0 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f748ddbe740 10 client.25115 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f748ddbe740 10 client.25115 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f748ddbe740 20 client.25115 populate_metadata read hostname 'smithi006' 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f748ddbe740 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b158085850 0x55b158087cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f748ddbe740 4 client.25115 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f748ddbe740 1 -- 172.21.15.6:0/3836824217 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b157fe0a20 con 0x55b158085850 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.709+0000 7f7483fff640 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b158085850 0x55b158087cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.710+0000 7f7463fff640 10 client.25115 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.710+0000 7f7483fff640 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b158085850 0x55b158087cc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d82993ec42ba3615 server_cookie=24086dbdba985989 in_seq=0 out_seq=0 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.710+0000 7f7463fff640 1 -- 172.21.15.6:0/3836824217 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b157fe0a20 con 0x55b158085850 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.710+0000 7f7463fff640 10 client.25115 handle_command_reply: tid=0 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f748ddbe740 1 client.25115 shutdown 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f748ddbe740 1 -- 172.21.15.6:0/3836824217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b15806f9a0 msgr2=0x55b158079b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f748ddbe740 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b15806f9a0 0x55b158079b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74780ccf00 tx=0x7f747809b630 comp rx=0 tx=0).stop 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f748ddbe740 1 -- 172.21.15.6:0/3836824217 shutdown_connections 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f748ddbe740 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 0x55b158081100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f748ddbe740 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b158085850 0x55b158087cc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f748ddbe740 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b1580702e0 0x55b15807a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f748ddbe740 1 --2- 172.21.15.6:0/3836824217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b15806f9a0 0x55b158079b80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f7463fff640 0 client.25115 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f748ddbe740 1 -- 172.21.15.6:0/3836824217 >> 172.21.15.6:0/3836824217 conn(0x55b15806b010 msgr2=0x55b15806c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f748ddbe740 1 -- 172.21.15.6:0/3836824217 shutdown_connections 2024-09-12T00:01:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f748ddbe740 1 -- 172.21.15.6:0/3836824217 wait complete. 2024-09-12T00:01:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.711+0000 7f748ddbe740 20 client.25115 trim_cache size 0 max 16384 2024-09-12T00:01:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.728+0000 7f748ddbe740 1 Processor -- start 2024-09-12T00:01:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.728+0000 7f748ddbe740 1 -- start start 2024-09-12T00:01:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f748ddbe740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b15806f9a0 0x55b15806bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f748ddbe740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 0x55b158081090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f748ddbe740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b158075370 0x55b15806c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f748ddbe740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f74841acab0 con 0x55b1580702e0 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f748ddbe740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f74841ae680 con 0x55b15806f9a0 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f748ddbe740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f74841ad180 con 0x55b158075370 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f7483fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 0x55b158081090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f7483fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 0x55b158081090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45044/0 (socket says 172.21.15.6:45044) 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f7483fff640 1 -- 172.21.15.6:0/2964241561 learned_addr learned my addr 172.21.15.6:0/2964241561 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f74894e6640 1 --2- 172.21.15.6:0/2964241561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b158075370 0x55b15806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f7488ce5640 1 --2- 172.21.15.6:0/2964241561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b15806f9a0 0x55b15806bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f7483fff640 1 -- 172.21.15.6:0/2964241561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b158075370 msgr2=0x55b15806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f7483fff640 1 --2- 172.21.15.6:0/2964241561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b158075370 0x55b15806c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f7483fff640 1 -- 172.21.15.6:0/2964241561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b15806f9a0 msgr2=0x55b15806bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f7483fff640 1 --2- 172.21.15.6:0/2964241561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b15806f9a0 0x55b15806bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f7483fff640 1 -- 172.21.15.6:0/2964241561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1580796c0 con 0x55b1580702e0 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.729+0000 7f7483fff640 1 --2- 172.21.15.6:0/2964241561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 0x55b158081090 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7470009900 tx=0x7f7470005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d974e76dae3b9f58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.730+0000 7f746e7fc640 1 -- 172.21.15.6:0/2964241561 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470035040 con 0x55b1580702e0 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.730+0000 7f746e7fc640 1 -- 172.21.15.6:0/2964241561 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7470040040 con 0x55b1580702e0 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.730+0000 7f746e7fc640 1 -- 172.21.15.6:0/2964241561 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470050670 con 0x55b1580702e0 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.730+0000 7f748ddbe740 1 -- 172.21.15.6:0/2964241561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 msgr2=0x55b158081090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.730+0000 7f748ddbe740 1 --2- 172.21.15.6:0/2964241561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 0x55b158081090 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7470009900 tx=0x7f7470005fd0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.730+0000 7f748ddbe740 1 -- 172.21.15.6:0/2964241561 shutdown_connections 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.730+0000 7f748ddbe740 1 --2- 172.21.15.6:0/2964241561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b158075370 0x55b15806c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.730+0000 7f748ddbe740 1 --2- 172.21.15.6:0/2964241561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1580702e0 0x55b158081090 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.730+0000 7f748ddbe740 1 --2- 172.21.15.6:0/2964241561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b15806f9a0 0x55b15806bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.730+0000 7f748ddbe740 1 -- 172.21.15.6:0/2964241561 >> 172.21.15.6:0/2964241561 conn(0x55b15806b010 msgr2=0x55b158079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f748ddbe740 1 -- 172.21.15.6:0/2964241561 shutdown_connections 2024-09-12T00:01:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f748ddbe740 1 -- 172.21.15.6:0/2964241561 wait complete. 2024-09-12T00:01:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f748ddbe740 1 -- start start 2024-09-12T00:01:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f748ddbe740 1 Processor -- start 2024-09-12T00:01:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f748ddbe740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15806f9a0 0x55b15807e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f748ddbe740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b1580702e0 0x55b15807e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f748ddbe740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 0x55b15807f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f748ddbe740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f74841adf20 con 0x55b158075370 2024-09-12T00:01:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f748ddbe740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f74841ad850 con 0x55b1580702e0 2024-09-12T00:01:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f748ddbe740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f74841aaa90 con 0x55b15806f9a0 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f748ddbe740 10 client.0 _ll_register_callbacks cb 0x7f7478097820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f74894e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 0x55b15807f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f74894e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 0x55b15807f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45046/0 (socket says 172.21.15.6:45046) 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.731+0000 7f74894e6640 1 -- 172.21.15.6:0/2640720508 learned_addr learned my addr 172.21.15.6:0/2640720508 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f7488ce5640 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15806f9a0 0x55b15807e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f7483fff640 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b1580702e0 0x55b15807e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f74894e6640 1 -- 172.21.15.6:0/2640720508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15806f9a0 msgr2=0x55b15807e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f74894e6640 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15806f9a0 0x55b15807e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f74894e6640 1 -- 172.21.15.6:0/2640720508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b1580702e0 msgr2=0x55b15807e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f74894e6640 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b1580702e0 0x55b15807e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f74894e6640 1 -- 172.21.15.6:0/2640720508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b158070f70 con 0x55b158075370 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f74894e6640 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 0x55b15807f870 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f747c010f70 tx=0x7f747c009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b49087f42771797 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f7463fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f7463fff640 1 -- 172.21.15.6:0/2640720508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c004b20 con 0x55b158075370 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f7463fff640 1 -- 172.21.15.6:0/2640720508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f747c01b040 con 0x55b158075370 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f748ddbe740 1 -- 172.21.15.6:0/2640720508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7470040040 con 0x55b158075370 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f7463fff640 1 -- 172.21.15.6:0/2640720508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f747c035050 con 0x55b158075370 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f748ddbe740 10 client.15489 fetch_fsmap learned FSMap version 30 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.732+0000 7f748ddbe740 1 -- 172.21.15.6:0/2640720508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b158081030 con 0x55b158075370 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.733+0000 7f7463fff640 1 -- 172.21.15.6:0/2640720508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7470040040 con 0x55b158075370 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.733+0000 7f7463fff640 1 -- 172.21.15.6:0/2640720508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f747c029070 con 0x55b158075370 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.733+0000 7f748ddbe740 10 client.15489 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.733+0000 7f748ddbe740 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.733+0000 7f748ddbe740 20 client.15489 populate_metadata read hostname 'smithi006' 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.733+0000 7f748ddbe740 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b1580f0980 0x55b1580f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.733+0000 7f748ddbe740 4 client.15489 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:01:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.733+0000 7f748ddbe740 1 -- 172.21.15.6:0/2640720508 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b157fdad70 con 0x55b1580f0980 2024-09-12T00:01:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.733+0000 7f7488ce5640 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b1580f0980 0x55b1580f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.733+0000 7f7463fff640 10 client.15489 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.733+0000 7f7488ce5640 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b1580f0980 0x55b1580f2da0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70571ce08cf6f5df server_cookie=8163e1688339f1f9 in_seq=0 out_seq=0 2024-09-12T00:01:11.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.749+0000 7f7463fff640 1 -- 172.21.15.6:0/2640720508 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b157fdad70 con 0x55b1580f0980 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.749+0000 7f7463fff640 10 client.15489 handle_command_reply: tid=0 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.749+0000 7f748ddbe740 1 client.15489 shutdown 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.749+0000 7f748ddbe740 1 -- 172.21.15.6:0/2640720508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 msgr2=0x55b15807f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.749+0000 7f748ddbe740 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 0x55b15807f870 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f747c010f70 tx=0x7f747c009600 comp rx=0 tx=0).stop 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.749+0000 7f748ddbe740 1 -- 172.21.15.6:0/2640720508 shutdown_connections 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.749+0000 7f748ddbe740 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b158075370 0x55b15807f870 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.749+0000 7f748ddbe740 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b1580702e0 0x55b15807e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.749+0000 7f748ddbe740 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b1580f0980 0x55b1580f2da0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.749+0000 7f748ddbe740 1 --2- 172.21.15.6:0/2640720508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15806f9a0 0x55b15807e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.749+0000 7f7463fff640 0 client.15489 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.749+0000 7f748ddbe740 1 -- 172.21.15.6:0/2640720508 >> 172.21.15.6:0/2640720508 conn(0x55b15806b010 msgr2=0x55b1580699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748ddbe740 1 -- 172.21.15.6:0/2640720508 shutdown_connections 2024-09-12T00:01:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748ddbe740 1 -- 172.21.15.6:0/2640720508 wait complete. 2024-09-12T00:01:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748ddbe740 20 client.15489 trim_cache size 0 max 16384 2024-09-12T00:01:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:01:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:01:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:01:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:01:11.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748af49640 1 -- 172.21.15.6:0/2198490746 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f74740a2b80 msgr2=0x7f74740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:11.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748af49640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f74740a2b80 0x7f74740a5040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f747c0098b0 tx=0x7f747c009e20 comp rx=0 tx=0).stop 2024-09-12T00:01:11.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748af49640 1 -- 172.21.15.6:0/2198490746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7484100a60 msgr2=0x7f7484199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:11.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748af49640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7484100a60 0x7f7484199fe0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f747800e9c0 tx=0x7f747800ee80 comp rx=0 tx=0).stop 2024-09-12T00:01:11.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748af49640 1 -- 172.21.15.6:0/2198490746 shutdown_connections 2024-09-12T00:01:11.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748af49640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f74740a2b80 0x7f74740a5040 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748af49640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7484102610 0x7f74841a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748af49640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7484101c50 0x7f748419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748af49640 1 --2- 172.21.15.6:0/2198490746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7484100a60 0x7f7484199fe0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:11.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.750+0000 7f748af49640 1 -- 172.21.15.6:0/2198490746 >> 172.21.15.6:0/2198490746 conn(0x7f74840fc1c0 msgr2=0x7f748406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:11.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.751+0000 7f748af49640 1 -- 172.21.15.6:0/2198490746 shutdown_connections 2024-09-12T00:01:11.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:11.751+0000 7f748af49640 1 -- 172.21.15.6:0/2198490746 wait complete. 2024-09-12T00:01:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:12 smithi134 ceph-mon[34893]: pgmap v415: 129 pgs: 129 active+clean; 667 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:01:13.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:12 smithi039 ceph-mon[34543]: pgmap v415: 129 pgs: 129 active+clean; 667 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:01:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:12 smithi006 ceph-mon[30947]: pgmap v415: 129 pgs: 129 active+clean; 667 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:01:15.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:14 smithi134 ceph-mon[34893]: pgmap v416: 129 pgs: 129 active+clean; 715 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:01:15.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:14 smithi039 ceph-mon[34543]: pgmap v416: 129 pgs: 129 active+clean; 715 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:01:15.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:14 smithi006 ceph-mon[30947]: pgmap v416: 129 pgs: 129 active+clean; 715 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:01:17.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:16 smithi134 ceph-mon[34893]: pgmap v417: 129 pgs: 129 active+clean; 775 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:01:17.401 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:16 smithi006 ceph-mon[30947]: pgmap v417: 129 pgs: 129 active+clean; 775 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:01:17.402 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:16 smithi039 ceph-mon[34543]: pgmap v417: 129 pgs: 129 active+clean; 775 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:01:19.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:18 smithi134 ceph-mon[34893]: pgmap v418: 129 pgs: 129 active+clean; 843 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:01:19.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:18 smithi039 ceph-mon[34543]: pgmap v418: 129 pgs: 129 active+clean; 843 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:01:19.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:18 smithi006 ceph-mon[30947]: pgmap v418: 129 pgs: 129 active+clean; 843 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:01:21.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:20 smithi134 ceph-mon[34893]: pgmap v419: 129 pgs: 129 active+clean; 903 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-12T00:01:21.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:20 smithi039 ceph-mon[34543]: pgmap v419: 129 pgs: 129 active+clean; 903 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-12T00:01:21.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:20 smithi006 ceph-mon[30947]: pgmap v419: 129 pgs: 129 active+clean; 903 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-12T00:01:23.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:22 smithi134 ceph-mon[34893]: pgmap v420: 129 pgs: 129 active+clean; 935 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:01:23.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:22 smithi039 ceph-mon[34543]: pgmap v420: 129 pgs: 129 active+clean; 935 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:01:23.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:22 smithi006 ceph-mon[30947]: pgmap v420: 129 pgs: 129 active+clean; 935 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:01:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.844+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/3523045349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aac1078e0 msgr2=0x7f4aac109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.844+0000 7f4ab0e0a640 1 --2- 172.21.15.6:0/3523045349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aac1078e0 0x7f4aac109cd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009ca0 tx=0x7f4aa402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.845+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/3523045349 shutdown_connections 2024-09-12T00:01:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.845+0000 7f4ab0e0a640 1 --2- 172.21.15.6:0/3523045349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aac1078e0 0x7f4aac109cd0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.845+0000 7f4ab0e0a640 1 --2- 172.21.15.6:0/3523045349 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aac104fb0 0x7f4aac1073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.845+0000 7f4ab0e0a640 1 --2- 172.21.15.6:0/3523045349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4aac102680 0x7f4aac104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.845+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/3523045349 >> 172.21.15.6:0/3523045349 conn(0x7f4aac0fc1c0 msgr2=0x7f4aac0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.845+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/3523045349 shutdown_connections 2024-09-12T00:01:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.845+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/3523045349 wait complete. 2024-09-12T00:01:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.845+0000 7f4ab0e0a640 1 Processor -- start 2024-09-12T00:01:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.845+0000 7f4ab0e0a640 1 -- start start 2024-09-12T00:01:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4ab0e0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4aac102680 0x7f4aac101ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4ab0e0a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aac104fb0 0x7f4aac100630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4ab0e0a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aac1078e0 0x7f4aac100b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4ab0e0a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac10d6a0 con 0x7f4aac1078e0 2024-09-12T00:01:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4ab0e0a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac10d520 con 0x7f4aac104fb0 2024-09-12T00:01:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4ab0e0a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac10d820 con 0x7f4aac102680 2024-09-12T00:01:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4aaad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aac1078e0 0x7f4aac100b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4aaad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aac1078e0 0x7f4aac100b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35074/0 (socket says 172.21.15.6:35074) 2024-09-12T00:01:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4aaad9d640 1 -- 172.21.15.6:0/1657948249 learned_addr learned my addr 172.21.15.6:0/1657948249 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4aaa59c640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4aac102680 0x7f4aac101ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aac104fb0 0x7f4aac100630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4aaad9d640 1 -- 172.21.15.6:0/1657948249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4aac102680 msgr2=0x7f4aac101ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4aaad9d640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4aac102680 0x7f4aac101ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4aaad9d640 1 -- 172.21.15.6:0/1657948249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aac104fb0 msgr2=0x7f4aac100630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4aaad9d640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aac104fb0 0x7f4aac100630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.846+0000 7f4aaad9d640 1 -- 172.21.15.6:0/1657948249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac101400 con 0x7f4aac1078e0 2024-09-12T00:01:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.847+0000 7f4aaad9d640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aac1078e0 0x7f4aac100b70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009dc0 tx=0x7f4aa4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.847+0000 7f4a9b7fe640 1 -- 172.21.15.6:0/1657948249 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4032ec0 con 0x7f4aac1078e0 2024-09-12T00:01:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.847+0000 7f4a9b7fe640 1 -- 172.21.15.6:0/1657948249 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4aa40044f0 con 0x7f4aac1078e0 2024-09-12T00:01:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.847+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/1657948249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aac1a1e80 con 0x7f4aac1078e0 2024-09-12T00:01:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.847+0000 7f4a9b7fe640 1 -- 172.21.15.6:0/1657948249 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4030d40 con 0x7f4aac1078e0 2024-09-12T00:01:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.847+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/1657948249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aac1a22e0 con 0x7f4aac1078e0 2024-09-12T00:01:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.849+0000 7f4a9b7fe640 1 -- 172.21.15.6:0/1657948249 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f4aa4004040 con 0x7f4aac1078e0 2024-09-12T00:01:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4ab3c77740 1 Processor -- start 2024-09-12T00:01:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4ab3c77740 1 -- start start 2024-09-12T00:01:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4ab3c77740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb1e9a0 0x557beeb1eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4ab3c77740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 0x557beeb23da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4ab3c77740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb24370 0x557beeb26830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4ab3c77740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557beea822f0 con 0x557beeb1f2e0 2024-09-12T00:01:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4ab3c77740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557beea2a270 con 0x557beeb24370 2024-09-12T00:01:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4ab3c77740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557beea7e2b0 con 0x557beeb1e9a0 2024-09-12T00:01:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4aaa59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 0x557beeb23da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4aaa59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 0x557beeb23da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35086/0 (socket says 172.21.15.6:35086) 2024-09-12T00:01:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4aaa59c640 1 -- 172.21.15.6:0/1060434493 learned_addr learned my addr 172.21.15.6:0/1060434493 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4a9b7fe640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4a940a2d20 0x7f4a940a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.850+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/1060434493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb1e9a0 0x557beeb1eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/1060434493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb24370 0x557beeb26830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4a9b7fe640 1 -- 172.21.15.6:0/1657948249 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f4aa40f08f0 con 0x7f4aac1078e0 2024-09-12T00:01:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4aaad9d640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4a940a2d20 0x7f4a940a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4aa9d9b640 1 -- 172.21.15.6:0/1060434493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb24370 msgr2=0x557beeb26830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/1060434493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb24370 0x557beeb26830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4aa9d9b640 1 -- 172.21.15.6:0/1060434493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 msgr2=0x557beeb23da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/1060434493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 0x557beeb23da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4aa9d9b640 1 -- 172.21.15.6:0/1060434493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557beea29340 con 0x557beeb1e9a0 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4aaa59c640 1 --2- 172.21.15.6:0/1060434493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 0x557beeb23da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/1060434493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb1e9a0 0x557beeb1eda0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4aac06a4b0 tx=0x7f4aa000a770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3f74cb371bebbc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4aaad9d640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4a940a2d20 0x7f4a940a51e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40c54a0 tx=0x7f4aa402a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4a98ff9640 1 -- 172.21.15.6:0/1060434493 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0005220 con 0x557beeb1e9a0 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4a98ff9640 1 -- 172.21.15.6:0/1060434493 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4aa0004c50 con 0x557beeb1e9a0 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.851+0000 7f4a98ff9640 1 -- 172.21.15.6:0/1060434493 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa000faf0 con 0x557beeb1e9a0 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.852+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1060434493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb1e9a0 msgr2=0x557beeb1eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.852+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/1060434493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb1e9a0 0x557beeb1eda0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4aac06a4b0 tx=0x7f4aa000a770 comp rx=0 tx=0).stop 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.852+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1060434493 shutdown_connections 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.852+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/1060434493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb24370 0x557beeb26830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.852+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/1060434493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 0x557beeb23da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.852+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/1060434493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb1e9a0 0x557beeb1eda0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.852+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1060434493 >> 172.21.15.6:0/1060434493 conn(0x557beeb1a010 msgr2=0x557beeb1a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.852+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1060434493 shutdown_connections 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.852+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1060434493 wait complete. 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4ab3c77740 1 -- start start 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4ab3c77740 1 Processor -- start 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4ab3c77740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1e9a0 0x557beeb28bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4ab3c77740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb1f2e0 0x557beeb29110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4ab3c77740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb24370 0x557beeb30150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4ab3c77740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557beeb27340 con 0x557beeb24370 2024-09-12T00:01:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4ab3c77740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557beea0b290 con 0x557beeb1e9a0 2024-09-12T00:01:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4ab3c77740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557beeb274c0 con 0x557beeb1f2e0 2024-09-12T00:01:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4ab3c77740 10 client.0 _ll_register_callbacks cb 0x557beea3c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4aa9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb24370 0x557beeb30150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4aa9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb24370 0x557beeb30150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35090/0 (socket says 172.21.15.6:35090) 2024-09-12T00:01:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4aa9d9b640 1 -- 172.21.15.6:0/1037612009 learned_addr learned my addr 172.21.15.6:0/1037612009 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4aaa59c640 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb1f2e0 0x557beeb29110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.853+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1e9a0 0x557beeb28bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4aa9d9b640 1 -- 172.21.15.6:0/1037612009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb1f2e0 msgr2=0x557beeb29110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb1f2e0 0x557beeb29110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4aa9d9b640 1 -- 172.21.15.6:0/1037612009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1e9a0 msgr2=0x557beeb28bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1e9a0 0x557beeb28bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4aa9d9b640 1 -- 172.21.15.6:0/1037612009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bee795210 con 0x557beeb24370 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4aaa59c640 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb1f2e0 0x557beeb29110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb24370 0x557beeb30150 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0005f10 tx=0x7f4aa0005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bc12f9e8152833 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4a91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4a91ffb640 1 -- 172.21.15.6:0/1037612009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0021070 con 0x557beeb24370 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1037612009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aa0004c50 con 0x557beeb24370 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4a91ffb640 1 -- 172.21.15.6:0/1037612009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f4aa000f870 con 0x557beeb24370 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4a91ffb640 1 -- 172.21.15.6:0/1037612009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4aa0033050 con 0x557beeb24370 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4ab3c77740 10 client.15501 fetch_fsmap learned FSMap version 30 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.854+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1037612009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557bee861620 con 0x557beeb24370 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.855+0000 7f4a91ffb640 1 -- 172.21.15.6:0/1037612009 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4aa0004c50 con 0x557beeb24370 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.855+0000 7f4a91ffb640 1 -- 172.21.15.6:0/1037612009 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f4aa001d930 con 0x557beeb24370 2024-09-12T00:01:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.855+0000 7f4ab3c77740 10 client.15501 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:01:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.855+0000 7f4ab3c77740 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:01:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.855+0000 7f4ab3c77740 20 client.15501 populate_metadata read hostname 'smithi006' 2024-09-12T00:01:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.855+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557beeb34610 0x557beeb36a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.855+0000 7f4ab3c77740 4 client.15501 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.855+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1037612009 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557beea8fa20 con 0x557beeb34610 2024-09-12T00:01:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.855+0000 7f4aaa59c640 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557beeb34610 0x557beeb36a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.855+0000 7f4aaa59c640 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557beeb34610 0x557beeb36a00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70ce9bca557363fe server_cookie=cf17391d3ef3be4b in_seq=0 out_seq=0 2024-09-12T00:01:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.855+0000 7f4a91ffb640 10 client.15501 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.856+0000 7f4a91ffb640 1 -- 172.21.15.6:0/1037612009 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557beea8fa20 con 0x557beeb34610 2024-09-12T00:01:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.856+0000 7f4a91ffb640 10 client.15501 handle_command_reply: tid=0 2024-09-12T00:01:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.856+0000 7f4ab3c77740 1 client.15501 shutdown 2024-09-12T00:01:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.856+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1037612009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb24370 msgr2=0x557beeb30150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.856+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb24370 0x557beeb30150 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0005f10 tx=0x7f4aa0005e60 comp rx=0 tx=0).stop 2024-09-12T00:01:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.856+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1037612009 shutdown_connections 2024-09-12T00:01:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.856+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb24370 0x557beeb30150 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.856+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557beeb34610 0x557beeb36a00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.856+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb1f2e0 0x557beeb29110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.856+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/1037612009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1e9a0 0x557beeb28bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.856+0000 7f4a91ffb640 0 client.15501 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.856+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1037612009 >> 172.21.15.6:0/1037612009 conn(0x557beeb1a010 msgr2=0x557beeb1b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.857+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1037612009 shutdown_connections 2024-09-12T00:01:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.857+0000 7f4ab3c77740 1 -- 172.21.15.6:0/1037612009 wait complete. 2024-09-12T00:01:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.857+0000 7f4ab3c77740 20 client.15501 trim_cache size 0 max 16384 2024-09-12T00:01:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.871+0000 7f4ab3c77740 1 Processor -- start 2024-09-12T00:01:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.871+0000 7f4ab3c77740 1 -- start start 2024-09-12T00:01:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.871+0000 7f4ab3c77740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1e9a0 0x557beeb1aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.871+0000 7f4ab3c77740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1f2e0 0x557beeb30110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.871+0000 7f4ab3c77740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb24370 0x557beeb1b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.871+0000 7f4ab3c77740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1aca40 con 0x557beeb1e9a0 2024-09-12T00:01:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.871+0000 7f4ab3c77740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1ae610 con 0x557beeb1f2e0 2024-09-12T00:01:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.871+0000 7f4ab3c77740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1ad110 con 0x557beeb24370 2024-09-12T00:01:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.871+0000 7f4aa9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1e9a0 0x557beeb1aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.871+0000 7f4aa9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1e9a0 0x557beeb1aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35096/0 (socket says 172.21.15.6:35096) 2024-09-12T00:01:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.871+0000 7f4aa9d9b640 1 -- 172.21.15.6:0/2329254099 learned_addr learned my addr 172.21.15.6:0/2329254099 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.871+0000 7f4aaa59c640 1 --2- 172.21.15.6:0/2329254099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1f2e0 0x557beeb30110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.872+0000 7f4aa9d9b640 1 -- 172.21.15.6:0/2329254099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb24370 msgr2=0x557beeb1b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.872+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/2329254099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb24370 0x557beeb1b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.872+0000 7f4aa9d9b640 1 -- 172.21.15.6:0/2329254099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1f2e0 msgr2=0x557beeb30110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.872+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/2329254099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1f2e0 0x557beeb30110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.872+0000 7f4aa9d9b640 1 -- 172.21.15.6:0/2329254099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557beeb1f7c0 con 0x557beeb1e9a0 2024-09-12T00:01:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.872+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/2329254099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1e9a0 0x557beeb1aec0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0005b70 tx=0x7f4aa000aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f424235090883355 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.872+0000 7f4a93fff640 1 -- 172.21.15.6:0/2329254099 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0021040 con 0x557beeb1e9a0 2024-09-12T00:01:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.872+0000 7f4a93fff640 1 -- 172.21.15.6:0/2329254099 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4aa000a630 con 0x557beeb1e9a0 2024-09-12T00:01:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.872+0000 7f4a93fff640 1 -- 172.21.15.6:0/2329254099 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa000f740 con 0x557beeb1e9a0 2024-09-12T00:01:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.873+0000 7f4ab3c77740 1 -- 172.21.15.6:0/2329254099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1e9a0 msgr2=0x557beeb1aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.873+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/2329254099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1e9a0 0x557beeb1aec0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0005b70 tx=0x7f4aa000aeb0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.873+0000 7f4ab3c77740 1 -- 172.21.15.6:0/2329254099 shutdown_connections 2024-09-12T00:01:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.873+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/2329254099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb24370 0x557beeb1b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.873+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/2329254099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1f2e0 0x557beeb30110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.873+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/2329254099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1e9a0 0x557beeb1aec0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.873+0000 7f4ab3c77740 1 -- 172.21.15.6:0/2329254099 >> 172.21.15.6:0/2329254099 conn(0x557beeb1a010 msgr2=0x557beeb28bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.873+0000 7f4ab3c77740 1 -- 172.21.15.6:0/2329254099 shutdown_connections 2024-09-12T00:01:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.873+0000 7f4ab3c77740 1 -- 172.21.15.6:0/2329254099 wait complete. 2024-09-12T00:01:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.873+0000 7f4ab3c77740 1 -- start start 2024-09-12T00:01:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.873+0000 7f4ab3c77740 1 Processor -- start 2024-09-12T00:01:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4ab3c77740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1e9a0 0x557beeb2d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4ab3c77740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 0x557beeb2d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4ab3c77740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb24370 0x557beeb2e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4ab3c77740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1adeb0 con 0x557beeb1f2e0 2024-09-12T00:01:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4ab3c77740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1ad7e0 con 0x557beeb1e9a0 2024-09-12T00:01:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4ab3c77740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1aaa20 con 0x557beeb24370 2024-09-12T00:01:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4ab3c77740 10 client.0 _ll_register_callbacks cb 0x7f4a9c004160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4aaa59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 0x557beeb2d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4aaa59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 0x557beeb2d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35098/0 (socket says 172.21.15.6:35098) 2024-09-12T00:01:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4aaa59c640 1 -- 172.21.15.6:0/3612455890 learned_addr learned my addr 172.21.15.6:0/3612455890 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1e9a0 0x557beeb2d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb24370 0x557beeb2e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4aaa59c640 1 -- 172.21.15.6:0/3612455890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb24370 msgr2=0x557beeb2e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4aaa59c640 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb24370 0x557beeb2e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4aaa59c640 1 -- 172.21.15.6:0/3612455890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1e9a0 msgr2=0x557beeb2d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4aaa59c640 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1e9a0 0x557beeb2d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4aaa59c640 1 -- 172.21.15.6:0/3612455890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557beeb2ee90 con 0x557beeb1f2e0 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4aaa59c640 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 0x557beeb2d870 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x557beeb1ae90 tx=0x7f4a9c00bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30f3b538dc6ac17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.874+0000 7f4a91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4a91ffb640 1 -- 172.21.15.6:0/3612455890 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c005020 con 0x557beeb1f2e0 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4a91ffb640 1 -- 172.21.15.6:0/3612455890 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f4a9c0051c0 con 0x557beeb1f2e0 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4ab3c77740 1 -- 172.21.15.6:0/3612455890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aa000a630 con 0x557beeb1f2e0 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4a91ffb640 1 -- 172.21.15.6:0/3612455890 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4a9c030050 con 0x557beeb1f2e0 2024-09-12T00:01:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4ab3c77740 10 client.15507 fetch_fsmap learned FSMap version 30 2024-09-12T00:01:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4ab3c77740 1 -- 172.21.15.6:0/3612455890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557beeb30230 con 0x557beeb1f2e0 2024-09-12T00:01:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4a91ffb640 1 -- 172.21.15.6:0/3612455890 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4aa000a630 con 0x557beeb1f2e0 2024-09-12T00:01:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4a91ffb640 1 -- 172.21.15.6:0/3612455890 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f4a9c024070 con 0x557beeb1f2e0 2024-09-12T00:01:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4ab3c77740 10 client.15507 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:01:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4ab3c77740 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:01:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4ab3c77740 20 client.15507 populate_metadata read hostname 'smithi006' 2024-09-12T00:01:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557beeb9f8e0 0x557beeba1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4ab3c77740 4 client.15507 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:01:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.875+0000 7f4ab3c77740 1 -- 172.21.15.6:0/3612455890 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557beea89d70 con 0x557beeb9f8e0 2024-09-12T00:01:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.876+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557beeb9f8e0 0x557beeba1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.876+0000 7f4a91ffb640 10 client.15507 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.876+0000 7f4aa9d9b640 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557beeb9f8e0 0x557beeba1d00 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3cbd1e04554589b server_cookie=29791766f3fb269d in_seq=0 out_seq=0 2024-09-12T00:01:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.893+0000 7f4a91ffb640 1 -- 172.21.15.6:0/3612455890 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557beea89d70 con 0x557beeb9f8e0 2024-09-12T00:01:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.893+0000 7f4a91ffb640 10 client.15507 handle_command_reply: tid=0 2024-09-12T00:01:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.893+0000 7f4ab3c77740 1 client.15507 shutdown 2024-09-12T00:01:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.893+0000 7f4ab3c77740 1 -- 172.21.15.6:0/3612455890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 msgr2=0x557beeb2d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.893+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 0x557beeb2d870 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x557beeb1ae90 tx=0x7f4a9c00bdb0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.893+0000 7f4ab3c77740 1 -- 172.21.15.6:0/3612455890 shutdown_connections 2024-09-12T00:01:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.893+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557beeb9f8e0 0x557beeba1d00 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557beeb24370 0x557beeb2e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557beeb1f2e0 0x557beeb2d870 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab3c77740 1 --2- 172.21.15.6:0/3612455890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557beeb1e9a0 0x557beeb2d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab3c77740 1 -- 172.21.15.6:0/3612455890 >> 172.21.15.6:0/3612455890 conn(0x557beeb1a010 msgr2=0x557beeb189a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4a91ffb640 0 client.15507 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab3c77740 1 -- 172.21.15.6:0/3612455890 shutdown_connections 2024-09-12T00:01:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab3c77740 1 -- 172.21.15.6:0/3612455890 wait complete. 2024-09-12T00:01:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab3c77740 20 client.15507 trim_cache size 0 max 16384 2024-09-12T00:01:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:01:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:01:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:01:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:01:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/1657948249 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4a940a2d20 msgr2=0x7f4a940a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab0e0a640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4a940a2d20 0x7f4a940a51e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40c54a0 tx=0x7f4aa402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/1657948249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aac1078e0 msgr2=0x7f4aac100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab0e0a640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aac1078e0 0x7f4aac100b70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009dc0 tx=0x7f4aa4003ba0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/1657948249 shutdown_connections 2024-09-12T00:01:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab0e0a640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f4a940a2d20 0x7f4a940a51e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab0e0a640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aac1078e0 0x7f4aac100b70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.894+0000 7f4ab0e0a640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aac104fb0 0x7f4aac100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.895+0000 7f4ab0e0a640 1 --2- 172.21.15.6:0/1657948249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4aac102680 0x7f4aac101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.895+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/1657948249 >> 172.21.15.6:0/1657948249 conn(0x7f4aac0fc1c0 msgr2=0x7f4aac102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.895+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/1657948249 shutdown_connections 2024-09-12T00:01:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:24.895+0000 7f4ab0e0a640 1 -- 172.21.15.6:0/1657948249 wait complete. 2024-09-12T00:01:25.169 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:24 smithi006 ceph-mon[30947]: pgmap v421: 129 pgs: 129 active+clean; 979 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:01:25.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:24 smithi134 ceph-mon[34893]: pgmap v421: 129 pgs: 129 active+clean; 979 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:01:25.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:24 smithi039 ceph-mon[34543]: pgmap v421: 129 pgs: 129 active+clean; 979 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:01:27.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:26 smithi134 ceph-mon[34893]: pgmap v422: 129 pgs: 129 active+clean; 1.0 GiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-09-12T00:01:27.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:26 smithi039 ceph-mon[34543]: pgmap v422: 129 pgs: 129 active+clean; 1.0 GiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-09-12T00:01:27.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:26 smithi006 ceph-mon[30947]: pgmap v422: 129 pgs: 129 active+clean; 1.0 GiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-09-12T00:01:29.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:28 smithi134 ceph-mon[34893]: pgmap v423: 129 pgs: 129 active+clean; 1.1 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:01:29.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:28 smithi039 ceph-mon[34543]: pgmap v423: 129 pgs: 129 active+clean; 1.1 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:01:29.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:28 smithi006 ceph-mon[30947]: pgmap v423: 129 pgs: 129 active+clean; 1.1 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:01:31.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:30 smithi134 ceph-mon[34893]: pgmap v424: 129 pgs: 129 active+clean; 1.1 GiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:01:31.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:30 smithi039 ceph-mon[34543]: pgmap v424: 129 pgs: 129 active+clean; 1.1 GiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:01:31.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:30 smithi006 ceph-mon[30947]: pgmap v424: 129 pgs: 129 active+clean; 1.1 GiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:01:33.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:32 smithi134 ceph-mon[34893]: pgmap v425: 129 pgs: 129 active+clean; 1.2 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:01:33.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:32 smithi039 ceph-mon[34543]: pgmap v425: 129 pgs: 129 active+clean; 1.2 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:01:33.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:32 smithi006 ceph-mon[30947]: pgmap v425: 129 pgs: 129 active+clean; 1.2 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:01:35.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:34 smithi134 ceph-mon[34893]: pgmap v426: 129 pgs: 129 active+clean; 1.2 GiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:01:35.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:34 smithi039 ceph-mon[34543]: pgmap v426: 129 pgs: 129 active+clean; 1.2 GiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:01:35.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:34 smithi006 ceph-mon[30947]: pgmap v426: 129 pgs: 129 active+clean; 1.2 GiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:01:37.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:36 smithi134 ceph-mon[34893]: pgmap v427: 129 pgs: 129 active+clean; 1.3 GiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:01:37.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:36 smithi039 ceph-mon[34543]: pgmap v427: 129 pgs: 129 active+clean; 1.3 GiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:01:37.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:36 smithi006 ceph-mon[30947]: pgmap v427: 129 pgs: 129 active+clean; 1.3 GiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:01:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.985+0000 7f3584853640 1 -- 172.21.15.6:0/1208366967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3580100410 msgr2=0x7f3580100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.985+0000 7f3584853640 1 --2- 172.21.15.6:0/1208366967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3580100410 0x7f3580100810 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3570009900 tx=0x7f357002a410 comp rx=0 tx=0).stop 2024-09-12T00:01:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.985+0000 7f3584853640 1 -- 172.21.15.6:0/1208366967 shutdown_connections 2024-09-12T00:01:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.985+0000 7f3584853640 1 --2- 172.21.15.6:0/1208366967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35801016f0 0x7f3580101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.985+0000 7f3584853640 1 --2- 172.21.15.6:0/1208366967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3580100d50 0x7f35801011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.985+0000 7f3584853640 1 --2- 172.21.15.6:0/1208366967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3580100410 0x7f3580100810 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.985+0000 7f3584853640 1 -- 172.21.15.6:0/1208366967 >> 172.21.15.6:0/1208366967 conn(0x7f35800fc1c0 msgr2=0x7f35800fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.985+0000 7f3584853640 1 -- 172.21.15.6:0/1208366967 shutdown_connections 2024-09-12T00:01:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.985+0000 7f3584853640 1 -- 172.21.15.6:0/1208366967 wait complete. 2024-09-12T00:01:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f3584853640 1 Processor -- start 2024-09-12T00:01:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f3584853640 1 -- start start 2024-09-12T00:01:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f3584853640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3580100410 0x7f3580199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f3584853640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3580100d50 0x7f358019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f3584853640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35801016f0 0x7f35801a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f3584853640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f358010f830 con 0x7f3580100410 2024-09-12T00:01:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f3584853640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f358010f6b0 con 0x7f3580100d50 2024-09-12T00:01:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f3584853640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f358010f9b0 con 0x7f35801016f0 2024-09-12T00:01:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f357e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3580100410 0x7f3580199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f357e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3580100410 0x7f3580199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51140/0 (socket says 172.21.15.6:51140) 2024-09-12T00:01:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f357e59c640 1 -- 172.21.15.6:0/1399823203 learned_addr learned my addr 172.21.15.6:0/1399823203 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f357dd9b640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3580100d50 0x7f358019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f357ed9d640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35801016f0 0x7f35801a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f357e59c640 1 -- 172.21.15.6:0/1399823203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35801016f0 msgr2=0x7f35801a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f357e59c640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35801016f0 0x7f35801a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f357e59c640 1 -- 172.21.15.6:0/1399823203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3580100d50 msgr2=0x7f358019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f357e59c640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3580100d50 0x7f358019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.986+0000 7f357e59c640 1 -- 172.21.15.6:0/1399823203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35801a1ad0 con 0x7f3580100410 2024-09-12T00:01:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.987+0000 7f357e59c640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3580100410 0x7f3580199eb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f35700314e0 tx=0x7f3570003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.987+0000 7f356f7fe640 1 -- 172.21.15.6:0/1399823203 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357003f070 con 0x7f3580100410 2024-09-12T00:01:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.987+0000 7f356f7fe640 1 -- 172.21.15.6:0/1399823203 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3570031e40 con 0x7f3580100410 2024-09-12T00:01:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.987+0000 7f3584853640 1 -- 172.21.15.6:0/1399823203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35801a1dc0 con 0x7f3580100410 2024-09-12T00:01:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.987+0000 7f356f7fe640 1 -- 172.21.15.6:0/1399823203 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3570035030 con 0x7f3580100410 2024-09-12T00:01:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.987+0000 7f3584853640 1 -- 172.21.15.6:0/1399823203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35801a2230 con 0x7f3580100410 2024-09-12T00:01:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.989+0000 7f356f7fe640 1 -- 172.21.15.6:0/1399823203 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f3570042070 con 0x7f3580100410 2024-09-12T00:01:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f35875f2740 1 Processor -- start 2024-09-12T00:01:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f35875f2740 1 -- start start 2024-09-12T00:01:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f35875f2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41469a0 0x561ec4146da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f35875f2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 0x561ec414bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f35875f2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec414c370 0x561ec414e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f35875f2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561ec40aa2f0 con 0x561ec41472e0 2024-09-12T00:01:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f35875f2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561ec4052270 con 0x561ec414c370 2024-09-12T00:01:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f35875f2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561ec40a62b0 con 0x561ec41469a0 2024-09-12T00:01:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f357e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 0x561ec414bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f357e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 0x561ec414bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51156/0 (socket says 172.21.15.6:51156) 2024-09-12T00:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f357e59c640 1 -- 172.21.15.6:0/3205657621 learned_addr learned my addr 172.21.15.6:0/3205657621 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f356f7fe640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f35680a2b80 0x7f35680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.990+0000 7f357dd9b640 1 --2- 172.21.15.6:0/3205657621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec414c370 0x561ec414e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f357ed9d640 1 --2- 172.21.15.6:0/3205657621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41469a0 0x561ec4146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f357ed9d640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f35680a2b80 0x7f35680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f356f7fe640 1 -- 172.21.15.6:0/1399823203 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f35700efc40 con 0x7f3580100410 2024-09-12T00:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f357e59c640 1 -- 172.21.15.6:0/3205657621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41469a0 msgr2=0x561ec4146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f357e59c640 1 --2- 172.21.15.6:0/3205657621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41469a0 0x561ec4146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f357e59c640 1 -- 172.21.15.6:0/3205657621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec414c370 msgr2=0x561ec414e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f357e59c640 1 --2- 172.21.15.6:0/3205657621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec414c370 0x561ec414e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f357e59c640 1 -- 172.21.15.6:0/3205657621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ec4051340 con 0x561ec41472e0 2024-09-12T00:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f357dd9b640 1 --2- 172.21.15.6:0/3205657621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec414c370 0x561ec414e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f357e59c640 1 --2- 172.21.15.6:0/3205657621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 0x561ec414bda0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f35700b8a80 tx=0x7f35700b6b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd1c8298411c8be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f357ed9d640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f35680a2b80 0x7f35680a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3578009fd0 tx=0x7f3578009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f356cff9640 1 -- 172.21.15.6:0/3205657621 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3570049070 con 0x561ec41472e0 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f356cff9640 1 -- 172.21.15.6:0/3205657621 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35700bc7b0 con 0x561ec41472e0 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.991+0000 7f356cff9640 1 -- 172.21.15.6:0/3205657621 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35700dc030 con 0x561ec41472e0 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.992+0000 7f35875f2740 1 -- 172.21.15.6:0/3205657621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 msgr2=0x561ec414bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.992+0000 7f35875f2740 1 --2- 172.21.15.6:0/3205657621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 0x561ec414bda0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f35700b8a80 tx=0x7f35700b6b10 comp rx=0 tx=0).stop 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.992+0000 7f35875f2740 1 -- 172.21.15.6:0/3205657621 shutdown_connections 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.992+0000 7f35875f2740 1 --2- 172.21.15.6:0/3205657621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec414c370 0x561ec414e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.992+0000 7f35875f2740 1 --2- 172.21.15.6:0/3205657621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 0x561ec414bda0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.992+0000 7f35875f2740 1 --2- 172.21.15.6:0/3205657621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41469a0 0x561ec4146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.992+0000 7f35875f2740 1 -- 172.21.15.6:0/3205657621 >> 172.21.15.6:0/3205657621 conn(0x561ec4142010 msgr2=0x561ec4142410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.992+0000 7f35875f2740 1 -- 172.21.15.6:0/3205657621 shutdown_connections 2024-09-12T00:01:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.992+0000 7f35875f2740 1 -- 172.21.15.6:0/3205657621 wait complete. 2024-09-12T00:01:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f35875f2740 1 -- start start 2024-09-12T00:01:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f35875f2740 1 Processor -- start 2024-09-12T00:01:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f35875f2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec41469a0 0x561ec4150890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f35875f2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41472e0 0x561ec4150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f35875f2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 0x561ec4157e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f35875f2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561ec414f100 con 0x561ec414c370 2024-09-12T00:01:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f35875f2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561ec4033290 con 0x561ec41469a0 2024-09-12T00:01:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f35875f2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561ec414f280 con 0x561ec41472e0 2024-09-12T00:01:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f35875f2740 10 client.0 _ll_register_callbacks cb 0x561ec4064140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f357ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 0x561ec4157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f357ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 0x561ec4157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51168/0 (socket says 172.21.15.6:51168) 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f357ed9d640 1 -- 172.21.15.6:0/1015724462 learned_addr learned my addr 172.21.15.6:0/1015724462 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f357dd9b640 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41472e0 0x561ec4150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.993+0000 7f357e59c640 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec41469a0 0x561ec4150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f357ed9d640 1 -- 172.21.15.6:0/1015724462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41472e0 msgr2=0x561ec4150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f357ed9d640 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41472e0 0x561ec4150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f357ed9d640 1 -- 172.21.15.6:0/1015724462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec41469a0 msgr2=0x561ec4150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f357ed9d640 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec41469a0 0x561ec4150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f357ed9d640 1 -- 172.21.15.6:0/1015724462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ec3dbd210 con 0x561ec414c370 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f357ed9d640 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 0x561ec4157e10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3578009e20 tx=0x7f3578004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6a730dcda83d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f3565ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f3565ffb640 1 -- 172.21.15.6:0/1015724462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578011cf0 con 0x561ec414c370 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f3565ffb640 1 -- 172.21.15.6:0/1015724462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f3578004b20 con 0x561ec414c370 2024-09-12T00:01:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f35875f2740 1 -- 172.21.15.6:0/1015724462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35700bc7b0 con 0x561ec414c370 2024-09-12T00:01:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f3565ffb640 1 -- 172.21.15.6:0/1015724462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3578031050 con 0x561ec414c370 2024-09-12T00:01:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f35875f2740 10 client.15519 fetch_fsmap learned FSMap version 30 2024-09-12T00:01:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f35875f2740 1 -- 172.21.15.6:0/1015724462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561ec3e89620 con 0x561ec414c370 2024-09-12T00:01:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.994+0000 7f3565ffb640 1 -- 172.21.15.6:0/1015724462 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35700bc7b0 con 0x561ec414c370 2024-09-12T00:01:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.995+0000 7f3565ffb640 1 -- 172.21.15.6:0/1015724462 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f357800f040 con 0x561ec414c370 2024-09-12T00:01:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.995+0000 7f35875f2740 10 client.15519 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:01:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.995+0000 7f35875f2740 10 client.15519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:01:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.995+0000 7f35875f2740 20 client.15519 populate_metadata read hostname 'smithi006' 2024-09-12T00:01:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.995+0000 7f35875f2740 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ec415c6a0 0x561ec415eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.995+0000 7f35875f2740 4 client.15519 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.995+0000 7f35875f2740 1 -- 172.21.15.6:0/1015724462 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ec40b7a20 con 0x561ec415c6a0 2024-09-12T00:01:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.995+0000 7f357e59c640 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ec415c6a0 0x561ec415eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f357e59c640 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ec415c6a0 0x561ec415eae0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0efceb27c1a2bd8 server_cookie=5e0d0bd3dcd44e5a in_seq=0 out_seq=0 2024-09-12T00:01:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f3565ffb640 10 client.15519 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f3565ffb640 1 -- 172.21.15.6:0/1015724462 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561ec40b7a20 con 0x561ec415c6a0 2024-09-12T00:01:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f3565ffb640 10 client.15519 handle_command_reply: tid=0 2024-09-12T00:01:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f35875f2740 1 client.15519 shutdown 2024-09-12T00:01:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f35875f2740 1 -- 172.21.15.6:0/1015724462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 msgr2=0x561ec4157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f35875f2740 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 0x561ec4157e10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3578009e20 tx=0x7f3578004a40 comp rx=0 tx=0).stop 2024-09-12T00:01:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f35875f2740 1 -- 172.21.15.6:0/1015724462 shutdown_connections 2024-09-12T00:01:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f35875f2740 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 0x561ec4157e10 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f35875f2740 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ec415c6a0 0x561ec415eae0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f35875f2740 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41472e0 0x561ec4150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f35875f2740 1 --2- 172.21.15.6:0/1015724462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec41469a0 0x561ec4150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f35875f2740 1 -- 172.21.15.6:0/1015724462 >> 172.21.15.6:0/1015724462 conn(0x561ec4142010 msgr2=0x561ec4143820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.996+0000 7f3565ffb640 0 client.15519 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.997+0000 7f35875f2740 1 -- 172.21.15.6:0/1015724462 shutdown_connections 2024-09-12T00:01:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.997+0000 7f35875f2740 1 -- 172.21.15.6:0/1015724462 wait complete. 2024-09-12T00:01:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:37.997+0000 7f35875f2740 20 client.15519 trim_cache size 0 max 16384 2024-09-12T00:01:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f35875f2740 1 Processor -- start 2024-09-12T00:01:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f35875f2740 1 -- start start 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f35875f2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41469a0 0x561ec4150890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f35875f2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 0x561ec4157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f35875f2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec414c370 0x561ec4150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f35875f2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35801ac930 con 0x561ec41472e0 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f35875f2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f35801ae500 con 0x561ec414c370 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f35875f2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35801ad000 con 0x561ec41469a0 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f357dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 0x561ec4157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f357dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 0x561ec4157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51172/0 (socket says 172.21.15.6:51172) 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f357dd9b640 1 -- 172.21.15.6:0/3945474758 learned_addr learned my addr 172.21.15.6:0/3945474758 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f357e59c640 1 --2- 172.21.15.6:0/3945474758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41469a0 0x561ec4150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.012+0000 7f357ed9d640 1 --2- 172.21.15.6:0/3945474758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec414c370 0x561ec4150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.013+0000 7f357dd9b640 1 -- 172.21.15.6:0/3945474758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41469a0 msgr2=0x561ec4150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.013+0000 7f357dd9b640 1 --2- 172.21.15.6:0/3945474758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41469a0 0x561ec4150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.013+0000 7f357dd9b640 1 -- 172.21.15.6:0/3945474758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec414c370 msgr2=0x561ec4150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.013+0000 7f357dd9b640 1 --2- 172.21.15.6:0/3945474758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec414c370 0x561ec4150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.013+0000 7f357dd9b640 1 -- 172.21.15.6:0/3945474758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ec41503d0 con 0x561ec41472e0 2024-09-12T00:01:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.013+0000 7f357dd9b640 1 --2- 172.21.15.6:0/3945474758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 0x561ec4157dd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f357400adb0 tx=0x7f357400a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384fed19ad6f9494 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.013+0000 7f3567fff640 1 -- 172.21.15.6:0/3945474758 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357401e030 con 0x561ec41472e0 2024-09-12T00:01:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.013+0000 7f3567fff640 1 -- 172.21.15.6:0/3945474758 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3574010e20 con 0x561ec41472e0 2024-09-12T00:01:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.013+0000 7f3567fff640 1 -- 172.21.15.6:0/3945474758 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357401a670 con 0x561ec41472e0 2024-09-12T00:01:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.014+0000 7f35875f2740 1 -- 172.21.15.6:0/3945474758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 msgr2=0x561ec4157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.014+0000 7f35875f2740 1 --2- 172.21.15.6:0/3945474758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 0x561ec4157dd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f357400adb0 tx=0x7f357400a2d0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.014+0000 7f35875f2740 1 -- 172.21.15.6:0/3945474758 shutdown_connections 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.014+0000 7f35875f2740 1 --2- 172.21.15.6:0/3945474758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec414c370 0x561ec4150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.014+0000 7f35875f2740 1 --2- 172.21.15.6:0/3945474758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec41472e0 0x561ec4157dd0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.014+0000 7f35875f2740 1 --2- 172.21.15.6:0/3945474758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41469a0 0x561ec4150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.014+0000 7f35875f2740 1 -- 172.21.15.6:0/3945474758 >> 172.21.15.6:0/3945474758 conn(0x561ec4142010 msgr2=0x561ec4148520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.014+0000 7f35875f2740 1 -- 172.21.15.6:0/3945474758 shutdown_connections 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.014+0000 7f35875f2740 1 -- 172.21.15.6:0/3945474758 wait complete. 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.014+0000 7f35875f2740 1 -- start start 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.014+0000 7f35875f2740 1 Processor -- start 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.014+0000 7f35875f2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec41469a0 0x561ec4154e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f35875f2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41472e0 0x561ec41553a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f35875f2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 0x561ec41563b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f35875f2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35801adda0 con 0x561ec414c370 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f35875f2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f35801ad6d0 con 0x561ec41469a0 2024-09-12T00:01:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f35875f2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35801aa910 con 0x561ec41472e0 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f35875f2740 10 client.0 _ll_register_callbacks cb 0x7f35780127e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f357ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 0x561ec41563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f357ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 0x561ec41563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51178/0 (socket says 172.21.15.6:51178) 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f357ed9d640 1 -- 172.21.15.6:0/3047928290 learned_addr learned my addr 172.21.15.6:0/3047928290 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f357dd9b640 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41472e0 0x561ec41553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f357e59c640 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec41469a0 0x561ec4154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f357ed9d640 1 -- 172.21.15.6:0/3047928290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41472e0 msgr2=0x561ec41553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f357ed9d640 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41472e0 0x561ec41553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f357ed9d640 1 -- 172.21.15.6:0/3047928290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec41469a0 msgr2=0x561ec4154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f357ed9d640 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec41469a0 0x561ec4154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f357ed9d640 1 -- 172.21.15.6:0/3047928290 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ec41569c0 con 0x561ec414c370 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f357ed9d640 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 0x561ec41563b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3578005980 tx=0x7f3578009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7b8d3920fbfe69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f3565ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.015+0000 7f3565ffb640 1 -- 172.21.15.6:0/3047928290 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578039070 con 0x561ec414c370 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f3565ffb640 1 -- 172.21.15.6:0/3047928290 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f3578029840 con 0x561ec414c370 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f35875f2740 1 -- 172.21.15.6:0/3047928290 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3574010e20 con 0x561ec414c370 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f3565ffb640 1 -- 172.21.15.6:0/3047928290 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3578046050 con 0x561ec414c370 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f35875f2740 10 client.15525 fetch_fsmap learned FSMap version 30 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f35875f2740 1 -- 172.21.15.6:0/3047928290 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561ec4157cd0 con 0x561ec414c370 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f3565ffb640 1 -- 172.21.15.6:0/3047928290 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3574010e20 con 0x561ec414c370 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f3565ffb640 1 -- 172.21.15.6:0/3047928290 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f357803d590 con 0x561ec414c370 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f35875f2740 10 client.15525 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f35875f2740 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f35875f2740 20 client.15525 populate_metadata read hostname 'smithi006' 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f35875f2740 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ec41c7700 0x561ec41c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f35875f2740 4 client.15525 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:01:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f35875f2740 1 -- 172.21.15.6:0/3047928290 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ec40b1d70 con 0x561ec41c7700 2024-09-12T00:01:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.016+0000 7f357e59c640 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ec41c7700 0x561ec41c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.017+0000 7f3565ffb640 10 client.15525 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.017+0000 7f357e59c640 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ec41c7700 0x561ec41c9b20 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6edea70a7bd86281 server_cookie=7a0d8eeb380f9804 in_seq=0 out_seq=0 2024-09-12T00:01:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.033+0000 7f3565ffb640 1 -- 172.21.15.6:0/3047928290 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ec40b1d70 con 0x561ec41c7700 2024-09-12T00:01:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.033+0000 7f3565ffb640 10 client.15525 handle_command_reply: tid=0 2024-09-12T00:01:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.033+0000 7f35875f2740 1 client.15525 shutdown 2024-09-12T00:01:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.034+0000 7f35875f2740 1 -- 172.21.15.6:0/3047928290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 msgr2=0x561ec41563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.034+0000 7f35875f2740 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 0x561ec41563b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3578005980 tx=0x7f3578009a00 comp rx=0 tx=0).stop 2024-09-12T00:01:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.034+0000 7f35875f2740 1 -- 172.21.15.6:0/3047928290 shutdown_connections 2024-09-12T00:01:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.034+0000 7f35875f2740 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ec414c370 0x561ec41563b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.034+0000 7f35875f2740 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ec41c7700 0x561ec41c9b20 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.034+0000 7f35875f2740 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ec41472e0 0x561ec41553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.034+0000 7f3565ffb640 0 client.15525 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.034+0000 7f35875f2740 1 --2- 172.21.15.6:0/3047928290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ec41469a0 0x561ec4154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.034+0000 7f35875f2740 1 -- 172.21.15.6:0/3047928290 >> 172.21.15.6:0/3047928290 conn(0x561ec4142010 msgr2=0x561ec41409a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.034+0000 7f35875f2740 1 -- 172.21.15.6:0/3047928290 shutdown_connections 2024-09-12T00:01:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.034+0000 7f35875f2740 1 -- 172.21.15.6:0/3047928290 wait complete. 2024-09-12T00:01:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.034+0000 7f35875f2740 20 client.15525 trim_cache size 0 max 16384 2024-09-12T00:01:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:01:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:01:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:01:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:01:38.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.035+0000 7f3584853640 1 -- 172.21.15.6:0/1399823203 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f35680a2b80 msgr2=0x7f35680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:38.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.035+0000 7f3584853640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f35680a2b80 0x7f35680a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3578009fd0 tx=0x7f3578009600 comp rx=0 tx=0).stop 2024-09-12T00:01:38.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.035+0000 7f3584853640 1 -- 172.21.15.6:0/1399823203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3580100410 msgr2=0x7f3580199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.035+0000 7f3584853640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3580100410 0x7f3580199eb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f35700314e0 tx=0x7f3570003c80 comp rx=0 tx=0).stop 2024-09-12T00:01:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.035+0000 7f3584853640 1 -- 172.21.15.6:0/1399823203 shutdown_connections 2024-09-12T00:01:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.035+0000 7f3584853640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f35680a2b80 0x7f35680a5040 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.035+0000 7f3584853640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35801016f0 0x7f35801a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.035+0000 7f3584853640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3580100d50 0x7f358019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.035+0000 7f3584853640 1 --2- 172.21.15.6:0/1399823203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3580100410 0x7f3580199eb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.035+0000 7f3584853640 1 -- 172.21.15.6:0/1399823203 >> 172.21.15.6:0/1399823203 conn(0x7f35800fc1c0 msgr2=0x7f35800fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.035+0000 7f3584853640 1 -- 172.21.15.6:0/1399823203 shutdown_connections 2024-09-12T00:01:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:38.035+0000 7f3584853640 1 -- 172.21.15.6:0/1399823203 wait complete. 2024-09-12T00:01:39.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:38 smithi134 ceph-mon[34893]: pgmap v428: 129 pgs: 129 active+clean; 1.3 GiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:01:39.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:38 smithi039 ceph-mon[34543]: pgmap v428: 129 pgs: 129 active+clean; 1.3 GiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:01:39.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:38 smithi006 ceph-mon[30947]: pgmap v428: 129 pgs: 129 active+clean; 1.3 GiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:01:41.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:40 smithi134 ceph-mon[34893]: pgmap v429: 129 pgs: 129 active+clean; 1.4 GiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:01:41.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:40 smithi039 ceph-mon[34543]: pgmap v429: 129 pgs: 129 active+clean; 1.4 GiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:01:41.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:40 smithi006 ceph-mon[30947]: pgmap v429: 129 pgs: 129 active+clean; 1.4 GiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:01:43.212 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:42 smithi134 ceph-mon[34893]: pgmap v430: 129 pgs: 129 active+clean; 1.4 GiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 22 op/s 2024-09-12T00:01:43.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:42 smithi039 ceph-mon[34543]: pgmap v430: 129 pgs: 129 active+clean; 1.4 GiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 22 op/s 2024-09-12T00:01:43.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:42 smithi006 ceph-mon[30947]: pgmap v430: 129 pgs: 129 active+clean; 1.4 GiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 22 op/s 2024-09-12T00:01:45.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:44 smithi134 ceph-mon[34893]: pgmap v431: 129 pgs: 129 active+clean; 1.5 GiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:01:45.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:44 smithi039 ceph-mon[34543]: pgmap v431: 129 pgs: 129 active+clean; 1.5 GiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:01:45.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:44 smithi006 ceph-mon[30947]: pgmap v431: 129 pgs: 129 active+clean; 1.5 GiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:01:47.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:46 smithi134 ceph-mon[34893]: pgmap v432: 129 pgs: 129 active+clean; 1.6 GiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:01:47.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:46 smithi039 ceph-mon[34543]: pgmap v432: 129 pgs: 129 active+clean; 1.6 GiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:01:47.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:46 smithi006 ceph-mon[30947]: pgmap v432: 129 pgs: 129 active+clean; 1.6 GiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:01:49.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:48 smithi134 ceph-mon[34893]: pgmap v433: 129 pgs: 129 active+clean; 1.6 GiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-09-12T00:01:49.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:48 smithi039 ceph-mon[34543]: pgmap v433: 129 pgs: 129 active+clean; 1.6 GiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-09-12T00:01:49.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:48 smithi006 ceph-mon[30947]: pgmap v433: 129 pgs: 129 active+clean; 1.6 GiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-09-12T00:01:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.139+0000 7f1a5a511640 1 -- 172.21.15.6:0/2976504779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a541016f0 msgr2=0x7f1a54101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.139+0000 7f1a5a511640 1 --2- 172.21.15.6:0/2976504779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a541016f0 0x7f1a54101ba0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009ca0 tx=0x7f1a4c02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.139+0000 7f1a5a511640 1 -- 172.21.15.6:0/2976504779 shutdown_connections 2024-09-12T00:01:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.139+0000 7f1a5a511640 1 --2- 172.21.15.6:0/2976504779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a541016f0 0x7f1a54101ba0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.139+0000 7f1a5a511640 1 --2- 172.21.15.6:0/2976504779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a54100d50 0x7f1a541011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.139+0000 7f1a5a511640 1 --2- 172.21.15.6:0/2976504779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a54100410 0x7f1a54100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.139+0000 7f1a5a511640 1 -- 172.21.15.6:0/2976504779 >> 172.21.15.6:0/2976504779 conn(0x7f1a540fc1c0 msgr2=0x7f1a540fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.139+0000 7f1a5a511640 1 -- 172.21.15.6:0/2976504779 shutdown_connections 2024-09-12T00:01:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.139+0000 7f1a5a511640 1 -- 172.21.15.6:0/2976504779 wait complete. 2024-09-12T00:01:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.139+0000 7f1a5a511640 1 Processor -- start 2024-09-12T00:01:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.139+0000 7f1a5a511640 1 -- start start 2024-09-12T00:01:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a5a511640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54100410 0x7f1a54199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a5a511640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a54100d50 0x7f1a5419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a5a511640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a541016f0 0x7f1a541a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a5a511640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5410f800 con 0x7f1a54100410 2024-09-12T00:01:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a5a511640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5410f680 con 0x7f1a54100d50 2024-09-12T00:01:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a5a511640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5410f980 con 0x7f1a541016f0 2024-09-12T00:01:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54100410 0x7f1a54199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54100410 0x7f1a54199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57768/0 (socket says 172.21.15.6:57768) 2024-09-12T00:01:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a53fff640 1 -- 172.21.15.6:0/86201137 learned_addr learned my addr 172.21.15.6:0/86201137 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a58aae640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a541016f0 0x7f1a541a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a537fe640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a54100d50 0x7f1a5419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a53fff640 1 -- 172.21.15.6:0/86201137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a541016f0 msgr2=0x7f1a541a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a53fff640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a541016f0 0x7f1a541a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a53fff640 1 -- 172.21.15.6:0/86201137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a54100d50 msgr2=0x7f1a5419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a53fff640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a54100d50 0x7f1a5419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a53fff640 1 -- 172.21.15.6:0/86201137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a541a1b60 con 0x7f1a54100410 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.140+0000 7f1a537fe640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a54100d50 0x7f1a5419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.141+0000 7f1a53fff640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54100410 0x7f1a54199f40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400e9f0 tx=0x7f1a4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.141+0000 7f1a517fa640 1 -- 172.21.15.6:0/86201137 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400cd80 con 0x7f1a54100410 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.141+0000 7f1a517fa640 1 -- 172.21.15.6:0/86201137 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a440108e0 con 0x7f1a54100410 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.141+0000 7f1a5a511640 1 -- 172.21.15.6:0/86201137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a541a1e50 con 0x7f1a54100410 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.141+0000 7f1a517fa640 1 -- 172.21.15.6:0/86201137 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44018920 con 0x7f1a54100410 2024-09-12T00:01:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.141+0000 7f1a5a511640 1 -- 172.21.15.6:0/86201137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a541a22b0 con 0x7f1a54100410 2024-09-12T00:01:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a517fa640 1 -- 172.21.15.6:0/86201137 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f1a44010a90 con 0x7f1a54100410 2024-09-12T00:01:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a5d2ad740 1 Processor -- start 2024-09-12T00:01:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a5d2ad740 1 -- start start 2024-09-12T00:01:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a517fa640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1a3c0a2b80 0x7f1a3c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a5d2ad740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e39a0 0x55dd249e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a5d2ad740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249e8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a5d2ad740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e9370 0x55dd249eb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a5d2ad740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55dd249472f0 con 0x55dd249e42e0 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a5d2ad740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55dd248ef270 con 0x55dd249e39a0 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a5d2ad740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dd249432b0 con 0x55dd249e9370 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a517fa640 1 -- 172.21.15.6:0/86201137 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f1a440cf7b0 con 0x7f1a54100410 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a58aae640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1a3c0a2b80 0x7f1a3c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249e8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249e8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57780/0 (socket says 172.21.15.6:57780) 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a537fe640 1 -- 172.21.15.6:0/3441118555 learned_addr learned my addr 172.21.15.6:0/3441118555 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a58aae640 1 --2- 172.21.15.6:0/3441118555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e9370 0x55dd249eb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.144+0000 7f1a53fff640 1 --2- 172.21.15.6:0/3441118555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e39a0 0x55dd249e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.145+0000 7f1a537fe640 1 -- 172.21.15.6:0/3441118555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e9370 msgr2=0x55dd249eb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.145+0000 7f1a537fe640 1 --2- 172.21.15.6:0/3441118555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e9370 0x55dd249eb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.145+0000 7f1a537fe640 1 -- 172.21.15.6:0/3441118555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e39a0 msgr2=0x55dd249e3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.145+0000 7f1a537fe640 1 --2- 172.21.15.6:0/3441118555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e39a0 0x55dd249e3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.145+0000 7f1a537fe640 1 -- 172.21.15.6:0/3441118555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd248ee340 con 0x55dd249e42e0 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.145+0000 7f1a58aae640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1a3c0a2b80 0x7f1a3c0a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c031040 tx=0x7f1a4c031ba0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.145+0000 7f1a537fe640 1 --2- 172.21.15.6:0/3441118555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249e8da0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009ce0 tx=0x7f1a480117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c30b0b910bcd89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.145+0000 7f1a3a7fc640 1 -- 172.21.15.6:0/3441118555 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48012450 con 0x55dd249e42e0 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.145+0000 7f1a3a7fc640 1 -- 172.21.15.6:0/3441118555 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a48012aa0 con 0x55dd249e42e0 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.145+0000 7f1a3a7fc640 1 -- 172.21.15.6:0/3441118555 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4800fa50 con 0x55dd249e42e0 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.146+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3441118555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 msgr2=0x55dd249e8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.146+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/3441118555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249e8da0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009ce0 tx=0x7f1a480117b0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.146+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3441118555 shutdown_connections 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.146+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/3441118555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e9370 0x55dd249eb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.146+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/3441118555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249e8da0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.146+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/3441118555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e39a0 0x55dd249e3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.146+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3441118555 >> 172.21.15.6:0/3441118555 conn(0x55dd249df010 msgr2=0x55dd249df410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.146+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3441118555 shutdown_connections 2024-09-12T00:01:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.146+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3441118555 wait complete. 2024-09-12T00:01:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.146+0000 7f1a5d2ad740 1 -- start start 2024-09-12T00:01:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a5d2ad740 1 Processor -- start 2024-09-12T00:01:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a5d2ad740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e39a0 0x55dd249edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a5d2ad740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249ee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a5d2ad740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e9370 0x55dd249f5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a5d2ad740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55dd249ec340 con 0x55dd249e42e0 2024-09-12T00:01:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a5d2ad740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55dd248d0290 con 0x55dd249e9370 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a5d2ad740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dd249ec4c0 con 0x55dd249e39a0 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a5d2ad740 10 client.0 _ll_register_callbacks cb 0x55dd24901140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249ee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57792/0 (socket says 172.21.15.6:57792) 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e39a0 0x55dd249edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a537fe640 1 -- 172.21.15.6:0/944164559 learned_addr learned my addr 172.21.15.6:0/944164559 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a58aae640 1 --2- 172.21.15.6:0/944164559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e9370 0x55dd249f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a537fe640 1 -- 172.21.15.6:0/944164559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e39a0 msgr2=0x55dd249edbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a537fe640 1 --2- 172.21.15.6:0/944164559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e39a0 0x55dd249edbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a537fe640 1 -- 172.21.15.6:0/944164559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e9370 msgr2=0x55dd249f5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a537fe640 1 --2- 172.21.15.6:0/944164559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e9370 0x55dd249f5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.147+0000 7f1a537fe640 1 -- 172.21.15.6:0/944164559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd2465a210 con 0x55dd249e42e0 2024-09-12T00:01:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.148+0000 7f1a537fe640 1 --2- 172.21.15.6:0/944164559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249ee100 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1a480124d0 tx=0x7f1a48012500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a1e0b30ac9ea01 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.148+0000 7f1a337fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:01:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.148+0000 7f1a337fe640 1 -- 172.21.15.6:0/944164559 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48029020 con 0x55dd249e42e0 2024-09-12T00:01:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.148+0000 7f1a337fe640 1 -- 172.21.15.6:0/944164559 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f1a48005040 con 0x55dd249e42e0 2024-09-12T00:01:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.148+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/944164559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a48012aa0 con 0x55dd249e42e0 2024-09-12T00:01:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.148+0000 7f1a337fe640 1 -- 172.21.15.6:0/944164559 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a48034050 con 0x55dd249e42e0 2024-09-12T00:01:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.148+0000 7f1a5d2ad740 10 client.15537 fetch_fsmap learned FSMap version 30 2024-09-12T00:01:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.148+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/944164559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55dd24726620 con 0x55dd249e42e0 2024-09-12T00:01:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.148+0000 7f1a337fe640 1 -- 172.21.15.6:0/944164559 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a48012aa0 con 0x55dd249e42e0 2024-09-12T00:01:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.149+0000 7f1a337fe640 1 -- 172.21.15.6:0/944164559 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f1a48004660 con 0x55dd249e42e0 2024-09-12T00:01:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.149+0000 7f1a5d2ad740 10 client.15537 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:01:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.149+0000 7f1a5d2ad740 10 client.15537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:01:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.149+0000 7f1a5d2ad740 20 client.15537 populate_metadata read hostname 'smithi006' 2024-09-12T00:01:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.149+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/944164559 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55dd249f9600 0x55dd249fba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.149+0000 7f1a5d2ad740 4 client.15537 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.149+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/944164559 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd24954a20 con 0x55dd249f9600 2024-09-12T00:01:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.149+0000 7f1a53fff640 1 --2- 172.21.15.6:0/944164559 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55dd249f9600 0x55dd249fba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.149+0000 7f1a53fff640 1 --2- 172.21.15.6:0/944164559 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55dd249f9600 0x55dd249fba10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce7626fb241d19d2 server_cookie=99e15f1fced548a3 in_seq=0 out_seq=0 2024-09-12T00:01:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.149+0000 7f1a337fe640 10 client.15537 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a337fe640 1 -- 172.21.15.6:0/944164559 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd24954a20 con 0x55dd249f9600 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a337fe640 10 client.15537 handle_command_reply: tid=0 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a5d2ad740 1 client.15537 shutdown 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/944164559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 msgr2=0x55dd249ee100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/944164559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249ee100 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1a480124d0 tx=0x7f1a48012500 comp rx=0 tx=0).stop 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/944164559 shutdown_connections 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/944164559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e9370 0x55dd249f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/944164559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249ee100 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/944164559 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55dd249f9600 0x55dd249fba10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/944164559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e39a0 0x55dd249edbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a337fe640 0 client.15537 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/944164559 >> 172.21.15.6:0/944164559 conn(0x55dd249df010 msgr2=0x55dd249e0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/944164559 shutdown_connections 2024-09-12T00:01:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/944164559 wait complete. 2024-09-12T00:01:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.151+0000 7f1a5d2ad740 20 client.15537 trim_cache size 0 max 16384 2024-09-12T00:01:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.166+0000 7f1a5d2ad740 1 Processor -- start 2024-09-12T00:01:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.166+0000 7f1a5d2ad740 1 -- start start 2024-09-12T00:01:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.166+0000 7f1a5d2ad740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e39a0 0x55dd249fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.166+0000 7f1a5d2ad740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249f5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.166+0000 7f1a5d2ad740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e9370 0x55dd249de0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.166+0000 7f1a5d2ad740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1a541ac9b0 con 0x55dd249e42e0 2024-09-12T00:01:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.166+0000 7f1a5d2ad740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1a541ae580 con 0x55dd249e39a0 2024-09-12T00:01:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.166+0000 7f1a5d2ad740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1a541ad080 con 0x55dd249e9370 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.166+0000 7f1a537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.166+0000 7f1a537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249f5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57796/0 (socket says 172.21.15.6:57796) 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.166+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e39a0 0x55dd249fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.166+0000 7f1a537fe640 1 -- 172.21.15.6:0/4263737028 learned_addr learned my addr 172.21.15.6:0/4263737028 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.167+0000 7f1a58aae640 1 --2- 172.21.15.6:0/4263737028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e9370 0x55dd249de0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.167+0000 7f1a53fff640 1 -- 172.21.15.6:0/4263737028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e9370 msgr2=0x55dd249de0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.167+0000 7f1a53fff640 1 --2- 172.21.15.6:0/4263737028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e9370 0x55dd249de0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.167+0000 7f1a53fff640 1 -- 172.21.15.6:0/4263737028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 msgr2=0x55dd249f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.167+0000 7f1a53fff640 1 --2- 172.21.15.6:0/4263737028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.167+0000 7f1a53fff640 1 -- 172.21.15.6:0/4263737028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd249e47c0 con 0x55dd249e39a0 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.167+0000 7f1a53fff640 1 --2- 172.21.15.6:0/4263737028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e39a0 0x55dd249fb9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1a440cd230 tx=0x7f1a4409bb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0b95eef912d55e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.167+0000 7f1a39ffb640 1 -- 172.21.15.6:0/4263737028 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4409c320 con 0x55dd249e39a0 2024-09-12T00:01:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.167+0000 7f1a39ffb640 1 -- 172.21.15.6:0/4263737028 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a4409bc20 con 0x55dd249e39a0 2024-09-12T00:01:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.167+0000 7f1a39ffb640 1 -- 172.21.15.6:0/4263737028 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4404a9d0 con 0x55dd249e39a0 2024-09-12T00:01:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.169+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/4263737028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e39a0 msgr2=0x55dd249fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.169+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/4263737028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e39a0 0x55dd249fb9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1a440cd230 tx=0x7f1a4409bb10 comp rx=0 tx=0).stop 2024-09-12T00:01:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.169+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/4263737028 shutdown_connections 2024-09-12T00:01:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.169+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/4263737028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e9370 0x55dd249de0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.169+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/4263737028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e42e0 0x55dd249f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.169+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/4263737028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e39a0 0x55dd249fb9f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.169+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/4263737028 >> 172.21.15.6:0/4263737028 conn(0x55dd249df010 msgr2=0x55dd249dd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.169+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/4263737028 shutdown_connections 2024-09-12T00:01:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.169+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/4263737028 wait complete. 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.169+0000 7f1a5d2ad740 1 -- start start 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 1 Processor -- start 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e39a0 0x55dd249f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e42e0 0x55dd249f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e9370 0x55dd249f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1a541ade20 con 0x55dd249e39a0 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1a541ad750 con 0x55dd249e9370 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1a541aa990 con 0x55dd249e42e0 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 10 client.0 _ll_register_callbacks cb 0x7f1a48009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e39a0 0x55dd249f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e39a0 0x55dd249f28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57800/0 (socket says 172.21.15.6:57800) 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a53fff640 1 -- 172.21.15.6:0/3762371663 learned_addr learned my addr 172.21.15.6:0/3762371663 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a58aae640 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e9370 0x55dd249f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a537fe640 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e42e0 0x55dd249f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a53fff640 1 -- 172.21.15.6:0/3762371663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e42e0 msgr2=0x55dd249f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a53fff640 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e42e0 0x55dd249f2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a53fff640 1 -- 172.21.15.6:0/3762371663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e9370 msgr2=0x55dd249f3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a53fff640 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e9370 0x55dd249f3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a53fff640 1 -- 172.21.15.6:0/3762371663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd249f43e0 con 0x55dd249e39a0 2024-09-12T00:01:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a58aae640 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e9370 0x55dd249f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a53fff640 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e39a0 0x55dd249f28d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400c6a0 tx=0x7f1a4409ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9c42dc65658ca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a337fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:01:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a337fe640 1 -- 172.21.15.6:0/3762371663 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a440b8020 con 0x55dd249e39a0 2024-09-12T00:01:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a337fe640 1 -- 172.21.15.6:0/3762371663 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f1a44098290 con 0x55dd249e39a0 2024-09-12T00:01:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3762371663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a4409bc20 con 0x55dd249e39a0 2024-09-12T00:01:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a337fe640 1 -- 172.21.15.6:0/3762371663 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a4409c320 con 0x55dd249e39a0 2024-09-12T00:01:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 10 client.15543 fetch_fsmap learned FSMap version 30 2024-09-12T00:01:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3762371663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55dd24a64300 con 0x55dd249e39a0 2024-09-12T00:01:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a337fe640 1 -- 172.21.15.6:0/3762371663 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a4409bc20 con 0x55dd249e39a0 2024-09-12T00:01:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a337fe640 1 -- 172.21.15.6:0/3762371663 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f1a440a4ae0 con 0x55dd249e39a0 2024-09-12T00:01:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 10 client.15543 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:01:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:01:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 20 client.15543 populate_metadata read hostname 'smithi006' 2024-09-12T00:01:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55dd24a64ce0 0x55dd24a67100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 4 client.15543 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:01:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.170+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3762371663 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dd2494ed70 con 0x55dd24a64ce0 2024-09-12T00:01:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.171+0000 7f1a537fe640 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55dd24a64ce0 0x55dd24a67100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.171+0000 7f1a337fe640 10 client.15543 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.171+0000 7f1a537fe640 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55dd24a64ce0 0x55dd24a67100 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9de3a2261fc90021 server_cookie=229bd673bfc9beaf in_seq=0 out_seq=0 2024-09-12T00:01:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a337fe640 1 -- 172.21.15.6:0/3762371663 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dd2494ed70 con 0x55dd24a64ce0 2024-09-12T00:01:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a337fe640 10 client.15543 handle_command_reply: tid=0 2024-09-12T00:01:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5d2ad740 1 client.15543 shutdown 2024-09-12T00:01:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3762371663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e39a0 msgr2=0x55dd249f28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e39a0 0x55dd249f28d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400c6a0 tx=0x7f1a4409ffd0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3762371663 shutdown_connections 2024-09-12T00:01:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dd249e9370 0x55dd249f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55dd24a64ce0 0x55dd24a67100 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a337fe640 0 client.15543 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:01:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd249e42e0 0x55dd249f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5d2ad740 1 --2- 172.21.15.6:0/3762371663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd249e39a0 0x55dd249f28d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3762371663 >> 172.21.15.6:0/3762371663 conn(0x55dd249df010 msgr2=0x55dd249dd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3762371663 shutdown_connections 2024-09-12T00:01:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5d2ad740 1 -- 172.21.15.6:0/3762371663 wait complete. 2024-09-12T00:01:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5d2ad740 20 client.15543 trim_cache size 0 max 16384 2024-09-12T00:01:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:01:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:01:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:01:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:01:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5a511640 1 -- 172.21.15.6:0/86201137 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1a3c0a2b80 msgr2=0x7f1a3c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5a511640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1a3c0a2b80 0x7f1a3c0a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c031040 tx=0x7f1a4c031ba0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5a511640 1 -- 172.21.15.6:0/86201137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54100410 msgr2=0x7f1a54199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5a511640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54100410 0x7f1a54199f40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400e9f0 tx=0x7f1a4400eeb0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5a511640 1 -- 172.21.15.6:0/86201137 shutdown_connections 2024-09-12T00:01:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5a511640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f1a3c0a2b80 0x7f1a3c0a5040 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5a511640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a541016f0 0x7f1a541a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5a511640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a54100d50 0x7f1a5419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5a511640 1 --2- 172.21.15.6:0/86201137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54100410 0x7f1a54199f40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5a511640 1 -- 172.21.15.6:0/86201137 >> 172.21.15.6:0/86201137 conn(0x7f1a540fc1c0 msgr2=0x7f1a540fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5a511640 1 -- 172.21.15.6:0/86201137 shutdown_connections 2024-09-12T00:01:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:01:51.188+0000 7f1a5a511640 1 -- 172.21.15.6:0/86201137 wait complete. 2024-09-12T00:01:51.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:50 smithi134 ceph-mon[34893]: pgmap v434: 129 pgs: 129 active+clean; 1.7 GiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:01:51.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:50 smithi039 ceph-mon[34543]: pgmap v434: 129 pgs: 129 active+clean; 1.7 GiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:01:51.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:50 smithi006 ceph-mon[30947]: pgmap v434: 129 pgs: 129 active+clean; 1.7 GiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:01:53.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:52 smithi134 ceph-mon[34893]: pgmap v435: 129 pgs: 129 active+clean; 1.7 GiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:01:53.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:52 smithi039 ceph-mon[34543]: pgmap v435: 129 pgs: 129 active+clean; 1.7 GiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:01:53.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:52 smithi006 ceph-mon[30947]: pgmap v435: 129 pgs: 129 active+clean; 1.7 GiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:01:55.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:54 smithi134 ceph-mon[34893]: pgmap v436: 129 pgs: 129 active+clean; 1.7 GiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:01:55.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:54 smithi039 ceph-mon[34543]: pgmap v436: 129 pgs: 129 active+clean; 1.7 GiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:01:55.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:54 smithi006 ceph-mon[30947]: pgmap v436: 129 pgs: 129 active+clean; 1.7 GiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:01:57.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:56 smithi134 ceph-mon[34893]: pgmap v437: 129 pgs: 129 active+clean; 1.8 GiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:01:57.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:56 smithi039 ceph-mon[34543]: pgmap v437: 129 pgs: 129 active+clean; 1.8 GiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:01:57.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:56 smithi006 ceph-mon[30947]: pgmap v437: 129 pgs: 129 active+clean; 1.8 GiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:01:59.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:01:58 smithi039 ceph-mon[34543]: pgmap v438: 129 pgs: 129 active+clean; 1.8 GiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:01:59.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:01:58 smithi006 ceph-mon[30947]: pgmap v438: 129 pgs: 129 active+clean; 1.8 GiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:01:59.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:01:58 smithi134 ceph-mon[34893]: pgmap v438: 129 pgs: 129 active+clean; 1.8 GiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:02:01.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:00 smithi039 ceph-mon[34543]: pgmap v439: 129 pgs: 129 active+clean; 1.9 GiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:02:01.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:00 smithi006 ceph-mon[30947]: pgmap v439: 129 pgs: 129 active+clean; 1.9 GiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:02:01.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:00 smithi134 ceph-mon[34893]: pgmap v439: 129 pgs: 129 active+clean; 1.9 GiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:02:02.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:02 smithi039 ceph-mon[34543]: pgmap v440: 129 pgs: 129 active+clean; 1.9 GiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:02:02.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:02 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:02:02.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:02 smithi006 ceph-mon[30947]: pgmap v440: 129 pgs: 129 active+clean; 1.9 GiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:02:02.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:02 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:02:02.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:02 smithi134 ceph-mon[34893]: pgmap v440: 129 pgs: 129 active+clean; 1.9 GiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:02:02.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:02 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:02:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:02:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:02:03.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:02:03.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:02:03.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:02:03.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:02:03.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:02:03.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:02:03.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:02:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.291+0000 7f7414d6d640 1 -- 172.21.15.6:0/2997597373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74101025f0 msgr2=0x7f7410108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.291+0000 7f7414d6d640 1 --2- 172.21.15.6:0/2997597373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74101025f0 0x7f7410108e80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7408009ca0 tx=0x7f740802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.291+0000 7f7414d6d640 1 -- 172.21.15.6:0/2997597373 shutdown_connections 2024-09-12T00:02:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.291+0000 7f7414d6d640 1 --2- 172.21.15.6:0/2997597373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74101025f0 0x7f7410108e80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.291+0000 7f7414d6d640 1 --2- 172.21.15.6:0/2997597373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7410101c30 0x7f74101020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.291+0000 7f7414d6d640 1 --2- 172.21.15.6:0/2997597373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7410100a40 0x7f7410100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.291+0000 7f7414d6d640 1 -- 172.21.15.6:0/2997597373 >> 172.21.15.6:0/2997597373 conn(0x7f74100fc1c0 msgr2=0x7f74100fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:04.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.292+0000 7f7414d6d640 1 -- 172.21.15.6:0/2997597373 shutdown_connections 2024-09-12T00:02:04.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.292+0000 7f7414d6d640 1 -- 172.21.15.6:0/2997597373 wait complete. 2024-09-12T00:02:04.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.292+0000 7f7414d6d640 1 Processor -- start 2024-09-12T00:02:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.292+0000 7f7414d6d640 1 -- start start 2024-09-12T00:02:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f7414d6d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7410100a40 0x7f741010b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f7414d6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7410101c30 0x7f7410109a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f7414d6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74101025f0 0x7f7410109f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f7414d6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f741010d680 con 0x7f74101025f0 2024-09-12T00:02:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f7414d6d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f741010d500 con 0x7f7410100a40 2024-09-12T00:02:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f7414d6d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f741010d800 con 0x7f7410101c30 2024-09-12T00:02:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f740ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74101025f0 0x7f7410109f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f740ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74101025f0 0x7f7410109f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54692/0 (socket says 172.21.15.6:54692) 2024-09-12T00:02:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f740ed9d640 1 -- 172.21.15.6:0/2846359768 learned_addr learned my addr 172.21.15.6:0/2846359768 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f740e59c640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7410100a40 0x7f741010b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f740dd9b640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7410101c30 0x7f7410109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f740ed9d640 1 -- 172.21.15.6:0/2846359768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7410101c30 msgr2=0x7f7410109a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f740ed9d640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7410101c30 0x7f7410109a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f740ed9d640 1 -- 172.21.15.6:0/2846359768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7410100a40 msgr2=0x7f741010b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f740ed9d640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7410100a40 0x7f741010b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f740ed9d640 1 -- 172.21.15.6:0/2846359768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741010a7d0 con 0x7f74101025f0 2024-09-12T00:02:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f740e59c640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7410100a40 0x7f741010b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.293+0000 7f740ed9d640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74101025f0 0x7f7410109f40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7408031970 tx=0x7f7408003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.294+0000 7f73ff7fe640 1 -- 172.21.15.6:0/2846359768 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7408003d90 con 0x7f74101025f0 2024-09-12T00:02:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.294+0000 7f7414d6d640 1 -- 172.21.15.6:0/2846359768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74101a1e90 con 0x7f74101025f0 2024-09-12T00:02:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.294+0000 7f73ff7fe640 1 -- 172.21.15.6:0/2846359768 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74080044f0 con 0x7f74101025f0 2024-09-12T00:02:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.294+0000 7f73ff7fe640 1 -- 172.21.15.6:0/2846359768 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7408030bd0 con 0x7f74101025f0 2024-09-12T00:02:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.294+0000 7f7414d6d640 1 -- 172.21.15.6:0/2846359768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74101a2350 con 0x7f74101025f0 2024-09-12T00:02:04.298 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:04 smithi039 ceph-mon[34543]: pgmap v441: 129 pgs: 129 active+clean; 2.0 GiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:02:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.296+0000 7f73ff7fe640 1 -- 172.21.15.6:0/2846359768 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f7408004040 con 0x7f74101025f0 2024-09-12T00:02:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.297+0000 7f7417beb740 1 Processor -- start 2024-09-12T00:02:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.297+0000 7f7417beb740 1 -- start start 2024-09-12T00:02:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.297+0000 7f7417beb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030cc9a0 0x55d3030ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.297+0000 7f7417beb740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.297+0000 7f7417beb740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 0x55d3030d4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.297+0000 7f7417beb740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d3030302f0 con 0x55d3030d2370 2024-09-12T00:02:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.297+0000 7f7417beb740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d302fd8270 con 0x55d3030cd2e0 2024-09-12T00:02:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.297+0000 7f7417beb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d30302c2b0 con 0x55d3030cc9a0 2024-09-12T00:02:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.297+0000 7f73ff7fe640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73f80a2c00 0x7f73f80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740ed9d640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73f80a2c00 0x7f73f80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 0x55d3030d4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 0x55d3030d4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54700/0 (socket says 172.21.15.6:54700) 2024-09-12T00:02:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740dd9b640 1 -- 172.21.15.6:0/252078523 learned_addr learned my addr 172.21.15.6:0/252078523 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f73ff7fe640 1 -- 172.21.15.6:0/2846359768 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f74080f0730 con 0x7f74101025f0 2024-09-12T00:02:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740e59c640 1 --2- 172.21.15.6:0/252078523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740dd9b640 1 --2- 172.21.15.6:0/252078523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030cc9a0 0x55d3030ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740e59c640 1 -- 172.21.15.6:0/252078523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030cc9a0 msgr2=0x55d3030ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740e59c640 1 --2- 172.21.15.6:0/252078523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030cc9a0 0x55d3030ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740e59c640 1 -- 172.21.15.6:0/252078523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 msgr2=0x55d3030d4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740e59c640 1 --2- 172.21.15.6:0/252078523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 0x55d3030d4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740e59c640 1 -- 172.21.15.6:0/252078523 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d302fd7340 con 0x55d3030cd2e0 2024-09-12T00:02:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740dd9b640 1 --2- 172.21.15.6:0/252078523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 0x55d3030d4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740ed9d640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73f80a2c00 0x7f73f80a50c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7408031040 tx=0x7f7408087d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f740e59c640 1 --2- 172.21.15.6:0/252078523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030d1da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7400009fa0 tx=0x7f74000118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0ca0d51df3b402d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f73fcff9640 1 -- 172.21.15.6:0/252078523 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7400004310 con 0x55d3030cd2e0 2024-09-12T00:02:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f73fcff9640 1 -- 172.21.15.6:0/252078523 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74000044b0 con 0x55d3030cd2e0 2024-09-12T00:02:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.298+0000 7f73fcff9640 1 -- 172.21.15.6:0/252078523 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74000035f0 con 0x55d3030cd2e0 2024-09-12T00:02:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.299+0000 7f7417beb740 1 -- 172.21.15.6:0/252078523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 msgr2=0x55d3030d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.299+0000 7f7417beb740 1 --2- 172.21.15.6:0/252078523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030d1da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7400009fa0 tx=0x7f74000118d0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.299+0000 7f7417beb740 1 -- 172.21.15.6:0/252078523 shutdown_connections 2024-09-12T00:02:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.299+0000 7f7417beb740 1 --2- 172.21.15.6:0/252078523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 0x55d3030d4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.299+0000 7f7417beb740 1 --2- 172.21.15.6:0/252078523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030d1da0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.299+0000 7f7417beb740 1 --2- 172.21.15.6:0/252078523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030cc9a0 0x55d3030ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.299+0000 7f7417beb740 1 -- 172.21.15.6:0/252078523 >> 172.21.15.6:0/252078523 conn(0x55d3030c8010 msgr2=0x55d3030c8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.299+0000 7f7417beb740 1 -- 172.21.15.6:0/252078523 shutdown_connections 2024-09-12T00:02:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.299+0000 7f7417beb740 1 -- 172.21.15.6:0/252078523 wait complete. 2024-09-12T00:02:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f7417beb740 1 -- start start 2024-09-12T00:02:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f7417beb740 1 Processor -- start 2024-09-12T00:02:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f7417beb740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cc9a0 0x55d3030d6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f7417beb740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cd2e0 0x55d3030d7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f7417beb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030d2370 0x55d3030de150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f7417beb740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d3030d5340 con 0x55d3030cd2e0 2024-09-12T00:02:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f7417beb740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d302fb9290 con 0x55d3030cc9a0 2024-09-12T00:02:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f7417beb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d3030d54c0 con 0x55d3030d2370 2024-09-12T00:02:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f7417beb740 10 client.0 _ll_register_callbacks cb 0x55d302fea140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f740e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cd2e0 0x55d3030d7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f740e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cd2e0 0x55d3030d7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54716/0 (socket says 172.21.15.6:54716) 2024-09-12T00:02:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f740e59c640 1 -- 172.21.15.6:0/72606161 learned_addr learned my addr 172.21.15.6:0/72606161 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f740dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030d2370 0x55d3030de150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f740dd9b640 1 --2- 172.21.15.6:0/72606161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cc9a0 0x55d3030d6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f740dd9b640 1 -- 172.21.15.6:0/72606161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cc9a0 msgr2=0x55d3030d6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f740dd9b640 1 --2- 172.21.15.6:0/72606161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cc9a0 0x55d3030d6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f740dd9b640 1 -- 172.21.15.6:0/72606161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cd2e0 msgr2=0x55d3030d7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f740dd9b640 1 --2- 172.21.15.6:0/72606161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cd2e0 0x55d3030d7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.300+0000 7f740dd9b640 1 -- 172.21.15.6:0/72606161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d302d43210 con 0x55d3030d2370 2024-09-12T00:02:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.301+0000 7f740dd9b640 1 --2- 172.21.15.6:0/72606161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030d2370 0x55d3030de150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7404009730 tx=0x7f7404004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de10c02f43335081 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.301+0000 7f73f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:02:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.301+0000 7f73f5ffb640 1 -- 172.21.15.6:0/72606161 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404012050 con 0x55d3030d2370 2024-09-12T00:02:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.301+0000 7f73f5ffb640 1 -- 172.21.15.6:0/72606161 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f74040121f0 con 0x55d3030d2370 2024-09-12T00:02:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.301+0000 7f7417beb740 1 -- 172.21.15.6:0/72606161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74000044b0 con 0x55d3030d2370 2024-09-12T00:02:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.301+0000 7f73f5ffb640 1 -- 172.21.15.6:0/72606161 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f74040123f0 con 0x55d3030d2370 2024-09-12T00:02:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.301+0000 7f7417beb740 10 client.25210 fetch_fsmap learned FSMap version 30 2024-09-12T00:02:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.301+0000 7f7417beb740 1 -- 172.21.15.6:0/72606161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d302e0f620 con 0x55d3030d2370 2024-09-12T00:02:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.301+0000 7f73f5ffb640 1 -- 172.21.15.6:0/72606161 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74000044b0 con 0x55d3030d2370 2024-09-12T00:02:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.301+0000 7f73f5ffb640 1 -- 172.21.15.6:0/72606161 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f74040047a0 con 0x55d3030d2370 2024-09-12T00:02:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.302+0000 7f7417beb740 10 client.25210 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:02:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.302+0000 7f7417beb740 10 client.25210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:02:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.302+0000 7f7417beb740 20 client.25210 populate_metadata read hostname 'smithi006' 2024-09-12T00:02:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.302+0000 7f7417beb740 1 --2- 172.21.15.6:0/72606161 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d3030e28a0 0x55d3030e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.302+0000 7f7417beb740 4 client.25210 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.302+0000 7f7417beb740 1 -- 172.21.15.6:0/72606161 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d30303da20 con 0x55d3030e28a0 2024-09-12T00:02:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.302+0000 7f740e59c640 1 --2- 172.21.15.6:0/72606161 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d3030e28a0 0x55d3030e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.302+0000 7f73f5ffb640 10 client.25210 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.302+0000 7f740e59c640 1 --2- 172.21.15.6:0/72606161 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d3030e28a0 0x55d3030e4cf0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=369433531d1b0a46 server_cookie=4a2ce9da6ca7bb58 in_seq=0 out_seq=0 2024-09-12T00:02:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f73f5ffb640 1 -- 172.21.15.6:0/72606161 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d30303da20 con 0x55d3030e28a0 2024-09-12T00:02:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f73f5ffb640 10 client.25210 handle_command_reply: tid=0 2024-09-12T00:02:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f7417beb740 1 client.25210 shutdown 2024-09-12T00:02:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f7417beb740 1 -- 172.21.15.6:0/72606161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030d2370 msgr2=0x55d3030de150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f7417beb740 1 --2- 172.21.15.6:0/72606161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030d2370 0x55d3030de150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7404009730 tx=0x7f7404004730 comp rx=0 tx=0).stop 2024-09-12T00:02:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f7417beb740 1 -- 172.21.15.6:0/72606161 shutdown_connections 2024-09-12T00:02:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f7417beb740 1 --2- 172.21.15.6:0/72606161 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d3030e28a0 0x55d3030e4cf0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f7417beb740 1 --2- 172.21.15.6:0/72606161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030d2370 0x55d3030de150 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f73f5ffb640 0 client.25210 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f7417beb740 1 --2- 172.21.15.6:0/72606161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cd2e0 0x55d3030d7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f7417beb740 1 --2- 172.21.15.6:0/72606161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cc9a0 0x55d3030d6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f7417beb740 1 -- 172.21.15.6:0/72606161 >> 172.21.15.6:0/72606161 conn(0x55d3030c8010 msgr2=0x55d3030c9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f7417beb740 1 -- 172.21.15.6:0/72606161 shutdown_connections 2024-09-12T00:02:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f7417beb740 1 -- 172.21.15.6:0/72606161 wait complete. 2024-09-12T00:02:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.303+0000 7f7417beb740 20 client.25210 trim_cache size 0 max 16384 2024-09-12T00:02:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.318+0000 7f7417beb740 1 Processor -- start 2024-09-12T00:02:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.318+0000 7f7417beb740 1 -- start start 2024-09-12T00:02:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.318+0000 7f7417beb740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cc9a0 0x55d3030c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.318+0000 7f7417beb740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030de110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.318+0000 7f7417beb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030d2370 0x55d3030c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f7417beb740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f74101aca70 con 0x55d3030cc9a0 2024-09-12T00:02:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f7417beb740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f74101ae640 con 0x55d3030cd2e0 2024-09-12T00:02:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f7417beb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f74101ad140 con 0x55d3030d2370 2024-09-12T00:02:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f740dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cc9a0 0x55d3030c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f740dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cc9a0 0x55d3030c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54728/0 (socket says 172.21.15.6:54728) 2024-09-12T00:02:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f740dd9b640 1 -- 172.21.15.6:0/2356380011 learned_addr learned my addr 172.21.15.6:0/2356380011 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f740e59c640 1 --2- 172.21.15.6:0/2356380011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030de110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f740dd9b640 1 --2- 172.21.15.6:0/2356380011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030d2370 0x55d3030c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f740dd9b640 1 -- 172.21.15.6:0/2356380011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030d2370 msgr2=0x55d3030c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f740dd9b640 1 --2- 172.21.15.6:0/2356380011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030d2370 0x55d3030c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f740dd9b640 1 -- 172.21.15.6:0/2356380011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 msgr2=0x55d3030de110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f740dd9b640 1 --2- 172.21.15.6:0/2356380011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030de110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f740dd9b640 1 -- 172.21.15.6:0/2356380011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3030e5370 con 0x55d3030cc9a0 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f740dd9b640 1 --2- 172.21.15.6:0/2356380011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cc9a0 0x55d3030c70b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f740400a010 tx=0x7f74040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09d6c611bfabffc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f73f7fff640 1 -- 172.21.15.6:0/2356380011 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404033070 con 0x55d3030cc9a0 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f73f7fff640 1 -- 172.21.15.6:0/2356380011 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74040047a0 con 0x55d3030cc9a0 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.319+0000 7f73f7fff640 1 -- 172.21.15.6:0/2356380011 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404020b80 con 0x55d3030cc9a0 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.320+0000 7f7417beb740 1 -- 172.21.15.6:0/2356380011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cc9a0 msgr2=0x55d3030c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.320+0000 7f7417beb740 1 --2- 172.21.15.6:0/2356380011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cc9a0 0x55d3030c70b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f740400a010 tx=0x7f74040046c0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.320+0000 7f7417beb740 1 -- 172.21.15.6:0/2356380011 shutdown_connections 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.320+0000 7f7417beb740 1 --2- 172.21.15.6:0/2356380011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030d2370 0x55d3030c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.320+0000 7f7417beb740 1 --2- 172.21.15.6:0/2356380011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030de110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.320+0000 7f7417beb740 1 --2- 172.21.15.6:0/2356380011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030cc9a0 0x55d3030c70b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.320+0000 7f7417beb740 1 -- 172.21.15.6:0/2356380011 >> 172.21.15.6:0/2356380011 conn(0x55d3030c8010 msgr2=0x55d3030c69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.320+0000 7f7417beb740 1 -- 172.21.15.6:0/2356380011 shutdown_connections 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.320+0000 7f7417beb740 1 -- 172.21.15.6:0/2356380011 wait complete. 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.320+0000 7f7417beb740 1 -- start start 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f7417beb740 1 Processor -- start 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f7417beb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030cc9a0 0x55d3030dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f7417beb740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030dc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f7417beb740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 0x55d3030dd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f7417beb740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f74101adee0 con 0x55d3030d2370 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f7417beb740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f74101ad810 con 0x55d3030cd2e0 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f7417beb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f74101aaa50 con 0x55d3030cc9a0 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f7417beb740 10 client.0 _ll_register_callbacks cb 0x7f7404009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f740dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 0x55d3030dd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f740dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 0x55d3030dd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54738/0 (socket says 172.21.15.6:54738) 2024-09-12T00:02:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f740dd9b640 1 -- 172.21.15.6:0/4014801688 learned_addr learned my addr 172.21.15.6:0/4014801688 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f740e59c640 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030dc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f740dd9b640 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030cc9a0 0x55d3030dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f740dd9b640 1 -- 172.21.15.6:0/4014801688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030cc9a0 msgr2=0x55d3030dbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f740dd9b640 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030cc9a0 0x55d3030dbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f740dd9b640 1 -- 172.21.15.6:0/4014801688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 msgr2=0x55d3030dc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f740dd9b640 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030dc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f740dd9b640 1 -- 172.21.15.6:0/4014801688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3030dd6e0 con 0x55d3030d2370 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f740dd9b640 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 0x55d3030dd0d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55d3030db150 tx=0x7f7404009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d898da3ad55f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.321+0000 7f73f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f73f5ffb640 1 -- 172.21.15.6:0/4014801688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404033060 con 0x55d3030d2370 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f7417beb740 1 -- 172.21.15.6:0/4014801688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74040047a0 con 0x55d3030d2370 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f73f5ffb640 1 -- 172.21.15.6:0/4014801688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f7404004d40 con 0x55d3030d2370 2024-09-12T00:02:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f73f5ffb640 1 -- 172.21.15.6:0/4014801688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7404021b60 con 0x55d3030d2370 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f7417beb740 10 client.15561 fetch_fsmap learned FSMap version 30 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f7417beb740 1 -- 172.21.15.6:0/4014801688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d30314d920 con 0x55d3030d2370 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f73f5ffb640 1 -- 172.21.15.6:0/4014801688 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74040047a0 con 0x55d3030d2370 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f73f5ffb640 1 -- 172.21.15.6:0/4014801688 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f740402e430 con 0x55d3030d2370 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f7417beb740 10 client.15561 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f7417beb740 10 client.15561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f7417beb740 20 client.15561 populate_metadata read hostname 'smithi006' 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f7417beb740 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d30314e390 0x55d3031507b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f7417beb740 4 client.15561 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.322+0000 7f7417beb740 1 -- 172.21.15.6:0/4014801688 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d303037d70 con 0x55d30314e390 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.323+0000 7f740e59c640 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d30314e390 0x55d3031507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.323+0000 7f740e59c640 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d30314e390 0x55d3031507b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94051ef46854738d server_cookie=61de01abe508eab4 in_seq=0 out_seq=0 2024-09-12T00:02:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.323+0000 7f73f5ffb640 10 client.15561 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.338+0000 7f73f5ffb640 1 -- 172.21.15.6:0/4014801688 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d303037d70 con 0x55d30314e390 2024-09-12T00:02:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.338+0000 7f73f5ffb640 10 client.15561 handle_command_reply: tid=0 2024-09-12T00:02:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.338+0000 7f7417beb740 1 client.15561 shutdown 2024-09-12T00:02:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.339+0000 7f7417beb740 1 -- 172.21.15.6:0/4014801688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 msgr2=0x55d3030dd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.339+0000 7f7417beb740 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 0x55d3030dd0d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55d3030db150 tx=0x7f7404009f50 comp rx=0 tx=0).stop 2024-09-12T00:02:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.339+0000 7f7417beb740 1 -- 172.21.15.6:0/4014801688 shutdown_connections 2024-09-12T00:02:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.339+0000 7f7417beb740 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3030d2370 0x55d3030dd0d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.339+0000 7f7417beb740 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3030cd2e0 0x55d3030dc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.339+0000 7f7417beb740 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d30314e390 0x55d3031507b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.339+0000 7f7417beb740 1 --2- 172.21.15.6:0/4014801688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3030cc9a0 0x55d3030dbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.339+0000 7f7417beb740 1 -- 172.21.15.6:0/4014801688 >> 172.21.15.6:0/4014801688 conn(0x55d3030c8010 msgr2=0x55d3030c71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.339+0000 7f73f5ffb640 0 client.15561 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.339+0000 7f7417beb740 1 -- 172.21.15.6:0/4014801688 shutdown_connections 2024-09-12T00:02:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.339+0000 7f7417beb740 1 -- 172.21.15.6:0/4014801688 wait complete. 2024-09-12T00:02:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.339+0000 7f7417beb740 20 client.15561 trim_cache size 0 max 16384 2024-09-12T00:02:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:02:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:02:04.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:02:04.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:02:04.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.340+0000 7f7414d6d640 1 -- 172.21.15.6:0/2846359768 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73f80a2c00 msgr2=0x7f73f80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.340+0000 7f7414d6d640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73f80a2c00 0x7f73f80a50c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7408031040 tx=0x7f7408087d80 comp rx=0 tx=0).stop 2024-09-12T00:02:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.340+0000 7f7414d6d640 1 -- 172.21.15.6:0/2846359768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74101025f0 msgr2=0x7f7410109f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.340+0000 7f7414d6d640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74101025f0 0x7f7410109f40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7408031970 tx=0x7f7408003ba0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.340+0000 7f7414d6d640 1 -- 172.21.15.6:0/2846359768 shutdown_connections 2024-09-12T00:02:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.340+0000 7f7414d6d640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f73f80a2c00 0x7f73f80a50c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.340+0000 7f7414d6d640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74101025f0 0x7f7410109f40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.340+0000 7f7414d6d640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7410101c30 0x7f7410109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.340+0000 7f7414d6d640 1 --2- 172.21.15.6:0/2846359768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7410100a40 0x7f741010b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.340+0000 7f7414d6d640 1 -- 172.21.15.6:0/2846359768 >> 172.21.15.6:0/2846359768 conn(0x7f74100fc1c0 msgr2=0x7f7410105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.340+0000 7f7414d6d640 1 -- 172.21.15.6:0/2846359768 shutdown_connections 2024-09-12T00:02:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:04.340+0000 7f7414d6d640 1 -- 172.21.15.6:0/2846359768 wait complete. 2024-09-12T00:02:04.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:04 smithi006 ceph-mon[30947]: pgmap v441: 129 pgs: 129 active+clean; 2.0 GiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:02:04.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:04 smithi134 ceph-mon[34893]: pgmap v441: 129 pgs: 129 active+clean; 2.0 GiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:02:06.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:06 smithi039 ceph-mon[34543]: pgmap v442: 129 pgs: 129 active+clean; 2.0 GiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:02:06.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:06 smithi006 ceph-mon[30947]: pgmap v442: 129 pgs: 129 active+clean; 2.0 GiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:02:06.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:06 smithi134 ceph-mon[34893]: pgmap v442: 129 pgs: 129 active+clean; 2.0 GiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:02:08.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:08 smithi039 ceph-mon[34543]: pgmap v443: 129 pgs: 129 active+clean; 2.1 GiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:02:08.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:08 smithi006 ceph-mon[30947]: pgmap v443: 129 pgs: 129 active+clean; 2.1 GiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:02:08.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:08 smithi134 ceph-mon[34893]: pgmap v443: 129 pgs: 129 active+clean; 2.1 GiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:02:10.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:10 smithi039 ceph-mon[34543]: pgmap v444: 129 pgs: 129 active+clean; 2.2 GiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:02:10.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:10 smithi006 ceph-mon[30947]: pgmap v444: 129 pgs: 129 active+clean; 2.2 GiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:02:10.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:10 smithi134 ceph-mon[34893]: pgmap v444: 129 pgs: 129 active+clean; 2.2 GiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:02:12.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:12 smithi039 ceph-mon[34543]: pgmap v445: 129 pgs: 129 active+clean; 2.2 GiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:02:12.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:12 smithi006 ceph-mon[30947]: pgmap v445: 129 pgs: 129 active+clean; 2.2 GiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:02:12.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:12 smithi134 ceph-mon[34893]: pgmap v445: 129 pgs: 129 active+clean; 2.2 GiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:02:14.303 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:14 smithi039 ceph-mon[34543]: pgmap v446: 129 pgs: 129 active+clean; 2.3 GiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:02:14.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:14 smithi006 ceph-mon[30947]: pgmap v446: 129 pgs: 129 active+clean; 2.3 GiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:02:14.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:14 smithi134 ceph-mon[34893]: pgmap v446: 129 pgs: 129 active+clean; 2.3 GiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:02:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:16 smithi039 ceph-mon[34543]: pgmap v447: 129 pgs: 129 active+clean; 2.3 GiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:02:16.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:16 smithi006 ceph-mon[30947]: pgmap v447: 129 pgs: 129 active+clean; 2.3 GiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:02:16.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:16 smithi134 ceph-mon[34893]: pgmap v447: 129 pgs: 129 active+clean; 2.3 GiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:02:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.439+0000 7ff9f77fd640 1 -- 172.21.15.6:0/1596178830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f0101c30 msgr2=0x7ff9f01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.439+0000 7ff9f77fd640 1 --2- 172.21.15.6:0/1596178830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f0101c30 0x7ff9f01020b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009900 tx=0x7ff9e002a410 comp rx=0 tx=0).stop 2024-09-12T00:02:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.439+0000 7ff9f77fd640 1 -- 172.21.15.6:0/1596178830 shutdown_connections 2024-09-12T00:02:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.439+0000 7ff9f77fd640 1 --2- 172.21.15.6:0/1596178830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f01025f0 0x7ff9f0108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.439+0000 7ff9f77fd640 1 --2- 172.21.15.6:0/1596178830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f0101c30 0x7ff9f01020b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.439+0000 7ff9f77fd640 1 --2- 172.21.15.6:0/1596178830 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9f0100a40 0x7ff9f0100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.439+0000 7ff9f77fd640 1 -- 172.21.15.6:0/1596178830 >> 172.21.15.6:0/1596178830 conn(0x7ff9f00fc1c0 msgr2=0x7ff9f00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.439+0000 7ff9f77fd640 1 -- 172.21.15.6:0/1596178830 shutdown_connections 2024-09-12T00:02:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.439+0000 7ff9f77fd640 1 -- 172.21.15.6:0/1596178830 wait complete. 2024-09-12T00:02:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.439+0000 7ff9f77fd640 1 Processor -- start 2024-09-12T00:02:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f77fd640 1 -- start start 2024-09-12T00:02:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f77fd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f0100a40 0x7ff9f0197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f77fd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9f0101c30 0x7ff9f0198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f77fd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f01025f0 0x7ff9f019f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f77fd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f010d6c0 con 0x7ff9f0100a40 2024-09-12T00:02:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f77fd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f010d540 con 0x7ff9f0101c30 2024-09-12T00:02:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f77fd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f010d840 con 0x7ff9f01025f0 2024-09-12T00:02:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f5599640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f0100a40 0x7ff9f0197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f5599640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f0100a40 0x7ff9f0197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52860/0 (socket says 172.21.15.6:52860) 2024-09-12T00:02:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f5599640 1 -- 172.21.15.6:0/3461379703 learned_addr learned my addr 172.21.15.6:0/3461379703 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f5d9a640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f01025f0 0x7ff9f019f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9f0101c30 0x7ff9f0198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f5599640 1 -- 172.21.15.6:0/3461379703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f01025f0 msgr2=0x7ff9f019f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f5599640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f01025f0 0x7ff9f019f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f5599640 1 -- 172.21.15.6:0/3461379703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9f0101c30 msgr2=0x7ff9f0198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f5599640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9f0101c30 0x7ff9f0198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f5599640 1 -- 172.21.15.6:0/3461379703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f019f9e0 con 0x7ff9f0100a40 2024-09-12T00:02:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.440+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9f0101c30 0x7ff9f0198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.441+0000 7ff9f5599640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f0100a40 0x7ff9f0197dc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00e9c0 tx=0x7ff9ec00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.441+0000 7ff9e67fc640 1 -- 172.21.15.6:0/3461379703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec00cd80 con 0x7ff9f0100a40 2024-09-12T00:02:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.441+0000 7ff9e67fc640 1 -- 172.21.15.6:0/3461379703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9ec0035f0 con 0x7ff9f0100a40 2024-09-12T00:02:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.441+0000 7ff9f77fd640 1 -- 172.21.15.6:0/3461379703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f019fcd0 con 0x7ff9f0100a40 2024-09-12T00:02:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.441+0000 7ff9e67fc640 1 -- 172.21.15.6:0/3461379703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec010690 con 0x7ff9f0100a40 2024-09-12T00:02:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.441+0000 7ff9f77fd640 1 -- 172.21.15.6:0/3461379703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f01a01c0 con 0x7ff9f0100a40 2024-09-12T00:02:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.444+0000 7ff9e67fc640 1 -- 172.21.15.6:0/3461379703 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7ff9ec0037a0 con 0x7ff9f0100a40 2024-09-12T00:02:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.444+0000 7ff9fa680740 1 Processor -- start 2024-09-12T00:02:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.444+0000 7ff9fa680740 1 -- start start 2024-09-12T00:02:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9fa680740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455d9a0 0x561ce455dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9fa680740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455e2e0 0x561ce4562da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9fa680740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce4563370 0x561ce4565830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9fa680740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561ce44c12f0 con 0x561ce455e2e0 2024-09-12T00:02:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9fa680740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561ce4469270 con 0x561ce455d9a0 2024-09-12T00:02:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9fa680740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561ce44bd2b0 con 0x561ce4563370 2024-09-12T00:02:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9e67fc640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff9dc0a2c00 0x7ff9dc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f5599640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455e2e0 0x561ce4562da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f5599640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455e2e0 0x561ce4562da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52864/0 (socket says 172.21.15.6:52864) 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f5599640 1 -- 172.21.15.6:0/158771465 learned_addr learned my addr 172.21.15.6:0/158771465 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f5d9a640 1 --2- 172.21.15.6:0/158771465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455d9a0 0x561ce455dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/158771465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce4563370 0x561ce4565830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f5d9a640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff9dc0a2c00 0x7ff9dc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9e67fc640 1 -- 172.21.15.6:0/3461379703 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7ff9ec0cf7d0 con 0x7ff9f0100a40 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f5d9a640 1 -- 172.21.15.6:0/158771465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce4563370 msgr2=0x561ce4565830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f5d9a640 1 --2- 172.21.15.6:0/158771465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce4563370 0x561ce4565830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f5d9a640 1 -- 172.21.15.6:0/158771465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455e2e0 msgr2=0x561ce4562da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f5d9a640 1 --2- 172.21.15.6:0/158771465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455e2e0 0x561ce4562da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f5d9a640 1 -- 172.21.15.6:0/158771465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce4468340 con 0x561ce455d9a0 2024-09-12T00:02:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/158771465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce4563370 0x561ce4565830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.445+0000 7ff9f5599640 1 --2- 172.21.15.6:0/158771465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455e2e0 0x561ce4562da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.446+0000 7ff9f5d9a640 1 --2- 172.21.15.6:0/158771465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455d9a0 0x561ce455dda0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80129b0 tx=0x7ff9e8012e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab95a5582ce090a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.446+0000 7ff9f5d9a640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff9dc0a2c00 0x7ff9dc0a50c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9e801b000 tx=0x7ff9e801d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.446+0000 7ff9db7fe640 1 -- 172.21.15.6:0/158771465 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8004d20 con 0x561ce455d9a0 2024-09-12T00:02:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.446+0000 7ff9db7fe640 1 -- 172.21.15.6:0/158771465 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9e800cca0 con 0x561ce455d9a0 2024-09-12T00:02:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.446+0000 7ff9db7fe640 1 -- 172.21.15.6:0/158771465 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8005610 con 0x561ce455d9a0 2024-09-12T00:02:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.447+0000 7ff9fa680740 1 -- 172.21.15.6:0/158771465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455d9a0 msgr2=0x561ce455dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.447+0000 7ff9fa680740 1 --2- 172.21.15.6:0/158771465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455d9a0 0x561ce455dda0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80129b0 tx=0x7ff9e8012e70 comp rx=0 tx=0).stop 2024-09-12T00:02:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.447+0000 7ff9fa680740 1 -- 172.21.15.6:0/158771465 shutdown_connections 2024-09-12T00:02:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.447+0000 7ff9fa680740 1 --2- 172.21.15.6:0/158771465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce4563370 0x561ce4565830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.447+0000 7ff9fa680740 1 --2- 172.21.15.6:0/158771465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455e2e0 0x561ce4562da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.447+0000 7ff9fa680740 1 --2- 172.21.15.6:0/158771465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455d9a0 0x561ce455dda0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.447+0000 7ff9fa680740 1 -- 172.21.15.6:0/158771465 >> 172.21.15.6:0/158771465 conn(0x561ce4559010 msgr2=0x561ce4559410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.447+0000 7ff9fa680740 1 -- 172.21.15.6:0/158771465 shutdown_connections 2024-09-12T00:02:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.447+0000 7ff9fa680740 1 -- 172.21.15.6:0/158771465 wait complete. 2024-09-12T00:02:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.447+0000 7ff9fa680740 1 -- start start 2024-09-12T00:02:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.447+0000 7ff9fa680740 1 Processor -- start 2024-09-12T00:02:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9fa680740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 0x561ce4567b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9fa680740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455e2e0 0x561ce45680a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9fa680740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce4563370 0x561ce456f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9fa680740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561ce4566280 con 0x561ce455d9a0 2024-09-12T00:02:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9fa680740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561ce444a290 con 0x561ce455e2e0 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9fa680740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561ce4566400 con 0x561ce4563370 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9fa680740 10 client.0 _ll_register_callbacks cb 0x561ce447b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9f5599640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 0x561ce4567b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9f5599640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 0x561ce4567b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52868/0 (socket says 172.21.15.6:52868) 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9f5599640 1 -- 172.21.15.6:0/1551338841 learned_addr learned my addr 172.21.15.6:0/1551338841 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455e2e0 0x561ce45680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9f5d9a640 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce4563370 0x561ce456f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9f5599640 1 -- 172.21.15.6:0/1551338841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce4563370 msgr2=0x561ce456f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9f5599640 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce4563370 0x561ce456f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9f5599640 1 -- 172.21.15.6:0/1551338841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455e2e0 msgr2=0x561ce45680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9f5599640 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455e2e0 0x561ce45680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9f5599640 1 -- 172.21.15.6:0/1551338841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce41d4210 con 0x561ce455d9a0 2024-09-12T00:02:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9f5599640 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 0x561ce4567b60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec020000 tx=0x7ff9ec0097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4e4a132a8ac75e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.448+0000 7ff9d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:02:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9d8ff9640 1 -- 172.21.15.6:0/1551338841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec003b30 con 0x561ce455d9a0 2024-09-12T00:02:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9d8ff9640 1 -- 172.21.15.6:0/1551338841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7ff9ec099f40 con 0x561ce455d9a0 2024-09-12T00:02:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9fa680740 1 -- 172.21.15.6:0/1551338841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e800cca0 con 0x561ce455d9a0 2024-09-12T00:02:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9d8ff9640 1 -- 172.21.15.6:0/1551338841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff9ec0b9050 con 0x561ce455d9a0 2024-09-12T00:02:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9fa680740 10 client.15573 fetch_fsmap learned FSMap version 30 2024-09-12T00:02:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9fa680740 1 -- 172.21.15.6:0/1551338841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561ce42a0620 con 0x561ce455d9a0 2024-09-12T00:02:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9d8ff9640 1 -- 172.21.15.6:0/1551338841 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9e800cca0 con 0x561ce455d9a0 2024-09-12T00:02:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9d8ff9640 1 -- 172.21.15.6:0/1551338841 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7ff9ec0a4b00 con 0x561ce455d9a0 2024-09-12T00:02:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9fa680740 10 client.15573 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:02:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9fa680740 10 client.15573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:02:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9fa680740 20 client.15573 populate_metadata read hostname 'smithi006' 2024-09-12T00:02:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9fa680740 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ce45737f0 0x561ce4575c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9fa680740 4 client.15573 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.449+0000 7ff9fa680740 1 -- 172.21.15.6:0/1551338841 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ce44cea20 con 0x561ce45737f0 2024-09-12T00:02:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.450+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ce45737f0 0x561ce4575c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.450+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ce45737f0 0x561ce4575c50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab09dbc27c50ca5b server_cookie=1ba5454f103dd3d8 in_seq=0 out_seq=0 2024-09-12T00:02:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.450+0000 7ff9d8ff9640 10 client.15573 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:17.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9d8ff9640 1 -- 172.21.15.6:0/1551338841 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561ce44cea20 con 0x561ce45737f0 2024-09-12T00:02:17.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9d8ff9640 10 client.15573 handle_command_reply: tid=0 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9fa680740 1 client.15573 shutdown 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9fa680740 1 -- 172.21.15.6:0/1551338841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 msgr2=0x561ce4567b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9fa680740 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 0x561ce4567b60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec020000 tx=0x7ff9ec0097c0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9fa680740 1 -- 172.21.15.6:0/1551338841 shutdown_connections 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9fa680740 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ce45737f0 0x561ce4575c50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9fa680740 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce4563370 0x561ce456f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9fa680740 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455e2e0 0x561ce45680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9fa680740 1 --2- 172.21.15.6:0/1551338841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 0x561ce4567b60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9fa680740 1 -- 172.21.15.6:0/1551338841 >> 172.21.15.6:0/1551338841 conn(0x561ce4559010 msgr2=0x561ce455a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9d8ff9640 0 client.15573 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9fa680740 1 -- 172.21.15.6:0/1551338841 shutdown_connections 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9fa680740 1 -- 172.21.15.6:0/1551338841 wait complete. 2024-09-12T00:02:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.451+0000 7ff9fa680740 20 client.15573 trim_cache size 0 max 16384 2024-09-12T00:02:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9fa680740 1 Processor -- start 2024-09-12T00:02:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9fa680740 1 -- start start 2024-09-12T00:02:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9fa680740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce4559010 0x561ce45580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9fa680740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 0x561ce456f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9fa680740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce455e2e0 0x561ce455a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9fa680740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01aa880 con 0x561ce455d9a0 2024-09-12T00:02:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9fa680740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01ac450 con 0x561ce4559010 2024-09-12T00:02:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9fa680740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01aaf50 con 0x561ce455e2e0 2024-09-12T00:02:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9f4d98640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 0x561ce456f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9f4d98640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 0x561ce456f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52870/0 (socket says 172.21.15.6:52870) 2024-09-12T00:02:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9f4d98640 1 -- 172.21.15.6:0/593271951 learned_addr learned my addr 172.21.15.6:0/593271951 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9f5d9a640 1 --2- 172.21.15.6:0/593271951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce455e2e0 0x561ce455a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.466+0000 7ff9f5599640 1 --2- 172.21.15.6:0/593271951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce4559010 0x561ce45580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.467+0000 7ff9f4d98640 1 -- 172.21.15.6:0/593271951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce455e2e0 msgr2=0x561ce455a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.467+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/593271951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce455e2e0 0x561ce455a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.467+0000 7ff9f4d98640 1 -- 172.21.15.6:0/593271951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce4559010 msgr2=0x561ce45580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.467+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/593271951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce4559010 0x561ce45580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.467+0000 7ff9f4d98640 1 -- 172.21.15.6:0/593271951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce4558e30 con 0x561ce455d9a0 2024-09-12T00:02:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.467+0000 7ff9f5d9a640 1 --2- 172.21.15.6:0/593271951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce455e2e0 0x561ce455a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.467+0000 7ff9f5599640 1 --2- 172.21.15.6:0/593271951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce4559010 0x561ce45580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.467+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/593271951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 0x561ce456f0a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0005940 tx=0x7ff9e00058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f361a06553b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.467+0000 7ff9daffd640 1 -- 172.21.15.6:0/593271951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0035040 con 0x561ce455d9a0 2024-09-12T00:02:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.467+0000 7ff9daffd640 1 -- 172.21.15.6:0/593271951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9e004a070 con 0x561ce455d9a0 2024-09-12T00:02:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.467+0000 7ff9daffd640 1 -- 172.21.15.6:0/593271951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0004920 con 0x561ce455d9a0 2024-09-12T00:02:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 -- 172.21.15.6:0/593271951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 msgr2=0x561ce456f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 --2- 172.21.15.6:0/593271951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 0x561ce456f0a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0005940 tx=0x7ff9e00058b0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 -- 172.21.15.6:0/593271951 shutdown_connections 2024-09-12T00:02:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 --2- 172.21.15.6:0/593271951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce455e2e0 0x561ce455a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 --2- 172.21.15.6:0/593271951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce455d9a0 0x561ce456f0a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 --2- 172.21.15.6:0/593271951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce4559010 0x561ce45580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 -- 172.21.15.6:0/593271951 >> 172.21.15.6:0/593271951 conn(0x561ce4562e90 msgr2=0x561ce45579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 -- 172.21.15.6:0/593271951 shutdown_connections 2024-09-12T00:02:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 -- 172.21.15.6:0/593271951 wait complete. 2024-09-12T00:02:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 -- start start 2024-09-12T00:02:17.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 Processor -- start 2024-09-12T00:02:17.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce4559010 0x561ce456c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.468+0000 7ff9fa680740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455d9a0 0x561ce456ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9fa680740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce455e2e0 0x561ce456dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9fa680740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01abcf0 con 0x561ce4559010 2024-09-12T00:02:17.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9fa680740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01ab620 con 0x561ce455d9a0 2024-09-12T00:02:17.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9fa680740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01a8860 con 0x561ce455e2e0 2024-09-12T00:02:17.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9fa680740 10 client.0 _ll_register_callbacks cb 0x7ff9ec0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:17.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9f5599640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce4559010 0x561ce456c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9f5599640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce4559010 0x561ce456c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52874/0 (socket says 172.21.15.6:52874) 2024-09-12T00:02:17.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9f5599640 1 -- 172.21.15.6:0/4094401684 learned_addr learned my addr 172.21.15.6:0/4094401684 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:17.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455d9a0 0x561ce456ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9f5d9a640 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce455e2e0 0x561ce456dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9f5599640 1 -- 172.21.15.6:0/4094401684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce455e2e0 msgr2=0x561ce456dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:17.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9f5599640 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce455e2e0 0x561ce456dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9f5599640 1 -- 172.21.15.6:0/4094401684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455d9a0 msgr2=0x561ce456ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:17.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9f5599640 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455d9a0 0x561ce456ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9f5599640 1 -- 172.21.15.6:0/4094401684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce456e4f0 con 0x561ce4559010 2024-09-12T00:02:17.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455d9a0 0x561ce456ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:17.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9f5599640 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce4559010 0x561ce456c990 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec099ef0 tx=0x7ff9ec09a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28725ffa38674da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:02:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9d8ff9640 1 -- 172.21.15.6:0/4094401684 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec003b30 con 0x561ce4559010 2024-09-12T00:02:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9d8ff9640 1 -- 172.21.15.6:0/4094401684 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7ff9ec097a10 con 0x561ce4559010 2024-09-12T00:02:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.469+0000 7ff9fa680740 1 -- 172.21.15.6:0/4094401684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e004a070 con 0x561ce4559010 2024-09-12T00:02:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.470+0000 7ff9d8ff9640 1 -- 172.21.15.6:0/4094401684 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff9ec09c340 con 0x561ce4559010 2024-09-12T00:02:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.470+0000 7ff9fa680740 10 client.15579 fetch_fsmap learned FSMap version 30 2024-09-12T00:02:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.470+0000 7ff9fa680740 1 -- 172.21.15.6:0/4094401684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561ce45de7e0 con 0x561ce4559010 2024-09-12T00:02:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.470+0000 7ff9d8ff9640 1 -- 172.21.15.6:0/4094401684 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9e004a070 con 0x561ce4559010 2024-09-12T00:02:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.470+0000 7ff9d8ff9640 1 -- 172.21.15.6:0/4094401684 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7ff9ec07aab0 con 0x561ce4559010 2024-09-12T00:02:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.470+0000 7ff9fa680740 10 client.15579 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:02:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.470+0000 7ff9fa680740 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:02:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.470+0000 7ff9fa680740 20 client.15579 populate_metadata read hostname 'smithi006' 2024-09-12T00:02:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.470+0000 7ff9fa680740 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ce4563370 0x561ce45e11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.470+0000 7ff9fa680740 4 client.15579 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:02:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.470+0000 7ff9fa680740 1 -- 172.21.15.6:0/4094401684 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ce44c8d70 con 0x561ce4563370 2024-09-12T00:02:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.470+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ce4563370 0x561ce45e11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.471+0000 7ff9d8ff9640 10 client.15579 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.471+0000 7ff9f4d98640 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ce4563370 0x561ce45e11e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=455e99baf6046ecf server_cookie=aa6149f808fc05a5 in_seq=0 out_seq=0 2024-09-12T00:02:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9d8ff9640 1 -- 172.21.15.6:0/4094401684 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ce44c8d70 con 0x561ce4563370 2024-09-12T00:02:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9d8ff9640 10 client.15579 handle_command_reply: tid=0 2024-09-12T00:02:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9fa680740 1 client.15579 shutdown 2024-09-12T00:02:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9fa680740 1 -- 172.21.15.6:0/4094401684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce4559010 msgr2=0x561ce456c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9fa680740 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce4559010 0x561ce456c990 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec099ef0 tx=0x7ff9ec09a150 comp rx=0 tx=0).stop 2024-09-12T00:02:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9fa680740 1 -- 172.21.15.6:0/4094401684 shutdown_connections 2024-09-12T00:02:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9fa680740 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561ce4563370 0x561ce45e11e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9fa680740 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561ce455e2e0 0x561ce456dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9fa680740 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ce455d9a0 0x561ce456ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9fa680740 1 --2- 172.21.15.6:0/4094401684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ce4559010 0x561ce456c990 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9d8ff9640 0 client.15579 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9fa680740 1 -- 172.21.15.6:0/4094401684 >> 172.21.15.6:0/4094401684 conn(0x561ce4562e90 msgr2=0x561ce45581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9fa680740 1 -- 172.21.15.6:0/4094401684 shutdown_connections 2024-09-12T00:02:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9fa680740 1 -- 172.21.15.6:0/4094401684 wait complete. 2024-09-12T00:02:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.488+0000 7ff9fa680740 20 client.15579 trim_cache size 0 max 16384 2024-09-12T00:02:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:02:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:02:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:02:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:02:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.489+0000 7ff9f77fd640 1 -- 172.21.15.6:0/3461379703 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff9dc0a2c00 msgr2=0x7ff9dc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.489+0000 7ff9f77fd640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff9dc0a2c00 0x7ff9dc0a50c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9e801b000 tx=0x7ff9e801d000 comp rx=0 tx=0).stop 2024-09-12T00:02:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.489+0000 7ff9f77fd640 1 -- 172.21.15.6:0/3461379703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f0100a40 msgr2=0x7ff9f0197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.489+0000 7ff9f77fd640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f0100a40 0x7ff9f0197dc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00e9c0 tx=0x7ff9ec00ee80 comp rx=0 tx=0).stop 2024-09-12T00:02:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.489+0000 7ff9f77fd640 1 -- 172.21.15.6:0/3461379703 shutdown_connections 2024-09-12T00:02:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.489+0000 7ff9f77fd640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff9dc0a2c00 0x7ff9dc0a50c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.489+0000 7ff9f77fd640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f01025f0 0x7ff9f019f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.489+0000 7ff9f77fd640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9f0101c30 0x7ff9f0198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.489+0000 7ff9f77fd640 1 --2- 172.21.15.6:0/3461379703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f0100a40 0x7ff9f0197dc0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.489+0000 7ff9f77fd640 1 -- 172.21.15.6:0/3461379703 >> 172.21.15.6:0/3461379703 conn(0x7ff9f00fc1c0 msgr2=0x7ff9f01050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.489+0000 7ff9f77fd640 1 -- 172.21.15.6:0/3461379703 shutdown_connections 2024-09-12T00:02:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:17.489+0000 7ff9f77fd640 1 -- 172.21.15.6:0/3461379703 wait complete. 2024-09-12T00:02:18.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:18 smithi039 ceph-mon[34543]: pgmap v448: 129 pgs: 129 active+clean; 2.4 GiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-09-12T00:02:18.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:18 smithi006 ceph-mon[30947]: pgmap v448: 129 pgs: 129 active+clean; 2.4 GiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-09-12T00:02:18.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:18 smithi134 ceph-mon[34893]: pgmap v448: 129 pgs: 129 active+clean; 2.4 GiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-09-12T00:02:20.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:20 smithi039 ceph-mon[34543]: pgmap v449: 129 pgs: 129 active+clean; 2.4 GiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-09-12T00:02:20.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:20 smithi006 ceph-mon[30947]: pgmap v449: 129 pgs: 129 active+clean; 2.4 GiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-09-12T00:02:20.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:20 smithi134 ceph-mon[34893]: pgmap v449: 129 pgs: 129 active+clean; 2.4 GiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-09-12T00:02:22.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:22 smithi039 ceph-mon[34543]: pgmap v450: 129 pgs: 129 active+clean; 2.5 GiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 27 op/s 2024-09-12T00:02:22.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:22 smithi006 ceph-mon[30947]: pgmap v450: 129 pgs: 129 active+clean; 2.5 GiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 27 op/s 2024-09-12T00:02:22.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:22 smithi134 ceph-mon[34893]: pgmap v450: 129 pgs: 129 active+clean; 2.5 GiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 27 op/s 2024-09-12T00:02:24.042 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:02:23 smithi006 sudo[90368]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:24.042 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:02:23 smithi006 sudo[90368]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:24.042 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:02:23 smithi006 sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:24.042 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:02:23 smithi006 sudo[90368]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:24.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:24 smithi039 ceph-mon[34543]: pgmap v451: 129 pgs: 129 active+clean; 2.5 GiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:02:24.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:24 smithi006 ceph-mon[30947]: pgmap v451: 129 pgs: 129 active+clean; 2.5 GiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:02:24.368 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:02:24 smithi006 sudo[90371]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:24.368 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:02:24 smithi006 sudo[90371]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:24.368 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:02:24 smithi006 sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:24.368 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:02:24 smithi006 sudo[90371]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:24 smithi134 ceph-mon[34893]: pgmap v451: 129 pgs: 129 active+clean; 2.5 GiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:02:25.044 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:02:24 smithi039 sudo[67400]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:25.044 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:02:24 smithi039 sudo[67400]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:25.044 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:02:24 smithi039 sudo[67400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:25.044 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:02:24 smithi039 sudo[67400]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:25.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:02:25.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:02:25.453 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:02:25 smithi134 sudo[68076]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:25.453 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:02:25 smithi134 sudo[68076]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:25.453 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:02:25 smithi134 sudo[68076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:25.454 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:02:25 smithi134 sudo[68076]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:25.543 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:02:25 smithi039 sudo[67404]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:25.544 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:02:25 smithi039 sudo[67404]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:25.544 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:02:25 smithi039 sudo[67404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:25.544 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:02:25 smithi039 sudo[67404]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:25.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:02:25.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:02:25.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:02:25.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:02:25.953 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:02:25 smithi134 sudo[68079]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:25.953 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:02:25 smithi134 sudo[68079]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:25.953 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:02:25 smithi134 sudo[68079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:25.953 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:02:25 smithi134 sudo[68079]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:26.368 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:02:26 smithi006 sudo[90374]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:26.368 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:02:26 smithi006 sudo[90374]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:26.368 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:02:26 smithi006 sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:26.369 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:02:26 smithi006 sudo[90374]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:26.868 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:02:26 smithi006 sudo[90377]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:26.868 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:02:26 smithi006 sudo[90377]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:26.868 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:02:26 smithi006 sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:26.868 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:02:26 smithi006 sudo[90377]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:26.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:26 smithi006 ceph-mon[30947]: pgmap v452: 129 pgs: 129 active+clean; 2.6 GiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:02:26.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:02:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:26 smithi134 ceph-mon[34893]: pgmap v452: 129 pgs: 129 active+clean; 2.6 GiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:02:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:02:27.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:26 smithi039 ceph-mon[34543]: pgmap v452: 129 pgs: 129 active+clean; 2.6 GiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:02:27.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:02:27.512 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:02:27 smithi039 sudo[67409]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:27.512 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:02:27 smithi039 sudo[67409]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:27.512 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:02:27 smithi039 sudo[67409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:27.512 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:02:27 smithi039 sudo[67409]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:27.793 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:02:27 smithi039 sudo[67412]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:27.794 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:02:27 smithi039 sudo[67412]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:27.794 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:02:27 smithi039 sudo[67412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:27.794 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:02:27 smithi039 sudo[67412]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:28.030 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:02:27 smithi134 sudo[68082]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:28.030 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:02:27 smithi134 sudo[68082]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:28.030 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:02:27 smithi134 sudo[68082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:28.030 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:02:27 smithi134 sudo[68082]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:28.453 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:02:28 smithi134 sudo[68085]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:28.453 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:02:28 smithi134 sudo[68085]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:28.453 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:02:28 smithi134 sudo[68085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:28.453 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:02:28 smithi134 sudo[68085]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:28.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:28 smithi006 ceph-mon[30947]: pgmap v453: 129 pgs: 129 active+clean; 2.6 GiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:02:28.868 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:02:28 smithi006 sudo[90380]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:28.869 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:02:28 smithi006 sudo[90380]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:28.869 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:02:28 smithi006 sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:28.869 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:02:28 smithi006 sudo[90380]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:28 smithi134 ceph-mon[34893]: pgmap v453: 129 pgs: 129 active+clean; 2.6 GiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:02:29.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:28 smithi039 ceph-mon[34543]: pgmap v453: 129 pgs: 129 active+clean; 2.6 GiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:02:29.368 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:02:28 smithi006 sudo[90383]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:29.368 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:02:28 smithi006 sudo[90383]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:29.368 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:02:28 smithi006 sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:29.368 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:02:28 smithi006 sudo[90383]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:29.793 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:02:29 smithi039 sudo[67417]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:29.794 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:02:29 smithi039 sudo[67417]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:29.794 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:02:29 smithi039 sudo[67417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:29.794 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:02:29 smithi039 sudo[67417]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:30.293 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:02:29 smithi039 sudo[67420]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:30.293 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:02:29 smithi039 sudo[67420]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:30.294 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:02:29 smithi039 sudo[67420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:30.294 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:02:29 smithi039 sudo[67420]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:30.409 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:02:30 smithi134 sudo[68088]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:30.409 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:02:30 smithi134 sudo[68088]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:30.409 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:02:30 smithi134 sudo[68088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:30.409 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:02:30 smithi134 sudo[68088]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.599+0000 7f554116d640 1 -- 172.21.15.6:0/347398789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f553c103700 msgr2=0x7f553c109f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.599+0000 7f554116d640 1 --2- 172.21.15.6:0/347398789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f553c103700 0x7f553c109f90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5534009ca0 tx=0x7f553402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.599+0000 7f554116d640 1 -- 172.21.15.6:0/347398789 shutdown_connections 2024-09-12T00:02:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.599+0000 7f554116d640 1 --2- 172.21.15.6:0/347398789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f553c103700 0x7f553c109f90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.599+0000 7f554116d640 1 --2- 172.21.15.6:0/347398789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c102d40 0x7f553c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.599+0000 7f554116d640 1 --2- 172.21.15.6:0/347398789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f553c101b50 0x7f553c101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.599+0000 7f554116d640 1 -- 172.21.15.6:0/347398789 >> 172.21.15.6:0/347398789 conn(0x7f553c0fd2f0 msgr2=0x7f553c0ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.599+0000 7f554116d640 1 -- 172.21.15.6:0/347398789 shutdown_connections 2024-09-12T00:02:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.599+0000 7f554116d640 1 -- 172.21.15.6:0/347398789 wait complete. 2024-09-12T00:02:30.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f554116d640 1 Processor -- start 2024-09-12T00:02:30.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f554116d640 1 -- start start 2024-09-12T00:02:30.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f554116d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c101b50 0x7f553c199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f554116d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f553c102d40 0x7f553c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f554116d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f553c103700 0x7f553c1a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f554116d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f553c10d660 con 0x7f553c101b50 2024-09-12T00:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f554116d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f553c10d4e0 con 0x7f553c103700 2024-09-12T00:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f554116d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f553c10d7e0 con 0x7f553c102d40 2024-09-12T00:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f553ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c101b50 0x7f553c199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f553b59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f553c103700 0x7f553c1a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f553ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c101b50 0x7f553c199f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51044/0 (socket says 172.21.15.6:51044) 2024-09-12T00:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f553ad9d640 1 -- 172.21.15.6:0/245849852 learned_addr learned my addr 172.21.15.6:0/245849852 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.600+0000 7f553a59c640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f553c102d40 0x7f553c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.601+0000 7f553b59e640 1 -- 172.21.15.6:0/245849852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f553c102d40 msgr2=0x7f553c19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.601+0000 7f553b59e640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f553c102d40 0x7f553c19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.601+0000 7f553b59e640 1 -- 172.21.15.6:0/245849852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c101b50 msgr2=0x7f553c199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.601+0000 7f553b59e640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c101b50 0x7f553c199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.601+0000 7f553b59e640 1 -- 172.21.15.6:0/245849852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c1a1b30 con 0x7f553c103700 2024-09-12T00:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.601+0000 7f553b59e640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f553c103700 0x7f553c1a14c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5534031040 tx=0x7f5534003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.601+0000 7f5523fff640 1 -- 172.21.15.6:0/245849852 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5534004040 con 0x7f553c103700 2024-09-12T00:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.601+0000 7f5523fff640 1 -- 172.21.15.6:0/245849852 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5534004690 con 0x7f553c103700 2024-09-12T00:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.601+0000 7f554116d640 1 -- 172.21.15.6:0/245849852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553c1a1dc0 con 0x7f553c103700 2024-09-12T00:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.601+0000 7f5523fff640 1 -- 172.21.15.6:0/245849852 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5534030c30 con 0x7f553c103700 2024-09-12T00:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.601+0000 7f554116d640 1 -- 172.21.15.6:0/245849852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553c1a2280 con 0x7f553c103700 2024-09-12T00:02:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.604+0000 7f5523fff640 1 -- 172.21.15.6:0/245849852 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f55340041e0 con 0x7f553c103700 2024-09-12T00:02:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.604+0000 7f5543fe7740 1 Processor -- start 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.604+0000 7f5543fe7740 1 -- start start 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.604+0000 7f5543fe7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296a9a0 0x557b4296ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.604+0000 7f5543fe7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296b2e0 0x557b4296fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.604+0000 7f5543fe7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b42970370 0x557b42972830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.604+0000 7f5543fe7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557b428ce2f0 con 0x557b4296a9a0 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.604+0000 7f5543fe7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557b42876270 con 0x557b42970370 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.604+0000 7f5543fe7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557b428ca2b0 con 0x557b4296b2e0 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f553a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296a9a0 0x557b4296ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f553a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296a9a0 0x557b4296ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51060/0 (socket says 172.21.15.6:51060) 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f553a59c640 1 -- 172.21.15.6:0/3822354450 learned_addr learned my addr 172.21.15.6:0/3822354450 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f553a59c640 1 --2- 172.21.15.6:0/3822354450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b42970370 0x557b42972830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f553ad9d640 1 --2- 172.21.15.6:0/3822354450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296b2e0 0x557b4296fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f5523fff640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f55240a2b80 0x7f55240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f553a59c640 1 -- 172.21.15.6:0/3822354450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296b2e0 msgr2=0x557b4296fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f553a59c640 1 --2- 172.21.15.6:0/3822354450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296b2e0 0x557b4296fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f553b59e640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f55240a2b80 0x7f55240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f553a59c640 1 -- 172.21.15.6:0/3822354450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b42970370 msgr2=0x557b42972830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f553a59c640 1 --2- 172.21.15.6:0/3822354450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b42970370 0x557b42972830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f553a59c640 1 -- 172.21.15.6:0/3822354450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b42875340 con 0x557b4296a9a0 2024-09-12T00:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f5523fff640 1 -- 172.21.15.6:0/245849852 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f55340f0810 con 0x7f553c103700 2024-09-12T00:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.605+0000 7f553a59c640 1 --2- 172.21.15.6:0/3822354450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296a9a0 0x557b4296ada0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5530013830 tx=0x7f5530005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4899495a6cd9d4ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.606+0000 7f55217fa640 1 -- 172.21.15.6:0/3822354450 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530013170 con 0x557b4296a9a0 2024-09-12T00:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.606+0000 7f553b59e640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f55240a2b80 0x7f55240a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f55340bc980 tx=0x7f553408fe60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.606+0000 7f55217fa640 1 -- 172.21.15.6:0/3822354450 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f553000fc70 con 0x557b4296a9a0 2024-09-12T00:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.606+0000 7f55217fa640 1 -- 172.21.15.6:0/3822354450 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530010830 con 0x557b4296a9a0 2024-09-12T00:02:30.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.607+0000 7f5543fe7740 1 -- 172.21.15.6:0/3822354450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296a9a0 msgr2=0x557b4296ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:30.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.607+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3822354450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296a9a0 0x557b4296ada0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5530013830 tx=0x7f5530005f90 comp rx=0 tx=0).stop 2024-09-12T00:02:30.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.607+0000 7f5543fe7740 1 -- 172.21.15.6:0/3822354450 shutdown_connections 2024-09-12T00:02:30.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.607+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3822354450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b42970370 0x557b42972830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.607+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3822354450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296b2e0 0x557b4296fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.607+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3822354450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296a9a0 0x557b4296ada0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.607+0000 7f5543fe7740 1 -- 172.21.15.6:0/3822354450 >> 172.21.15.6:0/3822354450 conn(0x557b42966010 msgr2=0x557b42966410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.607+0000 7f5543fe7740 1 -- 172.21.15.6:0/3822354450 shutdown_connections 2024-09-12T00:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.607+0000 7f5543fe7740 1 -- 172.21.15.6:0/3822354450 wait complete. 2024-09-12T00:02:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.607+0000 7f5543fe7740 1 -- start start 2024-09-12T00:02:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.607+0000 7f5543fe7740 1 Processor -- start 2024-09-12T00:02:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f5543fe7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b42974b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f5543fe7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b4296b2e0 0x557b429750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f5543fe7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 0x557b4297c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f5543fe7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557b429732e0 con 0x557b42970370 2024-09-12T00:02:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f5543fe7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557b42857290 con 0x557b4296b2e0 2024-09-12T00:02:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f5543fe7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557b42973460 con 0x557b4296a9a0 2024-09-12T00:02:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f5543fe7740 10 client.0 _ll_register_callbacks cb 0x557b42888140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f553a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 0x557b4297c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f553a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 0x557b4297c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51074/0 (socket says 172.21.15.6:51074) 2024-09-12T00:02:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f553a59c640 1 -- 172.21.15.6:0/3154767428 learned_addr learned my addr 172.21.15.6:0/3154767428 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f553ad9d640 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b4296b2e0 0x557b429750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f553a59c640 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b42974b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f553ad9d640 1 -- 172.21.15.6:0/3154767428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 msgr2=0x557b42974b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f553ad9d640 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b42974b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.608+0000 7f553ad9d640 1 -- 172.21.15.6:0/3154767428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 msgr2=0x557b4297c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.609+0000 7f553ad9d640 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 0x557b4297c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.609+0000 7f553ad9d640 1 -- 172.21.15.6:0/3154767428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b425e1210 con 0x557b4296b2e0 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.609+0000 7f553a59c640 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 0x557b4297c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.609+0000 7f553ad9d640 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b4296b2e0 0x557b429750a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x557b4296bd10 tx=0x7f552c00bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2a7f978593a2ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.609+0000 7f551eff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.609+0000 7f551eff5640 1 -- 172.21.15.6:0/3154767428 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c004020 con 0x557b4296b2e0 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.609+0000 7f5543fe7740 1 -- 172.21.15.6:0/3154767428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f553000fc70 con 0x557b4296b2e0 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.609+0000 7f551eff5640 1 -- 172.21.15.6:0/3154767428 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f552c0041c0 con 0x557b4296b2e0 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.609+0000 7f551eff5640 1 -- 172.21.15.6:0/3154767428 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f552c024050 con 0x557b4296b2e0 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.609+0000 7f5543fe7740 10 client.25217 fetch_fsmap learned FSMap version 30 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.609+0000 7f5543fe7740 1 -- 172.21.15.6:0/3154767428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557b426ad620 con 0x557b4296b2e0 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.610+0000 7f551eff5640 1 -- 172.21.15.6:0/3154767428 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f553000fc70 con 0x557b4296b2e0 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.610+0000 7f551eff5640 1 -- 172.21.15.6:0/3154767428 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f552c004c30 con 0x557b4296b2e0 2024-09-12T00:02:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.610+0000 7f5543fe7740 10 client.25217 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:02:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.610+0000 7f5543fe7740 10 client.25217 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:02:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.610+0000 7f5543fe7740 20 client.25217 populate_metadata read hostname 'smithi006' 2024-09-12T00:02:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.610+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557b429808b0 0x557b42982cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.610+0000 7f5543fe7740 4 client.25217 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.610+0000 7f5543fe7740 1 -- 172.21.15.6:0/3154767428 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b428dba20 con 0x557b429808b0 2024-09-12T00:02:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.610+0000 7f553a59c640 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557b429808b0 0x557b42982cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.611+0000 7f553a59c640 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557b429808b0 0x557b42982cc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aeada38158f721a server_cookie=ae0e7b403944203a in_seq=0 out_seq=0 2024-09-12T00:02:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.611+0000 7f551eff5640 10 client.25217 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.611+0000 7f551eff5640 1 -- 172.21.15.6:0/3154767428 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b428dba20 con 0x557b429808b0 2024-09-12T00:02:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.611+0000 7f551eff5640 10 client.25217 handle_command_reply: tid=0 2024-09-12T00:02:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.611+0000 7f5543fe7740 1 client.25217 shutdown 2024-09-12T00:02:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.612+0000 7f5543fe7740 1 -- 172.21.15.6:0/3154767428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b4296b2e0 msgr2=0x557b429750a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.612+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b4296b2e0 0x557b429750a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x557b4296bd10 tx=0x7f552c00bf90 comp rx=0 tx=0).stop 2024-09-12T00:02:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.612+0000 7f5543fe7740 1 -- 172.21.15.6:0/3154767428 shutdown_connections 2024-09-12T00:02:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.612+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 0x557b4297c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.612+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b4296b2e0 0x557b429750a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.612+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557b429808b0 0x557b42982cc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.612+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3154767428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b42974b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.612+0000 7f551eff5640 0 client.25217 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.612+0000 7f5543fe7740 1 -- 172.21.15.6:0/3154767428 >> 172.21.15.6:0/3154767428 conn(0x557b42966010 msgr2=0x557b42967820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.612+0000 7f5543fe7740 1 -- 172.21.15.6:0/3154767428 shutdown_connections 2024-09-12T00:02:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.612+0000 7f5543fe7740 1 -- 172.21.15.6:0/3154767428 wait complete. 2024-09-12T00:02:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.612+0000 7f5543fe7740 20 client.25217 trim_cache size 0 max 16384 2024-09-12T00:02:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f5543fe7740 1 Processor -- start 2024-09-12T00:02:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f5543fe7740 1 -- start start 2024-09-12T00:02:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f5543fe7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b4296ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f5543fe7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296b2e0 0x557b4297c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f5543fe7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b42970370 0x557b429663f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f5543fe7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f553c1ac9f0 con 0x557b4296b2e0 2024-09-12T00:02:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f5543fe7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f553c1ae5c0 con 0x557b42970370 2024-09-12T00:02:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f5543fe7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f553c1ad0c0 con 0x557b4296a9a0 2024-09-12T00:02:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f553ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296b2e0 0x557b4297c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f553ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296b2e0 0x557b4297c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51078/0 (socket says 172.21.15.6:51078) 2024-09-12T00:02:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f553ad9d640 1 -- 172.21.15.6:0/3377299748 learned_addr learned my addr 172.21.15.6:0/3377299748 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f553a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b4296ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f553a59c640 1 --2- 172.21.15.6:0/3377299748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b42970370 0x557b429663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f553a59c640 1 -- 172.21.15.6:0/3377299748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b42970370 msgr2=0x557b429663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f553a59c640 1 --2- 172.21.15.6:0/3377299748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b42970370 0x557b429663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f553a59c640 1 -- 172.21.15.6:0/3377299748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296b2e0 msgr2=0x557b4297c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f553a59c640 1 --2- 172.21.15.6:0/3377299748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296b2e0 0x557b4297c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.633+0000 7f553a59c640 1 -- 172.21.15.6:0/3377299748 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b42983340 con 0x557b4296a9a0 2024-09-12T00:02:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.634+0000 7f553a59c640 1 --2- 172.21.15.6:0/3377299748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b4296ad80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x557b42983510 tx=0x7f5530009a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc9a2fa86af7cedb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.634+0000 7f5520ff9640 1 -- 172.21.15.6:0/3377299748 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553000fc30 con 0x557b4296a9a0 2024-09-12T00:02:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.634+0000 7f5520ff9640 1 -- 172.21.15.6:0/3377299748 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55300055a0 con 0x557b4296a9a0 2024-09-12T00:02:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.634+0000 7f5520ff9640 1 -- 172.21.15.6:0/3377299748 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530003de0 con 0x557b4296a9a0 2024-09-12T00:02:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.635+0000 7f5543fe7740 1 -- 172.21.15.6:0/3377299748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 msgr2=0x557b4296ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.635+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3377299748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b4296ad80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x557b42983510 tx=0x7f5530009a40 comp rx=0 tx=0).stop 2024-09-12T00:02:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.635+0000 7f5543fe7740 1 -- 172.21.15.6:0/3377299748 shutdown_connections 2024-09-12T00:02:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.635+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3377299748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b42970370 0x557b429663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.635+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3377299748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b4296b2e0 0x557b4297c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.635+0000 7f5543fe7740 1 --2- 172.21.15.6:0/3377299748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b4296ad80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.635+0000 7f5543fe7740 1 -- 172.21.15.6:0/3377299748 >> 172.21.15.6:0/3377299748 conn(0x557b42966010 msgr2=0x557b429740c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.635+0000 7f5543fe7740 1 -- 172.21.15.6:0/3377299748 shutdown_connections 2024-09-12T00:02:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.635+0000 7f5543fe7740 1 -- 172.21.15.6:0/3377299748 wait complete. 2024-09-12T00:02:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.636+0000 7f5543fe7740 1 -- start start 2024-09-12T00:02:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.636+0000 7f5543fe7740 1 Processor -- start 2024-09-12T00:02:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.636+0000 7f5543fe7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b42979190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.636+0000 7f5543fe7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b4296b2e0 0x557b429796d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.636+0000 7f5543fe7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 0x557b4297a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f5543fe7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f553c1ade60 con 0x557b42970370 2024-09-12T00:02:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f5543fe7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f553c1ad790 con 0x557b4296b2e0 2024-09-12T00:02:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f5543fe7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f553c1aa9d0 con 0x557b4296a9a0 2024-09-12T00:02:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f5543fe7740 10 client.0 _ll_register_callbacks cb 0x7f552c00bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f553a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 0x557b4297a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f553a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 0x557b4297a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51086/0 (socket says 172.21.15.6:51086) 2024-09-12T00:02:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f553a59c640 1 -- 172.21.15.6:0/702448152 learned_addr learned my addr 172.21.15.6:0/702448152 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f553a59c640 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b42979190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f553ad9d640 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b4296b2e0 0x557b429796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f553a59c640 1 -- 172.21.15.6:0/702448152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 msgr2=0x557b42979190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f553a59c640 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b42979190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f553a59c640 1 -- 172.21.15.6:0/702448152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b4296b2e0 msgr2=0x557b429796d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f553a59c640 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b4296b2e0 0x557b429796d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f553a59c640 1 -- 172.21.15.6:0/702448152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b4297acf0 con 0x557b42970370 2024-09-12T00:02:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f553ad9d640 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b4296b2e0 0x557b429796d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f553a59c640 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 0x557b4297a6e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x557b42978760 tx=0x7f5530005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d820c00b3bd7237 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.637+0000 7f551eff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:02:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f551eff5640 1 -- 172.21.15.6:0/702448152 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530003b60 con 0x557b42970370 2024-09-12T00:02:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f5543fe7740 1 -- 172.21.15.6:0/702448152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55300055a0 con 0x557b42970370 2024-09-12T00:02:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f551eff5640 1 -- 172.21.15.6:0/702448152 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f5530003d00 con 0x557b42970370 2024-09-12T00:02:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f551eff5640 1 -- 172.21.15.6:0/702448152 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f55300050f0 con 0x557b42970370 2024-09-12T00:02:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f5543fe7740 10 client.15597 fetch_fsmap learned FSMap version 30 2024-09-12T00:02:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f5543fe7740 1 -- 172.21.15.6:0/702448152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557b4297c000 con 0x557b42970370 2024-09-12T00:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f551eff5640 1 -- 172.21.15.6:0/702448152 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55300055a0 con 0x557b42970370 2024-09-12T00:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f551eff5640 1 -- 172.21.15.6:0/702448152 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f5530010430 con 0x557b42970370 2024-09-12T00:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f5543fe7740 10 client.15597 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f5543fe7740 10 client.15597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f5543fe7740 20 client.15597 populate_metadata read hostname 'smithi006' 2024-09-12T00:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f5543fe7740 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557b429eb840 0x557b429edc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f5543fe7740 4 client.15597 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.638+0000 7f5543fe7740 1 -- 172.21.15.6:0/702448152 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b428d5d70 con 0x557b429eb840 2024-09-12T00:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.639+0000 7f553ad9d640 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557b429eb840 0x557b429edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.639+0000 7f551eff5640 10 client.15597 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.639+0000 7f553ad9d640 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557b429eb840 0x557b429edc60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42fdeaa34c78876e server_cookie=2638ccd59d3d20b8 in_seq=0 out_seq=0 2024-09-12T00:02:30.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f551eff5640 1 -- 172.21.15.6:0/702448152 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b428d5d70 con 0x557b429eb840 2024-09-12T00:02:30.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f551eff5640 10 client.15597 handle_command_reply: tid=0 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f5543fe7740 1 client.15597 shutdown 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f5543fe7740 1 -- 172.21.15.6:0/702448152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 msgr2=0x557b4297a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f5543fe7740 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 0x557b4297a6e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x557b42978760 tx=0x7f5530005b90 comp rx=0 tx=0).stop 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f5543fe7740 1 -- 172.21.15.6:0/702448152 shutdown_connections 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f5543fe7740 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b42970370 0x557b4297a6e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f5543fe7740 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b4296b2e0 0x557b429796d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f5543fe7740 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557b429eb840 0x557b429edc60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f5543fe7740 1 --2- 172.21.15.6:0/702448152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b4296a9a0 0x557b42979190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f551eff5640 0 client.15597 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f5543fe7740 1 -- 172.21.15.6:0/702448152 >> 172.21.15.6:0/702448152 conn(0x557b42966010 msgr2=0x557b429649a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f5543fe7740 1 -- 172.21.15.6:0/702448152 shutdown_connections 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.657+0000 7f5543fe7740 1 -- 172.21.15.6:0/702448152 wait complete. 2024-09-12T00:02:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.658+0000 7f5543fe7740 20 client.15597 trim_cache size 0 max 16384 2024-09-12T00:02:30.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:02:30.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:02:30.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:02:30.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:02:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.658+0000 7f554116d640 1 -- 172.21.15.6:0/245849852 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f55240a2b80 msgr2=0x7f55240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.658+0000 7f554116d640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f55240a2b80 0x7f55240a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f55340bc980 tx=0x7f553408fe60 comp rx=0 tx=0).stop 2024-09-12T00:02:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.658+0000 7f554116d640 1 -- 172.21.15.6:0/245849852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f553c103700 msgr2=0x7f553c1a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.658+0000 7f554116d640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f553c103700 0x7f553c1a14c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5534031040 tx=0x7f5534003ba0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.658+0000 7f554116d640 1 -- 172.21.15.6:0/245849852 shutdown_connections 2024-09-12T00:02:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.658+0000 7f554116d640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f55240a2b80 0x7f55240a5040 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.658+0000 7f554116d640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f553c103700 0x7f553c1a14c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.658+0000 7f554116d640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f553c102d40 0x7f553c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.658+0000 7f554116d640 1 --2- 172.21.15.6:0/245849852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c101b50 0x7f553c199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.658+0000 7f554116d640 1 -- 172.21.15.6:0/245849852 >> 172.21.15.6:0/245849852 conn(0x7f553c0fd2f0 msgr2=0x7f553c108530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.659+0000 7f554116d640 1 -- 172.21.15.6:0/245849852 shutdown_connections 2024-09-12T00:02:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:30.659+0000 7f554116d640 1 -- 172.21.15.6:0/245849852 wait complete. 2024-09-12T00:02:30.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:30 smithi134 ceph-mon[34893]: pgmap v454: 129 pgs: 129 active+clean; 2.7 GiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 31 op/s 2024-09-12T00:02:30.703 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:02:30 smithi134 sudo[68091]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:30.703 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:02:30 smithi134 sudo[68091]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:30.703 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:02:30 smithi134 sudo[68091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:30.703 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:02:30 smithi134 sudo[68091]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:30.915 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:30 smithi006 ceph-mon[30947]: pgmap v454: 129 pgs: 129 active+clean; 2.7 GiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 31 op/s 2024-09-12T00:02:31.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:30 smithi039 ceph-mon[34543]: pgmap v454: 129 pgs: 129 active+clean; 2.7 GiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 31 op/s 2024-09-12T00:02:31.368 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:02:30 smithi006 sudo[90433]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:31.368 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:02:30 smithi006 sudo[90433]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:31.368 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:02:30 smithi006 sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:31.369 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:02:30 smithi006 sudo[90433]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:31.868 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:02:31 smithi006 sudo[90436]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:31.868 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:02:31 smithi006 sudo[90436]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:31.868 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:02:31 smithi006 sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:31.869 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:02:31 smithi006 sudo[90436]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:32.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:02:31 smithi039 sudo[67425]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:32.294 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:02:31 smithi039 sudo[67425]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:32.294 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:02:31 smithi039 sudo[67425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:32.294 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:02:31 smithi039 sudo[67425]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:32.648 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:02:32 smithi039 sudo[67429]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:32.648 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:02:32 smithi039 sudo[67429]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:32.648 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:02:32 smithi039 sudo[67429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:32.648 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:02:32 smithi039 sudo[67429]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:32.835 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:32 smithi134 ceph-mon[34893]: pgmap v455: 129 pgs: 129 active+clean; 2.7 GiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 32 op/s 2024-09-12T00:02:32.835 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:02:32 smithi134 sudo[68094]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:32.835 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:02:32 smithi134 sudo[68094]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:32.835 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:02:32 smithi134 sudo[68094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:32.835 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:02:32 smithi134 sudo[68094]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:33.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:32 smithi039 ceph-mon[34543]: pgmap v455: 129 pgs: 129 active+clean; 2.7 GiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 32 op/s 2024-09-12T00:02:33.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:32 smithi006 ceph-mon[30947]: pgmap v455: 129 pgs: 129 active+clean; 2.7 GiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 32 op/s 2024-09-12T00:02:33.203 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:02:32 smithi134 sudo[68097]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:33.203 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:02:32 smithi134 sudo[68097]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:33.203 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:02:32 smithi134 sudo[68097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:33.203 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:02:32 smithi134 sudo[68097]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:33.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:33 smithi006 sudo[90439]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:33.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:33 smithi006 sudo[90439]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:33.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:33 smithi006 sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:33.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:33 smithi006 sudo[90439]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:34.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:33 smithi006 sudo[90442]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:34.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:33 smithi006 sudo[90442]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:34.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:33 smithi006 sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:34.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:33 smithi006 sudo[90442]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:34.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 sudo[68100]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:34.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 sudo[68100]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:34.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 sudo[68100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:34.308 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 sudo[68100]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:34.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:34 smithi006 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:02:34.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:34 smithi006 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:02:34.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:02:34.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:02:34.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:02:34.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:02:34.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:02:34.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:02:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 sudo[68103]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 sudo[68103]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 sudo[68103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 sudo[68103]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 ceph-mon[34893]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:02:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 ceph-mon[34893]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:02:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:02:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:02:34.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:02:34.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:02:34.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:02:34.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:02:34.762 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:34 smithi039 ceph-mon[34543]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:02:34.762 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:34 smithi039 ceph-mon[34543]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:02:34.763 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:02:34.763 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:02:34.763 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:02:34.763 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:02:34.763 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:02:34.763 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:02:35.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:34 smithi039 sudo[67434]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:02:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:34 smithi039 sudo[67434]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:34 smithi039 sudo[67434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:35.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:34 smithi039 sudo[67434]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:35.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:35 smithi039 sudo[67438]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:02:35.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:35 smithi039 sudo[67438]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:02:35.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:35 smithi039 sudo[67438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:02:35.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:35 smithi039 sudo[67438]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:02:35.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:35 smithi039 ceph-mon[34543]: pgmap v456: 129 pgs: 129 active+clean; 2.8 GiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:02:35.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:35 smithi039 ceph-mon[34543]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:02:35.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:35 smithi039 ceph-mon[34543]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:02:35.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:35 smithi039 ceph-mon[34543]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:02:35.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:35 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:02:35.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:35 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:02:35.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:35 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:02:35.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:35 smithi039 ceph-mon[34543]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:02:35.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:35 smithi006 ceph-mon[30947]: pgmap v456: 129 pgs: 129 active+clean; 2.8 GiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:02:35.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:35 smithi006 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:02:35.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:35 smithi006 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:02:35.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:35 smithi006 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:02:35.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:35 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:02:35.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:35 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:02:35.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:35 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:02:35.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:35 smithi006 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:02:35.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:35 smithi134 ceph-mon[34893]: pgmap v456: 129 pgs: 129 active+clean; 2.8 GiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:02:35.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:35 smithi134 ceph-mon[34893]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:02:35.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:35 smithi134 ceph-mon[34893]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:02:35.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:35 smithi134 ceph-mon[34893]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:02:35.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:35 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:02:35.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:35 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:02:35.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:35 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:02:35.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:35 smithi134 ceph-mon[34893]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:02:36.604 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:36 smithi134 ceph-mon[34893]: pgmap v457: 129 pgs: 129 active+clean; 2.8 GiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 32 op/s 2024-09-12T00:02:36.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:36 smithi006 ceph-mon[30947]: pgmap v457: 129 pgs: 129 active+clean; 2.8 GiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 32 op/s 2024-09-12T00:02:36.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:36 smithi039 ceph-mon[34543]: pgmap v457: 129 pgs: 129 active+clean; 2.8 GiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 32 op/s 2024-09-12T00:02:38.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:38 smithi006 ceph-mon[30947]: pgmap v458: 129 pgs: 129 active+clean; 2.9 GiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 27 MiB/s wr, 32 op/s 2024-09-12T00:02:38.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:38 smithi134 ceph-mon[34893]: pgmap v458: 129 pgs: 129 active+clean; 2.9 GiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 27 MiB/s wr, 32 op/s 2024-09-12T00:02:38.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:38 smithi039 ceph-mon[34543]: pgmap v458: 129 pgs: 129 active+clean; 2.9 GiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 27 MiB/s wr, 32 op/s 2024-09-12T00:02:39.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:39 smithi006 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:39.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:39 smithi134 ceph-mon[34893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:39.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:39 smithi039 ceph-mon[34543]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:40.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:40 smithi006 ceph-mon[30947]: pgmap v459: 129 pgs: 129 active+clean; 2.9 GiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 33 op/s 2024-09-12T00:02:40.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:40 smithi134 ceph-mon[34893]: pgmap v459: 129 pgs: 129 active+clean; 2.9 GiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 33 op/s 2024-09-12T00:02:40.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:40 smithi039 ceph-mon[34543]: pgmap v459: 129 pgs: 129 active+clean; 2.9 GiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 33 op/s 2024-09-12T00:02:42.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:42 smithi006 ceph-mon[30947]: pgmap v460: 129 pgs: 129 active+clean; 3.0 GiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:02:42.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:42 smithi134 ceph-mon[34893]: pgmap v460: 129 pgs: 129 active+clean; 3.0 GiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:02:42.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:42 smithi039 ceph-mon[34543]: pgmap v460: 129 pgs: 129 active+clean; 3.0 GiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:02:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.758+0000 7f5bcd04c640 1 -- 172.21.15.6:0/1474296304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8102d50 msgr2=0x7f5bc81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.758+0000 7f5bcd04c640 1 --2- 172.21.15.6:0/1474296304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8102d50 0x7f5bc81031d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009900 tx=0x7f5bbc02a410 comp rx=0 tx=0).stop 2024-09-12T00:02:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.758+0000 7f5bcd04c640 1 -- 172.21.15.6:0/1474296304 shutdown_connections 2024-09-12T00:02:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.758+0000 7f5bcd04c640 1 --2- 172.21.15.6:0/1474296304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc8103710 0x7f5bc8109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.758+0000 7f5bcd04c640 1 --2- 172.21.15.6:0/1474296304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8102d50 0x7f5bc81031d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.758+0000 7f5bcd04c640 1 --2- 172.21.15.6:0/1474296304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc8101b60 0x7f5bc8101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.758+0000 7f5bcd04c640 1 -- 172.21.15.6:0/1474296304 >> 172.21.15.6:0/1474296304 conn(0x7f5bc80fd2e0 msgr2=0x7f5bc80ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.758+0000 7f5bcd04c640 1 -- 172.21.15.6:0/1474296304 shutdown_connections 2024-09-12T00:02:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.758+0000 7f5bcd04c640 1 -- 172.21.15.6:0/1474296304 wait complete. 2024-09-12T00:02:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.759+0000 7f5bcd04c640 1 Processor -- start 2024-09-12T00:02:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.759+0000 7f5bcd04c640 1 -- start start 2024-09-12T00:02:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.759+0000 7f5bcd04c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc8101b60 0x7f5bc8197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.759+0000 7f5bcd04c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8102d50 0x7f5bc8198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.759+0000 7f5bcd04c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc8103710 0x7f5bc819f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.759+0000 7f5bcd04c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc810d6e0 con 0x7f5bc8102d50 2024-09-12T00:02:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.759+0000 7f5bcd04c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc810d560 con 0x7f5bc8103710 2024-09-12T00:02:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.759+0000 7f5bcd04c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc810d860 con 0x7f5bc8101b60 2024-09-12T00:02:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bc659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8102d50 0x7f5bc8198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bc659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8102d50 0x7f5bc8198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48810/0 (socket says 172.21.15.6:48810) 2024-09-12T00:02:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bc659c640 1 -- 172.21.15.6:0/4282981664 learned_addr learned my addr 172.21.15.6:0/4282981664 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bc759e640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc8103710 0x7f5bc819f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc8101b60 0x7f5bc8197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bc659c640 1 -- 172.21.15.6:0/4282981664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc8101b60 msgr2=0x7f5bc8197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bc659c640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc8101b60 0x7f5bc8197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bc659c640 1 -- 172.21.15.6:0/4282981664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc8103710 msgr2=0x7f5bc819f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bc659c640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc8103710 0x7f5bc819f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bc659c640 1 -- 172.21.15.6:0/4282981664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc819f960 con 0x7f5bc8102d50 2024-09-12T00:02:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bc659c640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8102d50 0x7f5bc8198280 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0314e0 tx=0x7f5bbc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5baffff640 1 -- 172.21.15.6:0/4282981664 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc03f070 con 0x7f5bc8102d50 2024-09-12T00:02:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bcd04c640 1 -- 172.21.15.6:0/4282981664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc819fbf0 con 0x7f5bc8102d50 2024-09-12T00:02:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5baffff640 1 -- 172.21.15.6:0/4282981664 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bbc031c40 con 0x7f5bc8102d50 2024-09-12T00:02:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5bcd04c640 1 -- 172.21.15.6:0/4282981664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc81a0130 con 0x7f5bc8102d50 2024-09-12T00:02:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.760+0000 7f5baffff640 1 -- 172.21.15.6:0/4282981664 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc049060 con 0x7f5bc8102d50 2024-09-12T00:02:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5baffff640 1 -- 172.21.15.6:0/4282981664 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f5bbc042070 con 0x7f5bc8102d50 2024-09-12T00:02:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bcfde6740 1 Processor -- start 2024-09-12T00:02:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bcfde6740 1 -- start start 2024-09-12T00:02:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bcfde6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c79a0 0x55aea51c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bcfde6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c82e0 0x55aea51ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bcfde6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51cd370 0x55aea51cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bcfde6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55aea512b2f0 con 0x55aea51c79a0 2024-09-12T00:02:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bcfde6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55aea50d3270 con 0x55aea51c82e0 2024-09-12T00:02:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bcfde6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55aea51272b0 con 0x55aea51cd370 2024-09-12T00:02:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bc759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c79a0 0x55aea51c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bc759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c79a0 0x55aea51c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48818/0 (socket says 172.21.15.6:48818) 2024-09-12T00:02:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bc759e640 1 -- 172.21.15.6:0/3005929188 learned_addr learned my addr 172.21.15.6:0/3005929188 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/3005929188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c82e0 0x55aea51ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.764+0000 7f5bc659c640 1 --2- 172.21.15.6:0/3005929188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51cd370 0x55aea51cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5bc759e640 1 -- 172.21.15.6:0/3005929188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51cd370 msgr2=0x55aea51cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5bc759e640 1 --2- 172.21.15.6:0/3005929188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51cd370 0x55aea51cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5bc759e640 1 -- 172.21.15.6:0/3005929188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c82e0 msgr2=0x55aea51ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5bc759e640 1 --2- 172.21.15.6:0/3005929188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c82e0 0x55aea51ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5bc759e640 1 -- 172.21.15.6:0/3005929188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aea50d2340 con 0x55aea51c79a0 2024-09-12T00:02:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5bc659c640 1 --2- 172.21.15.6:0/3005929188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51cd370 0x55aea51cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5baffff640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5bb00a2b80 0x7f5bb00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5bb00a2b80 0x7f5bb00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5bc759e640 1 --2- 172.21.15.6:0/3005929188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c79a0 0x55aea51c7da0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009fd0 tx=0x7f5bc00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d12fc6d5eaac8b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5baffff640 1 -- 172.21.15.6:0/4282981664 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f5bbc0eff50 con 0x7f5bc8102d50 2024-09-12T00:02:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5bad7fa640 1 -- 172.21.15.6:0/3005929188 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0004d20 con 0x55aea51c79a0 2024-09-12T00:02:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5bad7fa640 1 -- 172.21.15.6:0/3005929188 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bc0004050 con 0x55aea51c79a0 2024-09-12T00:02:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.765+0000 7f5bad7fa640 1 -- 172.21.15.6:0/3005929188 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0005280 con 0x55aea51c79a0 2024-09-12T00:02:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.766+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3005929188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c79a0 msgr2=0x55aea51c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.766+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5bb00a2b80 0x7f5bb00a5040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55aea51c8d10 tx=0x7f5bb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.766+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/3005929188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c79a0 0x55aea51c7da0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009fd0 tx=0x7f5bc00118d0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.766+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3005929188 shutdown_connections 2024-09-12T00:02:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.766+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/3005929188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51cd370 0x55aea51cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.766+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/3005929188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c82e0 0x55aea51ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.766+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/3005929188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c79a0 0x55aea51c7da0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.766+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3005929188 >> 172.21.15.6:0/3005929188 conn(0x55aea51c3010 msgr2=0x55aea51c3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.766+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3005929188 shutdown_connections 2024-09-12T00:02:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.766+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3005929188 wait complete. 2024-09-12T00:02:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.766+0000 7f5bcfde6740 1 -- start start 2024-09-12T00:02:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bcfde6740 1 Processor -- start 2024-09-12T00:02:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bcfde6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c79a0 0x55aea51d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bcfde6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c82e0 0x55aea51d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bcfde6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 0x55aea51d9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bcfde6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55aea51d0340 con 0x55aea51cd370 2024-09-12T00:02:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bcfde6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55aea50b4290 con 0x55aea51c82e0 2024-09-12T00:02:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bcfde6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55aea51d04c0 con 0x55aea51c79a0 2024-09-12T00:02:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bcfde6740 10 client.0 _ll_register_callbacks cb 0x55aea50e5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bc759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 0x55aea51d9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bc659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c82e0 0x55aea51d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bc759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 0x55aea51d9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48820/0 (socket says 172.21.15.6:48820) 2024-09-12T00:02:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bc759e640 1 -- 172.21.15.6:0/703040282 learned_addr learned my addr 172.21.15.6:0/703040282 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c79a0 0x55aea51d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bc659c640 1 -- 172.21.15.6:0/703040282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c79a0 msgr2=0x55aea51d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bc659c640 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c79a0 0x55aea51d1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bc659c640 1 -- 172.21.15.6:0/703040282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 msgr2=0x55aea51d9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bc659c640 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 0x55aea51d9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bc659c640 1 -- 172.21.15.6:0/703040282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aea4e3e210 con 0x55aea51c82e0 2024-09-12T00:02:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.767+0000 7f5bc759e640 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 0x55aea51d9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5bc659c640 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c82e0 0x55aea51d2100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0ed6b0 tx=0x7f5bbc0b87d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f424fe7180f018c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5baaff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:02:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5baaff5640 1 -- 172.21.15.6:0/703040282 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc031df0 con 0x55aea51c82e0 2024-09-12T00:02:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5bcfde6740 1 -- 172.21.15.6:0/703040282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bc0004050 con 0x55aea51c82e0 2024-09-12T00:02:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5baaff5640 1 -- 172.21.15.6:0/703040282 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f5bbc0f2070 con 0x55aea51c82e0 2024-09-12T00:02:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5baaff5640 1 -- 172.21.15.6:0/703040282 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5bbc0f2270 con 0x55aea51c82e0 2024-09-12T00:02:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5bcfde6740 10 client.25235 fetch_fsmap learned FSMap version 31 2024-09-12T00:02:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5bcfde6740 1 -- 172.21.15.6:0/703040282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55aea4f0a620 con 0x55aea51c82e0 2024-09-12T00:02:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5baaff5640 1 -- 172.21.15.6:0/703040282 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bc0004050 con 0x55aea51c82e0 2024-09-12T00:02:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5baaff5640 1 -- 172.21.15.6:0/703040282 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f5bbc0bc6d0 con 0x55aea51c82e0 2024-09-12T00:02:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5bcfde6740 10 client.25235 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:02:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5bcfde6740 10 client.25235 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:02:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5bcfde6740 20 client.25235 populate_metadata read hostname 'smithi006' 2024-09-12T00:02:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55aea51dd820 0x55aea51dfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5bcfde6740 4 client.25235 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.768+0000 7f5bcfde6740 1 -- 172.21.15.6:0/703040282 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aea5138a20 con 0x55aea51dd820 2024-09-12T00:02:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.769+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55aea51dd820 0x55aea51dfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.769+0000 7f5baaff5640 10 client.25235 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.769+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55aea51dd820 0x55aea51dfc60 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7fbd0eb8ab6b714 server_cookie=9fcb245324522d7 in_seq=0 out_seq=0 2024-09-12T00:02:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5baaff5640 1 -- 172.21.15.6:0/703040282 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aea5138a20 con 0x55aea51dd820 2024-09-12T00:02:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5baaff5640 10 client.25235 handle_command_reply: tid=0 2024-09-12T00:02:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5bcfde6740 1 client.25235 shutdown 2024-09-12T00:02:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5bcfde6740 1 -- 172.21.15.6:0/703040282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c82e0 msgr2=0x55aea51d2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c82e0 0x55aea51d2100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0ed6b0 tx=0x7f5bbc0b87d0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5bcfde6740 1 -- 172.21.15.6:0/703040282 shutdown_connections 2024-09-12T00:02:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 0x55aea51d9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c82e0 0x55aea51d2100 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55aea51dd820 0x55aea51dfc60 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/703040282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c79a0 0x55aea51d1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5baaff5640 0 client.25235 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5bcfde6740 1 -- 172.21.15.6:0/703040282 >> 172.21.15.6:0/703040282 conn(0x55aea51c3010 msgr2=0x55aea51c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5bcfde6740 1 -- 172.21.15.6:0/703040282 shutdown_connections 2024-09-12T00:02:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5bcfde6740 1 -- 172.21.15.6:0/703040282 wait complete. 2024-09-12T00:02:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.770+0000 7f5bcfde6740 20 client.25235 trim_cache size 0 max 16384 2024-09-12T00:02:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.793+0000 7f5bcfde6740 1 Processor -- start 2024-09-12T00:02:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.793+0000 7f5bcfde6740 1 -- start start 2024-09-12T00:02:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.793+0000 7f5bcfde6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c79a0 0x55aea51d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.793+0000 7f5bcfde6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c82e0 0x55aea51c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.793+0000 7f5bcfde6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51cd370 0x55aea51c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.793+0000 7f5bcfde6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc81aa780 con 0x55aea51c82e0 2024-09-12T00:02:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.793+0000 7f5bcfde6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc81ac2f0 con 0x55aea51cd370 2024-09-12T00:02:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.793+0000 7f5bcfde6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc81aae50 con 0x55aea51c79a0 2024-09-12T00:02:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.794+0000 7f5bc659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c82e0 0x55aea51c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.794+0000 7f5bc659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c82e0 0x55aea51c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48834/0 (socket says 172.21.15.6:48834) 2024-09-12T00:02:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.794+0000 7f5bc659c640 1 -- 172.21.15.6:0/2364898633 learned_addr learned my addr 172.21.15.6:0/2364898633 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.794+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/2364898633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c79a0 0x55aea51d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.794+0000 7f5bc759e640 1 --2- 172.21.15.6:0/2364898633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51cd370 0x55aea51c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.794+0000 7f5bc6d9d640 1 -- 172.21.15.6:0/2364898633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51cd370 msgr2=0x55aea51c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.794+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/2364898633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51cd370 0x55aea51c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.794+0000 7f5bc6d9d640 1 -- 172.21.15.6:0/2364898633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c82e0 msgr2=0x55aea51c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.794+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/2364898633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c82e0 0x55aea51c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.794+0000 7f5bc6d9d640 1 -- 172.21.15.6:0/2364898633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aea51e0290 con 0x55aea51c79a0 2024-09-12T00:02:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.794+0000 7f5bc659c640 1 --2- 172.21.15.6:0/2364898633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c82e0 0x55aea51c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.794+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/2364898633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c79a0 0x55aea51d0fd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55aea51e04c0 tx=0x7f5bb8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec1fb4597a77b2b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.795+0000 7f5bacff9640 1 -- 172.21.15.6:0/2364898633 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb801bcc0 con 0x55aea51c79a0 2024-09-12T00:02:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.795+0000 7f5bacff9640 1 -- 172.21.15.6:0/2364898633 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bb80288c0 con 0x55aea51c79a0 2024-09-12T00:02:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.795+0000 7f5bacff9640 1 -- 172.21.15.6:0/2364898633 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb800f660 con 0x55aea51c79a0 2024-09-12T00:02:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 -- 172.21.15.6:0/2364898633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c79a0 msgr2=0x55aea51d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/2364898633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c79a0 0x55aea51d0fd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55aea51e04c0 tx=0x7f5bb8017000 comp rx=0 tx=0).stop 2024-09-12T00:02:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 -- 172.21.15.6:0/2364898633 shutdown_connections 2024-09-12T00:02:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/2364898633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51cd370 0x55aea51c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/2364898633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51c82e0 0x55aea51c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/2364898633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c79a0 0x55aea51d0fd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 -- 172.21.15.6:0/2364898633 >> 172.21.15.6:0/2364898633 conn(0x55aea51c3010 msgr2=0x55aea51d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 -- 172.21.15.6:0/2364898633 shutdown_connections 2024-09-12T00:02:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 -- 172.21.15.6:0/2364898633 wait complete. 2024-09-12T00:02:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 -- start start 2024-09-12T00:02:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 Processor -- start 2024-09-12T00:02:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c79a0 0x55aea5243c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c82e0 0x55aea5244150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.796+0000 7f5bcfde6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 0x55aea524b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bcfde6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc81abbf0 con 0x55aea51cd370 2024-09-12T00:02:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bcfde6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc81ab520 con 0x55aea51c79a0 2024-09-12T00:02:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bcfde6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc81a8760 con 0x55aea51c82e0 2024-09-12T00:02:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bcfde6740 10 client.0 _ll_register_callbacks cb 0x7f5bbc009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 0x55aea524b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c79a0 0x55aea5243c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 0x55aea524b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48850/0 (socket says 172.21.15.6:48850) 2024-09-12T00:02:43.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc759e640 1 -- 172.21.15.6:0/3441956386 learned_addr learned my addr 172.21.15.6:0/3441956386 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:43.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc659c640 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c82e0 0x55aea5244150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc759e640 1 -- 172.21.15.6:0/3441956386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c82e0 msgr2=0x55aea5244150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc759e640 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c82e0 0x55aea5244150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc759e640 1 -- 172.21.15.6:0/3441956386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c79a0 msgr2=0x55aea5243c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc759e640 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c79a0 0x55aea5243c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc759e640 1 -- 172.21.15.6:0/3441956386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aea51c8f70 con 0x55aea51cd370 2024-09-12T00:02:43.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc659c640 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c82e0 0x55aea5244150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:43.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c79a0 0x55aea5243c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:43.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bc759e640 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 0x55aea524b190 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0011dd0 tx=0x7f5bc0009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9703252043253c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:43.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5baaff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:02:43.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5baaff5640 1 -- 172.21.15.6:0/3441956386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc00042e0 con 0x55aea51cd370 2024-09-12T00:02:43.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3441956386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bb80288c0 con 0x55aea51cd370 2024-09-12T00:02:43.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.797+0000 7f5baaff5640 1 -- 172.21.15.6:0/3441956386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f5bc0004480 con 0x55aea51cd370 2024-09-12T00:02:43.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.798+0000 7f5baaff5640 1 -- 172.21.15.6:0/3441956386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5bc0035050 con 0x55aea51cd370 2024-09-12T00:02:43.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.798+0000 7f5bcfde6740 10 client.15618 fetch_fsmap learned FSMap version 31 2024-09-12T00:02:43.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.798+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3441956386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55aea524c9a0 con 0x55aea51cd370 2024-09-12T00:02:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.798+0000 7f5baaff5640 1 -- 172.21.15.6:0/3441956386 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bb80288c0 con 0x55aea51cd370 2024-09-12T00:02:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.798+0000 7f5baaff5640 1 -- 172.21.15.6:0/3441956386 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f5bc0019550 con 0x55aea51cd370 2024-09-12T00:02:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.798+0000 7f5bcfde6740 10 client.15618 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:02:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.798+0000 7f5bcfde6740 10 client.15618 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:02:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.798+0000 7f5bcfde6740 20 client.15618 populate_metadata read hostname 'smithi006' 2024-09-12T00:02:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.798+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55aea524d240 0x55aea524f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.798+0000 7f5bcfde6740 4 client.15618 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:02:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.798+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3441956386 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aea5132d70 con 0x55aea524d240 2024-09-12T00:02:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.798+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55aea524d240 0x55aea524f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.799+0000 7f5baaff5640 10 client.15618 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:43.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.799+0000 7f5bc6d9d640 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55aea524d240 0x55aea524f660 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a4b64be0e59abba server_cookie=63429607c409f69 in_seq=0 out_seq=0 2024-09-12T00:02:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5baaff5640 1 -- 172.21.15.6:0/3441956386 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aea5132d70 con 0x55aea524d240 2024-09-12T00:02:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5baaff5640 10 client.15618 handle_command_reply: tid=0 2024-09-12T00:02:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5bcfde6740 1 client.15618 shutdown 2024-09-12T00:02:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3441956386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 msgr2=0x55aea524b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 0x55aea524b190 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0011dd0 tx=0x7f5bc0009d60 comp rx=0 tx=0).stop 2024-09-12T00:02:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3441956386 shutdown_connections 2024-09-12T00:02:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aea51cd370 0x55aea524b190 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55aea524d240 0x55aea524f660 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5baaff5640 0 client.15618 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aea51c82e0 0x55aea5244150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5bcfde6740 1 --2- 172.21.15.6:0/3441956386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aea51c79a0 0x55aea5243c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3441956386 >> 172.21.15.6:0/3441956386 conn(0x55aea51c3010 msgr2=0x55aea51d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3441956386 shutdown_connections 2024-09-12T00:02:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5bcfde6740 1 -- 172.21.15.6:0/3441956386 wait complete. 2024-09-12T00:02:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.813+0000 7f5bcfde6740 20 client.15618 trim_cache size 0 max 16384 2024-09-12T00:02:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:02:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:02:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:02:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:02:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.814+0000 7f5bcd04c640 1 -- 172.21.15.6:0/4282981664 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5bb00a2b80 msgr2=0x7f5bb00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.814+0000 7f5bcd04c640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5bb00a2b80 0x7f5bb00a5040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55aea51c8d10 tx=0x7f5bb8005f90 comp rx=0 tx=0).stop 2024-09-12T00:02:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.814+0000 7f5bcd04c640 1 -- 172.21.15.6:0/4282981664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8102d50 msgr2=0x7f5bc8198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.814+0000 7f5bcd04c640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8102d50 0x7f5bc8198280 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0314e0 tx=0x7f5bbc003c10 comp rx=0 tx=0).stop 2024-09-12T00:02:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.814+0000 7f5bcd04c640 1 -- 172.21.15.6:0/4282981664 shutdown_connections 2024-09-12T00:02:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.814+0000 7f5bcd04c640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5bb00a2b80 0x7f5bb00a5040 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.814+0000 7f5bcd04c640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc8103710 0x7f5bc819f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.814+0000 7f5bcd04c640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8102d50 0x7f5bc8198280 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.814+0000 7f5bcd04c640 1 --2- 172.21.15.6:0/4282981664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc8101b60 0x7f5bc8197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.814+0000 7f5bcd04c640 1 -- 172.21.15.6:0/4282981664 >> 172.21.15.6:0/4282981664 conn(0x7f5bc80fd2e0 msgr2=0x7f5bc8106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.814+0000 7f5bcd04c640 1 -- 172.21.15.6:0/4282981664 shutdown_connections 2024-09-12T00:02:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:43.814+0000 7f5bcd04c640 1 -- 172.21.15.6:0/4282981664 wait complete. 2024-09-12T00:02:44.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:44 smithi006 ceph-mon[30947]: pgmap v461: 129 pgs: 129 active+clean; 3.0 GiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:02:44.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:44 smithi134 ceph-mon[34893]: pgmap v461: 129 pgs: 129 active+clean; 3.0 GiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:02:44.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:44 smithi039 ceph-mon[34543]: pgmap v461: 129 pgs: 129 active+clean; 3.0 GiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:02:46.596 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:46 smithi039 ceph-mon[34543]: pgmap v462: 129 pgs: 129 active+clean; 3.1 GiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 28 op/s 2024-09-12T00:02:46.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:46 smithi006 ceph-mon[30947]: pgmap v462: 129 pgs: 129 active+clean; 3.1 GiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 28 op/s 2024-09-12T00:02:46.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:46 smithi134 ceph-mon[34893]: pgmap v462: 129 pgs: 129 active+clean; 3.1 GiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 28 op/s 2024-09-12T00:02:47.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:47 smithi006 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:47.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:47 smithi134 ceph-mon[34893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:47.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:47 smithi039 ceph-mon[34543]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:48.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:48 smithi006 ceph-mon[30947]: pgmap v463: 129 pgs: 129 active+clean; 3.2 GiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:02:48.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:48 smithi134 ceph-mon[34893]: pgmap v463: 129 pgs: 129 active+clean; 3.2 GiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:02:48.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:48 smithi039 ceph-mon[34543]: pgmap v463: 129 pgs: 129 active+clean; 3.2 GiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:02:50.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:50 smithi006 ceph-mon[30947]: pgmap v464: 129 pgs: 129 active+clean; 3.2 GiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:02:50.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:50 smithi134 ceph-mon[34893]: pgmap v464: 129 pgs: 129 active+clean; 3.2 GiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:02:50.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:50 smithi039 ceph-mon[34543]: pgmap v464: 129 pgs: 129 active+clean; 3.2 GiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:02:52.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:52 smithi006 ceph-mon[30947]: pgmap v465: 129 pgs: 129 active+clean; 3.2 GiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:02:52.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:52 smithi134 ceph-mon[34893]: pgmap v465: 129 pgs: 129 active+clean; 3.2 GiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:02:52.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:52 smithi039 ceph-mon[34543]: pgmap v465: 129 pgs: 129 active+clean; 3.2 GiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:02:54.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:54 smithi006 ceph-mon[30947]: pgmap v466: 129 pgs: 129 active+clean; 3.3 GiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:02:54.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:54 smithi134 ceph-mon[34893]: pgmap v466: 129 pgs: 129 active+clean; 3.3 GiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:02:54.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:54 smithi039 ceph-mon[34543]: pgmap v466: 129 pgs: 129 active+clean; 3.3 GiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:02:56.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:56 smithi006 ceph-mon[30947]: pgmap v467: 129 pgs: 129 active+clean; 3.3 GiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:02:56.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:56 smithi134 ceph-mon[34893]: pgmap v467: 129 pgs: 129 active+clean; 3.3 GiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:02:56.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:56 smithi039 ceph-mon[34543]: pgmap v467: 129 pgs: 129 active+clean; 3.3 GiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:02:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.930+0000 7f85a0c23640 1 -- 172.21.15.6:0/3192497607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c104f70 msgr2=0x7f859c107360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.931+0000 7f85a0c23640 1 --2- 172.21.15.6:0/3192497607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c104f70 0x7f859c107360 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8590009900 tx=0x7f859002a410 comp rx=0 tx=0).stop 2024-09-12T00:02:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.931+0000 7f85a0c23640 1 -- 172.21.15.6:0/3192497607 shutdown_connections 2024-09-12T00:02:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.931+0000 7f85a0c23640 1 --2- 172.21.15.6:0/3192497607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c1078a0 0x7f859c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.931+0000 7f85a0c23640 1 --2- 172.21.15.6:0/3192497607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c104f70 0x7f859c107360 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.931+0000 7f85a0c23640 1 --2- 172.21.15.6:0/3192497607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f859c102640 0x7f859c104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.931+0000 7f85a0c23640 1 -- 172.21.15.6:0/3192497607 >> 172.21.15.6:0/3192497607 conn(0x7f859c0fc1c0 msgr2=0x7f859c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.931+0000 7f85a0c23640 1 -- 172.21.15.6:0/3192497607 shutdown_connections 2024-09-12T00:02:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.931+0000 7f85a0c23640 1 -- 172.21.15.6:0/3192497607 wait complete. 2024-09-12T00:02:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.931+0000 7f85a0c23640 1 Processor -- start 2024-09-12T00:02:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f85a0c23640 1 -- start start 2024-09-12T00:02:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f85a0c23640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c102640 0x7f859c101fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f85a0c23640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f859c104f70 0x7f859c1005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f85a0c23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c1078a0 0x7f859c100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f85a0c23640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f859c10d6b0 con 0x7f859c102640 2024-09-12T00:02:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f85a0c23640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f859c10d530 con 0x7f859c104f70 2024-09-12T00:02:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f85a0c23640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f859c10d830 con 0x7f859c1078a0 2024-09-12T00:02:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f859a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c102640 0x7f859c101fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f859a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c102640 0x7f859c101fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34034/0 (socket says 172.21.15.6:34034) 2024-09-12T00:02:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f859a59c640 1 -- 172.21.15.6:0/3505657585 learned_addr learned my addr 172.21.15.6:0/3505657585 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f859ad9d640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c1078a0 0x7f859c100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f8599d9b640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f859c104f70 0x7f859c1005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f859a59c640 1 -- 172.21.15.6:0/3505657585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c1078a0 msgr2=0x7f859c100b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f859a59c640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c1078a0 0x7f859c100b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f859a59c640 1 -- 172.21.15.6:0/3505657585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f859c104f70 msgr2=0x7f859c1005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f859a59c640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f859c104f70 0x7f859c1005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.932+0000 7f859a59c640 1 -- 172.21.15.6:0/3505657585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c1013c0 con 0x7f859c102640 2024-09-12T00:02:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.933+0000 7f859a59c640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c102640 0x7f859c101fb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f858c00d950 tx=0x7f858c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.933+0000 7f858b7fe640 1 -- 172.21.15.6:0/3505657585 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c017070 con 0x7f859c102640 2024-09-12T00:02:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.933+0000 7f858b7fe640 1 -- 172.21.15.6:0/3505657585 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f858c009c30 con 0x7f859c102640 2024-09-12T00:02:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.933+0000 7f858b7fe640 1 -- 172.21.15.6:0/3505657585 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c00f620 con 0x7f859c102640 2024-09-12T00:02:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.933+0000 7f85a0c23640 1 -- 172.21.15.6:0/3505657585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859c1a1f90 con 0x7f859c102640 2024-09-12T00:02:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.933+0000 7f85a0c23640 1 -- 172.21.15.6:0/3505657585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859c1a2390 con 0x7f859c102640 2024-09-12T00:02:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.935+0000 7f858b7fe640 1 -- 172.21.15.6:0/3505657585 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f858c0109a0 con 0x7f859c102640 2024-09-12T00:02:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.936+0000 7f85a39ba740 1 Processor -- start 2024-09-12T00:02:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.936+0000 7f85a39ba740 1 -- start start 2024-09-12T00:02:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.936+0000 7f85a39ba740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 0x55e71f50eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.936+0000 7f85a39ba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f513da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.936+0000 7f85a39ba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f514370 0x55e71f516830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.936+0000 7f85a39ba740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e71f4722f0 con 0x55e71f50e9a0 2024-09-12T00:02:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.936+0000 7f85a39ba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e71f41a270 con 0x55e71f514370 2024-09-12T00:02:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.936+0000 7f85a39ba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e71f46e2b0 con 0x55e71f50f2e0 2024-09-12T00:02:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f859ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 0x55e71f50eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f859ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 0x55e71f50eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34044/0 (socket says 172.21.15.6:34044) 2024-09-12T00:02:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f859ad9d640 1 -- 172.21.15.6:0/2613554483 learned_addr learned my addr 172.21.15.6:0/2613554483 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f858b7fe640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f85840a2b80 0x7f85840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f8599d9b640 1 --2- 172.21.15.6:0/2613554483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f514370 0x55e71f516830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f859a59c640 1 --2- 172.21.15.6:0/2613554483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f513da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f859ad9d640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f85840a2b80 0x7f85840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f858b7fe640 1 -- 172.21.15.6:0/3505657585 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f858c0cf0c0 con 0x7f859c102640 2024-09-12T00:02:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f859ad9d640 1 -- 172.21.15.6:0/2613554483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 msgr2=0x55e71f513da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f859ad9d640 1 --2- 172.21.15.6:0/2613554483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f513da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f859ad9d640 1 -- 172.21.15.6:0/2613554483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f514370 msgr2=0x55e71f516830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f859ad9d640 1 --2- 172.21.15.6:0/2613554483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f514370 0x55e71f516830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f859ad9d640 1 -- 172.21.15.6:0/2613554483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e71f419340 con 0x55e71f50e9a0 2024-09-12T00:02:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f859ad9d640 1 --2- 172.21.15.6:0/2613554483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 0x55e71f50eda0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8594012a30 tx=0x7f8594012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54727c397eaab257 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.937+0000 7f8588ff9640 1 -- 172.21.15.6:0/2613554483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594012210 con 0x55e71f50e9a0 2024-09-12T00:02:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.938+0000 7f859ad9d640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f85840a2b80 0x7f85840a5040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8594022000 tx=0x7f8594020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.938+0000 7f8588ff9640 1 -- 172.21.15.6:0/2613554483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85940044e0 con 0x55e71f50e9a0 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.938+0000 7f8588ff9640 1 -- 172.21.15.6:0/2613554483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859401f7d0 con 0x55e71f50e9a0 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.938+0000 7f85a39ba740 1 -- 172.21.15.6:0/2613554483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 msgr2=0x55e71f50eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.938+0000 7f85a39ba740 1 --2- 172.21.15.6:0/2613554483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 0x55e71f50eda0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8594012a30 tx=0x7f8594012ef0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.938+0000 7f85a39ba740 1 -- 172.21.15.6:0/2613554483 shutdown_connections 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.938+0000 7f85a39ba740 1 --2- 172.21.15.6:0/2613554483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f514370 0x55e71f516830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.938+0000 7f85a39ba740 1 --2- 172.21.15.6:0/2613554483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f513da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.938+0000 7f85a39ba740 1 --2- 172.21.15.6:0/2613554483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 0x55e71f50eda0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.938+0000 7f85a39ba740 1 -- 172.21.15.6:0/2613554483 >> 172.21.15.6:0/2613554483 conn(0x55e71f50a010 msgr2=0x55e71f50a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.939+0000 7f85a39ba740 1 -- 172.21.15.6:0/2613554483 shutdown_connections 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.939+0000 7f85a39ba740 1 -- 172.21.15.6:0/2613554483 wait complete. 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.939+0000 7f85a39ba740 1 -- start start 2024-09-12T00:02:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.939+0000 7f85a39ba740 1 Processor -- start 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.939+0000 7f85a39ba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f50e9a0 0x55e71f518cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.939+0000 7f85a39ba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f5191f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.939+0000 7f85a39ba740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 0x55e71f5201c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.939+0000 7f85a39ba740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e71f517340 con 0x55e71f514370 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.939+0000 7f85a39ba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e71f3fb290 con 0x55e71f50e9a0 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.939+0000 7f85a39ba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e71f5174c0 con 0x55e71f50f2e0 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.939+0000 7f85a39ba740 10 client.0 _ll_register_callbacks cb 0x55e71f42c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.939+0000 7f859ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 0x55e71f5201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f859ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 0x55e71f5201c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34054/0 (socket says 172.21.15.6:34054) 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f859ad9d640 1 -- 172.21.15.6:0/1386061693 learned_addr learned my addr 172.21.15.6:0/1386061693 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f8599d9b640 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f5191f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f859a59c640 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f50e9a0 0x55e71f518cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f859ad9d640 1 -- 172.21.15.6:0/1386061693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 msgr2=0x55e71f5191f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f859ad9d640 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f5191f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f859ad9d640 1 -- 172.21.15.6:0/1386061693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f50e9a0 msgr2=0x55e71f518cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f859ad9d640 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f50e9a0 0x55e71f518cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f859ad9d640 1 -- 172.21.15.6:0/1386061693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e71f185210 con 0x55e71f514370 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f859ad9d640 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 0x55e71f5201c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8594006010 tx=0x7f8594012700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6782e167e52f127c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f8581ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f8581ffb640 1 -- 172.21.15.6:0/1386061693 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594036060 con 0x55e71f514370 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f8581ffb640 1 -- 172.21.15.6:0/1386061693 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f859401f740 con 0x55e71f514370 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f85a39ba740 1 -- 172.21.15.6:0/1386061693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85940044e0 con 0x55e71f514370 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f8581ffb640 1 -- 172.21.15.6:0/1386061693 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f859403d050 con 0x55e71f514370 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f85a39ba740 10 client.15630 fetch_fsmap learned FSMap version 32 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.940+0000 7f85a39ba740 1 -- 172.21.15.6:0/1386061693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e71f251620 con 0x55e71f514370 2024-09-12T00:02:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.941+0000 7f8581ffb640 1 -- 172.21.15.6:0/1386061693 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85940044e0 con 0x55e71f514370 2024-09-12T00:02:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.941+0000 7f8581ffb640 1 -- 172.21.15.6:0/1386061693 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f85940284f0 con 0x55e71f514370 2024-09-12T00:02:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.941+0000 7f85a39ba740 10 client.15630 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:02:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.941+0000 7f85a39ba740 10 client.15630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:02:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.941+0000 7f85a39ba740 20 client.15630 populate_metadata read hostname 'smithi006' 2024-09-12T00:02:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.941+0000 7f85a39ba740 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e71f524690 0x55e71f526a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.941+0000 7f85a39ba740 4 client.15630 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.941+0000 7f85a39ba740 1 -- 172.21.15.6:0/1386061693 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e71f47fa20 con 0x55e71f524690 2024-09-12T00:02:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.941+0000 7f859a59c640 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e71f524690 0x55e71f526a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.942+0000 7f8581ffb640 10 client.15630 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.942+0000 7f859a59c640 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e71f524690 0x55e71f526a80 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5560f84ccd188b6f server_cookie=470b45334dac6936 in_seq=0 out_seq=0 2024-09-12T00:02:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.942+0000 7f8581ffb640 1 -- 172.21.15.6:0/1386061693 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e71f47fa20 con 0x55e71f524690 2024-09-12T00:02:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.942+0000 7f8581ffb640 10 client.15630 handle_command_reply: tid=0 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f85a39ba740 1 client.15630 shutdown 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f85a39ba740 1 -- 172.21.15.6:0/1386061693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 msgr2=0x55e71f5201c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f85a39ba740 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 0x55e71f5201c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8594006010 tx=0x7f8594012700 comp rx=0 tx=0).stop 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f85a39ba740 1 -- 172.21.15.6:0/1386061693 shutdown_connections 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f85a39ba740 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 0x55e71f5201c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f85a39ba740 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e71f524690 0x55e71f526a80 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f85a39ba740 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f5191f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f85a39ba740 1 --2- 172.21.15.6:0/1386061693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f50e9a0 0x55e71f518cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f8581ffb640 0 client.15630 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f85a39ba740 1 -- 172.21.15.6:0/1386061693 >> 172.21.15.6:0/1386061693 conn(0x55e71f50a010 msgr2=0x55e71f50b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f85a39ba740 1 -- 172.21.15.6:0/1386061693 shutdown_connections 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f85a39ba740 1 -- 172.21.15.6:0/1386061693 wait complete. 2024-09-12T00:02:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.943+0000 7f85a39ba740 20 client.15630 trim_cache size 0 max 16384 2024-09-12T00:02:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f85a39ba740 1 Processor -- start 2024-09-12T00:02:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f85a39ba740 1 -- start start 2024-09-12T00:02:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f85a39ba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f50e9a0 0x55e71f5090b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f85a39ba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f520180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f85a39ba740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 0x55e71f5095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f85a39ba740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1acc00 con 0x55e71f514370 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f85a39ba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1ae770 con 0x55e71f50e9a0 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f85a39ba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1ad2d0 con 0x55e71f50f2e0 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f859ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 0x55e71f5095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f859ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 0x55e71f5095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34068/0 (socket says 172.21.15.6:34068) 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f859ad9d640 1 -- 172.21.15.6:0/1787180938 learned_addr learned my addr 172.21.15.6:0/1787180938 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f859a59c640 1 --2- 172.21.15.6:0/1787180938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f50e9a0 0x55e71f5090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.963+0000 7f8599d9b640 1 --2- 172.21.15.6:0/1787180938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f520180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.964+0000 7f859ad9d640 1 -- 172.21.15.6:0/1787180938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 msgr2=0x55e71f520180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.964+0000 7f859ad9d640 1 --2- 172.21.15.6:0/1787180938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f520180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.964+0000 7f859ad9d640 1 -- 172.21.15.6:0/1787180938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f50e9a0 msgr2=0x55e71f5090b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.964+0000 7f859ad9d640 1 --2- 172.21.15.6:0/1787180938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f50e9a0 0x55e71f5090b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.964+0000 7f859ad9d640 1 -- 172.21.15.6:0/1787180938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e71f517220 con 0x55e71f514370 2024-09-12T00:02:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.964+0000 7f859ad9d640 1 --2- 172.21.15.6:0/1787180938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 0x55e71f5095f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8594015090 tx=0x7f8594009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf520dd54acf11a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.964+0000 7f8583fff640 1 -- 172.21.15.6:0/1787180938 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594036070 con 0x55e71f514370 2024-09-12T00:02:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.964+0000 7f8583fff640 1 -- 172.21.15.6:0/1787180938 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8594004e50 con 0x55e71f514370 2024-09-12T00:02:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.964+0000 7f8583fff640 1 -- 172.21.15.6:0/1787180938 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594028460 con 0x55e71f514370 2024-09-12T00:02:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.965+0000 7f85a39ba740 1 -- 172.21.15.6:0/1787180938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 msgr2=0x55e71f5095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.965+0000 7f85a39ba740 1 --2- 172.21.15.6:0/1787180938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 0x55e71f5095f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8594015090 tx=0x7f8594009dd0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.965+0000 7f85a39ba740 1 -- 172.21.15.6:0/1787180938 shutdown_connections 2024-09-12T00:02:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.965+0000 7f85a39ba740 1 --2- 172.21.15.6:0/1787180938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f514370 0x55e71f5095f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.965+0000 7f85a39ba740 1 --2- 172.21.15.6:0/1787180938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f520180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.965+0000 7f85a39ba740 1 --2- 172.21.15.6:0/1787180938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f50e9a0 0x55e71f5090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.965+0000 7f85a39ba740 1 -- 172.21.15.6:0/1787180938 >> 172.21.15.6:0/1787180938 conn(0x55e71f50a010 msgr2=0x55e71f5089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.965+0000 7f85a39ba740 1 -- 172.21.15.6:0/1787180938 shutdown_connections 2024-09-12T00:02:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.965+0000 7f85a39ba740 1 -- 172.21.15.6:0/1787180938 wait complete. 2024-09-12T00:02:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.965+0000 7f85a39ba740 1 -- start start 2024-09-12T00:02:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.965+0000 7f85a39ba740 1 Processor -- start 2024-09-12T00:02:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f85a39ba740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 0x55e71f51d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f85a39ba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f51d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f85a39ba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f514370 0x55e71f58d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f85a39ba740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1ae070 con 0x55e71f50e9a0 2024-09-12T00:02:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f85a39ba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1ad9a0 con 0x55e71f514370 2024-09-12T00:02:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f85a39ba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1aabe0 con 0x55e71f50f2e0 2024-09-12T00:02:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f85a39ba740 10 client.0 _ll_register_callbacks cb 0x7f85940093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f859a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 0x55e71f51d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f859a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 0x55e71f51d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34074/0 (socket says 172.21.15.6:34074) 2024-09-12T00:02:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f859a59c640 1 -- 172.21.15.6:0/4224317369 learned_addr learned my addr 172.21.15.6:0/4224317369 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:02:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f859ad9d640 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f514370 0x55e71f58d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f8599d9b640 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f51d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f859a59c640 1 -- 172.21.15.6:0/4224317369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 msgr2=0x55e71f51d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f859a59c640 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f51d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f859a59c640 1 -- 172.21.15.6:0/4224317369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f514370 msgr2=0x55e71f58d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f859a59c640 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f514370 0x55e71f58d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f859a59c640 1 -- 172.21.15.6:0/4224317369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e71f58d870 con 0x55e71f50e9a0 2024-09-12T00:02:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f859ad9d640 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f514370 0x55e71f58d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f8599d9b640 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f51d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:02:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f859a59c640 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 0x55e71f51d0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f858c097990 tx=0x7f858c06b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf3da1f271b8af5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f8581ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:02:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.966+0000 7f8581ffb640 1 -- 172.21.15.6:0/4224317369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c0bb040 con 0x55e71f50e9a0 2024-09-12T00:02:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f8581ffb640 1 -- 172.21.15.6:0/4224317369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f858c06a1b0 con 0x55e71f50e9a0 2024-09-12T00:02:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f85a39ba740 1 -- 172.21.15.6:0/4224317369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8594004e50 con 0x55e71f50e9a0 2024-09-12T00:02:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f8581ffb640 1 -- 172.21.15.6:0/4224317369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f858c020040 con 0x55e71f50e9a0 2024-09-12T00:02:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f85a39ba740 10 client.15636 fetch_fsmap learned FSMap version 32 2024-09-12T00:02:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f85a39ba740 1 -- 172.21.15.6:0/4224317369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e71f58ec00 con 0x55e71f50e9a0 2024-09-12T00:02:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f8581ffb640 1 -- 172.21.15.6:0/4224317369 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8594004e50 con 0x55e71f50e9a0 2024-09-12T00:02:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f8581ffb640 1 -- 172.21.15.6:0/4224317369 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f858c083030 con 0x55e71f50e9a0 2024-09-12T00:02:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f85a39ba740 10 client.15636 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:02:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f85a39ba740 10 client.15636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:02:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f85a39ba740 20 client.15636 populate_metadata read hostname 'smithi006' 2024-09-12T00:02:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f85a39ba740 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e71f58f530 0x55e71f591950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f85a39ba740 4 client.15636 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:02:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f85a39ba740 1 -- 172.21.15.6:0/4224317369 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e71f479d70 con 0x55e71f58f530 2024-09-12T00:02:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.967+0000 7f8599d9b640 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e71f58f530 0x55e71f591950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.968+0000 7f8599d9b640 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e71f58f530 0x55e71f591950 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac2f666f8721688a server_cookie=999eabdc99d22e01 in_seq=0 out_seq=0 2024-09-12T00:02:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.968+0000 7f8581ffb640 10 client.15636 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f8581ffb640 1 -- 172.21.15.6:0/4224317369 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e71f479d70 con 0x55e71f58f530 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f8581ffb640 10 client.15636 handle_command_reply: tid=0 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f85a39ba740 1 client.15636 shutdown 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f85a39ba740 1 -- 172.21.15.6:0/4224317369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 msgr2=0x55e71f51d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f85a39ba740 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 0x55e71f51d0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f858c097990 tx=0x7f858c06b3e0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f85a39ba740 1 -- 172.21.15.6:0/4224317369 shutdown_connections 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f85a39ba740 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e71f514370 0x55e71f58d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f85a39ba740 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e71f58f530 0x55e71f591950 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f85a39ba740 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e71f50f2e0 0x55e71f51d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f85a39ba740 1 --2- 172.21.15.6:0/4224317369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e71f50e9a0 0x55e71f51d0a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f85a39ba740 1 -- 172.21.15.6:0/4224317369 >> 172.21.15.6:0/4224317369 conn(0x55e71f50a010 msgr2=0x55e71f5091c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f8581ffb640 0 client.15636 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f85a39ba740 1 -- 172.21.15.6:0/4224317369 shutdown_connections 2024-09-12T00:02:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.986+0000 7f85a39ba740 1 -- 172.21.15.6:0/4224317369 wait complete. 2024-09-12T00:02:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a39ba740 20 client.15636 trim_cache size 0 max 16384 2024-09-12T00:02:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:02:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:02:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:02:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:02:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a0c23640 1 -- 172.21.15.6:0/3505657585 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f85840a2b80 msgr2=0x7f85840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a0c23640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f85840a2b80 0x7f85840a5040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8594022000 tx=0x7f8594020000 comp rx=0 tx=0).stop 2024-09-12T00:02:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a0c23640 1 -- 172.21.15.6:0/3505657585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c102640 msgr2=0x7f859c101fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a0c23640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c102640 0x7f859c101fb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f858c00d950 tx=0x7f858c00de10 comp rx=0 tx=0).stop 2024-09-12T00:02:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a0c23640 1 -- 172.21.15.6:0/3505657585 shutdown_connections 2024-09-12T00:02:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a0c23640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f85840a2b80 0x7f85840a5040 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a0c23640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c1078a0 0x7f859c100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a0c23640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f859c104f70 0x7f859c1005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a0c23640 1 --2- 172.21.15.6:0/3505657585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c102640 0x7f859c101fb0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a0c23640 1 -- 172.21.15.6:0/3505657585 >> 172.21.15.6:0/3505657585 conn(0x7f859c0fc1c0 msgr2=0x7f859c102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a0c23640 1 -- 172.21.15.6:0/3505657585 shutdown_connections 2024-09-12T00:02:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:02:56.987+0000 7f85a0c23640 1 -- 172.21.15.6:0/3505657585 wait complete. 2024-09-12T00:02:58.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:02:58 smithi006 ceph-mon[30947]: pgmap v468: 129 pgs: 129 active+clean; 3.4 GiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:02:58.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:02:58 smithi134 ceph-mon[34893]: pgmap v468: 129 pgs: 129 active+clean; 3.4 GiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:02:58.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:02:58 smithi039 ceph-mon[34543]: pgmap v468: 129 pgs: 129 active+clean; 3.4 GiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:03:00.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:00 smithi006 ceph-mon[30947]: pgmap v469: 129 pgs: 129 active+clean; 3.5 GiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:03:00.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:00 smithi134 ceph-mon[34893]: pgmap v469: 129 pgs: 129 active+clean; 3.5 GiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:03:00.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:00 smithi039 ceph-mon[34543]: pgmap v469: 129 pgs: 129 active+clean; 3.5 GiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:03:02.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:02 smithi006 ceph-mon[30947]: pgmap v470: 129 pgs: 129 active+clean; 3.5 GiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:03:02.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:02 smithi134 ceph-mon[34893]: pgmap v470: 129 pgs: 129 active+clean; 3.5 GiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:03:02.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:02 smithi039 ceph-mon[34543]: pgmap v470: 129 pgs: 129 active+clean; 3.5 GiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:03:03.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:03:03.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:03:03.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:03:03.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:03:03.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:03:03.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:03:03.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:03:03.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:03:03.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:03:03.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:03:03.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:03:03.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:03:04.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:04 smithi134 ceph-mon[34893]: pgmap v471: 129 pgs: 129 active+clean; 3.6 GiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:03:04.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:04 smithi039 ceph-mon[34543]: pgmap v471: 129 pgs: 129 active+clean; 3.6 GiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:03:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:04 smithi006 ceph-mon[30947]: pgmap v471: 129 pgs: 129 active+clean; 3.6 GiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:03:06.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:06 smithi134 ceph-mon[34893]: pgmap v472: 129 pgs: 129 active+clean; 3.6 GiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:03:06.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:06 smithi039 ceph-mon[34543]: pgmap v472: 129 pgs: 129 active+clean; 3.6 GiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:03:06.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:06 smithi006 ceph-mon[30947]: pgmap v472: 129 pgs: 129 active+clean; 3.6 GiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:03:08.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:08 smithi134 ceph-mon[34893]: pgmap v473: 129 pgs: 129 active+clean; 3.7 GiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-09-12T00:03:08.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:08 smithi039 ceph-mon[34543]: pgmap v473: 129 pgs: 129 active+clean; 3.7 GiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-09-12T00:03:08.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:08 smithi006 ceph-mon[30947]: pgmap v473: 129 pgs: 129 active+clean; 3.7 GiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-09-12T00:03:10.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.085+0000 7f4153ed7640 1 -- 172.21.15.6:0/4239474384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414c103710 msgr2=0x7f414c109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.085+0000 7f4153ed7640 1 --2- 172.21.15.6:0/4239474384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414c103710 0x7f414c109fa0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4144009ca0 tx=0x7f414402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.085+0000 7f4153ed7640 1 -- 172.21.15.6:0/4239474384 shutdown_connections 2024-09-12T00:03:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.085+0000 7f4153ed7640 1 --2- 172.21.15.6:0/4239474384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414c103710 0x7f414c109fa0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.085+0000 7f4153ed7640 1 --2- 172.21.15.6:0/4239474384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c102d50 0x7f414c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.085+0000 7f4153ed7640 1 --2- 172.21.15.6:0/4239474384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c101b60 0x7f414c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.085+0000 7f4153ed7640 1 -- 172.21.15.6:0/4239474384 >> 172.21.15.6:0/4239474384 conn(0x7f414c0fd2e0 msgr2=0x7f414c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.085+0000 7f4153ed7640 1 -- 172.21.15.6:0/4239474384 shutdown_connections 2024-09-12T00:03:10.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.085+0000 7f4153ed7640 1 -- 172.21.15.6:0/4239474384 wait complete. 2024-09-12T00:03:10.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4153ed7640 1 Processor -- start 2024-09-12T00:03:10.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4153ed7640 1 -- start start 2024-09-12T00:03:10.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4153ed7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c101b60 0x7f414c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4153ed7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c102d50 0x7f414c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4153ed7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414c103710 0x7f414c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4153ed7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f414c10d690 con 0x7f414c103710 2024-09-12T00:03:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4153ed7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f414c10d510 con 0x7f414c101b60 2024-09-12T00:03:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4153ed7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f414c10d810 con 0x7f414c102d50 2024-09-12T00:03:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4152474640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414c103710 0x7f414c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4151c73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c101b60 0x7f414c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4152474640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414c103710 0x7f414c074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52424/0 (socket says 172.21.15.6:52424) 2024-09-12T00:03:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4151c73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c101b60 0x7f414c075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:58684/0 (socket says 172.21.15.6:58684) 2024-09-12T00:03:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4152474640 1 -- 172.21.15.6:0/3372994077 learned_addr learned my addr 172.21.15.6:0/3372994077 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.086+0000 7f4151472640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c102d50 0x7f414c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.087+0000 7f4152474640 1 -- 172.21.15.6:0/3372994077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c102d50 msgr2=0x7f414c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.087+0000 7f4152474640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c102d50 0x7f414c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.087+0000 7f4152474640 1 -- 172.21.15.6:0/3372994077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c101b60 msgr2=0x7f414c075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.087+0000 7f4152474640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c101b60 0x7f414c075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.087+0000 7f4152474640 1 -- 172.21.15.6:0/3372994077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c0753b0 con 0x7f414c103710 2024-09-12T00:03:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.087+0000 7f4152474640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414c103710 0x7f414c074b20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4144009dc0 tx=0x7f4144003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.087+0000 7f4142ffd640 1 -- 172.21.15.6:0/3372994077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4144032ec0 con 0x7f414c103710 2024-09-12T00:03:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.087+0000 7f4153ed7640 1 -- 172.21.15.6:0/3372994077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f414c1a1e90 con 0x7f414c103710 2024-09-12T00:03:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.087+0000 7f4142ffd640 1 -- 172.21.15.6:0/3372994077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41440044f0 con 0x7f414c103710 2024-09-12T00:03:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.087+0000 7f4142ffd640 1 -- 172.21.15.6:0/3372994077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4144030d40 con 0x7f414c103710 2024-09-12T00:03:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.087+0000 7f4153ed7640 1 -- 172.21.15.6:0/3372994077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f414c1a22f0 con 0x7f414c103710 2024-09-12T00:03:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.090+0000 7f4142ffd640 1 -- 172.21.15.6:0/3372994077 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f4144004040 con 0x7f414c103710 2024-09-12T00:03:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.090+0000 7f4156c70740 1 Processor -- start 2024-09-12T00:03:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.090+0000 7f4156c70740 1 -- start start 2024-09-12T00:03:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.090+0000 7f4156c70740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69687da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4156c70740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e696882e0 0x564e6968cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4156c70740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e6968d370 0x564e6968f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4156c70740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564e695eb2f0 con 0x564e696879a0 2024-09-12T00:03:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4156c70740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564e69593270 con 0x564e696882e0 2024-09-12T00:03:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4156c70740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564e695e72b0 con 0x564e6968d370 2024-09-12T00:03:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4151472640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69687da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4151472640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69687da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52428/0 (socket says 172.21.15.6:52428) 2024-09-12T00:03:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4151472640 1 -- 172.21.15.6:0/1975942325 learned_addr learned my addr 172.21.15.6:0/1975942325 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4151c73640 1 --2- 172.21.15.6:0/1975942325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e696882e0 0x564e6968cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4151472640 1 --2- 172.21.15.6:0/1975942325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e6968d370 0x564e6968f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4142ffd640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f41380a2d20 0x7f41380a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4151472640 1 -- 172.21.15.6:0/1975942325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e6968d370 msgr2=0x564e6968f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4151472640 1 --2- 172.21.15.6:0/1975942325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e6968d370 0x564e6968f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4151472640 1 -- 172.21.15.6:0/1975942325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e696882e0 msgr2=0x564e6968cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4151472640 1 --2- 172.21.15.6:0/1975942325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e696882e0 0x564e6968cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4151472640 1 -- 172.21.15.6:0/1975942325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e69592340 con 0x564e696879a0 2024-09-12T00:03:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4152474640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f41380a2d20 0x7f41380a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4142ffd640 1 -- 172.21.15.6:0/3372994077 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f41440f0900 con 0x7f414c103710 2024-09-12T00:03:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.091+0000 7f4151472640 1 --2- 172.21.15.6:0/1975942325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69687da0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f413c005cf0 tx=0x7f413c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f47688db5255532 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.092+0000 7f4137fff640 1 -- 172.21.15.6:0/1975942325 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c004030 con 0x564e696879a0 2024-09-12T00:03:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.092+0000 7f4152474640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f41380a2d20 0x7f41380a51e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f41440bca70 tx=0x7f4144087fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.092+0000 7f4137fff640 1 -- 172.21.15.6:0/1975942325 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f413c005020 con 0x564e696879a0 2024-09-12T00:03:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.092+0000 7f4137fff640 1 -- 172.21.15.6:0/1975942325 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c004af0 con 0x564e696879a0 2024-09-12T00:03:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.093+0000 7f4156c70740 1 -- 172.21.15.6:0/1975942325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 msgr2=0x564e69687da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.093+0000 7f4156c70740 1 --2- 172.21.15.6:0/1975942325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69687da0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f413c005cf0 tx=0x7f413c00b840 comp rx=0 tx=0).stop 2024-09-12T00:03:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.093+0000 7f4156c70740 1 -- 172.21.15.6:0/1975942325 shutdown_connections 2024-09-12T00:03:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.093+0000 7f4156c70740 1 --2- 172.21.15.6:0/1975942325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e6968d370 0x564e6968f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.093+0000 7f4156c70740 1 --2- 172.21.15.6:0/1975942325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e696882e0 0x564e6968cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.093+0000 7f4156c70740 1 --2- 172.21.15.6:0/1975942325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69687da0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.093+0000 7f4156c70740 1 -- 172.21.15.6:0/1975942325 >> 172.21.15.6:0/1975942325 conn(0x564e69683010 msgr2=0x564e69683410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.093+0000 7f4156c70740 1 -- 172.21.15.6:0/1975942325 shutdown_connections 2024-09-12T00:03:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.093+0000 7f4156c70740 1 -- 172.21.15.6:0/1975942325 wait complete. 2024-09-12T00:03:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.093+0000 7f4156c70740 1 -- start start 2024-09-12T00:03:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.093+0000 7f4156c70740 1 Processor -- start 2024-09-12T00:03:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4156c70740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69691c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4156c70740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e696882e0 0x564e69692160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4156c70740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e6968d370 0x564e696991a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4156c70740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564e69690340 con 0x564e696879a0 2024-09-12T00:03:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4156c70740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564e69574290 con 0x564e696882e0 2024-09-12T00:03:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4156c70740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564e696904c0 con 0x564e6968d370 2024-09-12T00:03:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4156c70740 10 client.0 _ll_register_callbacks cb 0x564e695a5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:10.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4151472640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69691c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4151472640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69691c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52444/0 (socket says 172.21.15.6:52444) 2024-09-12T00:03:10.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4151472640 1 -- 172.21.15.6:0/3832227675 learned_addr learned my addr 172.21.15.6:0/3832227675 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:10.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4151472640 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e6968d370 0x564e696991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4151c73640 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e696882e0 0x564e69692160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4151472640 1 -- 172.21.15.6:0/3832227675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e6968d370 msgr2=0x564e696991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:10.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4151472640 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e6968d370 0x564e696991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4151472640 1 -- 172.21.15.6:0/3832227675 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e696882e0 msgr2=0x564e69692160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4151472640 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e696882e0 0x564e69692160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4151472640 1 -- 172.21.15.6:0/3832227675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e692fe210 con 0x564e696879a0 2024-09-12T00:03:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f4151472640 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69691c20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f413c004770 tx=0x7f413c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12842f5afe7195f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.094+0000 7f41357fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:03:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f41357fa640 1 -- 172.21.15.6:0/3832227675 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c01f070 con 0x564e696879a0 2024-09-12T00:03:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f41357fa640 1 -- 172.21.15.6:0/3832227675 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f413c004c20 con 0x564e696879a0 2024-09-12T00:03:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f4156c70740 1 -- 172.21.15.6:0/3832227675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f413c005020 con 0x564e696879a0 2024-09-12T00:03:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f41357fa640 1 -- 172.21.15.6:0/3832227675 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f413c030050 con 0x564e696879a0 2024-09-12T00:03:10.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f4156c70740 10 client.15648 fetch_fsmap learned FSMap version 32 2024-09-12T00:03:10.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f4156c70740 1 -- 172.21.15.6:0/3832227675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564e693ca620 con 0x564e696879a0 2024-09-12T00:03:10.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f41357fa640 1 -- 172.21.15.6:0/3832227675 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f413c005020 con 0x564e696879a0 2024-09-12T00:03:10.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f41357fa640 1 -- 172.21.15.6:0/3832227675 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f413c029060 con 0x564e696879a0 2024-09-12T00:03:10.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f4156c70740 10 client.15648 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:03:10.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f4156c70740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:03:10.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f4156c70740 20 client.15648 populate_metadata read hostname 'smithi006' 2024-09-12T00:03:10.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f4156c70740 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e6969d6a0 0x564e6969fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f4156c70740 4 client.15648 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:10.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.095+0000 7f4156c70740 1 -- 172.21.15.6:0/3832227675 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e695f8a20 con 0x564e6969d6a0 2024-09-12T00:03:10.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.096+0000 7f4151c73640 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e6969d6a0 0x564e6969fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.096+0000 7f41357fa640 10 client.15648 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:10.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.096+0000 7f4151c73640 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e6969d6a0 0x564e6969fac0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bec173cc222fef79 server_cookie=9489787c4866ed65 in_seq=0 out_seq=0 2024-09-12T00:03:10.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f41357fa640 1 -- 172.21.15.6:0/3832227675 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e695f8a20 con 0x564e6969d6a0 2024-09-12T00:03:10.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f41357fa640 10 client.15648 handle_command_reply: tid=0 2024-09-12T00:03:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f4156c70740 1 client.15648 shutdown 2024-09-12T00:03:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f4156c70740 1 -- 172.21.15.6:0/3832227675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 msgr2=0x564e69691c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f4156c70740 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69691c20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f413c004770 tx=0x7f413c0046c0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f4156c70740 1 -- 172.21.15.6:0/3832227675 shutdown_connections 2024-09-12T00:03:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f4156c70740 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e6969d6a0 0x564e6969fac0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f4156c70740 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e6968d370 0x564e696991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f4156c70740 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e696882e0 0x564e69692160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f4156c70740 1 --2- 172.21.15.6:0/3832227675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69691c20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f41357fa640 0 client.15648 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:10.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f4156c70740 1 -- 172.21.15.6:0/3832227675 >> 172.21.15.6:0/3832227675 conn(0x564e69683010 msgr2=0x564e69684820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:10.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f4156c70740 1 -- 172.21.15.6:0/3832227675 shutdown_connections 2024-09-12T00:03:10.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f4156c70740 1 -- 172.21.15.6:0/3832227675 wait complete. 2024-09-12T00:03:10.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.097+0000 7f4156c70740 20 client.15648 trim_cache size 0 max 16384 2024-09-12T00:03:10.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4156c70740 1 Processor -- start 2024-09-12T00:03:10.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4156c70740 1 -- start start 2024-09-12T00:03:10.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4156c70740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e696921f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4156c70740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e696882e0 0x564e696990c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4156c70740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e6968d370 0x564e696820b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4156c70740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1aca70 con 0x564e696879a0 2024-09-12T00:03:10.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4156c70740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1ae5e0 con 0x564e6968d370 2024-09-12T00:03:10.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4156c70740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1ad140 con 0x564e696882e0 2024-09-12T00:03:10.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4151472640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e696921f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4151472640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e696921f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52454/0 (socket says 172.21.15.6:52454) 2024-09-12T00:03:10.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4151472640 1 -- 172.21.15.6:0/3492082703 learned_addr learned my addr 172.21.15.6:0/3492082703 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:10.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4151c73640 1 --2- 172.21.15.6:0/3492082703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e696882e0 0x564e696990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4151472640 1 -- 172.21.15.6:0/3492082703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e696882e0 msgr2=0x564e696990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:10.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4151472640 1 --2- 172.21.15.6:0/3492082703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e696882e0 0x564e696990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4151472640 1 -- 172.21.15.6:0/3492082703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e6968d370 msgr2=0x564e696820b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:10.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4151472640 1 --2- 172.21.15.6:0/3492082703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e6968d370 0x564e696820b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4151472640 1 -- 172.21.15.6:0/3492082703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e69682e30 con 0x564e696879a0 2024-09-12T00:03:10.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4151c73640 1 --2- 172.21.15.6:0/3492082703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e696882e0 0x564e696990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:10.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.114+0000 7f4151472640 1 --2- 172.21.15.6:0/3492082703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e696921f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f413c00bd70 tx=0x7f413c012270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cbd2ace1bb21c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.115+0000 7f41377fe640 1 -- 172.21.15.6:0/3492082703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c01f040 con 0x564e696879a0 2024-09-12T00:03:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.115+0000 7f41377fe640 1 -- 172.21.15.6:0/3492082703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f413c00b770 con 0x564e696879a0 2024-09-12T00:03:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.115+0000 7f41377fe640 1 -- 172.21.15.6:0/3492082703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c004c80 con 0x564e696879a0 2024-09-12T00:03:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.115+0000 7f4156c70740 1 -- 172.21.15.6:0/3492082703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 msgr2=0x564e696921f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.115+0000 7f4156c70740 1 --2- 172.21.15.6:0/3492082703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e696921f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f413c00bd70 tx=0x7f413c012270 comp rx=0 tx=0).stop 2024-09-12T00:03:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.115+0000 7f4156c70740 1 -- 172.21.15.6:0/3492082703 shutdown_connections 2024-09-12T00:03:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.115+0000 7f4156c70740 1 --2- 172.21.15.6:0/3492082703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e6968d370 0x564e696820b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.115+0000 7f4156c70740 1 --2- 172.21.15.6:0/3492082703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e696882e0 0x564e696990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.115+0000 7f4156c70740 1 --2- 172.21.15.6:0/3492082703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e696921f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.115+0000 7f4156c70740 1 -- 172.21.15.6:0/3492082703 >> 172.21.15.6:0/3492082703 conn(0x564e69683010 msgr2=0x564e696819a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.116+0000 7f4156c70740 1 -- 172.21.15.6:0/3492082703 shutdown_connections 2024-09-12T00:03:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.116+0000 7f4156c70740 1 -- 172.21.15.6:0/3492082703 wait complete. 2024-09-12T00:03:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.116+0000 7f4156c70740 1 -- start start 2024-09-12T00:03:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.116+0000 7f4156c70740 1 Processor -- start 2024-09-12T00:03:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.116+0000 7f4156c70740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69696540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.116+0000 7f4156c70740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e696882e0 0x564e69696a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.116+0000 7f4156c70740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e6968d370 0x564e69697a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.116+0000 7f4156c70740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1adee0 con 0x564e696879a0 2024-09-12T00:03:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.116+0000 7f4156c70740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1ad810 con 0x564e6968d370 2024-09-12T00:03:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.116+0000 7f4156c70740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1aaa50 con 0x564e696882e0 2024-09-12T00:03:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.116+0000 7f4156c70740 10 client.0 _ll_register_callbacks cb 0x7f414800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.116+0000 7f4151472640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69696540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4151472640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69696540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52456/0 (socket says 172.21.15.6:52456) 2024-09-12T00:03:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4151472640 1 -- 172.21.15.6:0/477961204 learned_addr learned my addr 172.21.15.6:0/477961204 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4151c73640 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e696882e0 0x564e69696a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4151472640 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e6968d370 0x564e69697a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4151472640 1 -- 172.21.15.6:0/477961204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e696882e0 msgr2=0x564e69696a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4151472640 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e696882e0 0x564e69696a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4151472640 1 -- 172.21.15.6:0/477961204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e6968d370 msgr2=0x564e69697a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:10.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4151472640 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e6968d370 0x564e69697a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4151472640 1 -- 172.21.15.6:0/477961204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e696980a0 con 0x564e696879a0 2024-09-12T00:03:10.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4151472640 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69696540 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f413c0047e0 tx=0x7f413c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ed4c915cc853aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:10.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f41357fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:03:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f41357fa640 1 -- 172.21.15.6:0/477961204 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c03a020 con 0x564e696879a0 2024-09-12T00:03:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f41357fa640 1 -- 172.21.15.6:0/477961204 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f413c004ce0 con 0x564e696879a0 2024-09-12T00:03:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4156c70740 1 -- 172.21.15.6:0/477961204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f413c00b770 con 0x564e696879a0 2024-09-12T00:03:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f41357fa640 1 -- 172.21.15.6:0/477961204 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f413c045050 con 0x564e696879a0 2024-09-12T00:03:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4156c70740 10 client.15654 fetch_fsmap learned FSMap version 32 2024-09-12T00:03:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.117+0000 7f4156c70740 1 -- 172.21.15.6:0/477961204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564e69699320 con 0x564e696879a0 2024-09-12T00:03:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.118+0000 7f41357fa640 1 -- 172.21.15.6:0/477961204 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f413c00b770 con 0x564e696879a0 2024-09-12T00:03:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.118+0000 7f41357fa640 1 -- 172.21.15.6:0/477961204 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f413c029040 con 0x564e696879a0 2024-09-12T00:03:10.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.118+0000 7f4156c70740 10 client.15654 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:03:10.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.118+0000 7f4156c70740 10 client.15654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:03:10.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.118+0000 7f4156c70740 20 client.15654 populate_metadata read hostname 'smithi006' 2024-09-12T00:03:10.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.118+0000 7f4156c70740 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e69708a00 0x564e6970ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:10.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.118+0000 7f4156c70740 4 client.15654 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:03:10.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.118+0000 7f4156c70740 1 -- 172.21.15.6:0/477961204 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e695f2d70 con 0x564e69708a00 2024-09-12T00:03:10.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.118+0000 7f4151c73640 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e69708a00 0x564e6970ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:10.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.119+0000 7f4151c73640 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e69708a00 0x564e6970ae20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b269905197603041 server_cookie=193963fea8c2c03d in_seq=0 out_seq=0 2024-09-12T00:03:10.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.119+0000 7f41357fa640 10 client.15654 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.134+0000 7f41357fa640 1 -- 172.21.15.6:0/477961204 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e695f2d70 con 0x564e69708a00 2024-09-12T00:03:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.134+0000 7f41357fa640 10 client.15654 handle_command_reply: tid=0 2024-09-12T00:03:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.134+0000 7f4156c70740 1 client.15654 shutdown 2024-09-12T00:03:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.134+0000 7f4156c70740 1 -- 172.21.15.6:0/477961204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 msgr2=0x564e69696540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.134+0000 7f4156c70740 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69696540 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f413c0047e0 tx=0x7f413c001e70 comp rx=0 tx=0).stop 2024-09-12T00:03:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.134+0000 7f4156c70740 1 -- 172.21.15.6:0/477961204 shutdown_connections 2024-09-12T00:03:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.134+0000 7f4156c70740 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564e6968d370 0x564e69697a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.134+0000 7f4156c70740 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564e69708a00 0x564e6970ae20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4156c70740 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e696882e0 0x564e69696a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4156c70740 1 --2- 172.21.15.6:0/477961204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e696879a0 0x564e69696540 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f41357fa640 0 client.15654 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4156c70740 1 -- 172.21.15.6:0/477961204 >> 172.21.15.6:0/477961204 conn(0x564e69683010 msgr2=0x564e696846e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4156c70740 1 -- 172.21.15.6:0/477961204 shutdown_connections 2024-09-12T00:03:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4156c70740 1 -- 172.21.15.6:0/477961204 wait complete. 2024-09-12T00:03:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4156c70740 20 client.15654 trim_cache size 0 max 16384 2024-09-12T00:03:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:03:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:03:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:03:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:03:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4153ed7640 1 -- 172.21.15.6:0/3372994077 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f41380a2d20 msgr2=0x7f41380a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4153ed7640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f41380a2d20 0x7f41380a51e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f41440bca70 tx=0x7f4144087fb0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4153ed7640 1 -- 172.21.15.6:0/3372994077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414c103710 msgr2=0x7f414c074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4153ed7640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414c103710 0x7f414c074b20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4144009dc0 tx=0x7f4144003ba0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4153ed7640 1 -- 172.21.15.6:0/3372994077 shutdown_connections 2024-09-12T00:03:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4153ed7640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f41380a2d20 0x7f41380a51e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4153ed7640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414c103710 0x7f414c074b20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4153ed7640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c102d50 0x7f414c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4153ed7640 1 --2- 172.21.15.6:0/3372994077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c101b60 0x7f414c075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.135+0000 7f4153ed7640 1 -- 172.21.15.6:0/3372994077 >> 172.21.15.6:0/3372994077 conn(0x7f414c0fd2e0 msgr2=0x7f414c1061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.136+0000 7f4153ed7640 1 -- 172.21.15.6:0/3372994077 shutdown_connections 2024-09-12T00:03:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:10.136+0000 7f4153ed7640 1 -- 172.21.15.6:0/3372994077 wait complete. 2024-09-12T00:03:10.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:10 smithi134 ceph-mon[34893]: pgmap v474: 129 pgs: 129 active+clean; 3.7 GiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:03:10.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:10 smithi039 ceph-mon[34543]: pgmap v474: 129 pgs: 129 active+clean; 3.7 GiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:03:10.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:10 smithi006 ceph-mon[30947]: pgmap v474: 129 pgs: 129 active+clean; 3.7 GiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:03:12.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:12 smithi134 ceph-mon[34893]: pgmap v475: 129 pgs: 129 active+clean; 3.8 GiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:03:12.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:12 smithi039 ceph-mon[34543]: pgmap v475: 129 pgs: 129 active+clean; 3.8 GiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:03:12.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:12 smithi006 ceph-mon[30947]: pgmap v475: 129 pgs: 129 active+clean; 3.8 GiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:03:14.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:14 smithi134 ceph-mon[34893]: pgmap v476: 129 pgs: 129 active+clean; 3.8 GiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 21 op/s 2024-09-12T00:03:14.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:14 smithi039 ceph-mon[34543]: pgmap v476: 129 pgs: 129 active+clean; 3.8 GiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 21 op/s 2024-09-12T00:03:14.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:14 smithi006 ceph-mon[30947]: pgmap v476: 129 pgs: 129 active+clean; 3.8 GiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 21 op/s 2024-09-12T00:03:16.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:16 smithi134 ceph-mon[34893]: pgmap v477: 129 pgs: 129 active+clean; 3.9 GiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:03:16.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:16 smithi039 ceph-mon[34543]: pgmap v477: 129 pgs: 129 active+clean; 3.9 GiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:03:16.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:16 smithi006 ceph-mon[30947]: pgmap v477: 129 pgs: 129 active+clean; 3.9 GiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:03:18.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:18 smithi134 ceph-mon[34893]: pgmap v478: 129 pgs: 129 active+clean; 3.9 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:03:18.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:18 smithi039 ceph-mon[34543]: pgmap v478: 129 pgs: 129 active+clean; 3.9 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:03:18.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:18 smithi006 ceph-mon[30947]: pgmap v478: 129 pgs: 129 active+clean; 3.9 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:03:20.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:20 smithi134 ceph-mon[34893]: pgmap v479: 129 pgs: 129 active+clean; 4.0 GiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:03:20.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:20 smithi039 ceph-mon[34543]: pgmap v479: 129 pgs: 129 active+clean; 4.0 GiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:03:20.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:20 smithi006 ceph-mon[30947]: pgmap v479: 129 pgs: 129 active+clean; 4.0 GiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:03:22.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:22 smithi134 ceph-mon[34893]: pgmap v480: 129 pgs: 129 active+clean; 4.0 GiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:03:22.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:22 smithi039 ceph-mon[34543]: pgmap v480: 129 pgs: 129 active+clean; 4.0 GiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:03:22.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:22 smithi006 ceph-mon[30947]: pgmap v480: 129 pgs: 129 active+clean; 4.0 GiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:03:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.229+0000 7fa89c931640 1 -- 172.21.15.6:0/1371178623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa898101b50 msgr2=0x7fa898101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.229+0000 7fa89c931640 1 --2- 172.21.15.6:0/1371178623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa898101b50 0x7fa898101f50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa888009900 tx=0x7fa88802a410 comp rx=0 tx=0).stop 2024-09-12T00:03:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.229+0000 7fa89c931640 1 -- 172.21.15.6:0/1371178623 shutdown_connections 2024-09-12T00:03:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.229+0000 7fa89c931640 1 --2- 172.21.15.6:0/1371178623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898103700 0x7fa898109f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.229+0000 7fa89c931640 1 --2- 172.21.15.6:0/1371178623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa898102d40 0x7fa8981031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.229+0000 7fa89c931640 1 --2- 172.21.15.6:0/1371178623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa898101b50 0x7fa898101f50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.230 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.229+0000 7fa89c931640 1 -- 172.21.15.6:0/1371178623 >> 172.21.15.6:0/1371178623 conn(0x7fa8980fd2f0 msgr2=0x7fa8980ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:23.230 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.229+0000 7fa89c931640 1 -- 172.21.15.6:0/1371178623 shutdown_connections 2024-09-12T00:03:23.230 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.229+0000 7fa89c931640 1 -- 172.21.15.6:0/1371178623 wait complete. 2024-09-12T00:03:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa89c931640 1 Processor -- start 2024-09-12T00:03:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa89c931640 1 -- start start 2024-09-12T00:03:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa89c931640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898101b50 0x7fa898075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa89c931640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa898102d40 0x7fa8980745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa89c931640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa898103700 0x7fa898074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa89c931640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa89810d6d0 con 0x7fa898103700 2024-09-12T00:03:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa89c931640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa89810d550 con 0x7fa898101b50 2024-09-12T00:03:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa89c931640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa89810d850 con 0x7fa898102d40 2024-09-12T00:03:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa896d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa898103700 0x7fa898074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa896d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa898103700 0x7fa898074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56632/0 (socket says 172.21.15.6:56632) 2024-09-12T00:03:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa896d9d640 1 -- 172.21.15.6:0/1951628422 learned_addr learned my addr 172.21.15.6:0/1951628422 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa89659c640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898101b50 0x7fa898075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa895d9b640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa898102d40 0x7fa8980745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa896d9d640 1 -- 172.21.15.6:0/1951628422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa898102d40 msgr2=0x7fa8980745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa896d9d640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa898102d40 0x7fa8980745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa896d9d640 1 -- 172.21.15.6:0/1951628422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898101b50 msgr2=0x7fa898075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa896d9d640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898101b50 0x7fa898075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.230+0000 7fa896d9d640 1 -- 172.21.15.6:0/1951628422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8980753b0 con 0x7fa898103700 2024-09-12T00:03:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.231+0000 7fa896d9d640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa898103700 0x7fa898074b20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa89000eb10 tx=0x7fa89000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.231+0000 7fa8877fe640 1 -- 172.21.15.6:0/1951628422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa890004b20 con 0x7fa898103700 2024-09-12T00:03:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.231+0000 7fa89c931640 1 -- 172.21.15.6:0/1951628422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8981a1ef0 con 0x7fa898103700 2024-09-12T00:03:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.231+0000 7fa8877fe640 1 -- 172.21.15.6:0/1951628422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa890004cc0 con 0x7fa898103700 2024-09-12T00:03:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.231+0000 7fa8877fe640 1 -- 172.21.15.6:0/1951628422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa890010690 con 0x7fa898103700 2024-09-12T00:03:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.231+0000 7fa89c931640 1 -- 172.21.15.6:0/1951628422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8981a2300 con 0x7fa898103700 2024-09-12T00:03:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.234+0000 7fa8877fe640 1 -- 172.21.15.6:0/1951628422 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fa890005020 con 0x7fa898103700 2024-09-12T00:03:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.234+0000 7fa89f6cc740 1 Processor -- start 2024-09-12T00:03:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.234+0000 7fa89f6cc740 1 -- start start 2024-09-12T00:03:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.234+0000 7fa89f6cc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb1209a0 0x55cedb120da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.234+0000 7fa89f6cc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 0x55cedb125da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.234+0000 7fa89f6cc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb126370 0x55cedb128830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.234+0000 7fa89f6cc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55cedb0842f0 con 0x55cedb1212e0 2024-09-12T00:03:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.234+0000 7fa89f6cc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55cedb02c270 con 0x55cedb126370 2024-09-12T00:03:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.234+0000 7fa89f6cc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cedb0802b0 con 0x55cedb1209a0 2024-09-12T00:03:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.234+0000 7fa89659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 0x55cedb125da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa89659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 0x55cedb125da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56634/0 (socket says 172.21.15.6:56634) 2024-09-12T00:03:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa89659c640 1 -- 172.21.15.6:0/910745743 learned_addr learned my addr 172.21.15.6:0/910745743 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa895d9b640 1 --2- 172.21.15.6:0/910745743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb1209a0 0x55cedb120da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa895d9b640 1 --2- 172.21.15.6:0/910745743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb126370 0x55cedb128830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa8877fe640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa8800a2b80 0x7fa8800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa895d9b640 1 -- 172.21.15.6:0/910745743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb1209a0 msgr2=0x55cedb120da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa895d9b640 1 --2- 172.21.15.6:0/910745743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb1209a0 0x55cedb120da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa895d9b640 1 -- 172.21.15.6:0/910745743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 msgr2=0x55cedb125da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa895d9b640 1 --2- 172.21.15.6:0/910745743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 0x55cedb125da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa895d9b640 1 -- 172.21.15.6:0/910745743 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cedb02b340 con 0x55cedb126370 2024-09-12T00:03:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa896d9d640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa8800a2b80 0x7fa8800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa89659c640 1 --2- 172.21.15.6:0/910745743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 0x55cedb125da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:03:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa8877fe640 1 -- 172.21.15.6:0/1951628422 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fa8900cf9c0 con 0x7fa898103700 2024-09-12T00:03:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa895d9b640 1 --2- 172.21.15.6:0/910745743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb126370 0x55cedb128830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa898075d10 tx=0x7fa88c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=876e15f37b104959 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.235+0000 7fa884ff9640 1 -- 172.21.15.6:0/910745743 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c011d50 con 0x55cedb126370 2024-09-12T00:03:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.236+0000 7fa884ff9640 1 -- 172.21.15.6:0/910745743 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa88c00f7c0 con 0x55cedb126370 2024-09-12T00:03:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.236+0000 7fa884ff9640 1 -- 172.21.15.6:0/910745743 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c010690 con 0x55cedb126370 2024-09-12T00:03:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.236+0000 7fa89f6cc740 1 -- 172.21.15.6:0/910745743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb126370 msgr2=0x55cedb128830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.236+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/910745743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb126370 0x55cedb128830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa898075d10 tx=0x7fa88c005f90 comp rx=0 tx=0).stop 2024-09-12T00:03:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.236+0000 7fa896d9d640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa8800a2b80 0x7fa8800a5040 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa890098290 tx=0x7fa890066ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.236+0000 7fa89f6cc740 1 -- 172.21.15.6:0/910745743 shutdown_connections 2024-09-12T00:03:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.236+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/910745743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb126370 0x55cedb128830 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.236+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/910745743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 0x55cedb125da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.236+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/910745743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb1209a0 0x55cedb120da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.236+0000 7fa89f6cc740 1 -- 172.21.15.6:0/910745743 >> 172.21.15.6:0/910745743 conn(0x55cedb11c010 msgr2=0x55cedb11c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.236+0000 7fa89f6cc740 1 -- 172.21.15.6:0/910745743 shutdown_connections 2024-09-12T00:03:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.236+0000 7fa89f6cc740 1 -- 172.21.15.6:0/910745743 wait complete. 2024-09-12T00:03:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa89f6cc740 1 -- start start 2024-09-12T00:03:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa89f6cc740 1 Processor -- start 2024-09-12T00:03:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa89f6cc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1209a0 0x55cedb12abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa89f6cc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 0x55cedb12b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa89f6cc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb126370 0x55cedb132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa89f6cc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55cedb129340 con 0x55cedb1212e0 2024-09-12T00:03:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa89f6cc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55cedb00d290 con 0x55cedb1209a0 2024-09-12T00:03:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa89f6cc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cedb1294c0 con 0x55cedb126370 2024-09-12T00:03:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa89f6cc740 10 client.0 _ll_register_callbacks cb 0x55cedb03e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa89659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 0x55cedb12b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa89659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 0x55cedb12b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56640/0 (socket says 172.21.15.6:56640) 2024-09-12T00:03:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa89659c640 1 -- 172.21.15.6:0/141861244 learned_addr learned my addr 172.21.15.6:0/141861244 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa895d9b640 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1209a0 0x55cedb12abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.237+0000 7fa895d9b640 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb126370 0x55cedb132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa89659c640 1 -- 172.21.15.6:0/141861244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb126370 msgr2=0x55cedb132170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa89659c640 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb126370 0x55cedb132170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa89659c640 1 -- 172.21.15.6:0/141861244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1209a0 msgr2=0x55cedb12abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa89659c640 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1209a0 0x55cedb12abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa89659c640 1 -- 172.21.15.6:0/141861244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cedad97210 con 0x55cedb1212e0 2024-09-12T00:03:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa895d9b640 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1209a0 0x55cedb12abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:03:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa89659c640 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 0x55cedb12b130 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa888009230 tx=0x7fa888004440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ec44910b64c795 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa87dffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:03:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa87dffb640 1 -- 172.21.15.6:0/141861244 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888035040 con 0x55cedb1212e0 2024-09-12T00:03:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa87dffb640 1 -- 172.21.15.6:0/141861244 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fa888003ac0 con 0x55cedb1212e0 2024-09-12T00:03:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa89f6cc740 1 -- 172.21.15.6:0/141861244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa88c00f7c0 con 0x55cedb1212e0 2024-09-12T00:03:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa87dffb640 1 -- 172.21.15.6:0/141861244 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa88804e050 con 0x55cedb1212e0 2024-09-12T00:03:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa89f6cc740 10 client.15666 fetch_fsmap learned FSMap version 32 2024-09-12T00:03:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.238+0000 7fa89f6cc740 1 -- 172.21.15.6:0/141861244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cedae63620 con 0x55cedb1212e0 2024-09-12T00:03:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.239+0000 7fa87dffb640 1 -- 172.21.15.6:0/141861244 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa88c00f7c0 con 0x55cedb1212e0 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.239+0000 7fa87dffb640 1 -- 172.21.15.6:0/141861244 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fa88803c440 con 0x55cedb1212e0 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.239+0000 7fa89f6cc740 10 client.15666 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.239+0000 7fa89f6cc740 10 client.15666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.239+0000 7fa89f6cc740 20 client.15666 populate_metadata read hostname 'smithi006' 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.239+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cedb136880 0x55cedb138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.239+0000 7fa89f6cc740 4 client.15666 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.239+0000 7fa89f6cc740 1 -- 172.21.15.6:0/141861244 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cedb091a20 con 0x55cedb136880 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.239+0000 7fa895d9b640 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cedb136880 0x55cedb138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa87dffb640 10 client.15666 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa895d9b640 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cedb136880 0x55cedb138cb0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6491bf6d2717cbe9 server_cookie=4f892aadae7e76d5 in_seq=0 out_seq=0 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa87dffb640 1 -- 172.21.15.6:0/141861244 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cedb091a20 con 0x55cedb136880 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa87dffb640 10 client.15666 handle_command_reply: tid=0 2024-09-12T00:03:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa89f6cc740 1 client.15666 shutdown 2024-09-12T00:03:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa89f6cc740 1 -- 172.21.15.6:0/141861244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 msgr2=0x55cedb12b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 0x55cedb12b130 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa888009230 tx=0x7fa888004440 comp rx=0 tx=0).stop 2024-09-12T00:03:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa89f6cc740 1 -- 172.21.15.6:0/141861244 shutdown_connections 2024-09-12T00:03:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cedb136880 0x55cedb138cb0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb126370 0x55cedb132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa87dffb640 0 client.15666 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1212e0 0x55cedb12b130 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/141861244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1209a0 0x55cedb12abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.240+0000 7fa89f6cc740 1 -- 172.21.15.6:0/141861244 >> 172.21.15.6:0/141861244 conn(0x55cedb11c010 msgr2=0x55cedb11d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.241+0000 7fa89f6cc740 1 -- 172.21.15.6:0/141861244 shutdown_connections 2024-09-12T00:03:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.241+0000 7fa89f6cc740 1 -- 172.21.15.6:0/141861244 wait complete. 2024-09-12T00:03:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.241+0000 7fa89f6cc740 20 client.15666 trim_cache size 0 max 16384 2024-09-12T00:03:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.256+0000 7fa89f6cc740 1 Processor -- start 2024-09-12T00:03:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.256+0000 7fa89f6cc740 1 -- start start 2024-09-12T00:03:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.256+0000 7fa89f6cc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1209a0 0x55cedb11b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.256+0000 7fa89f6cc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb1212e0 0x55cedb132130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.256+0000 7fa89f6cc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb126370 0x55cedb11d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.256+0000 7fa89f6cc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981aca70 con 0x55cedb126370 2024-09-12T00:03:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.256+0000 7fa89f6cc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981ae5e0 con 0x55cedb1209a0 2024-09-12T00:03:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.256+0000 7fa89f6cc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981ad140 con 0x55cedb1212e0 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa89659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb1212e0 0x55cedb132130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa895d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb126370 0x55cedb11d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa89659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb1212e0 0x55cedb132130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:45738/0 (socket says 172.21.15.6:45738) 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa89659c640 1 -- 172.21.15.6:0/3442399854 learned_addr learned my addr 172.21.15.6:0/3442399854 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa895d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb126370 0x55cedb11d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56648/0 (socket says 172.21.15.6:56648) 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa895d9b640 1 --2- 172.21.15.6:0/3442399854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1209a0 0x55cedb11b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa89659c640 1 -- 172.21.15.6:0/3442399854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1209a0 msgr2=0x55cedb11b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa89659c640 1 --2- 172.21.15.6:0/3442399854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1209a0 0x55cedb11b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa89659c640 1 -- 172.21.15.6:0/3442399854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb126370 msgr2=0x55cedb11d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa89659c640 1 --2- 172.21.15.6:0/3442399854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb126370 0x55cedb11d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa89659c640 1 -- 172.21.15.6:0/3442399854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cedb11be30 con 0x55cedb1212e0 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa89659c640 1 --2- 172.21.15.6:0/3442399854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb1212e0 0x55cedb132130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa888006010 tx=0x7fa8880095a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79379edf80620fb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa87ffff640 1 -- 172.21.15.6:0/3442399854 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888057070 con 0x55cedb1212e0 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa87ffff640 1 -- 172.21.15.6:0/3442399854 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa888005850 con 0x55cedb1212e0 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.257+0000 7fa87ffff640 1 -- 172.21.15.6:0/3442399854 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888035070 con 0x55cedb1212e0 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.258+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3442399854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb1212e0 msgr2=0x55cedb132130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.258+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/3442399854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb1212e0 0x55cedb132130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa888006010 tx=0x7fa8880095a0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.258+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3442399854 shutdown_connections 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.258+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/3442399854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb126370 0x55cedb11d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.258+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/3442399854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb1212e0 0x55cedb132130 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.258+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/3442399854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1209a0 0x55cedb11b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.258+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3442399854 >> 172.21.15.6:0/3442399854 conn(0x55cedb11c010 msgr2=0x55cedb11a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.258+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3442399854 shutdown_connections 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.258+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3442399854 wait complete. 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.258+0000 7fa89f6cc740 1 -- start start 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa89f6cc740 1 Processor -- start 2024-09-12T00:03:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa89f6cc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1209a0 0x55cedb12f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa89f6cc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1212e0 0x55cedb12f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa89f6cc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb126370 0x55cedb130700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa89f6cc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981adee0 con 0x55cedb1209a0 2024-09-12T00:03:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa89f6cc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981ad810 con 0x55cedb1212e0 2024-09-12T00:03:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa89f6cc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981aaa50 con 0x55cedb126370 2024-09-12T00:03:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa89f6cc740 10 client.0 _ll_register_callbacks cb 0x7fa888009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa895d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1209a0 0x55cedb12f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa895d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1209a0 0x55cedb12f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56660/0 (socket says 172.21.15.6:56660) 2024-09-12T00:03:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa895d9b640 1 -- 172.21.15.6:0/3733489389 learned_addr learned my addr 172.21.15.6:0/3733489389 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa89659c640 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1212e0 0x55cedb12f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa895d9b640 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb126370 0x55cedb130700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa895d9b640 1 -- 172.21.15.6:0/3733489389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb126370 msgr2=0x55cedb130700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa895d9b640 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb126370 0x55cedb130700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa895d9b640 1 -- 172.21.15.6:0/3733489389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1212e0 msgr2=0x55cedb12f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa895d9b640 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1212e0 0x55cedb12f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa895d9b640 1 -- 172.21.15.6:0/3733489389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cedb130d10 con 0x55cedb1209a0 2024-09-12T00:03:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa895d9b640 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1209a0 0x55cedb12f200 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009680 tx=0x7fa88c021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf378a56b1e5122 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.259+0000 7fa87dffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:03:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa87dffb640 1 -- 172.21.15.6:0/3733489389 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c032040 con 0x55cedb1209a0 2024-09-12T00:03:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa87dffb640 1 -- 172.21.15.6:0/3733489389 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fa88c005270 con 0x55cedb1209a0 2024-09-12T00:03:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3733489389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa888005850 con 0x55cedb1209a0 2024-09-12T00:03:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa87dffb640 1 -- 172.21.15.6:0/3733489389 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa88c005470 con 0x55cedb1209a0 2024-09-12T00:03:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa89f6cc740 10 client.15672 fetch_fsmap learned FSMap version 32 2024-09-12T00:03:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3733489389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cedb132020 con 0x55cedb1209a0 2024-09-12T00:03:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa87dffb640 1 -- 172.21.15.6:0/3733489389 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa888005850 con 0x55cedb1209a0 2024-09-12T00:03:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa87dffb640 1 -- 172.21.15.6:0/3733489389 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fa88c02e040 con 0x55cedb1209a0 2024-09-12T00:03:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa89f6cc740 10 client.15672 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:03:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa89f6cc740 10 client.15672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:03:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa89f6cc740 20 client.15672 populate_metadata read hostname 'smithi006' 2024-09-12T00:03:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cedb1a1730 0x55cedb1a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa89f6cc740 4 client.15672 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:03:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.260+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3733489389 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cedb08bd70 con 0x55cedb1a1730 2024-09-12T00:03:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.261+0000 7fa89659c640 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cedb1a1730 0x55cedb1a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.261+0000 7fa89659c640 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cedb1a1730 0x55cedb1a3b20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41230df94449be63 server_cookie=a3809a4492205a34 in_seq=0 out_seq=0 2024-09-12T00:03:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.261+0000 7fa87dffb640 10 client.15672 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa87dffb640 1 -- 172.21.15.6:0/3733489389 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cedb08bd70 con 0x55cedb1a1730 2024-09-12T00:03:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa87dffb640 10 client.15672 handle_command_reply: tid=0 2024-09-12T00:03:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa89f6cc740 1 client.15672 shutdown 2024-09-12T00:03:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3733489389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1209a0 msgr2=0x55cedb12f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1209a0 0x55cedb12f200 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009680 tx=0x7fa88c021040 comp rx=0 tx=0).stop 2024-09-12T00:03:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3733489389 shutdown_connections 2024-09-12T00:03:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cedb1a1730 0x55cedb1a3b20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cedb126370 0x55cedb130700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cedb1212e0 0x55cedb12f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa87dffb640 0 client.15672 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa89f6cc740 1 --2- 172.21.15.6:0/3733489389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cedb1209a0 0x55cedb12f200 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3733489389 >> 172.21.15.6:0/3733489389 conn(0x55cedb11c010 msgr2=0x55cedb11b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3733489389 shutdown_connections 2024-09-12T00:03:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa89f6cc740 1 -- 172.21.15.6:0/3733489389 wait complete. 2024-09-12T00:03:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.277+0000 7fa89f6cc740 20 client.15672 trim_cache size 0 max 16384 2024-09-12T00:03:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:03:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:03:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:03:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:03:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.278+0000 7fa89c931640 1 -- 172.21.15.6:0/1951628422 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa8800a2b80 msgr2=0x7fa8800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.278+0000 7fa89c931640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa8800a2b80 0x7fa8800a5040 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa890098290 tx=0x7fa890066ab0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.278+0000 7fa89c931640 1 -- 172.21.15.6:0/1951628422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa898103700 msgr2=0x7fa898074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.278+0000 7fa89c931640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa898103700 0x7fa898074b20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa89000eb10 tx=0x7fa89000c2d0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.278+0000 7fa89c931640 1 -- 172.21.15.6:0/1951628422 shutdown_connections 2024-09-12T00:03:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.278+0000 7fa89c931640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa8800a2b80 0x7fa8800a5040 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.278+0000 7fa89c931640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa898103700 0x7fa898074b20 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.278+0000 7fa89c931640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa898102d40 0x7fa8980745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.278+0000 7fa89c931640 1 --2- 172.21.15.6:0/1951628422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898101b50 0x7fa898075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.278+0000 7fa89c931640 1 -- 172.21.15.6:0/1951628422 >> 172.21.15.6:0/1951628422 conn(0x7fa8980fd2f0 msgr2=0x7fa898106200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.278+0000 7fa89c931640 1 -- 172.21.15.6:0/1951628422 shutdown_connections 2024-09-12T00:03:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:23.278+0000 7fa89c931640 1 -- 172.21.15.6:0/1951628422 wait complete. 2024-09-12T00:03:24.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:24 smithi134 ceph-mon[34893]: pgmap v481: 129 pgs: 129 active+clean; 4.1 GiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-09-12T00:03:24.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:24 smithi039 ceph-mon[34543]: pgmap v481: 129 pgs: 129 active+clean; 4.1 GiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-09-12T00:03:24.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:24 smithi006 ceph-mon[30947]: pgmap v481: 129 pgs: 129 active+clean; 4.1 GiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-09-12T00:03:26.669 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:26 smithi006 ceph-mon[30947]: pgmap v482: 129 pgs: 129 active+clean; 4.1 GiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:03:26.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:26 smithi134 ceph-mon[34893]: pgmap v482: 129 pgs: 129 active+clean; 4.1 GiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:03:26.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:26 smithi039 ceph-mon[34543]: pgmap v482: 129 pgs: 129 active+clean; 4.1 GiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:03:28.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:28 smithi134 ceph-mon[34893]: pgmap v483: 129 pgs: 129 active+clean; 4.2 GiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-09-12T00:03:28.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:28 smithi039 ceph-mon[34543]: pgmap v483: 129 pgs: 129 active+clean; 4.2 GiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-09-12T00:03:28.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:28 smithi006 ceph-mon[30947]: pgmap v483: 129 pgs: 129 active+clean; 4.2 GiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-09-12T00:03:29.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:29 smithi134 ceph-mon[34893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:03:29.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:29 smithi039 ceph-mon[34543]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:03:29.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:29 smithi006 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:03:30.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:30 smithi134 ceph-mon[34893]: pgmap v484: 129 pgs: 129 active+clean; 4.2 GiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:03:30.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:30 smithi039 ceph-mon[34543]: pgmap v484: 129 pgs: 129 active+clean; 4.2 GiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:03:30.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:30 smithi006 ceph-mon[30947]: pgmap v484: 129 pgs: 129 active+clean; 4.2 GiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:03:32.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:32 smithi134 ceph-mon[34893]: pgmap v485: 129 pgs: 129 active+clean; 4.3 GiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:03:32.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:32 smithi039 ceph-mon[34543]: pgmap v485: 129 pgs: 129 active+clean; 4.3 GiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:03:32.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:32 smithi006 ceph-mon[30947]: pgmap v485: 129 pgs: 129 active+clean; 4.3 GiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:03:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:34 smithi134 ceph-mon[34893]: pgmap v486: 129 pgs: 129 active+clean; 4.3 GiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:03:34.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:34 smithi039 ceph-mon[34543]: pgmap v486: 129 pgs: 129 active+clean; 4.3 GiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:03:34.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:34 smithi006 ceph-mon[30947]: pgmap v486: 129 pgs: 129 active+clean; 4.3 GiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:03:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.380+0000 7f93e6dfd640 1 -- 172.21.15.6:0/3920212245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0100d50 msgr2=0x7f93e01011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.380+0000 7f93e6dfd640 1 --2- 172.21.15.6:0/3920212245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0100d50 0x7f93e01011b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009900 tx=0x7f93cc02a410 comp rx=0 tx=0).stop 2024-09-12T00:03:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.380+0000 7f93e6dfd640 1 -- 172.21.15.6:0/3920212245 shutdown_connections 2024-09-12T00:03:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.380+0000 7f93e6dfd640 1 --2- 172.21.15.6:0/3920212245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93e01016f0 0x7f93e0101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.380+0000 7f93e6dfd640 1 --2- 172.21.15.6:0/3920212245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0100d50 0x7f93e01011b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.380+0000 7f93e6dfd640 1 --2- 172.21.15.6:0/3920212245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e0100410 0x7f93e0100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.380+0000 7f93e6dfd640 1 -- 172.21.15.6:0/3920212245 >> 172.21.15.6:0/3920212245 conn(0x7f93e00fc1c0 msgr2=0x7f93e00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.380+0000 7f93e6dfd640 1 -- 172.21.15.6:0/3920212245 shutdown_connections 2024-09-12T00:03:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.380+0000 7f93e6dfd640 1 -- 172.21.15.6:0/3920212245 wait complete. 2024-09-12T00:03:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.381+0000 7f93e6dfd640 1 Processor -- start 2024-09-12T00:03:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.381+0000 7f93e6dfd640 1 -- start start 2024-09-12T00:03:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.381+0000 7f93e6dfd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e0100410 0x7f93e0199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.381+0000 7f93e6dfd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0100d50 0x7f93e019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.381+0000 7f93e6dfd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93e01016f0 0x7f93e01a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.381+0000 7f93e6dfd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f93e010f800 con 0x7f93e0100d50 2024-09-12T00:03:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.381+0000 7f93e6dfd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f93e010f680 con 0x7f93e01016f0 2024-09-12T00:03:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.381+0000 7f93e6dfd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f93e010f980 con 0x7f93e0100410 2024-09-12T00:03:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.381+0000 7f93dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0100d50 0x7f93e019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.381+0000 7f93dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0100d50 0x7f93e019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42726/0 (socket says 172.21.15.6:42726) 2024-09-12T00:03:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.381+0000 7f93dffff640 1 -- 172.21.15.6:0/2029219356 learned_addr learned my addr 172.21.15.6:0/2029219356 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93e4b99640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e0100410 0x7f93e0199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93e539a640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93e01016f0 0x7f93e01a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93dffff640 1 -- 172.21.15.6:0/2029219356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e0100410 msgr2=0x7f93e0199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93dffff640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e0100410 0x7f93e0199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93dffff640 1 -- 172.21.15.6:0/2029219356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93e01016f0 msgr2=0x7f93e01a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93dffff640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93e01016f0 0x7f93e01a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93dffff640 1 -- 172.21.15.6:0/2029219356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e01a1be0 con 0x7f93e0100d50 2024-09-12T00:03:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93e4b99640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e0100410 0x7f93e0199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93dffff640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0100d50 0x7f93e019a500 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f93cc005940 tx=0x7f93cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93ddffb640 1 -- 172.21.15.6:0/2029219356 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc03f030 con 0x7f93e0100d50 2024-09-12T00:03:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93ddffb640 1 -- 172.21.15.6:0/2029219356 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f93cc003cb0 con 0x7f93e0100d50 2024-09-12T00:03:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93e6dfd640 1 -- 172.21.15.6:0/2029219356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e01a1e70 con 0x7f93e0100d50 2024-09-12T00:03:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93ddffb640 1 -- 172.21.15.6:0/2029219356 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc035070 con 0x7f93e0100d50 2024-09-12T00:03:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.382+0000 7f93e6dfd640 1 -- 172.21.15.6:0/2029219356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e01a2330 con 0x7f93e0100d50 2024-09-12T00:03:36.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.385+0000 7f93ddffb640 1 -- 172.21.15.6:0/2029219356 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f93cc042030 con 0x7f93e0100d50 2024-09-12T00:03:36.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.385+0000 7f93e9c80740 1 Processor -- start 2024-09-12T00:03:36.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.385+0000 7f93e9c80740 1 -- start start 2024-09-12T00:03:36.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93e9c80740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0249a0 0x56453f024da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93e9c80740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0252e0 0x56453f029da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93e9c80740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f02c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93e9c80740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56453ef882f0 con 0x56453f02a370 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93e9c80740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56453ef30270 con 0x56453f0252e0 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93e9c80740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56453ef842b0 con 0x56453f0249a0 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f02c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f02c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42740/0 (socket says 172.21.15.6:42740) 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93dffff640 1 -- 172.21.15.6:0/1677831176 learned_addr learned my addr 172.21.15.6:0/1677831176 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93e539a640 1 --2- 172.21.15.6:0/1677831176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0249a0 0x56453f024da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93e4b99640 1 --2- 172.21.15.6:0/1677831176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0252e0 0x56453f029da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93ddffb640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f93d00a2b80 0x7f93d00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93dffff640 1 -- 172.21.15.6:0/1677831176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0249a0 msgr2=0x56453f024da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93dffff640 1 --2- 172.21.15.6:0/1677831176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0249a0 0x56453f024da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93dffff640 1 -- 172.21.15.6:0/1677831176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0252e0 msgr2=0x56453f029da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93dffff640 1 --2- 172.21.15.6:0/1677831176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0252e0 0x56453f029da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93dffff640 1 -- 172.21.15.6:0/1677831176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56453ef2f340 con 0x56453f02a370 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93e539a640 1 --2- 172.21.15.6:0/1677831176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0249a0 0x56453f024da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93e539a640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f93d00a2b80 0x7f93d00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.386+0000 7f93ddffb640 1 -- 172.21.15.6:0/2029219356 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f93cc0efaa0 con 0x7f93e0100d50 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.387+0000 7f93dffff640 1 --2- 172.21.15.6:0/1677831176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f02c830 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f93cc07a860 tx=0x7f93cc07bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3d65fac8f2b211 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.387+0000 7f93e539a640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f93d00a2b80 0x7f93d00a5040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93d8005fd0 tx=0x7f93d8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.387+0000 7f93caffd640 1 -- 172.21.15.6:0/1677831176 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0bbce0 con 0x56453f02a370 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.387+0000 7f93caffd640 1 -- 172.21.15.6:0/1677831176 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f93cc0bc610 con 0x56453f02a370 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.387+0000 7f93caffd640 1 -- 172.21.15.6:0/1677831176 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0044e0 con 0x56453f02a370 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.388+0000 7f93e9c80740 1 -- 172.21.15.6:0/1677831176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 msgr2=0x56453f02c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.388+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1677831176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f02c830 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f93cc07a860 tx=0x7f93cc07bf80 comp rx=0 tx=0).stop 2024-09-12T00:03:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.388+0000 7f93e9c80740 1 -- 172.21.15.6:0/1677831176 shutdown_connections 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.388+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1677831176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f02c830 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.388+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1677831176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0252e0 0x56453f029da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.388+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1677831176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0249a0 0x56453f024da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.388+0000 7f93e9c80740 1 -- 172.21.15.6:0/1677831176 >> 172.21.15.6:0/1677831176 conn(0x56453f020010 msgr2=0x56453f020410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.388+0000 7f93e9c80740 1 -- 172.21.15.6:0/1677831176 shutdown_connections 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.388+0000 7f93e9c80740 1 -- 172.21.15.6:0/1677831176 wait complete. 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.388+0000 7f93e9c80740 1 -- start start 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.388+0000 7f93e9c80740 1 Processor -- start 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e9c80740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0249a0 0x56453f02e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e9c80740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0252e0 0x56453f02ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e9c80740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f035da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e9c80740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56453f02d100 con 0x56453f02a370 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e9c80740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56453ef11290 con 0x56453f0249a0 2024-09-12T00:03:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e9c80740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56453f02d280 con 0x56453f0252e0 2024-09-12T00:03:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e9c80740 10 client.0 _ll_register_callbacks cb 0x56453ef42140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e539a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f035da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e4b99640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0249a0 0x56453f02e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e4b99640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0249a0 0x56453f02e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:45210/0 (socket says 172.21.15.6:45210) 2024-09-12T00:03:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e4b99640 1 -- 172.21.15.6:0/1662792907 learned_addr learned my addr 172.21.15.6:0/1662792907 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e539a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f035da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42754/0 (socket says 172.21.15.6:42754) 2024-09-12T00:03:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93dffff640 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0252e0 0x56453f02ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e4b99640 1 -- 172.21.15.6:0/1662792907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0252e0 msgr2=0x56453f02ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e4b99640 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0252e0 0x56453f02ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e4b99640 1 -- 172.21.15.6:0/1662792907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 msgr2=0x56453f035da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e4b99640 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f035da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e4b99640 1 -- 172.21.15.6:0/1662792907 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56453ec9b210 con 0x56453f0249a0 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e539a640 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f035da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93e4b99640 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0249a0 0x56453f02e820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f93d400bf80 tx=0x7f93d40128e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdc6f376ca1ba8f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.389+0000 7f93bffff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93bffff640 1 -- 172.21.15.6:0/1662792907 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d4005220 con 0x56453f0249a0 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93e9c80740 1 -- 172.21.15.6:0/1662792907 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93cc0bc610 con 0x56453f0249a0 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93bffff640 1 -- 172.21.15.6:0/1662792907 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f93d40053c0 con 0x56453f0249a0 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93bffff640 1 -- 172.21.15.6:0/1662792907 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f93d4025050 con 0x56453f0249a0 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93e9c80740 10 client.25304 fetch_fsmap learned FSMap version 33 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93e9c80740 1 -- 172.21.15.6:0/1662792907 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56453ed67620 con 0x56453f0249a0 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93bffff640 1 -- 172.21.15.6:0/1662792907 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f93cc0bc610 con 0x56453f0249a0 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93bffff640 1 -- 172.21.15.6:0/1662792907 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f93d4019030 con 0x56453f0249a0 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93e9c80740 10 client.25304 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93e9c80740 10 client.25304 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:03:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93e9c80740 20 client.25304 populate_metadata read hostname 'smithi006' 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56453f03a570 0x56453f03ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93e9c80740 4 client.25304 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.390+0000 7f93e9c80740 1 -- 172.21.15.6:0/1662792907 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56453ef95a20 con 0x56453f03a570 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.391+0000 7f93dffff640 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56453f03a570 0x56453f03ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.391+0000 7f93dffff640 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56453f03a570 0x56453f03ca30 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f014dc9812ee9ca server_cookie=b50a0fccfb013f26 in_seq=0 out_seq=0 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.391+0000 7f93bffff640 10 client.25304 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93bffff640 1 -- 172.21.15.6:0/1662792907 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56453ef95a20 con 0x56453f03a570 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93bffff640 10 client.25304 handle_command_reply: tid=0 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93e9c80740 1 client.25304 shutdown 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93e9c80740 1 -- 172.21.15.6:0/1662792907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0249a0 msgr2=0x56453f02e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0249a0 0x56453f02e820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f93d400bf80 tx=0x7f93d40128e0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93e9c80740 1 -- 172.21.15.6:0/1662792907 shutdown_connections 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f035da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56453f03a570 0x56453f03ca30 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0252e0 0x56453f02ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1662792907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0249a0 0x56453f02e820 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93bffff640 0 client.25304 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93e9c80740 1 -- 172.21.15.6:0/1662792907 >> 172.21.15.6:0/1662792907 conn(0x56453f020010 msgr2=0x56453f021820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93e9c80740 1 -- 172.21.15.6:0/1662792907 shutdown_connections 2024-09-12T00:03:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93e9c80740 1 -- 172.21.15.6:0/1662792907 wait complete. 2024-09-12T00:03:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.392+0000 7f93e9c80740 20 client.25304 trim_cache size 0 max 16384 2024-09-12T00:03:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e9c80740 1 Processor -- start 2024-09-12T00:03:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e9c80740 1 -- start start 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e9c80740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f0249a0 0x56453f020e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e9c80740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0252e0 0x56453f035cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e9c80740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f02a370 0x56453f0213d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e9c80740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f93e01acae0 con 0x56453f0249a0 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e9c80740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f93e01ae620 con 0x56453f02a370 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e9c80740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f93e01ad1b0 con 0x56453f0252e0 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e4b99640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f0249a0 0x56453f020e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e4b99640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f0249a0 0x56453f020e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42770/0 (socket says 172.21.15.6:42770) 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e4b99640 1 -- 172.21.15.6:0/4087243553 learned_addr learned my addr 172.21.15.6:0/4087243553 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e539a640 1 --2- 172.21.15.6:0/4087243553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f02a370 0x56453f0213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93dffff640 1 --2- 172.21.15.6:0/4087243553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0252e0 0x56453f035cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e4b99640 1 -- 172.21.15.6:0/4087243553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0252e0 msgr2=0x56453f035cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e4b99640 1 --2- 172.21.15.6:0/4087243553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0252e0 0x56453f035cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e4b99640 1 -- 172.21.15.6:0/4087243553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f02a370 msgr2=0x56453f0213d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e4b99640 1 --2- 172.21.15.6:0/4087243553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f02a370 0x56453f0213d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.408+0000 7f93e4b99640 1 -- 172.21.15.6:0/4087243553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56453f02a0a0 con 0x56453f0249a0 2024-09-12T00:03:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.409+0000 7f93e4b99640 1 --2- 172.21.15.6:0/4087243553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f0249a0 0x56453f020e90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f93d4010b30 tx=0x7f93d4005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bc5b28591b8a38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.409+0000 7f93ca7fc640 1 -- 172.21.15.6:0/4087243553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d402d020 con 0x56453f0249a0 2024-09-12T00:03:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.409+0000 7f93ca7fc640 1 -- 172.21.15.6:0/4087243553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f93d4010900 con 0x56453f0249a0 2024-09-12T00:03:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.409+0000 7f93ca7fc640 1 -- 172.21.15.6:0/4087243553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d4004b40 con 0x56453f0249a0 2024-09-12T00:03:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.409+0000 7f93e9c80740 1 -- 172.21.15.6:0/4087243553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f0249a0 msgr2=0x56453f020e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.409+0000 7f93e9c80740 1 --2- 172.21.15.6:0/4087243553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f0249a0 0x56453f020e90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f93d4010b30 tx=0x7f93d4005990 comp rx=0 tx=0).stop 2024-09-12T00:03:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.410+0000 7f93e9c80740 1 -- 172.21.15.6:0/4087243553 shutdown_connections 2024-09-12T00:03:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.410+0000 7f93e9c80740 1 --2- 172.21.15.6:0/4087243553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f02a370 0x56453f0213d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.410+0000 7f93e9c80740 1 --2- 172.21.15.6:0/4087243553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0252e0 0x56453f035cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.410+0000 7f93e9c80740 1 --2- 172.21.15.6:0/4087243553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f0249a0 0x56453f020e90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.410+0000 7f93e9c80740 1 -- 172.21.15.6:0/4087243553 >> 172.21.15.6:0/4087243553 conn(0x56453f020010 msgr2=0x56453f02e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.410+0000 7f93e9c80740 1 -- 172.21.15.6:0/4087243553 shutdown_connections 2024-09-12T00:03:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.410+0000 7f93e9c80740 1 -- 172.21.15.6:0/4087243553 wait complete. 2024-09-12T00:03:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.410+0000 7f93e9c80740 1 -- start start 2024-09-12T00:03:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.410+0000 7f93e9c80740 1 Processor -- start 2024-09-12T00:03:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.410+0000 7f93e9c80740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0249a0 0x56453f033000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.410+0000 7f93e9c80740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0252e0 0x56453f033540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.410+0000 7f93e9c80740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f034550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e9c80740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f93e01adf50 con 0x56453f02a370 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e9c80740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f93e01ad880 con 0x56453f0252e0 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e9c80740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f93e01aaac0 con 0x56453f0249a0 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e9c80740 10 client.0 _ll_register_callbacks cb 0x7f93d400bb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e539a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f034550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e539a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f034550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42784/0 (socket says 172.21.15.6:42784) 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e539a640 1 -- 172.21.15.6:0/1426900268 learned_addr learned my addr 172.21.15.6:0/1426900268 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93dffff640 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0252e0 0x56453f033540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e4b99640 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0249a0 0x56453f033000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e539a640 1 -- 172.21.15.6:0/1426900268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0249a0 msgr2=0x56453f033000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e539a640 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0249a0 0x56453f033000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e539a640 1 -- 172.21.15.6:0/1426900268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0252e0 msgr2=0x56453f033540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e539a640 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0252e0 0x56453f033540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e539a640 1 -- 172.21.15.6:0/1426900268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56453f034b60 con 0x56453f02a370 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e539a640 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f034550 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f93d801e700 tx=0x7f93d8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9087f0ab59bacc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93bffff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93bffff640 1 -- 172.21.15.6:0/1426900268 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d802b020 con 0x56453f02a370 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93bffff640 1 -- 172.21.15.6:0/1426900268 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f93d801c9a0 con 0x56453f02a370 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.411+0000 7f93e9c80740 1 -- 172.21.15.6:0/1426900268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93d4010900 con 0x56453f02a370 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.412+0000 7f93bffff640 1 -- 172.21.15.6:0/1426900268 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f93d8036050 con 0x56453f02a370 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.412+0000 7f93e9c80740 10 client.15690 fetch_fsmap learned FSMap version 33 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.412+0000 7f93e9c80740 1 -- 172.21.15.6:0/1426900268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56453f035f40 con 0x56453f02a370 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.412+0000 7f93bffff640 1 -- 172.21.15.6:0/1426900268 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f93d4010900 con 0x56453f02a370 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.412+0000 7f93bffff640 1 -- 172.21.15.6:0/1426900268 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f93d8027cd0 con 0x56453f02a370 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.412+0000 7f93e9c80740 10 client.15690 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.412+0000 7f93e9c80740 10 client.15690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:03:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.412+0000 7f93e9c80740 20 client.15690 populate_metadata read hostname 'smithi006' 2024-09-12T00:03:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.412+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56453f0a5a40 0x56453f0a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.412+0000 7f93e9c80740 4 client.15690 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:03:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.412+0000 7f93e9c80740 1 -- 172.21.15.6:0/1426900268 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56453ef8fd70 con 0x56453f0a5a40 2024-09-12T00:03:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.412+0000 7f93e4b99640 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56453f0a5a40 0x56453f0a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.413+0000 7f93e4b99640 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56453f0a5a40 0x56453f0a7e60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71237725da3a5db server_cookie=6f5a28de52fb6648 in_seq=0 out_seq=0 2024-09-12T00:03:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.413+0000 7f93bffff640 10 client.15690 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.429+0000 7f93bffff640 1 -- 172.21.15.6:0/1426900268 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56453ef8fd70 con 0x56453f0a5a40 2024-09-12T00:03:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.429+0000 7f93bffff640 10 client.15690 handle_command_reply: tid=0 2024-09-12T00:03:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.429+0000 7f93e9c80740 1 client.15690 shutdown 2024-09-12T00:03:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.430+0000 7f93e9c80740 1 -- 172.21.15.6:0/1426900268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 msgr2=0x56453f034550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.430+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f034550 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f93d801e700 tx=0x7f93d8004ab0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.430+0000 7f93e9c80740 1 -- 172.21.15.6:0/1426900268 shutdown_connections 2024-09-12T00:03:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.430+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56453f02a370 0x56453f034550 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.430+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56453f0252e0 0x56453f033540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.430+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56453f0a5a40 0x56453f0a7e60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.430+0000 7f93e9c80740 1 --2- 172.21.15.6:0/1426900268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56453f0249a0 0x56453f033000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.430+0000 7f93e9c80740 1 -- 172.21.15.6:0/1426900268 >> 172.21.15.6:0/1426900268 conn(0x56453f020010 msgr2=0x56453f01e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.430+0000 7f93bffff640 0 client.15690 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.430+0000 7f93e9c80740 1 -- 172.21.15.6:0/1426900268 shutdown_connections 2024-09-12T00:03:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.430+0000 7f93e9c80740 1 -- 172.21.15.6:0/1426900268 wait complete. 2024-09-12T00:03:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.430+0000 7f93e9c80740 20 client.15690 trim_cache size 0 max 16384 2024-09-12T00:03:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:03:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:03:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:03:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:03:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.431+0000 7f93e6dfd640 1 -- 172.21.15.6:0/2029219356 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f93d00a2b80 msgr2=0x7f93d00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.431+0000 7f93e6dfd640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f93d00a2b80 0x7f93d00a5040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93d8005fd0 tx=0x7f93d8004a40 comp rx=0 tx=0).stop 2024-09-12T00:03:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.431+0000 7f93e6dfd640 1 -- 172.21.15.6:0/2029219356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0100d50 msgr2=0x7f93e019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.431+0000 7f93e6dfd640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0100d50 0x7f93e019a500 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f93cc005940 tx=0x7f93cc0042f0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.431+0000 7f93e6dfd640 1 -- 172.21.15.6:0/2029219356 shutdown_connections 2024-09-12T00:03:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.431+0000 7f93e6dfd640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f93d00a2b80 0x7f93d00a5040 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.431+0000 7f93e6dfd640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93e01016f0 0x7f93e01a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.431+0000 7f93e6dfd640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0100d50 0x7f93e019a500 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.431+0000 7f93e6dfd640 1 --2- 172.21.15.6:0/2029219356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e0100410 0x7f93e0199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.431+0000 7f93e6dfd640 1 -- 172.21.15.6:0/2029219356 >> 172.21.15.6:0/2029219356 conn(0x7f93e00fc1c0 msgr2=0x7f93e00fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.431+0000 7f93e6dfd640 1 -- 172.21.15.6:0/2029219356 shutdown_connections 2024-09-12T00:03:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:36.431+0000 7f93e6dfd640 1 -- 172.21.15.6:0/2029219356 wait complete. 2024-09-12T00:03:36.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:36 smithi134 ceph-mon[34893]: pgmap v487: 129 pgs: 129 active+clean; 4.4 GiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:03:36.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:36 smithi039 ceph-mon[34543]: pgmap v487: 129 pgs: 129 active+clean; 4.4 GiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:03:36.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:36 smithi006 ceph-mon[30947]: pgmap v487: 129 pgs: 129 active+clean; 4.4 GiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:03:38.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:38 smithi134 ceph-mon[34893]: pgmap v488: 129 pgs: 129 active+clean; 4.4 GiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:03:38.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:38 smithi039 ceph-mon[34543]: pgmap v488: 129 pgs: 129 active+clean; 4.4 GiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:03:38.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:38 smithi006 ceph-mon[30947]: pgmap v488: 129 pgs: 129 active+clean; 4.4 GiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:03:40.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:40 smithi134 ceph-mon[34893]: pgmap v489: 129 pgs: 129 active+clean; 4.5 GiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 22 op/s 2024-09-12T00:03:40.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:40 smithi039 ceph-mon[34543]: pgmap v489: 129 pgs: 129 active+clean; 4.5 GiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 22 op/s 2024-09-12T00:03:40.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:40 smithi006 ceph-mon[30947]: pgmap v489: 129 pgs: 129 active+clean; 4.5 GiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 22 op/s 2024-09-12T00:03:42.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:42 smithi134 ceph-mon[34893]: pgmap v490: 129 pgs: 129 active+clean; 4.5 GiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:03:42.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:42 smithi039 ceph-mon[34543]: pgmap v490: 129 pgs: 129 active+clean; 4.5 GiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:03:42.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:42 smithi006 ceph-mon[30947]: pgmap v490: 129 pgs: 129 active+clean; 4.5 GiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:03:44.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:44 smithi134 ceph-mon[34893]: pgmap v491: 129 pgs: 129 active+clean; 4.6 GiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:03:44.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:44 smithi039 ceph-mon[34543]: pgmap v491: 129 pgs: 129 active+clean; 4.6 GiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:03:44.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:44 smithi006 ceph-mon[30947]: pgmap v491: 129 pgs: 129 active+clean; 4.6 GiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:03:46.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:46 smithi134 ceph-mon[34893]: pgmap v492: 129 pgs: 129 active+clean; 4.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:03:46.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:46 smithi039 ceph-mon[34543]: pgmap v492: 129 pgs: 129 active+clean; 4.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:03:46.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:46 smithi006 ceph-mon[30947]: pgmap v492: 129 pgs: 129 active+clean; 4.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:03:48.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:48 smithi134 ceph-mon[34893]: pgmap v493: 129 pgs: 129 active+clean; 4.7 GiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:03:48.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:48 smithi039 ceph-mon[34543]: pgmap v493: 129 pgs: 129 active+clean; 4.7 GiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:03:48.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:48 smithi006 ceph-mon[30947]: pgmap v493: 129 pgs: 129 active+clean; 4.7 GiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:03:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.545+0000 7fc7b98ae640 1 -- 172.21.15.6:0/786714169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b41016f0 msgr2=0x7fc7b4101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.545+0000 7fc7b98ae640 1 --2- 172.21.15.6:0/786714169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b41016f0 0x7fc7b4101ba0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009ca0 tx=0x7fc7ac02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.545+0000 7fc7b98ae640 1 -- 172.21.15.6:0/786714169 shutdown_connections 2024-09-12T00:03:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.545+0000 7fc7b98ae640 1 --2- 172.21.15.6:0/786714169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b41016f0 0x7fc7b4101ba0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.545+0000 7fc7b98ae640 1 --2- 172.21.15.6:0/786714169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7b4100d50 0x7fc7b41011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.545+0000 7fc7b98ae640 1 --2- 172.21.15.6:0/786714169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7b4100410 0x7fc7b4100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.545+0000 7fc7b98ae640 1 -- 172.21.15.6:0/786714169 >> 172.21.15.6:0/786714169 conn(0x7fc7b40fc1c0 msgr2=0x7fc7b40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.545+0000 7fc7b98ae640 1 -- 172.21.15.6:0/786714169 shutdown_connections 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.545+0000 7fc7b98ae640 1 -- 172.21.15.6:0/786714169 wait complete. 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.546+0000 7fc7b98ae640 1 Processor -- start 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.546+0000 7fc7b98ae640 1 -- start start 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.546+0000 7fc7b98ae640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7b4100410 0x7fc7b4199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.546+0000 7fc7b98ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7b4100d50 0x7fc7b419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.546+0000 7fc7b98ae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b41016f0 0x7fc7b41a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.546+0000 7fc7b98ae640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b410f800 con 0x7fc7b41016f0 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.546+0000 7fc7b98ae640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b410f680 con 0x7fc7b4100410 2024-09-12T00:03:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.546+0000 7fc7b98ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b410f980 con 0x7fc7b4100d50 2024-09-12T00:03:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b41016f0 0x7fc7b41a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b41016f0 0x7fc7b41a14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57408/0 (socket says 172.21.15.6:57408) 2024-09-12T00:03:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7b4100410 0x7fc7b4199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b37fe640 1 -- 172.21.15.6:0/1307840926 learned_addr learned my addr 172.21.15.6:0/1307840926 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7b4100d50 0x7fc7b419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b37fe640 1 -- 172.21.15.6:0/1307840926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7b4100d50 msgr2=0x7fc7b419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b37fe640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7b4100d50 0x7fc7b419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b37fe640 1 -- 172.21.15.6:0/1307840926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7b4100410 msgr2=0x7fc7b4199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b37fe640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7b4100410 0x7fc7b4199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b37fe640 1 -- 172.21.15.6:0/1307840926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b41a1b60 con 0x7fc7b41016f0 2024-09-12T00:03:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7b4100d50 0x7fc7b419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b2ffd640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7b4100410 0x7fc7b4199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:03:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b37fe640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b41016f0 0x7fc7b41a14f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0319d0 tx=0x7fc7ac0317f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b88ac640 1 -- 172.21.15.6:0/1307840926 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac003bf0 con 0x7fc7b41016f0 2024-09-12T00:03:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b98ae640 1 -- 172.21.15.6:0/1307840926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b41a1df0 con 0x7fc7b41016f0 2024-09-12T00:03:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.547+0000 7fc7b88ac640 1 -- 172.21.15.6:0/1307840926 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7ac003d90 con 0x7fc7b41016f0 2024-09-12T00:03:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.548+0000 7fc7b88ac640 1 -- 172.21.15.6:0/1307840926 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac030b70 con 0x7fc7b41016f0 2024-09-12T00:03:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.548+0000 7fc7b98ae640 1 -- 172.21.15.6:0/1307840926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b41a22b0 con 0x7fc7b41016f0 2024-09-12T00:03:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.550+0000 7fc7bc648740 1 Processor -- start 2024-09-12T00:03:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.550+0000 7fc7b88ac640 1 -- 172.21.15.6:0/1307840926 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fc7ac0046d0 con 0x7fc7b41016f0 2024-09-12T00:03:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.550+0000 7fc7bc648740 1 -- start start 2024-09-12T00:03:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.550+0000 7fc7bc648740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149509a0 0x559014950da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.550+0000 7fc7bc648740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 0x559014955da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7bc648740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x559014958830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7bc648740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5590148b42f0 con 0x559014956370 2024-09-12T00:03:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7bc648740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55901485c270 con 0x5590149509a0 2024-09-12T00:03:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7bc648740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5590148b02b0 con 0x5590149512e0 2024-09-12T00:03:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x559014958830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x559014958830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57424/0 (socket says 172.21.15.6:57424) 2024-09-12T00:03:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b27fc640 1 -- 172.21.15.6:0/903262914 learned_addr learned my addr 172.21.15.6:0/903262914 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/903262914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149509a0 0x559014950da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b2ffd640 1 --2- 172.21.15.6:0/903262914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 0x559014955da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b27fc640 1 -- 172.21.15.6:0/903262914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 msgr2=0x559014955da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/903262914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 0x559014955da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b88ac640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc79c0a2b80 0x7fc79c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b27fc640 1 -- 172.21.15.6:0/903262914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149509a0 msgr2=0x559014950da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:49.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/903262914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149509a0 0x559014950da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b27fc640 1 -- 172.21.15.6:0/903262914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55901485b340 con 0x559014956370 2024-09-12T00:03:49.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b37fe640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc79c0a2b80 0x7fc79c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.551+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/903262914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x559014958830 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80127a0 tx=0x7fc7a80096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b9dc56f77b96bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:49.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.552+0000 7fc7b88ac640 1 -- 172.21.15.6:0/1307840926 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fc7ac0f0af0 con 0x7fc7b41016f0 2024-09-12T00:03:49.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.552+0000 7fc799ffb640 1 -- 172.21.15.6:0/903262914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8012d20 con 0x559014956370 2024-09-12T00:03:49.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.552+0000 7fc799ffb640 1 -- 172.21.15.6:0/903262914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7a8010c80 con 0x559014956370 2024-09-12T00:03:49.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.552+0000 7fc799ffb640 1 -- 172.21.15.6:0/903262914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a801eba0 con 0x559014956370 2024-09-12T00:03:49.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.553+0000 7fc7bc648740 1 -- 172.21.15.6:0/903262914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 msgr2=0x559014958830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:49.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.553+0000 7fc7bc648740 1 --2- 172.21.15.6:0/903262914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x559014958830 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80127a0 tx=0x7fc7a80096a0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.553+0000 7fc7b37fe640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc79c0a2b80 0x7fc79c0a5040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0c56a0 tx=0x7fc7ac0b8b80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:49.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.553+0000 7fc7bc648740 1 -- 172.21.15.6:0/903262914 shutdown_connections 2024-09-12T00:03:49.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.553+0000 7fc7bc648740 1 --2- 172.21.15.6:0/903262914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x559014958830 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.553+0000 7fc7bc648740 1 --2- 172.21.15.6:0/903262914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 0x559014955da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.553+0000 7fc7bc648740 1 --2- 172.21.15.6:0/903262914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149509a0 0x559014950da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.553+0000 7fc7bc648740 1 -- 172.21.15.6:0/903262914 >> 172.21.15.6:0/903262914 conn(0x55901494c010 msgr2=0x55901494c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:49.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.553+0000 7fc7bc648740 1 -- 172.21.15.6:0/903262914 shutdown_connections 2024-09-12T00:03:49.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.553+0000 7fc7bc648740 1 -- 172.21.15.6:0/903262914 wait complete. 2024-09-12T00:03:49.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.553+0000 7fc7bc648740 1 -- start start 2024-09-12T00:03:49.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.553+0000 7fc7bc648740 1 Processor -- start 2024-09-12T00:03:49.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7bc648740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590149509a0 0x55901495ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7bc648740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 0x55901495b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7bc648740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559014956370 0x559014962210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7bc648740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x559014959340 con 0x5590149509a0 2024-09-12T00:03:49.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7bc648740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55901483d290 con 0x559014956370 2024-09-12T00:03:49.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7bc648740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5590149594c0 con 0x5590149512e0 2024-09-12T00:03:49.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7bc648740 10 client.0 _ll_register_callbacks cb 0x55901486e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:49.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7b27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590149509a0 0x55901495ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7b27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590149509a0 0x55901495ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57438/0 (socket says 172.21.15.6:57438) 2024-09-12T00:03:49.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7b27fc640 1 -- 172.21.15.6:0/3920692590 learned_addr learned my addr 172.21.15.6:0/3920692590 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:49.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7b2ffd640 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 0x55901495b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559014956370 0x559014962210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7b27fc640 1 -- 172.21.15.6:0/3920692590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 msgr2=0x55901495b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:49.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 0x55901495b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7b27fc640 1 -- 172.21.15.6:0/3920692590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559014956370 msgr2=0x559014962210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:49.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559014956370 0x559014962210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7b27fc640 1 -- 172.21.15.6:0/3920692590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590145c7210 con 0x5590149509a0 2024-09-12T00:03:49.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590149509a0 0x55901495ac90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8006010 tx=0x7fc7a8012540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45bdeb0058524a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:49.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.554+0000 7fc792ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:03:49.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc792ffd640 1 -- 172.21.15.6:0/3920692590 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a801e920 con 0x5590149509a0 2024-09-12T00:03:49.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc792ffd640 1 -- 172.21.15.6:0/3920692590 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fc7a801eac0 con 0x5590149509a0 2024-09-12T00:03:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc7bc648740 1 -- 172.21.15.6:0/3920692590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7a8010c80 con 0x5590149509a0 2024-09-12T00:03:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc792ffd640 1 -- 172.21.15.6:0/3920692590 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc7a8033050 con 0x5590149509a0 2024-09-12T00:03:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc7bc648740 10 client.15702 fetch_fsmap learned FSMap version 33 2024-09-12T00:03:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc7bc648740 1 -- 172.21.15.6:0/3920692590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559014693620 con 0x5590149509a0 2024-09-12T00:03:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc792ffd640 1 -- 172.21.15.6:0/3920692590 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7a8010c80 con 0x5590149509a0 2024-09-12T00:03:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc792ffd640 1 -- 172.21.15.6:0/3920692590 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fc7a8027070 con 0x5590149509a0 2024-09-12T00:03:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc7bc648740 10 client.15702 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:03:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc7bc648740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:03:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc7bc648740 20 client.15702 populate_metadata read hostname 'smithi006' 2024-09-12T00:03:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc7bc648740 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5590149666c0 0x559014968ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc7bc648740 4 client.15702 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:49.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.555+0000 7fc7bc648740 1 -- 172.21.15.6:0/3920692590 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590148c1a20 con 0x5590149666c0 2024-09-12T00:03:49.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.556+0000 7fc7b2ffd640 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5590149666c0 0x559014968ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.556+0000 7fc7b2ffd640 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5590149666c0 0x559014968ab0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8e2841e9b193b46 server_cookie=23de3aa596404c6e in_seq=0 out_seq=0 2024-09-12T00:03:49.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.556+0000 7fc792ffd640 10 client.15702 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:49.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc792ffd640 1 -- 172.21.15.6:0/3920692590 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590148c1a20 con 0x5590149666c0 2024-09-12T00:03:49.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc792ffd640 10 client.15702 handle_command_reply: tid=0 2024-09-12T00:03:49.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc7bc648740 1 client.15702 shutdown 2024-09-12T00:03:49.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc7bc648740 1 -- 172.21.15.6:0/3920692590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590149509a0 msgr2=0x55901495ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:49.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc7bc648740 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590149509a0 0x55901495ac90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8006010 tx=0x7fc7a8012540 comp rx=0 tx=0).stop 2024-09-12T00:03:49.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc7bc648740 1 -- 172.21.15.6:0/3920692590 shutdown_connections 2024-09-12T00:03:49.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc7bc648740 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559014956370 0x559014962210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc7bc648740 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5590149666c0 0x559014968ab0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc7bc648740 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 0x55901495b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc7bc648740 1 --2- 172.21.15.6:0/3920692590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590149509a0 0x55901495ac90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc7bc648740 1 -- 172.21.15.6:0/3920692590 >> 172.21.15.6:0/3920692590 conn(0x55901494c010 msgr2=0x55901494d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:49.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc792ffd640 0 client.15702 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:49.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc7bc648740 1 -- 172.21.15.6:0/3920692590 shutdown_connections 2024-09-12T00:03:49.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc7bc648740 1 -- 172.21.15.6:0/3920692590 wait complete. 2024-09-12T00:03:49.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.557+0000 7fc7bc648740 20 client.15702 trim_cache size 0 max 16384 2024-09-12T00:03:49.575 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7bc648740 1 Processor -- start 2024-09-12T00:03:49.575 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7bc648740 1 -- start start 2024-09-12T00:03:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7bc648740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149509a0 0x55901495b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7bc648740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149512e0 0x5590149621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7bc648740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x55901494a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7bc648740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b41ac970 con 0x559014956370 2024-09-12T00:03:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7bc648740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b41ae4b0 con 0x5590149512e0 2024-09-12T00:03:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7bc648740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b41ad040 con 0x5590149509a0 2024-09-12T00:03:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7b27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x55901494a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7b27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x55901494a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57454/0 (socket says 172.21.15.6:57454) 2024-09-12T00:03:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7b27fc640 1 -- 172.21.15.6:0/870572812 learned_addr learned my addr 172.21.15.6:0/870572812 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/870572812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149509a0 0x55901495b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7b2ffd640 1 --2- 172.21.15.6:0/870572812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149512e0 0x5590149621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7b27fc640 1 -- 172.21.15.6:0/870572812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149509a0 msgr2=0x55901495b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:49.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/870572812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149509a0 0x55901495b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7b27fc640 1 -- 172.21.15.6:0/870572812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149512e0 msgr2=0x5590149621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:49.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/870572812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149512e0 0x5590149621a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7b27fc640 1 -- 172.21.15.6:0/870572812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55901494be30 con 0x559014956370 2024-09-12T00:03:49.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.576+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/870572812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x55901494a9a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8011010 tx=0x7fc7a8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7051cee658598d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:49.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.577+0000 7fc7997fa640 1 -- 172.21.15.6:0/870572812 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8004660 con 0x559014956370 2024-09-12T00:03:49.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.577+0000 7fc7997fa640 1 -- 172.21.15.6:0/870572812 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7a801ede0 con 0x559014956370 2024-09-12T00:03:49.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.577+0000 7fc7997fa640 1 -- 172.21.15.6:0/870572812 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8004e40 con 0x559014956370 2024-09-12T00:03:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.577+0000 7fc7bc648740 1 -- 172.21.15.6:0/870572812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 msgr2=0x55901494a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.577+0000 7fc7bc648740 1 --2- 172.21.15.6:0/870572812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x55901494a9a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8011010 tx=0x7fc7a8014040 comp rx=0 tx=0).stop 2024-09-12T00:03:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.577+0000 7fc7bc648740 1 -- 172.21.15.6:0/870572812 shutdown_connections 2024-09-12T00:03:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.577+0000 7fc7bc648740 1 --2- 172.21.15.6:0/870572812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x55901494a9a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.577+0000 7fc7bc648740 1 --2- 172.21.15.6:0/870572812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149512e0 0x5590149621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.577+0000 7fc7bc648740 1 --2- 172.21.15.6:0/870572812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149509a0 0x55901495b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.577+0000 7fc7bc648740 1 -- 172.21.15.6:0/870572812 >> 172.21.15.6:0/870572812 conn(0x55901494c010 msgr2=0x55901495aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.577+0000 7fc7bc648740 1 -- 172.21.15.6:0/870572812 shutdown_connections 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7bc648740 1 -- 172.21.15.6:0/870572812 wait complete. 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7bc648740 1 -- start start 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7bc648740 1 Processor -- start 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7bc648740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149509a0 0x55901495f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7bc648740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 0x55901495f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7bc648740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x5590149608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7bc648740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b41adde0 con 0x559014956370 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7bc648740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b41ad710 con 0x5590149509a0 2024-09-12T00:03:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7bc648740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b41aa950 con 0x5590149512e0 2024-09-12T00:03:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7bc648740 10 client.0 _ll_register_callbacks cb 0x7fc7a8009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7b27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x5590149608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7b27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x5590149608d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57468/0 (socket says 172.21.15.6:57468) 2024-09-12T00:03:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.578+0000 7fc7b27fc640 1 -- 172.21.15.6:0/1752902499 learned_addr learned my addr 172.21.15.6:0/1752902499 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:03:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc7b2ffd640 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 0x55901495f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149509a0 0x55901495f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc7b27fc640 1 -- 172.21.15.6:0/1752902499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 msgr2=0x55901495f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 0x55901495f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc7b27fc640 1 -- 172.21.15.6:0/1752902499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149509a0 msgr2=0x55901495f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149509a0 0x55901495f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc7b27fc640 1 -- 172.21.15.6:0/1752902499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559014960ee0 con 0x559014956370 2024-09-12T00:03:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc7b27fc640 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x5590149608d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8010f00 tx=0x7fc7a8012720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4647dcf719ad3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc792ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:03:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc792ffd640 1 -- 172.21.15.6:0/1752902499 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a802f070 con 0x559014956370 2024-09-12T00:03:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc792ffd640 1 -- 172.21.15.6:0/1752902499 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fc7a8024040 con 0x559014956370 2024-09-12T00:03:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc7bc648740 1 -- 172.21.15.6:0/1752902499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7a801ede0 con 0x559014956370 2024-09-12T00:03:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc792ffd640 1 -- 172.21.15.6:0/1752902499 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc7a8049050 con 0x559014956370 2024-09-12T00:03:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc7bc648740 10 client.15708 fetch_fsmap learned FSMap version 33 2024-09-12T00:03:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.579+0000 7fc7bc648740 1 -- 172.21.15.6:0/1752902499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5590149621f0 con 0x559014956370 2024-09-12T00:03:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.580+0000 7fc792ffd640 1 -- 172.21.15.6:0/1752902499 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7a801ede0 con 0x559014956370 2024-09-12T00:03:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.580+0000 7fc792ffd640 1 -- 172.21.15.6:0/1752902499 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fc7a8027030 con 0x559014956370 2024-09-12T00:03:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.580+0000 7fc7bc648740 10 client.15708 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:03:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.580+0000 7fc7bc648740 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:03:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.580+0000 7fc7bc648740 20 client.15708 populate_metadata read hostname 'smithi006' 2024-09-12T00:03:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.580+0000 7fc7bc648740 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5590149d1690 0x5590149d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.580+0000 7fc7bc648740 4 client.15708 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:03:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.580+0000 7fc7bc648740 1 -- 172.21.15.6:0/1752902499 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5590148bbd70 con 0x5590149d1690 2024-09-12T00:03:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.580+0000 7fc7b2ffd640 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5590149d1690 0x5590149d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.580+0000 7fc7b2ffd640 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5590149d1690 0x5590149d3ab0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b6221ada19b2aa2 server_cookie=6ee739436125d204 in_seq=0 out_seq=0 2024-09-12T00:03:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.580+0000 7fc792ffd640 10 client.15708 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc792ffd640 1 -- 172.21.15.6:0/1752902499 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5590148bbd70 con 0x5590149d1690 2024-09-12T00:03:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc792ffd640 10 client.15708 handle_command_reply: tid=0 2024-09-12T00:03:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc7bc648740 1 client.15708 shutdown 2024-09-12T00:03:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc7bc648740 1 -- 172.21.15.6:0/1752902499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 msgr2=0x5590149608d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc7bc648740 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x5590149608d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8010f00 tx=0x7fc7a8012720 comp rx=0 tx=0).stop 2024-09-12T00:03:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc7bc648740 1 -- 172.21.15.6:0/1752902499 shutdown_connections 2024-09-12T00:03:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc7bc648740 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559014956370 0x5590149608d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc7bc648740 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5590149d1690 0x5590149d3ab0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc7bc648740 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5590149512e0 0x55901495f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc792ffd640 0 client.15708 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:03:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc7bc648740 1 --2- 172.21.15.6:0/1752902499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590149509a0 0x55901495f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc7bc648740 1 -- 172.21.15.6:0/1752902499 >> 172.21.15.6:0/1752902499 conn(0x55901494c010 msgr2=0x55901494cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc7bc648740 1 -- 172.21.15.6:0/1752902499 shutdown_connections 2024-09-12T00:03:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc7bc648740 1 -- 172.21.15.6:0/1752902499 wait complete. 2024-09-12T00:03:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.598+0000 7fc7bc648740 20 client.15708 trim_cache size 0 max 16384 2024-09-12T00:03:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:03:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:03:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:03:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:03:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.599+0000 7fc7b98ae640 1 -- 172.21.15.6:0/1307840926 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc79c0a2b80 msgr2=0x7fc79c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.599+0000 7fc7b98ae640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc79c0a2b80 0x7fc79c0a5040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0c56a0 tx=0x7fc7ac0b8b80 comp rx=0 tx=0).stop 2024-09-12T00:03:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.599+0000 7fc7b98ae640 1 -- 172.21.15.6:0/1307840926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b41016f0 msgr2=0x7fc7b41a14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.599+0000 7fc7b98ae640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b41016f0 0x7fc7b41a14f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0319d0 tx=0x7fc7ac0317f0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.599+0000 7fc7b98ae640 1 -- 172.21.15.6:0/1307840926 shutdown_connections 2024-09-12T00:03:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.599+0000 7fc7b98ae640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc79c0a2b80 0x7fc79c0a5040 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.599+0000 7fc7b98ae640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b41016f0 0x7fc7b41a14f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.599+0000 7fc7b98ae640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7b4100d50 0x7fc7b419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.599+0000 7fc7b98ae640 1 --2- 172.21.15.6:0/1307840926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7b4100410 0x7fc7b4199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.599+0000 7fc7b98ae640 1 -- 172.21.15.6:0/1307840926 >> 172.21.15.6:0/1307840926 conn(0x7fc7b40fc1c0 msgr2=0x7fc7b40fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.599+0000 7fc7b98ae640 1 -- 172.21.15.6:0/1307840926 shutdown_connections 2024-09-12T00:03:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:03:49.599+0000 7fc7b98ae640 1 -- 172.21.15.6:0/1307840926 wait complete. 2024-09-12T00:03:50.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:50 smithi134 ceph-mon[34893]: pgmap v494: 129 pgs: 129 active+clean; 4.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-12T00:03:50.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:50 smithi039 ceph-mon[34543]: pgmap v494: 129 pgs: 129 active+clean; 4.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-12T00:03:50.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:50 smithi006 ceph-mon[30947]: pgmap v494: 129 pgs: 129 active+clean; 4.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-12T00:03:52.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:52 smithi134 ceph-mon[34893]: pgmap v495: 129 pgs: 129 active+clean; 4.8 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 25 op/s 2024-09-12T00:03:52.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:52 smithi039 ceph-mon[34543]: pgmap v495: 129 pgs: 129 active+clean; 4.8 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 25 op/s 2024-09-12T00:03:52.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:52 smithi006 ceph-mon[30947]: pgmap v495: 129 pgs: 129 active+clean; 4.8 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 25 op/s 2024-09-12T00:03:54.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:54 smithi134 ceph-mon[34893]: pgmap v496: 129 pgs: 129 active+clean; 4.8 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-09-12T00:03:54.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:54 smithi039 ceph-mon[34543]: pgmap v496: 129 pgs: 129 active+clean; 4.8 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-09-12T00:03:54.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:54 smithi006 ceph-mon[30947]: pgmap v496: 129 pgs: 129 active+clean; 4.8 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-09-12T00:03:56.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:56 smithi134 ceph-mon[34893]: pgmap v497: 129 pgs: 129 active+clean; 4.9 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:03:56.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:56 smithi039 ceph-mon[34543]: pgmap v497: 129 pgs: 129 active+clean; 4.9 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:03:56.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:56 smithi006 ceph-mon[30947]: pgmap v497: 129 pgs: 129 active+clean; 4.9 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:03:58.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:03:58 smithi134 ceph-mon[34893]: pgmap v498: 129 pgs: 129 active+clean; 5.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-09-12T00:03:58.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:03:58 smithi039 ceph-mon[34543]: pgmap v498: 129 pgs: 129 active+clean; 5.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-09-12T00:03:58.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:03:58 smithi006 ceph-mon[30947]: pgmap v498: 129 pgs: 129 active+clean; 5.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-09-12T00:04:00.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:00 smithi134 ceph-mon[34893]: pgmap v499: 129 pgs: 129 active+clean; 5.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:04:00.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:00 smithi039 ceph-mon[34543]: pgmap v499: 129 pgs: 129 active+clean; 5.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:04:00.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:00 smithi006 ceph-mon[30947]: pgmap v499: 129 pgs: 129 active+clean; 5.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:04:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.695+0000 7f79a0591640 1 -- 172.21.15.6:0/3045937214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7998101b50 msgr2=0x7f7998101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.695+0000 7f79a0591640 1 --2- 172.21.15.6:0/3045937214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7998101b50 0x7f7998101f50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7994009900 tx=0x7f799402a410 comp rx=0 tx=0).stop 2024-09-12T00:04:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.695+0000 7f79a0591640 1 -- 172.21.15.6:0/3045937214 shutdown_connections 2024-09-12T00:04:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.695+0000 7f79a0591640 1 --2- 172.21.15.6:0/3045937214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7998103700 0x7f7998109f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.695+0000 7f79a0591640 1 --2- 172.21.15.6:0/3045937214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7998102d40 0x7f79981031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.695+0000 7f79a0591640 1 --2- 172.21.15.6:0/3045937214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7998101b50 0x7f7998101f50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.695+0000 7f79a0591640 1 -- 172.21.15.6:0/3045937214 >> 172.21.15.6:0/3045937214 conn(0x7f79980fd2f0 msgr2=0x7f79980ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.695+0000 7f79a0591640 1 -- 172.21.15.6:0/3045937214 shutdown_connections 2024-09-12T00:04:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.695+0000 7f79a0591640 1 -- 172.21.15.6:0/3045937214 wait complete. 2024-09-12T00:04:02.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.696+0000 7f79a0591640 1 Processor -- start 2024-09-12T00:04:02.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.696+0000 7f79a0591640 1 -- start start 2024-09-12T00:04:02.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.696+0000 7f79a0591640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7998101b50 0x7f7998197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.696+0000 7f79a0591640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7998102d40 0x7f79981983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.696+0000 7f79a0591640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7998103700 0x7f799819f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.696+0000 7f79a0591640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f799810d680 con 0x7f7998101b50 2024-09-12T00:04:02.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.696+0000 7f79a0591640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f799810d500 con 0x7f7998103700 2024-09-12T00:04:02.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.696+0000 7f79a0591640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f799810d800 con 0x7f7998102d40 2024-09-12T00:04:02.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.696+0000 7f799e32d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7998101b50 0x7f7998197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.696+0000 7f799e32d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7998101b50 0x7f7998197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36892/0 (socket says 172.21.15.6:36892) 2024-09-12T00:04:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.696+0000 7f799e32d640 1 -- 172.21.15.6:0/4086764481 learned_addr learned my addr 172.21.15.6:0/4086764481 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f799db2c640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7998102d40 0x7f79981983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f799eb2e640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7998103700 0x7f799819f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f799e32d640 1 -- 172.21.15.6:0/4086764481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7998102d40 msgr2=0x7f79981983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f799e32d640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7998102d40 0x7f79981983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f799e32d640 1 -- 172.21.15.6:0/4086764481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7998103700 msgr2=0x7f799819f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f799e32d640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7998103700 0x7f799819f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f799e32d640 1 -- 172.21.15.6:0/4086764481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799819fa90 con 0x7f7998101b50 2024-09-12T00:04:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f799eb2e640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7998103700 0x7f799819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f799e32d640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7998101b50 0x7f7998197e70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7994004270 tx=0x7f7994031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f798f7fe640 1 -- 172.21.15.6:0/4086764481 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799403f030 con 0x7f7998101b50 2024-09-12T00:04:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f79a0591640 1 -- 172.21.15.6:0/4086764481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f799819fd20 con 0x7f7998101b50 2024-09-12T00:04:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f798f7fe640 1 -- 172.21.15.6:0/4086764481 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7994003cb0 con 0x7f7998101b50 2024-09-12T00:04:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f798f7fe640 1 -- 172.21.15.6:0/4086764481 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994035070 con 0x7f7998101b50 2024-09-12T00:04:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.697+0000 7f79a0591640 1 -- 172.21.15.6:0/4086764481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79981a01b0 con 0x7f7998101b50 2024-09-12T00:04:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.700+0000 7f798f7fe640 1 -- 172.21.15.6:0/4086764481 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f7994042030 con 0x7f7998101b50 2024-09-12T00:04:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.700+0000 7f79a340d740 1 Processor -- start 2024-09-12T00:04:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f79a340d740 1 -- start start 2024-09-12T00:04:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f79a340d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 0x5626085e71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f79a340d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e76f0 0x5626085ec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f79a340d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085ec780 0x5626085eec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f79a340d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5626085462f0 con 0x5626085e6db0 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f79a340d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5626084ee270 con 0x5626085e76f0 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f79a340d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5626085422b0 con 0x5626085ec780 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f798f7fe640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f79840a2b80 0x7f79840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f799eb2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 0x5626085e71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f799db2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085ec780 0x5626085eec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f799eb2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 0x5626085e71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36896/0 (socket says 172.21.15.6:36896) 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f799eb2e640 1 -- 172.21.15.6:0/3448234349 learned_addr learned my addr 172.21.15.6:0/3448234349 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f799e32d640 1 --2- 172.21.15.6:0/3448234349 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e76f0 0x5626085ec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f799eb2e640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f79840a2b80 0x7f79840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f799db2c640 1 -- 172.21.15.6:0/3448234349 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e76f0 msgr2=0x5626085ec1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f798f7fe640 1 -- 172.21.15.6:0/4086764481 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f79940ef9d0 con 0x7f7998101b50 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f799db2c640 1 --2- 172.21.15.6:0/3448234349 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e76f0 0x5626085ec1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f799db2c640 1 -- 172.21.15.6:0/3448234349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 msgr2=0x5626085e71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f799db2c640 1 --2- 172.21.15.6:0/3448234349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 0x5626085e71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.701+0000 7f799db2c640 1 -- 172.21.15.6:0/3448234349 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626084ed340 con 0x5626085ec780 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.702+0000 7f799db2c640 1 --2- 172.21.15.6:0/3448234349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085ec780 0x5626085eec40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f79880058c0 tx=0x7f798800f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db08dce1599aaed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.702+0000 7f799eb2e640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f79840a2b80 0x7f79840a5040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f79900149b0 tx=0x7f7990004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.702+0000 7f798cbfe640 1 -- 172.21.15.6:0/3448234349 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7988004020 con 0x5626085ec780 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.702+0000 7f798cbfe640 1 -- 172.21.15.6:0/3448234349 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f79880041c0 con 0x5626085ec780 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.702+0000 7f798cbfe640 1 -- 172.21.15.6:0/3448234349 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79880186a0 con 0x5626085ec780 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 -- 172.21.15.6:0/3448234349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085ec780 msgr2=0x5626085eec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 --2- 172.21.15.6:0/3448234349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085ec780 0x5626085eec40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f79880058c0 tx=0x7f798800f3c0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 -- 172.21.15.6:0/3448234349 shutdown_connections 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 --2- 172.21.15.6:0/3448234349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085ec780 0x5626085eec40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 --2- 172.21.15.6:0/3448234349 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e76f0 0x5626085ec1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 --2- 172.21.15.6:0/3448234349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 0x5626085e71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 -- 172.21.15.6:0/3448234349 >> 172.21.15.6:0/3448234349 conn(0x5626085de010 msgr2=0x5626085de410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 -- 172.21.15.6:0/3448234349 shutdown_connections 2024-09-12T00:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 -- 172.21.15.6:0/3448234349 wait complete. 2024-09-12T00:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 -- start start 2024-09-12T00:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 Processor -- start 2024-09-12T00:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085e6db0 0x5626085f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e76f0 0x5626085f1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085ec780 0x5626085f8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5626085ef750 con 0x5626085e76f0 2024-09-12T00:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5626084cf290 con 0x5626085ec780 2024-09-12T00:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.703+0000 7f79a340d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5626085ef8d0 con 0x5626085e6db0 2024-09-12T00:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f79a340d740 10 client.0 _ll_register_callbacks cb 0x562608500140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f799db2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e76f0 0x5626085f1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f799db2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e76f0 0x5626085f1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36908/0 (socket says 172.21.15.6:36908) 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f799db2c640 1 -- 172.21.15.6:0/2127916641 learned_addr learned my addr 172.21.15.6:0/2127916641 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f799eb2e640 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085ec780 0x5626085f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f799e32d640 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085e6db0 0x5626085f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f799db2c640 1 -- 172.21.15.6:0/2127916641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085e6db0 msgr2=0x5626085f0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f799db2c640 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085e6db0 0x5626085f0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f799db2c640 1 -- 172.21.15.6:0/2127916641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085ec780 msgr2=0x5626085f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f799db2c640 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085ec780 0x5626085f8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f799db2c640 1 -- 172.21.15.6:0/2127916641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562608259210 con 0x5626085e76f0 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f799e32d640 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085e6db0 0x5626085f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f799db2c640 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e76f0 0x5626085f1450 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f798800a740 tx=0x7f798800fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e658830fe0b3477 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f7981ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:04:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f7981ffb640 1 -- 172.21.15.6:0/2127916641 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7988027020 con 0x5626085e76f0 2024-09-12T00:04:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f79a340d740 1 -- 172.21.15.6:0/2127916641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79880041c0 con 0x5626085e76f0 2024-09-12T00:04:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.704+0000 7f7981ffb640 1 -- 172.21.15.6:0/2127916641 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f7988004370 con 0x5626085e76f0 2024-09-12T00:04:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.705+0000 7f7981ffb640 1 -- 172.21.15.6:0/2127916641 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7988032050 con 0x5626085e76f0 2024-09-12T00:04:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.705+0000 7f79a340d740 10 client.15720 fetch_fsmap learned FSMap version 33 2024-09-12T00:04:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.705+0000 7f79a340d740 1 -- 172.21.15.6:0/2127916641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562608325620 con 0x5626085e76f0 2024-09-12T00:04:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.705+0000 7f7981ffb640 1 -- 172.21.15.6:0/2127916641 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f79880041c0 con 0x5626085e76f0 2024-09-12T00:04:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.705+0000 7f7981ffb640 1 -- 172.21.15.6:0/2127916641 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f7988004b60 con 0x5626085e76f0 2024-09-12T00:04:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.705+0000 7f79a340d740 10 client.15720 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:04:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.705+0000 7f79a340d740 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:04:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.705+0000 7f79a340d740 20 client.15720 populate_metadata read hostname 'smithi006' 2024-09-12T00:04:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.705+0000 7f79a340d740 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5626085fc900 0x5626085fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.705+0000 7f79a340d740 4 client.15720 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.705+0000 7f79a340d740 1 -- 172.21.15.6:0/2127916641 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562608553a20 con 0x5626085fc900 2024-09-12T00:04:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.705+0000 7f799e32d640 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5626085fc900 0x5626085fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.706+0000 7f7981ffb640 10 client.15720 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.706+0000 7f799e32d640 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5626085fc900 0x5626085fecf0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c95b4ae5ebdf21a server_cookie=a151239ca6b01366 in_seq=0 out_seq=0 2024-09-12T00:04:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.706+0000 7f7981ffb640 1 -- 172.21.15.6:0/2127916641 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562608553a20 con 0x5626085fc900 2024-09-12T00:04:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.706+0000 7f7981ffb640 10 client.15720 handle_command_reply: tid=0 2024-09-12T00:04:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.706+0000 7f79a340d740 1 client.15720 shutdown 2024-09-12T00:04:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.707+0000 7f79a340d740 1 -- 172.21.15.6:0/2127916641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e76f0 msgr2=0x5626085f1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.707+0000 7f79a340d740 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e76f0 0x5626085f1450 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f798800a740 tx=0x7f798800fdd0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.707+0000 7f79a340d740 1 -- 172.21.15.6:0/2127916641 shutdown_connections 2024-09-12T00:04:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.707+0000 7f79a340d740 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085ec780 0x5626085f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.707+0000 7f79a340d740 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e76f0 0x5626085f1450 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.707+0000 7f79a340d740 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5626085fc900 0x5626085fecf0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.707+0000 7f79a340d740 1 --2- 172.21.15.6:0/2127916641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085e6db0 0x5626085f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.707+0000 7f79a340d740 1 -- 172.21.15.6:0/2127916641 >> 172.21.15.6:0/2127916641 conn(0x5626085de010 msgr2=0x5626085df820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.707+0000 7f7981ffb640 0 client.15720 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.707+0000 7f79a340d740 1 -- 172.21.15.6:0/2127916641 shutdown_connections 2024-09-12T00:04:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.707+0000 7f79a340d740 1 -- 172.21.15.6:0/2127916641 wait complete. 2024-09-12T00:04:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.707+0000 7f79a340d740 20 client.15720 trim_cache size 0 max 16384 2024-09-12T00:04:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.722+0000 7f79a340d740 1 Processor -- start 2024-09-12T00:04:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.722+0000 7f79a340d740 1 -- start start 2024-09-12T00:04:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.722+0000 7f79a340d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e6db0 0x5626085dd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.722+0000 7f79a340d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085e76f0 0x5626085f8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.722+0000 7f79a340d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085ec780 0x5626085df400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.722+0000 7f79a340d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f79981a86f0 con 0x5626085ec780 2024-09-12T00:04:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.722+0000 7f79a340d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f79981aa230 con 0x5626085e6db0 2024-09-12T00:04:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.722+0000 7f79a340d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f79981a8dc0 con 0x5626085e76f0 2024-09-12T00:04:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.722+0000 7f799eb2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085ec780 0x5626085df400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f799eb2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085ec780 0x5626085df400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36922/0 (socket says 172.21.15.6:36922) 2024-09-12T00:04:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f799eb2e640 1 -- 172.21.15.6:0/3850219187 learned_addr learned my addr 172.21.15.6:0/3850219187 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f799e32d640 1 --2- 172.21.15.6:0/3850219187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e6db0 0x5626085dd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f799db2c640 1 --2- 172.21.15.6:0/3850219187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085e76f0 0x5626085f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f799eb2e640 1 -- 172.21.15.6:0/3850219187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085e76f0 msgr2=0x5626085f8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f799eb2e640 1 --2- 172.21.15.6:0/3850219187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085e76f0 0x5626085f8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f799eb2e640 1 -- 172.21.15.6:0/3850219187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e6db0 msgr2=0x5626085dd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f799eb2e640 1 --2- 172.21.15.6:0/3850219187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e6db0 0x5626085dd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f799eb2e640 1 -- 172.21.15.6:0/3850219187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626085efed0 con 0x5626085ec780 2024-09-12T00:04:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f799eb2e640 1 --2- 172.21.15.6:0/3850219187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085ec780 0x5626085df400 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f79900142f0 tx=0x7f79900099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df773ea49d8a0068 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f7983fff640 1 -- 172.21.15.6:0/3850219187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990027070 con 0x5626085ec780 2024-09-12T00:04:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f7983fff640 1 -- 172.21.15.6:0/3850219187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7990013e30 con 0x5626085ec780 2024-09-12T00:04:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.723+0000 7f7983fff640 1 -- 172.21.15.6:0/3850219187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799001a040 con 0x5626085ec780 2024-09-12T00:04:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.724+0000 7f79a340d740 1 -- 172.21.15.6:0/3850219187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085ec780 msgr2=0x5626085df400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.724+0000 7f79a340d740 1 --2- 172.21.15.6:0/3850219187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085ec780 0x5626085df400 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f79900142f0 tx=0x7f79900099a0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.724+0000 7f79a340d740 1 -- 172.21.15.6:0/3850219187 shutdown_connections 2024-09-12T00:04:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.724+0000 7f79a340d740 1 --2- 172.21.15.6:0/3850219187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085ec780 0x5626085df400 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.724+0000 7f79a340d740 1 --2- 172.21.15.6:0/3850219187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085e76f0 0x5626085f8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.724+0000 7f79a340d740 1 --2- 172.21.15.6:0/3850219187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e6db0 0x5626085dd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.724+0000 7f79a340d740 1 -- 172.21.15.6:0/3850219187 >> 172.21.15.6:0/3850219187 conn(0x5626085de010 msgr2=0x5626085dc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.724+0000 7f79a340d740 1 -- 172.21.15.6:0/3850219187 shutdown_connections 2024-09-12T00:04:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.724+0000 7f79a340d740 1 -- 172.21.15.6:0/3850219187 wait complete. 2024-09-12T00:04:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.724+0000 7f79a340d740 1 -- start start 2024-09-12T00:04:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f79a340d740 1 Processor -- start 2024-09-12T00:04:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f79a340d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 0x5626085f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f79a340d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e76f0 0x5626085f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f79a340d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085ec780 0x5626085f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f79a340d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f79981a9b60 con 0x5626085e6db0 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f79a340d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f79981a9490 con 0x5626085e76f0 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f79a340d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f79981a66d0 con 0x5626085ec780 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f79a340d740 10 client.0 _ll_register_callbacks cb 0x7f7990009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f799e32d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 0x5626085f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f799e32d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 0x5626085f5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36934/0 (socket says 172.21.15.6:36934) 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f799e32d640 1 -- 172.21.15.6:0/3927486779 learned_addr learned my addr 172.21.15.6:0/3927486779 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f799db2c640 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e76f0 0x5626085f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f799eb2e640 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085ec780 0x5626085f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f799e32d640 1 -- 172.21.15.6:0/3927486779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085ec780 msgr2=0x5626085f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f799e32d640 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085ec780 0x5626085f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f799e32d640 1 -- 172.21.15.6:0/3927486779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e76f0 msgr2=0x5626085f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f799e32d640 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e76f0 0x5626085f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f799e32d640 1 -- 172.21.15.6:0/3927486779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626085f78c0 con 0x5626085e6db0 2024-09-12T00:04:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f799e32d640 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 0x5626085f5d60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7994006010 tx=0x7f799408de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3185ed41d920112d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.725+0000 7f7981ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:04:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f7981ffb640 1 -- 172.21.15.6:0/3927486779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79940be070 con 0x5626085e6db0 2024-09-12T00:04:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f79a340d740 1 -- 172.21.15.6:0/3927486779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7990013e30 con 0x5626085e6db0 2024-09-12T00:04:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f7981ffb640 1 -- 172.21.15.6:0/3927486779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f79940b84b0 con 0x5626085e6db0 2024-09-12T00:04:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f7981ffb640 1 -- 172.21.15.6:0/3927486779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7994049040 con 0x5626085e6db0 2024-09-12T00:04:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f79a340d740 10 client.15726 fetch_fsmap learned FSMap version 33 2024-09-12T00:04:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f79a340d740 1 -- 172.21.15.6:0/3927486779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562608667870 con 0x5626085e6db0 2024-09-12T00:04:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f7981ffb640 1 -- 172.21.15.6:0/3927486779 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7990013e30 con 0x5626085e6db0 2024-09-12T00:04:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f7981ffb640 1 -- 172.21.15.6:0/3927486779 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f799403b460 con 0x5626085e6db0 2024-09-12T00:04:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f79a340d740 10 client.15726 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:04:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f79a340d740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:04:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f79a340d740 20 client.15726 populate_metadata read hostname 'smithi006' 2024-09-12T00:04:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f79a340d740 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5626086681a0 0x56260866a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f79a340d740 4 client.15726 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:04:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.726+0000 7f79a340d740 1 -- 172.21.15.6:0/3927486779 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56260854dd70 con 0x5626086681a0 2024-09-12T00:04:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.727+0000 7f799db2c640 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5626086681a0 0x56260866a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.727+0000 7f799db2c640 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5626086681a0 0x56260866a5c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=459cc1a056662640 server_cookie=a356df982b8a1eac in_seq=0 out_seq=0 2024-09-12T00:04:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.727+0000 7f7981ffb640 10 client.15726 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f7981ffb640 1 -- 172.21.15.6:0/3927486779 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56260854dd70 con 0x5626086681a0 2024-09-12T00:04:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f7981ffb640 10 client.15726 handle_command_reply: tid=0 2024-09-12T00:04:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f79a340d740 1 client.15726 shutdown 2024-09-12T00:04:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f79a340d740 1 -- 172.21.15.6:0/3927486779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 msgr2=0x5626085f5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f79a340d740 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 0x5626085f5d60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7994006010 tx=0x7f799408de50 comp rx=0 tx=0).stop 2024-09-12T00:04:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f79a340d740 1 -- 172.21.15.6:0/3927486779 shutdown_connections 2024-09-12T00:04:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f79a340d740 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5626086681a0 0x56260866a5c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f79a340d740 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626085ec780 0x5626085f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f79a340d740 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5626085e76f0 0x5626085f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f79a340d740 1 --2- 172.21.15.6:0/3927486779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5626085e6db0 0x5626085f5d60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f79a340d740 1 -- 172.21.15.6:0/3927486779 >> 172.21.15.6:0/3927486779 conn(0x5626085de010 msgr2=0x5626085dd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f7981ffb640 0 client.15726 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f79a340d740 1 -- 172.21.15.6:0/3927486779 shutdown_connections 2024-09-12T00:04:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f79a340d740 1 -- 172.21.15.6:0/3927486779 wait complete. 2024-09-12T00:04:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.743+0000 7f79a340d740 20 client.15726 trim_cache size 0 max 16384 2024-09-12T00:04:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:04:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:04:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:04:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:04:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.744+0000 7f79a0591640 1 -- 172.21.15.6:0/4086764481 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f79840a2b80 msgr2=0x7f79840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.744+0000 7f79a0591640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f79840a2b80 0x7f79840a5040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f79900149b0 tx=0x7f7990004ab0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.744+0000 7f79a0591640 1 -- 172.21.15.6:0/4086764481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7998101b50 msgr2=0x7f7998197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.744+0000 7f79a0591640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7998101b50 0x7f7998197e70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7994004270 tx=0x7f7994031a30 comp rx=0 tx=0).stop 2024-09-12T00:04:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.744+0000 7f79a0591640 1 -- 172.21.15.6:0/4086764481 shutdown_connections 2024-09-12T00:04:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.744+0000 7f79a0591640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f79840a2b80 0x7f79840a5040 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.744+0000 7f79a0591640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7998103700 0x7f799819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.744+0000 7f79a0591640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7998102d40 0x7f79981983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.744+0000 7f79a0591640 1 --2- 172.21.15.6:0/4086764481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7998101b50 0x7f7998197e70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.744+0000 7f79a0591640 1 -- 172.21.15.6:0/4086764481 >> 172.21.15.6:0/4086764481 conn(0x7f79980fd2f0 msgr2=0x7f79981062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.744+0000 7f79a0591640 1 -- 172.21.15.6:0/4086764481 shutdown_connections 2024-09-12T00:04:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:02.744+0000 7f79a0591640 1 -- 172.21.15.6:0/4086764481 wait complete. 2024-09-12T00:04:02.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:02 smithi039 ceph-mon[34543]: pgmap v500: 129 pgs: 129 active+clean; 5.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:04:02.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:02 smithi006 ceph-mon[30947]: pgmap v500: 129 pgs: 129 active+clean; 5.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:04:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:02 smithi134 ceph-mon[34893]: pgmap v500: 129 pgs: 129 active+clean; 5.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:04:03.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:03 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:04:03.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:03 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:04:03.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:03 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:04:04.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:04 smithi039 ceph-mon[34543]: pgmap v501: 129 pgs: 129 active+clean; 5.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-09-12T00:04:04.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:04 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:04:04.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:04 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:04:04.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:04 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:04:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:04 smithi006 ceph-mon[30947]: pgmap v501: 129 pgs: 129 active+clean; 5.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-09-12T00:04:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:04:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:04:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:04:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:04 smithi134 ceph-mon[34893]: pgmap v501: 129 pgs: 129 active+clean; 5.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-09-12T00:04:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:04 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:04:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:04 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:04:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:04 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:04:06.755 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:06 smithi134 ceph-mon[34893]: pgmap v502: 129 pgs: 129 active+clean; 5.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:04:06.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:06 smithi039 ceph-mon[34543]: pgmap v502: 129 pgs: 129 active+clean; 5.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:04:06.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:06 smithi006 ceph-mon[30947]: pgmap v502: 129 pgs: 129 active+clean; 5.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:04:08.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:08 smithi039 ceph-mon[34543]: pgmap v503: 129 pgs: 129 active+clean; 5.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:04:08.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:08 smithi006 ceph-mon[30947]: pgmap v503: 129 pgs: 129 active+clean; 5.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:04:08.957 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:08 smithi134 ceph-mon[34893]: pgmap v503: 129 pgs: 129 active+clean; 5.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:04:10.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:10 smithi039 ceph-mon[34543]: pgmap v504: 129 pgs: 129 active+clean; 5.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:04:10.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:10 smithi006 ceph-mon[30947]: pgmap v504: 129 pgs: 129 active+clean; 5.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:04:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:10 smithi134 ceph-mon[34893]: pgmap v504: 129 pgs: 129 active+clean; 5.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:04:12.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:12 smithi039 ceph-mon[34543]: pgmap v505: 129 pgs: 129 active+clean; 5.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:04:12.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:12 smithi006 ceph-mon[30947]: pgmap v505: 129 pgs: 129 active+clean; 5.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:04:12.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:12 smithi134 ceph-mon[34893]: pgmap v505: 129 pgs: 129 active+clean; 5.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:04:14.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:14 smithi039 ceph-mon[34543]: pgmap v506: 129 pgs: 129 active+clean; 5.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:04:14.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:14 smithi006 ceph-mon[30947]: pgmap v506: 129 pgs: 129 active+clean; 5.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:04:14.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:14 smithi134 ceph-mon[34893]: pgmap v506: 129 pgs: 129 active+clean; 5.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:04:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.847+0000 7f0494b8d640 1 -- 172.21.15.6:0/1442916486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0490107870 msgr2=0x7f0490109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.847+0000 7f0494b8d640 1 --2- 172.21.15.6:0/1442916486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0490107870 0x7f0490109c80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0488009ca0 tx=0x7f048802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.847+0000 7f0494b8d640 1 -- 172.21.15.6:0/1442916486 shutdown_connections 2024-09-12T00:04:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.847+0000 7f0494b8d640 1 --2- 172.21.15.6:0/1442916486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0490107870 0x7f0490109c80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.847+0000 7f0494b8d640 1 --2- 172.21.15.6:0/1442916486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0490104f40 0x7f0490107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.847+0000 7f0494b8d640 1 --2- 172.21.15.6:0/1442916486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0490102610 0x7f0490104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.847+0000 7f0494b8d640 1 -- 172.21.15.6:0/1442916486 >> 172.21.15.6:0/1442916486 conn(0x7f04900fc190 msgr2=0x7f04900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:15.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.847+0000 7f0494b8d640 1 -- 172.21.15.6:0/1442916486 shutdown_connections 2024-09-12T00:04:15.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.847+0000 7f0494b8d640 1 -- 172.21.15.6:0/1442916486 wait complete. 2024-09-12T00:04:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.848+0000 7f0494b8d640 1 Processor -- start 2024-09-12T00:04:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.848+0000 7f0494b8d640 1 -- start start 2024-09-12T00:04:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.848+0000 7f0494b8d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0490102610 0x7f0490197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.848+0000 7f0494b8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0490104f40 0x7f0490198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.848+0000 7f0494b8d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0490107870 0x7f049019f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.848+0000 7f0494b8d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f049010d6d0 con 0x7f0490102610 2024-09-12T00:04:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.848+0000 7f0494b8d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f049010d550 con 0x7f0490107870 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.848+0000 7f0494b8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f049010d850 con 0x7f0490104f40 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.848+0000 7f048e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0490102610 0x7f0490197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.848+0000 7f048e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0490102610 0x7f0490197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42890/0 (socket says 172.21.15.6:42890) 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.848+0000 7f048e59c640 1 -- 172.21.15.6:0/1607395662 learned_addr learned my addr 172.21.15.6:0/1607395662 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.848+0000 7f048dd9b640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0490104f40 0x7f0490198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.849+0000 7f048ed9d640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0490107870 0x7f049019f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.849+0000 7f048e59c640 1 -- 172.21.15.6:0/1607395662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0490104f40 msgr2=0x7f0490198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.849+0000 7f048e59c640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0490104f40 0x7f0490198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.849+0000 7f048e59c640 1 -- 172.21.15.6:0/1607395662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0490107870 msgr2=0x7f049019f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.849+0000 7f048e59c640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0490107870 0x7f049019f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.849+0000 7f048e59c640 1 -- 172.21.15.6:0/1607395662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049019f9f0 con 0x7f0490102610 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.849+0000 7f048e59c640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0490102610 0x7f0490197dd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f048000e9f0 tx=0x7f048000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.849+0000 7f047f7fe640 1 -- 172.21.15.6:0/1607395662 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048000cd80 con 0x7f0490102610 2024-09-12T00:04:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.849+0000 7f047f7fe640 1 -- 172.21.15.6:0/1607395662 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04800108e0 con 0x7f0490102610 2024-09-12T00:04:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.849+0000 7f0494b8d640 1 -- 172.21.15.6:0/1607395662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049019fce0 con 0x7f0490102610 2024-09-12T00:04:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.849+0000 7f047f7fe640 1 -- 172.21.15.6:0/1607395662 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480018920 con 0x7f0490102610 2024-09-12T00:04:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.849+0000 7f0494b8d640 1 -- 172.21.15.6:0/1607395662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04901a01d0 con 0x7f0490102610 2024-09-12T00:04:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.852+0000 7f047f7fe640 1 -- 172.21.15.6:0/1607395662 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f0480010a90 con 0x7f0490102610 2024-09-12T00:04:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.852+0000 7f047f7fe640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f04780a2c00 0x7f04780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.852+0000 7f0497a05740 1 Processor -- start 2024-09-12T00:04:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.852+0000 7f048dd9b640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f04780a2c00 0x7f04780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.852+0000 7f047f7fe640 1 -- 172.21.15.6:0/1607395662 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f04800cf6b0 con 0x7f0490102610 2024-09-12T00:04:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f0497a05740 1 -- start start 2024-09-12T00:04:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f0497a05740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f0497a05740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9be2e0 0x55e02d9c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f0497a05740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f0497a05740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e02d9212f0 con 0x55e02d9be2e0 2024-09-12T00:04:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f0497a05740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e02d8c9270 con 0x55e02d9c3370 2024-09-12T00:04:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f0497a05740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e02d91d2b0 con 0x55e02d9bd9a0 2024-09-12T00:04:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f048e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f048dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9be2e0 0x55e02d9c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f048e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9bdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:33294/0 (socket says 172.21.15.6:33294) 2024-09-12T00:04:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f048e59c640 1 -- 172.21.15.6:0/1543257894 learned_addr learned my addr 172.21.15.6:0/1543257894 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f048ed9d640 1 --2- 172.21.15.6:0/1543257894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f048dd9b640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f04780a2c00 0x7f04780a50c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f04901992e0 tx=0x7f048400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f048e59c640 1 -- 172.21.15.6:0/1543257894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 msgr2=0x55e02d9c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f048e59c640 1 --2- 172.21.15.6:0/1543257894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f048e59c640 1 -- 172.21.15.6:0/1543257894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9be2e0 msgr2=0x55e02d9c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f048e59c640 1 --2- 172.21.15.6:0/1543257894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9be2e0 0x55e02d9c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.853+0000 7f048e59c640 1 -- 172.21.15.6:0/1543257894 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e02d8c8340 con 0x55e02d9bd9a0 2024-09-12T00:04:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.854+0000 7f048e59c640 1 --2- 172.21.15.6:0/1543257894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9bdda0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f048009bb60 tx=0x7f048009b650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f22b20b69238a2cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.854+0000 7f047cff9640 1 -- 172.21.15.6:0/1543257894 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04800a4790 con 0x55e02d9bd9a0 2024-09-12T00:04:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.854+0000 7f047cff9640 1 -- 172.21.15.6:0/1543257894 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f048009ce50 con 0x55e02d9bd9a0 2024-09-12T00:04:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.854+0000 7f047cff9640 1 -- 172.21.15.6:0/1543257894 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048009b280 con 0x55e02d9bd9a0 2024-09-12T00:04:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 -- 172.21.15.6:0/1543257894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 msgr2=0x55e02d9bdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 --2- 172.21.15.6:0/1543257894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9bdda0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f048009bb60 tx=0x7f048009b650 comp rx=0 tx=0).stop 2024-09-12T00:04:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 -- 172.21.15.6:0/1543257894 shutdown_connections 2024-09-12T00:04:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 --2- 172.21.15.6:0/1543257894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 --2- 172.21.15.6:0/1543257894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9be2e0 0x55e02d9c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 --2- 172.21.15.6:0/1543257894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9bdda0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 -- 172.21.15.6:0/1543257894 >> 172.21.15.6:0/1543257894 conn(0x55e02d9b9010 msgr2=0x55e02d9b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:15.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 -- 172.21.15.6:0/1543257894 shutdown_connections 2024-09-12T00:04:15.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 -- 172.21.15.6:0/1543257894 wait complete. 2024-09-12T00:04:15.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 -- start start 2024-09-12T00:04:15.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 Processor -- start 2024-09-12T00:04:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.855+0000 7f0497a05740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9be2e0 0x55e02d9c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f0497a05740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f0497a05740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e02d9c62e0 con 0x55e02d9be2e0 2024-09-12T00:04:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f0497a05740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e02d8aa290 con 0x55e02d9c3370 2024-09-12T00:04:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f0497a05740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e02d9c6460 con 0x55e02d9bd9a0 2024-09-12T00:04:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f0497a05740 10 client.0 _ll_register_callbacks cb 0x55e02d8db140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9be2e0 0x55e02d9c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9be2e0 0x55e02d9c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42906/0 (socket says 172.21.15.6:42906) 2024-09-12T00:04:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048dd9b640 1 -- 172.21.15.6:0/4207097576 learned_addr learned my addr 172.21.15.6:0/4207097576 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048ed9d640 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048e59c640 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048dd9b640 1 -- 172.21.15.6:0/4207097576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 msgr2=0x55e02d9c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048dd9b640 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048dd9b640 1 -- 172.21.15.6:0/4207097576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 msgr2=0x55e02d9cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048dd9b640 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048dd9b640 1 -- 172.21.15.6:0/4207097576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e02d634210 con 0x55e02d9be2e0 2024-09-12T00:04:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048ed9d640 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:04:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048e59c640 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:04:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f048dd9b640 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9be2e0 0x55e02d9c80b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0484011710 tx=0x7f0484004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4ea7a8788c8cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f0475ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:04:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.856+0000 7f0475ffb640 1 -- 172.21.15.6:0/4207097576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484005220 con 0x55e02d9be2e0 2024-09-12T00:04:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.857+0000 7f0497a05740 1 -- 172.21.15.6:0/4207097576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f048009ce50 con 0x55e02d9be2e0 2024-09-12T00:04:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.857+0000 7f0475ffb640 1 -- 172.21.15.6:0/4207097576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f04840053c0 con 0x55e02d9be2e0 2024-09-12T00:04:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.857+0000 7f0475ffb640 1 -- 172.21.15.6:0/4207097576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0484031050 con 0x55e02d9be2e0 2024-09-12T00:04:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.857+0000 7f0497a05740 10 client.15738 fetch_fsmap learned FSMap version 33 2024-09-12T00:04:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.857+0000 7f0497a05740 1 -- 172.21.15.6:0/4207097576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e02d700620 con 0x55e02d9be2e0 2024-09-12T00:04:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.857+0000 7f0475ffb640 1 -- 172.21.15.6:0/4207097576 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f048009ce50 con 0x55e02d9be2e0 2024-09-12T00:04:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.857+0000 7f0475ffb640 1 -- 172.21.15.6:0/4207097576 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f048401e940 con 0x55e02d9be2e0 2024-09-12T00:04:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.857+0000 7f0497a05740 10 client.15738 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:04:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.857+0000 7f0497a05740 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:04:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.857+0000 7f0497a05740 20 client.15738 populate_metadata read hostname 'smithi006' 2024-09-12T00:04:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.858+0000 7f0497a05740 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e02d9d2950 0x55e02d9d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.858+0000 7f0497a05740 4 client.15738 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.858+0000 7f0497a05740 1 -- 172.21.15.6:0/4207097576 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e02d92ea20 con 0x55e02d9d2950 2024-09-12T00:04:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.858+0000 7f048e59c640 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e02d9d2950 0x55e02d9d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.858+0000 7f048e59c640 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e02d9d2950 0x55e02d9d2dc0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f836494d874baa4 server_cookie=9fd7a96c100bee5e in_seq=0 out_seq=0 2024-09-12T00:04:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.858+0000 7f0475ffb640 10 client.15738 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0475ffb640 1 -- 172.21.15.6:0/4207097576 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e02d92ea20 con 0x55e02d9d2950 2024-09-12T00:04:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0475ffb640 10 client.15738 handle_command_reply: tid=0 2024-09-12T00:04:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0497a05740 1 client.15738 shutdown 2024-09-12T00:04:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0497a05740 1 -- 172.21.15.6:0/4207097576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9be2e0 msgr2=0x55e02d9c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0497a05740 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9be2e0 0x55e02d9c80b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0484011710 tx=0x7f0484004730 comp rx=0 tx=0).stop 2024-09-12T00:04:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0497a05740 1 -- 172.21.15.6:0/4207097576 shutdown_connections 2024-09-12T00:04:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0497a05740 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0497a05740 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9be2e0 0x55e02d9c80b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0497a05740 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e02d9d2950 0x55e02d9d2dc0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0497a05740 1 --2- 172.21.15.6:0/4207097576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0497a05740 1 -- 172.21.15.6:0/4207097576 >> 172.21.15.6:0/4207097576 conn(0x55e02d9b9010 msgr2=0x55e02d9ba820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0475ffb640 0 client.15738 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0497a05740 1 -- 172.21.15.6:0/4207097576 shutdown_connections 2024-09-12T00:04:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0497a05740 1 -- 172.21.15.6:0/4207097576 wait complete. 2024-09-12T00:04:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.859+0000 7f0497a05740 20 client.15738 trim_cache size 0 max 16384 2024-09-12T00:04:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f0497a05740 1 Processor -- start 2024-09-12T00:04:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f0497a05740 1 -- start start 2024-09-12T00:04:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f0497a05740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9bdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f0497a05740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f0497a05740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9bf4c0 0x55e02d9bf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f0497a05740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f04901a86b0 con 0x55e02d9bf4c0 2024-09-12T00:04:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f0497a05740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f04901aa1f0 con 0x55e02d9c3370 2024-09-12T00:04:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f0497a05740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f04901a8d80 con 0x55e02d9bd9a0 2024-09-12T00:04:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f048ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9bf4c0 0x55e02d9bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f048ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9bf4c0 0x55e02d9bf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42914/0 (socket says 172.21.15.6:42914) 2024-09-12T00:04:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f048ed9d640 1 -- 172.21.15.6:0/231423029 learned_addr learned my addr 172.21.15.6:0/231423029 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f048dd9b640 1 --2- 172.21.15.6:0/231423029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f048e59c640 1 --2- 172.21.15.6:0/231423029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9bdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f048ed9d640 1 -- 172.21.15.6:0/231423029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 msgr2=0x55e02d9bdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f048ed9d640 1 --2- 172.21.15.6:0/231423029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9bdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f048ed9d640 1 -- 172.21.15.6:0/231423029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 msgr2=0x55e02d9cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f048ed9d640 1 --2- 172.21.15.6:0/231423029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f048ed9d640 1 -- 172.21.15.6:0/231423029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e02d9b8e30 con 0x55e02d9bf4c0 2024-09-12T00:04:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.879+0000 7f048dd9b640 1 --2- 172.21.15.6:0/231423029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:04:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.880+0000 7f048ed9d640 1 --2- 172.21.15.6:0/231423029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9bf4c0 0x55e02d9bf920 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0488009ca0 tx=0x7f0488031a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe178c08ff7aec5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.880+0000 7f0477fff640 1 -- 172.21.15.6:0/231423029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488003970 con 0x55e02d9bf4c0 2024-09-12T00:04:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.880+0000 7f0477fff640 1 -- 172.21.15.6:0/231423029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f048804b070 con 0x55e02d9bf4c0 2024-09-12T00:04:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.880+0000 7f0477fff640 1 -- 172.21.15.6:0/231423029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04880305c0 con 0x55e02d9bf4c0 2024-09-12T00:04:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.880+0000 7f0497a05740 1 -- 172.21.15.6:0/231423029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9bf4c0 msgr2=0x55e02d9bf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.880+0000 7f0497a05740 1 --2- 172.21.15.6:0/231423029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9bf4c0 0x55e02d9bf920 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0488009ca0 tx=0x7f0488031a40 comp rx=0 tx=0).stop 2024-09-12T00:04:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 -- 172.21.15.6:0/231423029 shutdown_connections 2024-09-12T00:04:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 --2- 172.21.15.6:0/231423029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9bf4c0 0x55e02d9bf920 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 --2- 172.21.15.6:0/231423029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9c3370 0x55e02d9cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 --2- 172.21.15.6:0/231423029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9bdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 -- 172.21.15.6:0/231423029 >> 172.21.15.6:0/231423029 conn(0x55e02d9b9010 msgr2=0x55e02d9c2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 -- 172.21.15.6:0/231423029 shutdown_connections 2024-09-12T00:04:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 -- 172.21.15.6:0/231423029 wait complete. 2024-09-12T00:04:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 -- start start 2024-09-12T00:04:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 Processor -- start 2024-09-12T00:04:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9bf4c0 0x55e02d9cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9c3370 0x55e02d9cb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f04901a9b20 con 0x55e02d9c3370 2024-09-12T00:04:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f04901a9450 con 0x55e02d9bf4c0 2024-09-12T00:04:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f04901a6690 con 0x55e02d9bd9a0 2024-09-12T00:04:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f0497a05740 10 client.0 _ll_register_callbacks cb 0x7f0484010c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f048ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9c3370 0x55e02d9cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f048ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9c3370 0x55e02d9cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42930/0 (socket says 172.21.15.6:42930) 2024-09-12T00:04:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.881+0000 7f048ed9d640 1 -- 172.21.15.6:0/1364275314 learned_addr learned my addr 172.21.15.6:0/1364275314 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f048dd9b640 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9bf4c0 0x55e02d9cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f048e59c640 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f048ed9d640 1 -- 172.21.15.6:0/1364275314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 msgr2=0x55e02d9ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f048ed9d640 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f048ed9d640 1 -- 172.21.15.6:0/1364275314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9bf4c0 msgr2=0x55e02d9cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f048ed9d640 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9bf4c0 0x55e02d9cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f048ed9d640 1 -- 172.21.15.6:0/1364275314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e02d9cbba0 con 0x55e02d9c3370 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f048ed9d640 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9c3370 0x55e02d9cb460 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0488031970 tx=0x7f0488030b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a3865c0f079b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f0475ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f0475ffb640 1 -- 172.21.15.6:0/1364275314 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048804f420 con 0x55e02d9c3370 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f0475ffb640 1 -- 172.21.15.6:0/1364275314 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f048804f5c0 con 0x55e02d9c3370 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f0497a05740 1 -- 172.21.15.6:0/1364275314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f048804b070 con 0x55e02d9c3370 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f0475ffb640 1 -- 172.21.15.6:0/1364275314 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f048804f7c0 con 0x55e02d9c3370 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f0497a05740 10 client.15744 fetch_fsmap learned FSMap version 33 2024-09-12T00:04:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.882+0000 7f0497a05740 1 -- 172.21.15.6:0/1364275314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e02da460f0 con 0x55e02d9c3370 2024-09-12T00:04:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.883+0000 7f0475ffb640 1 -- 172.21.15.6:0/1364275314 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f048804b070 con 0x55e02d9c3370 2024-09-12T00:04:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.883+0000 7f0475ffb640 1 -- 172.21.15.6:0/1364275314 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f0488058900 con 0x55e02d9c3370 2024-09-12T00:04:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.883+0000 7f0497a05740 10 client.15744 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:04:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.883+0000 7f0497a05740 10 client.15744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:04:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.883+0000 7f0497a05740 20 client.15744 populate_metadata read hostname 'smithi006' 2024-09-12T00:04:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.883+0000 7f0497a05740 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e02da46aa0 0x55e02da48ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.883+0000 7f0497a05740 4 client.15744 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:04:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.883+0000 7f0497a05740 1 -- 172.21.15.6:0/1364275314 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e02d928d70 con 0x55e02da46aa0 2024-09-12T00:04:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.883+0000 7f048e59c640 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e02da46aa0 0x55e02da48ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.884+0000 7f048e59c640 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e02da46aa0 0x55e02da48ec0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9926e32aab7f1412 server_cookie=7b7cfd2e27b1c1db in_seq=0 out_seq=0 2024-09-12T00:04:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.884+0000 7f0475ffb640 10 client.15744 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0475ffb640 1 -- 172.21.15.6:0/1364275314 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e02d928d70 con 0x55e02da46aa0 2024-09-12T00:04:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0475ffb640 10 client.15744 handle_command_reply: tid=0 2024-09-12T00:04:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0497a05740 1 client.15744 shutdown 2024-09-12T00:04:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0497a05740 1 -- 172.21.15.6:0/1364275314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9c3370 msgr2=0x55e02d9cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0497a05740 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9c3370 0x55e02d9cb460 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0488031970 tx=0x7f0488030b60 comp rx=0 tx=0).stop 2024-09-12T00:04:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0497a05740 1 -- 172.21.15.6:0/1364275314 shutdown_connections 2024-09-12T00:04:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0497a05740 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e02d9c3370 0x55e02d9cb460 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0497a05740 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02d9bf4c0 0x55e02d9cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0497a05740 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e02da46aa0 0x55e02da48ec0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0497a05740 1 --2- 172.21.15.6:0/1364275314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e02d9bd9a0 0x55e02d9ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0475ffb640 0 client.15744 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0497a05740 1 -- 172.21.15.6:0/1364275314 >> 172.21.15.6:0/1364275314 conn(0x55e02d9b9010 msgr2=0x55e02d9b79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0497a05740 1 -- 172.21.15.6:0/1364275314 shutdown_connections 2024-09-12T00:04:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0497a05740 1 -- 172.21.15.6:0/1364275314 wait complete. 2024-09-12T00:04:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.899+0000 7f0497a05740 20 client.15744 trim_cache size 0 max 16384 2024-09-12T00:04:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:04:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:04:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:04:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:04:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.900+0000 7f0494b8d640 1 -- 172.21.15.6:0/1607395662 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f04780a2c00 msgr2=0x7f04780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.900+0000 7f0494b8d640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f04780a2c00 0x7f04780a50c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f04901992e0 tx=0x7f048400b390 comp rx=0 tx=0).stop 2024-09-12T00:04:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.900+0000 7f0494b8d640 1 -- 172.21.15.6:0/1607395662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0490102610 msgr2=0x7f0490197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.900+0000 7f0494b8d640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0490102610 0x7f0490197dd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f048000e9f0 tx=0x7f048000eeb0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.900+0000 7f0494b8d640 1 -- 172.21.15.6:0/1607395662 shutdown_connections 2024-09-12T00:04:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.900+0000 7f0494b8d640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f04780a2c00 0x7f04780a50c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.900+0000 7f0494b8d640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0490107870 0x7f049019f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.900+0000 7f0494b8d640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0490104f40 0x7f0490198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.900+0000 7f0494b8d640 1 --2- 172.21.15.6:0/1607395662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0490102610 0x7f0490197dd0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.900+0000 7f0494b8d640 1 -- 172.21.15.6:0/1607395662 >> 172.21.15.6:0/1607395662 conn(0x7f04900fc190 msgr2=0x7f0490102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.900+0000 7f0494b8d640 1 -- 172.21.15.6:0/1607395662 shutdown_connections 2024-09-12T00:04:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:15.900+0000 7f0494b8d640 1 -- 172.21.15.6:0/1607395662 wait complete. 2024-09-12T00:04:16.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:16 smithi039 ceph-mon[34543]: pgmap v507: 129 pgs: 129 active+clean; 5.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:04:16.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:16 smithi006 ceph-mon[30947]: pgmap v507: 129 pgs: 129 active+clean; 5.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:04:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:16 smithi134 ceph-mon[34893]: pgmap v507: 129 pgs: 129 active+clean; 5.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:04:18.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:18 smithi039 ceph-mon[34543]: pgmap v508: 129 pgs: 129 active+clean; 5.5 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 23 op/s 2024-09-12T00:04:18.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:18 smithi006 ceph-mon[30947]: pgmap v508: 129 pgs: 129 active+clean; 5.5 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 23 op/s 2024-09-12T00:04:18.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:18 smithi134 ceph-mon[34893]: pgmap v508: 129 pgs: 129 active+clean; 5.5 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 23 op/s 2024-09-12T00:04:20.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:20 smithi039 ceph-mon[34543]: pgmap v509: 129 pgs: 129 active+clean; 5.5 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-09-12T00:04:20.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:20 smithi006 ceph-mon[30947]: pgmap v509: 129 pgs: 129 active+clean; 5.5 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-09-12T00:04:20.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:20 smithi134 ceph-mon[34893]: pgmap v509: 129 pgs: 129 active+clean; 5.5 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-09-12T00:04:22.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:22 smithi039 ceph-mon[34543]: pgmap v510: 129 pgs: 129 active+clean; 5.5 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:04:22.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:22 smithi006 ceph-mon[30947]: pgmap v510: 129 pgs: 129 active+clean; 5.5 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:04:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:22 smithi134 ceph-mon[34893]: pgmap v510: 129 pgs: 129 active+clean; 5.5 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:04:24.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:24 smithi039 ceph-mon[34543]: pgmap v511: 129 pgs: 129 active+clean; 5.6 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-09-12T00:04:24.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:24 smithi006 ceph-mon[30947]: pgmap v511: 129 pgs: 129 active+clean; 5.6 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-09-12T00:04:24.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:24 smithi134 ceph-mon[34893]: pgmap v511: 129 pgs: 129 active+clean; 5.6 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-09-12T00:04:26.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:26 smithi039 ceph-mon[34543]: pgmap v512: 129 pgs: 129 active+clean; 5.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:04:26.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:26 smithi006 ceph-mon[30947]: pgmap v512: 129 pgs: 129 active+clean; 5.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:04:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:26 smithi134 ceph-mon[34893]: pgmap v512: 129 pgs: 129 active+clean; 5.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:04:28.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:28 smithi039 ceph-mon[34543]: pgmap v513: 129 pgs: 129 active+clean; 5.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:04:28.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:28 smithi006 ceph-mon[30947]: pgmap v513: 129 pgs: 129 active+clean; 5.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:04:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:28 smithi134 ceph-mon[34893]: pgmap v513: 129 pgs: 129 active+clean; 5.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:04:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.015+0000 7f309ab03640 1 -- 172.21.15.6:0/3791380060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3094103d40 msgr2=0x7f3094104140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.015+0000 7f309ab03640 1 --2- 172.21.15.6:0/3791380060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3094103d40 0x7f3094104140 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3088009900 tx=0x7f308802a410 comp rx=0 tx=0).stop 2024-09-12T00:04:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.015+0000 7f309ab03640 1 -- 172.21.15.6:0/3791380060 shutdown_connections 2024-09-12T00:04:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.015+0000 7f309ab03640 1 --2- 172.21.15.6:0/3791380060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30941058f0 0x7f309410c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.015+0000 7f309ab03640 1 --2- 172.21.15.6:0/3791380060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3094104f30 0x7f30941053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.015+0000 7f309ab03640 1 --2- 172.21.15.6:0/3791380060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3094103d40 0x7f3094104140 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.015+0000 7f309ab03640 1 -- 172.21.15.6:0/3791380060 >> 172.21.15.6:0/3791380060 conn(0x7f30940ff4a0 msgr2=0x7f30941018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.015+0000 7f309ab03640 1 -- 172.21.15.6:0/3791380060 shutdown_connections 2024-09-12T00:04:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.015+0000 7f309ab03640 1 -- 172.21.15.6:0/3791380060 wait complete. 2024-09-12T00:04:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.016+0000 7f309ab03640 1 Processor -- start 2024-09-12T00:04:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.016+0000 7f309ab03640 1 -- start start 2024-09-12T00:04:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.016+0000 7f309ab03640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3094103d40 0x7f3094199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.016+0000 7f309ab03640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3094104f30 0x7f309419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.016+0000 7f309ab03640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30941058f0 0x7f30941a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.016+0000 7f309ab03640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f309410f850 con 0x7f3094103d40 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.016+0000 7f309ab03640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f309410f6d0 con 0x7f30941058f0 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.016+0000 7f309ab03640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f309410f9d0 con 0x7f3094104f30 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.016+0000 7f309889f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3094103d40 0x7f3094199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.016+0000 7f309889f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3094103d40 0x7f3094199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51596/0 (socket says 172.21.15.6:51596) 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.016+0000 7f309889f640 1 -- 172.21.15.6:0/3244605464 learned_addr learned my addr 172.21.15.6:0/3244605464 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f3093fff640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3094104f30 0x7f309419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f309889f640 1 -- 172.21.15.6:0/3244605464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3094104f30 msgr2=0x7f309419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f30990a0640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30941058f0 0x7f30941a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f309889f640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3094104f30 0x7f309419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f309889f640 1 -- 172.21.15.6:0/3244605464 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30941058f0 msgr2=0x7f30941a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f309889f640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30941058f0 0x7f30941a15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f309889f640 1 -- 172.21.15.6:0/3244605464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30941a1c10 con 0x7f3094103d40 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f3093fff640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3094104f30 0x7f309419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:04:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f309889f640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3094103d40 0x7f3094199ff0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f30880314e0 tx=0x7f30880042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f3091ffb640 1 -- 172.21.15.6:0/3244605464 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308803f030 con 0x7f3094103d40 2024-09-12T00:04:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f3091ffb640 1 -- 172.21.15.6:0/3244605464 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3088003cb0 con 0x7f3094103d40 2024-09-12T00:04:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f309ab03640 1 -- 172.21.15.6:0/3244605464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30941a1ea0 con 0x7f3094103d40 2024-09-12T00:04:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f3091ffb640 1 -- 172.21.15.6:0/3244605464 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088035070 con 0x7f3094103d40 2024-09-12T00:04:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.017+0000 7f309ab03640 1 -- 172.21.15.6:0/3244605464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30941a2300 con 0x7f3094103d40 2024-09-12T00:04:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.020+0000 7f3091ffb640 1 -- 172.21.15.6:0/3244605464 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f3088042030 con 0x7f3094103d40 2024-09-12T00:04:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.020+0000 7f309d89b740 1 Processor -- start 2024-09-12T00:04:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.020+0000 7f309d89b740 1 -- start start 2024-09-12T00:04:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.020+0000 7f309d89b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 0x560fdfdd5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.020+0000 7f309d89b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd62e0 0x560fdfddada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.020+0000 7f309d89b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfddd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.020+0000 7f309d89b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560fdfd392f0 con 0x560fdfdd59a0 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.020+0000 7f309d89b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560fdfce1270 con 0x560fdfddb370 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.020+0000 7f309d89b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560fdfd352b0 con 0x560fdfdd62e0 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f30990a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 0x560fdfdd5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f30990a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 0x560fdfdd5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51600/0 (socket says 172.21.15.6:51600) 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f30990a0640 1 -- 172.21.15.6:0/1160873552 learned_addr learned my addr 172.21.15.6:0/1160873552 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f3093fff640 1 --2- 172.21.15.6:0/1160873552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfddd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f309889f640 1 --2- 172.21.15.6:0/1160873552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd62e0 0x560fdfddada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f3091ffb640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f30840a2c00 0x7f30840a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f30990a0640 1 -- 172.21.15.6:0/1160873552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd62e0 msgr2=0x560fdfddada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f30990a0640 1 --2- 172.21.15.6:0/1160873552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd62e0 0x560fdfddada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f30990a0640 1 -- 172.21.15.6:0/1160873552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 msgr2=0x560fdfddd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f30990a0640 1 --2- 172.21.15.6:0/1160873552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfddd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f30990a0640 1 -- 172.21.15.6:0/1160873552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fdfce0340 con 0x560fdfdd59a0 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f3093fff640 1 --2- 172.21.15.6:0/1160873552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfddd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f30990a0640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f30840a2c00 0x7f30840a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f3091ffb640 1 -- 172.21.15.6:0/3244605464 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f30880efa70 con 0x7f3094103d40 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.021+0000 7f30990a0640 1 --2- 172.21.15.6:0/1160873552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 0x560fdfdd5da0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f308c009eb0 tx=0x7f308c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c5a5642cc652be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.022+0000 7f307effd640 1 -- 172.21.15.6:0/1160873552 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c01a610 con 0x560fdfdd59a0 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.022+0000 7f307effd640 1 -- 172.21.15.6:0/1160873552 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f308c012e40 con 0x560fdfdd59a0 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.022+0000 7f307effd640 1 -- 172.21.15.6:0/1160873552 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c00d7e0 con 0x560fdfdd59a0 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.022+0000 7f30990a0640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f30840a2c00 0x7f30840a50c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f308c020000 tx=0x7f308c01d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.022+0000 7f309d89b740 1 -- 172.21.15.6:0/1160873552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 msgr2=0x560fdfdd5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.022+0000 7f309d89b740 1 --2- 172.21.15.6:0/1160873552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 0x560fdfdd5da0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f308c009eb0 tx=0x7f308c00f730 comp rx=0 tx=0).stop 2024-09-12T00:04:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.022+0000 7f309d89b740 1 -- 172.21.15.6:0/1160873552 shutdown_connections 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.022+0000 7f309d89b740 1 --2- 172.21.15.6:0/1160873552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfddd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.022+0000 7f309d89b740 1 --2- 172.21.15.6:0/1160873552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd62e0 0x560fdfddada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.022+0000 7f309d89b740 1 --2- 172.21.15.6:0/1160873552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 0x560fdfdd5da0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.022+0000 7f309d89b740 1 -- 172.21.15.6:0/1160873552 >> 172.21.15.6:0/1160873552 conn(0x560fdfdd1010 msgr2=0x560fdfdd1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.022+0000 7f309d89b740 1 -- 172.21.15.6:0/1160873552 shutdown_connections 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f309d89b740 1 -- 172.21.15.6:0/1160873552 wait complete. 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f309d89b740 1 -- start start 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f309d89b740 1 Processor -- start 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f309d89b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd59a0 0x560fdfddfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f309d89b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 0x560fdfde0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f309d89b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfde7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f309d89b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560fdfdde340 con 0x560fdfdd62e0 2024-09-12T00:04:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f309d89b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560fdfcc2290 con 0x560fdfddb370 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f309d89b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560fdfdde4c0 con 0x560fdfdd59a0 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f309d89b740 10 client.0 _ll_register_callbacks cb 0x560fdfcf3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f3093fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 0x560fdfde0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f3093fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 0x560fdfde0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51610/0 (socket says 172.21.15.6:51610) 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.023+0000 7f3093fff640 1 -- 172.21.15.6:0/1092266134 learned_addr learned my addr 172.21.15.6:0/1092266134 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f309889f640 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd59a0 0x560fdfddfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f30990a0640 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfde7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f3093fff640 1 -- 172.21.15.6:0/1092266134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd59a0 msgr2=0x560fdfddfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f3093fff640 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd59a0 0x560fdfddfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f3093fff640 1 -- 172.21.15.6:0/1092266134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 msgr2=0x560fdfde7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f3093fff640 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfde7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f3093fff640 1 -- 172.21.15.6:0/1092266134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fdfa4c210 con 0x560fdfdd62e0 2024-09-12T00:04:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f30990a0640 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfde7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f3093fff640 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 0x560fdfde0110 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3080009eb0 tx=0x7f30800117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95598ca5feddfeb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f3073fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f3073fff640 1 -- 172.21.15.6:0/1092266134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3080004220 con 0x560fdfdd62e0 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f3073fff640 1 -- 172.21.15.6:0/1092266134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f30800043c0 con 0x560fdfdd62e0 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f309d89b740 1 -- 172.21.15.6:0/1092266134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560fdfd46a20 con 0x560fdfdd62e0 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f3073fff640 1 -- 172.21.15.6:0/1092266134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3080005020 con 0x560fdfdd62e0 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f309d89b740 10 client.15756 fetch_fsmap learned FSMap version 33 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.024+0000 7f309d89b740 1 -- 172.21.15.6:0/1092266134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560fdfb18620 con 0x560fdfdd62e0 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.025+0000 7f3073fff640 1 -- 172.21.15.6:0/1092266134 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x560fdfd46a20 con 0x560fdfdd62e0 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.025+0000 7f3073fff640 1 -- 172.21.15.6:0/1092266134 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f308000f040 con 0x560fdfdd62e0 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.025+0000 7f309d89b740 10 client.15756 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.025+0000 7f309d89b740 10 client.15756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:04:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.025+0000 7f309d89b740 20 client.15756 populate_metadata read hostname 'smithi006' 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.025+0000 7f309d89b740 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560fdfdeb910 0x560fdfdedd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.025+0000 7f309d89b740 4 client.15756 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.025+0000 7f309d89b740 1 -- 172.21.15.6:0/1092266134 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fdfd40d70 con 0x560fdfdeb910 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.025+0000 7f309889f640 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560fdfdeb910 0x560fdfdedd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.026+0000 7f309889f640 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560fdfdeb910 0x560fdfdedd70 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9a9018c46a875cf server_cookie=62657bdedfba56fd in_seq=0 out_seq=0 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.026+0000 7f3073fff640 10 client.15756 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.026+0000 7f3073fff640 1 -- 172.21.15.6:0/1092266134 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560fdfd40d70 con 0x560fdfdeb910 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.026+0000 7f3073fff640 10 client.15756 handle_command_reply: tid=0 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f309d89b740 1 client.15756 shutdown 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f309d89b740 1 -- 172.21.15.6:0/1092266134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 msgr2=0x560fdfde0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f309d89b740 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 0x560fdfde0110 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3080009eb0 tx=0x7f30800117b0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f309d89b740 1 -- 172.21.15.6:0/1092266134 shutdown_connections 2024-09-12T00:04:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f309d89b740 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfde7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f309d89b740 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 0x560fdfde0110 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f309d89b740 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560fdfdeb910 0x560fdfdedd70 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f309d89b740 1 --2- 172.21.15.6:0/1092266134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd59a0 0x560fdfddfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f309d89b740 1 -- 172.21.15.6:0/1092266134 >> 172.21.15.6:0/1092266134 conn(0x560fdfdd1010 msgr2=0x560fdfdd2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f3073fff640 0 client.15756 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f309d89b740 1 -- 172.21.15.6:0/1092266134 shutdown_connections 2024-09-12T00:04:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f309d89b740 1 -- 172.21.15.6:0/1092266134 wait complete. 2024-09-12T00:04:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.027+0000 7f309d89b740 20 client.15756 trim_cache size 0 max 16384 2024-09-12T00:04:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.042+0000 7f309d89b740 1 Processor -- start 2024-09-12T00:04:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.042+0000 7f309d89b740 1 -- start start 2024-09-12T00:04:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.042+0000 7f309d89b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 0x560fdfdd00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.042+0000 7f309d89b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfdd62e0 0x560fdfde7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.042+0000 7f309d89b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfddb370 0x560fdfdf2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.042+0000 7f309d89b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f30941acaa0 con 0x560fdfdd59a0 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.042+0000 7f309d89b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30941ae5e0 con 0x560fdfdd62e0 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.042+0000 7f309d89b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f30941ad170 con 0x560fdfddb370 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f309889f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 0x560fdfdd00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f309889f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 0x560fdfdd00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51620/0 (socket says 172.21.15.6:51620) 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f309889f640 1 -- 172.21.15.6:0/2750763673 learned_addr learned my addr 172.21.15.6:0/2750763673 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f3093fff640 1 --2- 172.21.15.6:0/2750763673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfdd62e0 0x560fdfde7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f30990a0640 1 --2- 172.21.15.6:0/2750763673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfddb370 0x560fdfdf2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f309889f640 1 -- 172.21.15.6:0/2750763673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfddb370 msgr2=0x560fdfdf2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f309889f640 1 --2- 172.21.15.6:0/2750763673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfddb370 0x560fdfdf2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f309889f640 1 -- 172.21.15.6:0/2750763673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfdd62e0 msgr2=0x560fdfde7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f309889f640 1 --2- 172.21.15.6:0/2750763673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfdd62e0 0x560fdfde7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f309889f640 1 -- 172.21.15.6:0/2750763673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fdfdde530 con 0x560fdfdd59a0 2024-09-12T00:04:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f309889f640 1 --2- 172.21.15.6:0/2750763673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 0x560fdfdd00b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f30880b88b0 tx=0x7f30880ed050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac590c01e2e53c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f307e7fc640 1 -- 172.21.15.6:0/2750763673 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088049040 con 0x560fdfdd59a0 2024-09-12T00:04:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f307e7fc640 1 -- 172.21.15.6:0/2750763673 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30880bc5e0 con 0x560fdfdd59a0 2024-09-12T00:04:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.043+0000 7f307e7fc640 1 -- 172.21.15.6:0/2750763673 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30880c4b50 con 0x560fdfdd59a0 2024-09-12T00:04:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.044+0000 7f309d89b740 1 -- 172.21.15.6:0/2750763673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 msgr2=0x560fdfdd00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.044+0000 7f309d89b740 1 --2- 172.21.15.6:0/2750763673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 0x560fdfdd00b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f30880b88b0 tx=0x7f30880ed050 comp rx=0 tx=0).stop 2024-09-12T00:04:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.044+0000 7f309d89b740 1 -- 172.21.15.6:0/2750763673 shutdown_connections 2024-09-12T00:04:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.044+0000 7f309d89b740 1 --2- 172.21.15.6:0/2750763673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfddb370 0x560fdfdf2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.044+0000 7f309d89b740 1 --2- 172.21.15.6:0/2750763673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfdd62e0 0x560fdfde7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.044+0000 7f309d89b740 1 --2- 172.21.15.6:0/2750763673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd59a0 0x560fdfdd00b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.044+0000 7f309d89b740 1 -- 172.21.15.6:0/2750763673 >> 172.21.15.6:0/2750763673 conn(0x560fdfdd1010 msgr2=0x560fdfdcf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.044+0000 7f309d89b740 1 -- 172.21.15.6:0/2750763673 shutdown_connections 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.044+0000 7f309d89b740 1 -- 172.21.15.6:0/2750763673 wait complete. 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f309d89b740 1 -- start start 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f309d89b740 1 Processor -- start 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f309d89b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd59a0 0x560fdfde4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f309d89b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 0x560fdfde50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f309d89b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfde6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f309d89b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f30941adf10 con 0x560fdfdd62e0 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f309d89b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30941ad840 con 0x560fdfddb370 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f309d89b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f30941aaa80 con 0x560fdfdd59a0 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f309d89b740 10 client.0 _ll_register_callbacks cb 0x7f3080009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f3093fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 0x560fdfde50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f309889f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd59a0 0x560fdfde4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f3093fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 0x560fdfde50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51626/0 (socket says 172.21.15.6:51626) 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f3093fff640 1 -- 172.21.15.6:0/231712375 learned_addr learned my addr 172.21.15.6:0/231712375 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f30990a0640 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfde6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.045+0000 7f309889f640 1 -- 172.21.15.6:0/231712375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 msgr2=0x560fdfde6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f309889f640 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfde6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f309889f640 1 -- 172.21.15.6:0/231712375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 msgr2=0x560fdfde50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f309889f640 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 0x560fdfde50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f309889f640 1 -- 172.21.15.6:0/231712375 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fdfde6640 con 0x560fdfdd59a0 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f30990a0640 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfde6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f3093fff640 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 0x560fdfde50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f309889f640 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd59a0 0x560fdfde4b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f30880ed4f0 tx=0x7f3088004590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfaf360cb1516aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f3073fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f3073fff640 1 -- 172.21.15.6:0/231712375 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088049070 con 0x560fdfdd59a0 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f309d89b740 1 -- 172.21.15.6:0/231712375 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30880bc5e0 con 0x560fdfdd59a0 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f3073fff640 1 -- 172.21.15.6:0/231712375 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f30880b8550 con 0x560fdfdd59a0 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f3073fff640 1 -- 172.21.15.6:0/231712375 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f30880bb840 con 0x560fdfdd59a0 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f309d89b740 10 client.25399 fetch_fsmap learned FSMap version 33 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f309d89b740 1 -- 172.21.15.6:0/231712375 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560fdfe56950 con 0x560fdfdd59a0 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.046+0000 7f3073fff640 1 -- 172.21.15.6:0/231712375 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30880bc5e0 con 0x560fdfdd59a0 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.047+0000 7f3073fff640 1 -- 172.21.15.6:0/231712375 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f308803b460 con 0x560fdfdd59a0 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.047+0000 7f309d89b740 10 client.25399 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.047+0000 7f309d89b740 10 client.25399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.047+0000 7f309d89b740 20 client.25399 populate_metadata read hostname 'smithi006' 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.047+0000 7f309d89b740 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560fdfe57220 0x560fdfe59640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.047+0000 7f309d89b740 4 client.25399 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:04:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.047+0000 7f309d89b740 1 -- 172.21.15.6:0/231712375 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560fdfcbd900 con 0x560fdfe57220 2024-09-12T00:04:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.047+0000 7f3093fff640 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560fdfe57220 0x560fdfe59640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.047+0000 7f3073fff640 10 client.25399 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.047+0000 7f3093fff640 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560fdfe57220 0x560fdfe59640 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a07cdec84a1e837 server_cookie=f717c9809901d6e in_seq=0 out_seq=0 2024-09-12T00:04:29.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f3073fff640 1 -- 172.21.15.6:0/231712375 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560fdfcbd900 con 0x560fdfe57220 2024-09-12T00:04:29.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f3073fff640 10 client.25399 handle_command_reply: tid=0 2024-09-12T00:04:29.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f309d89b740 1 client.25399 shutdown 2024-09-12T00:04:29.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f309d89b740 1 -- 172.21.15.6:0/231712375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd59a0 msgr2=0x560fdfde4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:29.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f309d89b740 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd59a0 0x560fdfde4b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f30880ed4f0 tx=0x7f3088004590 comp rx=0 tx=0).stop 2024-09-12T00:04:29.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f309d89b740 1 -- 172.21.15.6:0/231712375 shutdown_connections 2024-09-12T00:04:29.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f309d89b740 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fdfddb370 0x560fdfde6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f309d89b740 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560fdfdd62e0 0x560fdfde50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f309d89b740 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560fdfe57220 0x560fdfe59640 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f309d89b740 1 --2- 172.21.15.6:0/231712375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fdfdd59a0 0x560fdfde4b80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f3073fff640 0 client.25399 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f309d89b740 1 -- 172.21.15.6:0/231712375 >> 172.21.15.6:0/231712375 conn(0x560fdfdd1010 msgr2=0x560fdfdd01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f309d89b740 1 -- 172.21.15.6:0/231712375 shutdown_connections 2024-09-12T00:04:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f309d89b740 1 -- 172.21.15.6:0/231712375 wait complete. 2024-09-12T00:04:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.064+0000 7f309d89b740 20 client.25399 trim_cache size 0 max 16384 2024-09-12T00:04:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:04:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:04:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:04:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:04:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.065+0000 7f309ab03640 1 -- 172.21.15.6:0/3244605464 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f30840a2c00 msgr2=0x7f30840a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.065+0000 7f309ab03640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f30840a2c00 0x7f30840a50c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f308c020000 tx=0x7f308c01d000 comp rx=0 tx=0).stop 2024-09-12T00:04:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.065+0000 7f309ab03640 1 -- 172.21.15.6:0/3244605464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3094103d40 msgr2=0x7f3094199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.065+0000 7f309ab03640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3094103d40 0x7f3094199ff0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f30880314e0 tx=0x7f30880042e0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.065+0000 7f309ab03640 1 -- 172.21.15.6:0/3244605464 shutdown_connections 2024-09-12T00:04:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.065+0000 7f309ab03640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f30840a2c00 0x7f30840a50c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.065+0000 7f309ab03640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30941058f0 0x7f30941a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.065+0000 7f309ab03640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3094104f30 0x7f309419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.065+0000 7f309ab03640 1 --2- 172.21.15.6:0/3244605464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3094103d40 0x7f3094199ff0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.065+0000 7f309ab03640 1 -- 172.21.15.6:0/3244605464 >> 172.21.15.6:0/3244605464 conn(0x7f30940ff4a0 msgr2=0x7f3094108490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.065+0000 7f309ab03640 1 -- 172.21.15.6:0/3244605464 shutdown_connections 2024-09-12T00:04:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:29.065+0000 7f309ab03640 1 -- 172.21.15.6:0/3244605464 wait complete. 2024-09-12T00:04:30.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:30 smithi039 ceph-mon[34543]: pgmap v514: 129 pgs: 129 active+clean; 5.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-09-12T00:04:30.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:30 smithi006 ceph-mon[30947]: pgmap v514: 129 pgs: 129 active+clean; 5.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-09-12T00:04:30.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:30 smithi134 ceph-mon[34893]: pgmap v514: 129 pgs: 129 active+clean; 5.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-09-12T00:04:32.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:32 smithi039 ceph-mon[34543]: pgmap v515: 129 pgs: 129 active+clean; 5.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-12T00:04:32.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:32 smithi006 ceph-mon[30947]: pgmap v515: 129 pgs: 129 active+clean; 5.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-12T00:04:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:32 smithi134 ceph-mon[34893]: pgmap v515: 129 pgs: 129 active+clean; 5.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-12T00:04:34.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:34 smithi039 ceph-mon[34543]: pgmap v516: 129 pgs: 129 active+clean; 5.9 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:04:34.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:34 smithi006 ceph-mon[30947]: pgmap v516: 129 pgs: 129 active+clean; 5.9 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:04:34.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:34 smithi134 ceph-mon[34893]: pgmap v516: 129 pgs: 129 active+clean; 5.9 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:04:36.755 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:36 smithi134 ceph-mon[34893]: pgmap v517: 129 pgs: 129 active+clean; 5.9 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:04:36.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:36 smithi039 ceph-mon[34543]: pgmap v517: 129 pgs: 129 active+clean; 5.9 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:04:36.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:36 smithi006 ceph-mon[30947]: pgmap v517: 129 pgs: 129 active+clean; 5.9 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:04:38.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:38 smithi039 ceph-mon[34543]: pgmap v518: 129 pgs: 129 active+clean; 6.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:04:38.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:38 smithi006 ceph-mon[30947]: pgmap v518: 129 pgs: 129 active+clean; 6.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:04:38.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:38 smithi134 ceph-mon[34893]: pgmap v518: 129 pgs: 129 active+clean; 6.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:04:40.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:40 smithi039 ceph-mon[34543]: pgmap v519: 129 pgs: 129 active+clean; 6.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:04:40.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:40 smithi006 ceph-mon[30947]: pgmap v519: 129 pgs: 129 active+clean; 6.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:04:40.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:40 smithi134 ceph-mon[34893]: pgmap v519: 129 pgs: 129 active+clean; 6.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:04:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.168+0000 7f232ea8c640 1 -- 172.21.15.6:0/2235668375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2328101b60 msgr2=0x7f2328101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.168+0000 7f232ea8c640 1 --2- 172.21.15.6:0/2235668375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2328101b60 0x7f2328101f60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f231c009900 tx=0x7f231c02a410 comp rx=0 tx=0).stop 2024-09-12T00:04:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.168+0000 7f232ea8c640 1 -- 172.21.15.6:0/2235668375 shutdown_connections 2024-09-12T00:04:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.168+0000 7f232ea8c640 1 --2- 172.21.15.6:0/2235668375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2328103710 0x7f2328109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.168+0000 7f232ea8c640 1 --2- 172.21.15.6:0/2235668375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2328102d50 0x7f23281031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.168+0000 7f232ea8c640 1 --2- 172.21.15.6:0/2235668375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2328101b60 0x7f2328101f60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.168+0000 7f232ea8c640 1 -- 172.21.15.6:0/2235668375 >> 172.21.15.6:0/2235668375 conn(0x7f23280fd2e0 msgr2=0x7f23280ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.168+0000 7f232ea8c640 1 -- 172.21.15.6:0/2235668375 shutdown_connections 2024-09-12T00:04:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.168+0000 7f232ea8c640 1 -- 172.21.15.6:0/2235668375 wait complete. 2024-09-12T00:04:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.168+0000 7f232ea8c640 1 Processor -- start 2024-09-12T00:04:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f232ea8c640 1 -- start start 2024-09-12T00:04:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f232ea8c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2328101b60 0x7f2328075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f232ea8c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2328102d50 0x7f23280745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f232ea8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2328103710 0x7f2328074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f232ea8c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f232810d690 con 0x7f2328102d50 2024-09-12T00:04:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f232ea8c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f232810d510 con 0x7f2328103710 2024-09-12T00:04:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f232ea8c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f232810d810 con 0x7f2328101b60 2024-09-12T00:04:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f2327fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2328102d50 0x7f23280745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f2327fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2328102d50 0x7f23280745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38044/0 (socket says 172.21.15.6:38044) 2024-09-12T00:04:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f2327fff640 1 -- 172.21.15.6:0/3320665567 learned_addr learned my addr 172.21.15.6:0/3320665567 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f232c828640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2328101b60 0x7f2328075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f232d029640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2328103710 0x7f2328074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f2327fff640 1 -- 172.21.15.6:0/3320665567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2328101b60 msgr2=0x7f2328075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f2327fff640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2328101b60 0x7f2328075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f2327fff640 1 -- 172.21.15.6:0/3320665567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2328103710 msgr2=0x7f2328074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f2327fff640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2328103710 0x7f2328074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f2327fff640 1 -- 172.21.15.6:0/3320665567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23280753b0 con 0x7f2328102d50 2024-09-12T00:04:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f232d029640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2328103710 0x7f2328074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.169+0000 7f2327fff640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2328102d50 0x7f23280745e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f231400e9f0 tx=0x7f231400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.170+0000 7f2325ffb640 1 -- 172.21.15.6:0/3320665567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231400cd80 con 0x7f2328102d50 2024-09-12T00:04:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.170+0000 7f2325ffb640 1 -- 172.21.15.6:0/3320665567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23140054d0 con 0x7f2328102d50 2024-09-12T00:04:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.170+0000 7f2325ffb640 1 -- 172.21.15.6:0/3320665567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314010490 con 0x7f2328102d50 2024-09-12T00:04:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.170+0000 7f232ea8c640 1 -- 172.21.15.6:0/3320665567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23281a1f50 con 0x7f2328102d50 2024-09-12T00:04:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.170+0000 7f232ea8c640 1 -- 172.21.15.6:0/3320665567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23281a2360 con 0x7f2328102d50 2024-09-12T00:04:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.172+0000 7f2325ffb640 1 -- 172.21.15.6:0/3320665567 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f2314005020 con 0x7f2328102d50 2024-09-12T00:04:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f2331825740 1 Processor -- start 2024-09-12T00:04:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f2331825740 1 -- start start 2024-09-12T00:04:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f2331825740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7e9a0 0x557290e7eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f2331825740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7f2e0 0x557290e83da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f2331825740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 0x557290e86830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f2331825740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557290de22f0 con 0x557290e84370 2024-09-12T00:04:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f2331825740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557290d8a270 con 0x557290e7e9a0 2024-09-12T00:04:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f2331825740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557290dde2b0 con 0x557290e7f2e0 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f2325ffb640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f23180a2c00 0x7f23180a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f2327fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 0x557290e86830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f2327fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 0x557290e86830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38052/0 (socket says 172.21.15.6:38052) 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f2327fff640 1 -- 172.21.15.6:0/3244443895 learned_addr learned my addr 172.21.15.6:0/3244443895 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f232c828640 1 --2- 172.21.15.6:0/3244443895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7f2e0 0x557290e83da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f232d029640 1 --2- 172.21.15.6:0/3244443895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7e9a0 0x557290e7eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.173+0000 7f232d029640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f23180a2c00 0x7f23180a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.174+0000 7f2325ffb640 1 -- 172.21.15.6:0/3320665567 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f23140cf790 con 0x7f2328102d50 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.174+0000 7f232c828640 1 -- 172.21.15.6:0/3244443895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7e9a0 msgr2=0x557290e7eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.174+0000 7f232c828640 1 --2- 172.21.15.6:0/3244443895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7e9a0 0x557290e7eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.174+0000 7f232c828640 1 -- 172.21.15.6:0/3244443895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 msgr2=0x557290e86830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.174+0000 7f232c828640 1 --2- 172.21.15.6:0/3244443895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 0x557290e86830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.174+0000 7f232c828640 1 -- 172.21.15.6:0/3244443895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557290d89340 con 0x557290e7f2e0 2024-09-12T00:04:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.174+0000 7f2327fff640 1 --2- 172.21.15.6:0/3244443895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 0x557290e86830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:04:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.174+0000 7f232d029640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f23180a2c00 0x7f23180a50c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2320009370 tx=0x7f2320009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.174+0000 7f232c828640 1 --2- 172.21.15.6:0/3244443895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7f2e0 0x557290e83da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f231c009230 tx=0x7f231c031ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=954cbbce6c4b59e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.174+0000 7f2312ffd640 1 -- 172.21.15.6:0/3244443895 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c035030 con 0x557290e7f2e0 2024-09-12T00:04:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.174+0000 7f2312ffd640 1 -- 172.21.15.6:0/3244443895 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f231c040070 con 0x557290e7f2e0 2024-09-12T00:04:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.174+0000 7f2312ffd640 1 -- 172.21.15.6:0/3244443895 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c003a30 con 0x557290e7f2e0 2024-09-12T00:04:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.175+0000 7f2331825740 1 -- 172.21.15.6:0/3244443895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7f2e0 msgr2=0x557290e83da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.175+0000 7f2331825740 1 --2- 172.21.15.6:0/3244443895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7f2e0 0x557290e83da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f231c009230 tx=0x7f231c031ba0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.175+0000 7f2331825740 1 -- 172.21.15.6:0/3244443895 shutdown_connections 2024-09-12T00:04:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.175+0000 7f2331825740 1 --2- 172.21.15.6:0/3244443895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 0x557290e86830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.175+0000 7f2331825740 1 --2- 172.21.15.6:0/3244443895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7f2e0 0x557290e83da0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.175+0000 7f2331825740 1 --2- 172.21.15.6:0/3244443895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7e9a0 0x557290e7eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.175+0000 7f2331825740 1 -- 172.21.15.6:0/3244443895 >> 172.21.15.6:0/3244443895 conn(0x557290e7a010 msgr2=0x557290e7a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:42.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.175+0000 7f2331825740 1 -- 172.21.15.6:0/3244443895 shutdown_connections 2024-09-12T00:04:42.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.175+0000 7f2331825740 1 -- 172.21.15.6:0/3244443895 wait complete. 2024-09-12T00:04:42.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.175+0000 7f2331825740 1 -- start start 2024-09-12T00:04:42.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f2331825740 1 Processor -- start 2024-09-12T00:04:42.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f2331825740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7e9a0 0x557290e88b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f2331825740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7f2e0 0x557290e89080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f2331825740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 0x557290e900c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f2331825740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557290e872e0 con 0x557290e84370 2024-09-12T00:04:42.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f2331825740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557290d6b290 con 0x557290e7f2e0 2024-09-12T00:04:42.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f2331825740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557290e87460 con 0x557290e7e9a0 2024-09-12T00:04:42.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f2331825740 10 client.0 _ll_register_callbacks cb 0x557290d9c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:42.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f232d029640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 0x557290e900c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f232d029640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 0x557290e900c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38062/0 (socket says 172.21.15.6:38062) 2024-09-12T00:04:42.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f232d029640 1 -- 172.21.15.6:0/721439192 learned_addr learned my addr 172.21.15.6:0/721439192 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:42.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f232c828640 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7e9a0 0x557290e88b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f2327fff640 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7f2e0 0x557290e89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f232c828640 1 -- 172.21.15.6:0/721439192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7f2e0 msgr2=0x557290e89080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:42.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f232c828640 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7f2e0 0x557290e89080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f232c828640 1 -- 172.21.15.6:0/721439192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 msgr2=0x557290e900c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:42.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.176+0000 7f232c828640 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 0x557290e900c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.177+0000 7f232c828640 1 -- 172.21.15.6:0/721439192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557290af5210 con 0x557290e7e9a0 2024-09-12T00:04:42.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.177+0000 7f232d029640 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 0x557290e900c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:04:42.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.177+0000 7f232c828640 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7e9a0 0x557290e88b40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x557290e7ae90 tx=0x7f231c02ab10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8f1717722de1001 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.177+0000 7f2307fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:04:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.177+0000 7f2307fff640 1 -- 172.21.15.6:0/721439192 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c035070 con 0x557290e7e9a0 2024-09-12T00:04:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.177+0000 7f2331825740 1 -- 172.21.15.6:0/721439192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f231c040070 con 0x557290e7e9a0 2024-09-12T00:04:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.177+0000 7f2307fff640 1 -- 172.21.15.6:0/721439192 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f231c03c850 con 0x557290e7e9a0 2024-09-12T00:04:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.177+0000 7f2307fff640 1 -- 172.21.15.6:0/721439192 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f231c009520 con 0x557290e7e9a0 2024-09-12T00:04:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.177+0000 7f2331825740 10 client.25411 fetch_fsmap learned FSMap version 33 2024-09-12T00:04:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.177+0000 7f2331825740 1 -- 172.21.15.6:0/721439192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557290bc1620 con 0x557290e7e9a0 2024-09-12T00:04:42.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.177+0000 7f2307fff640 1 -- 172.21.15.6:0/721439192 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f231c040070 con 0x557290e7e9a0 2024-09-12T00:04:42.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.178+0000 7f2307fff640 1 -- 172.21.15.6:0/721439192 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f231c044c00 con 0x557290e7e9a0 2024-09-12T00:04:42.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.178+0000 7f2331825740 10 client.25411 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:04:42.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.178+0000 7f2331825740 10 client.25411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:04:42.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.178+0000 7f2331825740 20 client.25411 populate_metadata read hostname 'smithi006' 2024-09-12T00:04:42.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.178+0000 7f2331825740 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557290e943c0 0x557290e967b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.178+0000 7f2331825740 4 client.25411 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.178+0000 7f2331825740 1 -- 172.21.15.6:0/721439192 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557290defa20 con 0x557290e943c0 2024-09-12T00:04:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.178+0000 7f2327fff640 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557290e943c0 0x557290e967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2307fff640 10 client.25411 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.178+0000 7f2327fff640 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557290e943c0 0x557290e967b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45bb869b9e17c993 server_cookie=e397d9ca7e5b4fa0 in_seq=0 out_seq=0 2024-09-12T00:04:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2307fff640 1 -- 172.21.15.6:0/721439192 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557290defa20 con 0x557290e943c0 2024-09-12T00:04:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2307fff640 10 client.25411 handle_command_reply: tid=0 2024-09-12T00:04:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2331825740 1 client.25411 shutdown 2024-09-12T00:04:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2331825740 1 -- 172.21.15.6:0/721439192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7e9a0 msgr2=0x557290e88b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2331825740 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7e9a0 0x557290e88b40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x557290e7ae90 tx=0x7f231c02ab10 comp rx=0 tx=0).stop 2024-09-12T00:04:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2331825740 1 -- 172.21.15.6:0/721439192 shutdown_connections 2024-09-12T00:04:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2331825740 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e84370 0x557290e900c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2331825740 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7f2e0 0x557290e89080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2331825740 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557290e943c0 0x557290e967b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2331825740 1 --2- 172.21.15.6:0/721439192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7e9a0 0x557290e88b40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2307fff640 0 client.25411 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.179+0000 7f2331825740 1 -- 172.21.15.6:0/721439192 >> 172.21.15.6:0/721439192 conn(0x557290e7a010 msgr2=0x557290e7b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.180+0000 7f2331825740 1 -- 172.21.15.6:0/721439192 shutdown_connections 2024-09-12T00:04:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.180+0000 7f2331825740 1 -- 172.21.15.6:0/721439192 wait complete. 2024-09-12T00:04:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.180+0000 7f2331825740 20 client.25411 trim_cache size 0 max 16384 2024-09-12T00:04:42.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.197+0000 7f2331825740 1 Processor -- start 2024-09-12T00:04:42.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.197+0000 7f2331825740 1 -- start start 2024-09-12T00:04:42.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.197+0000 7f2331825740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7e9a0 0x557290e89000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.197+0000 7f2331825740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7f2e0 0x557290e8ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.197+0000 7f2331825740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e84370 0x557290e7aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.197+0000 7f2331825740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f23281aca40 con 0x557290e7f2e0 2024-09-12T00:04:42.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.197+0000 7f2331825740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f23281ae580 con 0x557290e84370 2024-09-12T00:04:42.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.197+0000 7f2331825740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f23281ad110 con 0x557290e7e9a0 2024-09-12T00:04:42.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.197+0000 7f2327fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7f2e0 0x557290e8ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.197+0000 7f2327fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7f2e0 0x557290e8ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38068/0 (socket says 172.21.15.6:38068) 2024-09-12T00:04:42.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.197+0000 7f2327fff640 1 -- 172.21.15.6:0/1725773476 learned_addr learned my addr 172.21.15.6:0/1725773476 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:42.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.198+0000 7f232c828640 1 --2- 172.21.15.6:0/1725773476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7e9a0 0x557290e89000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.198+0000 7f232d029640 1 --2- 172.21.15.6:0/1725773476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e84370 0x557290e7aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.198+0000 7f2327fff640 1 -- 172.21.15.6:0/1725773476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7e9a0 msgr2=0x557290e89000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:42.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.198+0000 7f2327fff640 1 --2- 172.21.15.6:0/1725773476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7e9a0 0x557290e89000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.198+0000 7f2327fff640 1 -- 172.21.15.6:0/1725773476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e84370 msgr2=0x557290e7aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.198+0000 7f2327fff640 1 --2- 172.21.15.6:0/1725773476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e84370 0x557290e7aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.198+0000 7f2327fff640 1 -- 172.21.15.6:0/1725773476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557290e7f7c0 con 0x557290e7f2e0 2024-09-12T00:04:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.198+0000 7f2327fff640 1 --2- 172.21.15.6:0/1725773476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7f2e0 0x557290e8ffe0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f23140ccef0 tx=0x7f2314004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb055f20ef3ec347 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.198+0000 7f23127fc640 1 -- 172.21.15.6:0/1725773476 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231409bc00 con 0x557290e7f2e0 2024-09-12T00:04:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.198+0000 7f23127fc640 1 -- 172.21.15.6:0/1725773476 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f231409ffb0 con 0x557290e7f2e0 2024-09-12T00:04:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.198+0000 7f23127fc640 1 -- 172.21.15.6:0/1725773476 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314098270 con 0x557290e7f2e0 2024-09-12T00:04:42.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.199+0000 7f2331825740 1 -- 172.21.15.6:0/1725773476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7f2e0 msgr2=0x557290e8ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:42.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.199+0000 7f2331825740 1 --2- 172.21.15.6:0/1725773476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7f2e0 0x557290e8ffe0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f23140ccef0 tx=0x7f2314004990 comp rx=0 tx=0).stop 2024-09-12T00:04:42.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.199+0000 7f2331825740 1 -- 172.21.15.6:0/1725773476 shutdown_connections 2024-09-12T00:04:42.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.199+0000 7f2331825740 1 --2- 172.21.15.6:0/1725773476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e84370 0x557290e7aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.199+0000 7f2331825740 1 --2- 172.21.15.6:0/1725773476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7f2e0 0x557290e8ffe0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.199+0000 7f2331825740 1 --2- 172.21.15.6:0/1725773476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e7e9a0 0x557290e89000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.199+0000 7f2331825740 1 -- 172.21.15.6:0/1725773476 >> 172.21.15.6:0/1725773476 conn(0x557290e7a010 msgr2=0x557290e888f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.199+0000 7f2331825740 1 -- 172.21.15.6:0/1725773476 shutdown_connections 2024-09-12T00:04:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.199+0000 7f2331825740 1 -- 172.21.15.6:0/1725773476 wait complete. 2024-09-12T00:04:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.199+0000 7f2331825740 1 -- start start 2024-09-12T00:04:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.199+0000 7f2331825740 1 Processor -- start 2024-09-12T00:04:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f2331825740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7e9a0 0x557290e8d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f2331825740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7f2e0 0x557290e8dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f2331825740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e84370 0x557290e8ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f2331825740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f23281adeb0 con 0x557290e7e9a0 2024-09-12T00:04:42.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f2331825740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f23281ad7e0 con 0x557290e7f2e0 2024-09-12T00:04:42.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f2331825740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f23281aaa20 con 0x557290e84370 2024-09-12T00:04:42.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f2331825740 10 client.0 _ll_register_callbacks cb 0x7f231409b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:42.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f232c828640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7e9a0 0x557290e8d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f232c828640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7e9a0 0x557290e8d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38084/0 (socket says 172.21.15.6:38084) 2024-09-12T00:04:42.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f232d029640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e84370 0x557290e8ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f232c828640 1 -- 172.21.15.6:0/122329041 learned_addr learned my addr 172.21.15.6:0/122329041 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f2327fff640 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7f2e0 0x557290e8dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f232c828640 1 -- 172.21.15.6:0/122329041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e84370 msgr2=0x557290e8ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f232c828640 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e84370 0x557290e8ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f232c828640 1 -- 172.21.15.6:0/122329041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7f2e0 msgr2=0x557290e8dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f232c828640 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7f2e0 0x557290e8dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f232c828640 1 -- 172.21.15.6:0/122329041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557290e8f200 con 0x557290e7e9a0 2024-09-12T00:04:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.200+0000 7f2327fff640 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7f2e0 0x557290e8dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f232c828640 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7e9a0 0x557290e8d6f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f231c004720 tx=0x7f231c005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3474e81d7c92ea22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2307fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:04:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2307fff640 1 -- 172.21.15.6:0/122329041 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c060060 con 0x557290e7e9a0 2024-09-12T00:04:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2307fff640 1 -- 172.21.15.6:0/122329041 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f231c004450 con 0x557290e7e9a0 2024-09-12T00:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2331825740 1 -- 172.21.15.6:0/122329041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f231409ffb0 con 0x557290e7e9a0 2024-09-12T00:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2307fff640 1 -- 172.21.15.6:0/122329041 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f231c035040 con 0x557290e7e9a0 2024-09-12T00:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2331825740 10 client.15780 fetch_fsmap learned FSMap version 33 2024-09-12T00:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2331825740 1 -- 172.21.15.6:0/122329041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557290eff050 con 0x557290e7e9a0 2024-09-12T00:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2307fff640 1 -- 172.21.15.6:0/122329041 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f231409ffb0 con 0x557290e7e9a0 2024-09-12T00:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2307fff640 1 -- 172.21.15.6:0/122329041 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f231c0035f0 con 0x557290e7e9a0 2024-09-12T00:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2331825740 10 client.15780 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:04:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2331825740 10 client.15780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:04:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2331825740 20 client.15780 populate_metadata read hostname 'smithi006' 2024-09-12T00:04:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2331825740 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557290eff840 0x557290f01c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2331825740 4 client.15780 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:04:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.201+0000 7f2331825740 1 -- 172.21.15.6:0/122329041 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557290de9d70 con 0x557290eff840 2024-09-12T00:04:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.202+0000 7f2327fff640 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557290eff840 0x557290f01c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.202+0000 7f2307fff640 10 client.15780 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:42.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.202+0000 7f2327fff640 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557290eff840 0x557290f01c60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=910c8a645873cee1 server_cookie=91b7db183444fdf3 in_seq=0 out_seq=0 2024-09-12T00:04:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2307fff640 1 -- 172.21.15.6:0/122329041 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557290de9d70 con 0x557290eff840 2024-09-12T00:04:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2307fff640 10 client.15780 handle_command_reply: tid=0 2024-09-12T00:04:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2331825740 1 client.15780 shutdown 2024-09-12T00:04:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2331825740 1 -- 172.21.15.6:0/122329041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7e9a0 msgr2=0x557290e8d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2331825740 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7e9a0 0x557290e8d6f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f231c004720 tx=0x7f231c005e30 comp rx=0 tx=0).stop 2024-09-12T00:04:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2331825740 1 -- 172.21.15.6:0/122329041 shutdown_connections 2024-09-12T00:04:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2331825740 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557290eff840 0x557290f01c60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2331825740 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557290e84370 0x557290e8ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2331825740 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557290e7f2e0 0x557290e8dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2331825740 1 --2- 172.21.15.6:0/122329041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557290e7e9a0 0x557290e8d6f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2307fff640 0 client.15780 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2331825740 1 -- 172.21.15.6:0/122329041 >> 172.21.15.6:0/122329041 conn(0x557290e7a010 msgr2=0x557290e789a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2331825740 1 -- 172.21.15.6:0/122329041 shutdown_connections 2024-09-12T00:04:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2331825740 1 -- 172.21.15.6:0/122329041 wait complete. 2024-09-12T00:04:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.219+0000 7f2331825740 20 client.15780 trim_cache size 0 max 16384 2024-09-12T00:04:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:04:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:04:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:04:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:04:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.220+0000 7f232ea8c640 1 -- 172.21.15.6:0/3320665567 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f23180a2c00 msgr2=0x7f23180a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.220+0000 7f232ea8c640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f23180a2c00 0x7f23180a50c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2320009370 tx=0x7f2320009520 comp rx=0 tx=0).stop 2024-09-12T00:04:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.220+0000 7f232ea8c640 1 -- 172.21.15.6:0/3320665567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2328102d50 msgr2=0x7f23280745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.220+0000 7f232ea8c640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2328102d50 0x7f23280745e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f231400e9f0 tx=0x7f231400edf0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.220+0000 7f232ea8c640 1 -- 172.21.15.6:0/3320665567 shutdown_connections 2024-09-12T00:04:42.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.220+0000 7f232ea8c640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f23180a2c00 0x7f23180a50c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.220+0000 7f232ea8c640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2328103710 0x7f2328074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.220+0000 7f232ea8c640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2328102d50 0x7f23280745e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.220+0000 7f232ea8c640 1 --2- 172.21.15.6:0/3320665567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2328101b60 0x7f2328075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:42.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.220+0000 7f232ea8c640 1 -- 172.21.15.6:0/3320665567 >> 172.21.15.6:0/3320665567 conn(0x7f23280fd2e0 msgr2=0x7f2328106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:42.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.220+0000 7f232ea8c640 1 -- 172.21.15.6:0/3320665567 shutdown_connections 2024-09-12T00:04:42.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:42.220+0000 7f232ea8c640 1 -- 172.21.15.6:0/3320665567 wait complete. 2024-09-12T00:04:42.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:42 smithi039 ceph-mon[34543]: pgmap v520: 129 pgs: 129 active+clean; 6.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 25 op/s 2024-09-12T00:04:42.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:42 smithi006 ceph-mon[30947]: pgmap v520: 129 pgs: 129 active+clean; 6.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 25 op/s 2024-09-12T00:04:42.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:42 smithi134 ceph-mon[34893]: pgmap v520: 129 pgs: 129 active+clean; 6.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 25 op/s 2024-09-12T00:04:44.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:44 smithi039 ceph-mon[34543]: pgmap v521: 129 pgs: 129 active+clean; 6.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 22 op/s 2024-09-12T00:04:44.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:44 smithi006 ceph-mon[30947]: pgmap v521: 129 pgs: 129 active+clean; 6.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 22 op/s 2024-09-12T00:04:44.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:44 smithi134 ceph-mon[34893]: pgmap v521: 129 pgs: 129 active+clean; 6.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 22 op/s 2024-09-12T00:04:46.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:46 smithi039 ceph-mon[34543]: pgmap v522: 129 pgs: 129 active+clean; 6.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:04:46.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:46 smithi006 ceph-mon[30947]: pgmap v522: 129 pgs: 129 active+clean; 6.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:04:46.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:46 smithi134 ceph-mon[34893]: pgmap v522: 129 pgs: 129 active+clean; 6.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:04:48.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:48 smithi039 ceph-mon[34543]: pgmap v523: 129 pgs: 129 active+clean; 6.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:04:48.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:48 smithi006 ceph-mon[30947]: pgmap v523: 129 pgs: 129 active+clean; 6.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:04:48.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:48 smithi134 ceph-mon[34893]: pgmap v523: 129 pgs: 129 active+clean; 6.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:04:50.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:50 smithi039 ceph-mon[34543]: pgmap v524: 129 pgs: 129 active+clean; 6.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:04:50.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:50 smithi006 ceph-mon[30947]: pgmap v524: 129 pgs: 129 active+clean; 6.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:04:50.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:50 smithi134 ceph-mon[34893]: pgmap v524: 129 pgs: 129 active+clean; 6.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:04:52.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:52 smithi039 ceph-mon[34543]: pgmap v525: 129 pgs: 129 active+clean; 6.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:04:52.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:52 smithi006 ceph-mon[30947]: pgmap v525: 129 pgs: 129 active+clean; 6.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:04:52.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:52 smithi134 ceph-mon[34893]: pgmap v525: 129 pgs: 129 active+clean; 6.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:04:54.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:54 smithi039 ceph-mon[34543]: pgmap v526: 129 pgs: 129 active+clean; 6.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:04:54.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:54 smithi006 ceph-mon[30947]: pgmap v526: 129 pgs: 129 active+clean; 6.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:04:54.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:54 smithi134 ceph-mon[34893]: pgmap v526: 129 pgs: 129 active+clean; 6.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:04:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.317+0000 7fe4bc665640 1 -- 172.21.15.6:0/1413018674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4100a40 msgr2=0x7fe4b4100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.317+0000 7fe4bc665640 1 --2- 172.21.15.6:0/1413018674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4100a40 0x7fe4b4100e40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009900 tx=0x7fe4b002a410 comp rx=0 tx=0).stop 2024-09-12T00:04:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.317+0000 7fe4bc665640 1 -- 172.21.15.6:0/1413018674 shutdown_connections 2024-09-12T00:04:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.317+0000 7fe4bc665640 1 --2- 172.21.15.6:0/1413018674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4b41025f0 0x7fe4b4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.317+0000 7fe4bc665640 1 --2- 172.21.15.6:0/1413018674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4b4101c30 0x7fe4b41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.317+0000 7fe4bc665640 1 --2- 172.21.15.6:0/1413018674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4100a40 0x7fe4b4100e40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.317+0000 7fe4bc665640 1 -- 172.21.15.6:0/1413018674 >> 172.21.15.6:0/1413018674 conn(0x7fe4b40fc1c0 msgr2=0x7fe4b40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.317+0000 7fe4bc665640 1 -- 172.21.15.6:0/1413018674 shutdown_connections 2024-09-12T00:04:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.317+0000 7fe4bc665640 1 -- 172.21.15.6:0/1413018674 wait complete. 2024-09-12T00:04:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.317+0000 7fe4bc665640 1 Processor -- start 2024-09-12T00:04:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.317+0000 7fe4bc665640 1 -- start start 2024-09-12T00:04:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4bc665640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4100a40 0x7fe4b406a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4bc665640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4b4101c30 0x7fe4b419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4bc665640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4b41025f0 0x7fe4b419f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4bc665640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b410c550 con 0x7fe4b4100a40 2024-09-12T00:04:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4bc665640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b410c3d0 con 0x7fe4b41025f0 2024-09-12T00:04:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4bc665640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b410c6d0 con 0x7fe4b4101c30 2024-09-12T00:04:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4ba401640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4100a40 0x7fe4b406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4ba401640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4100a40 0x7fe4b406a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56560/0 (socket says 172.21.15.6:56560) 2024-09-12T00:04:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4ba401640 1 -- 172.21.15.6:0/1936464804 learned_addr learned my addr 172.21.15.6:0/1936464804 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4bac02640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4b41025f0 0x7fe4b419f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4b9c00640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4b4101c30 0x7fe4b419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4ba401640 1 -- 172.21.15.6:0/1936464804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4b4101c30 msgr2=0x7fe4b419cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4ba401640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4b4101c30 0x7fe4b419cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4ba401640 1 -- 172.21.15.6:0/1936464804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4b41025f0 msgr2=0x7fe4b419f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4ba401640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4b41025f0 0x7fe4b419f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4ba401640 1 -- 172.21.15.6:0/1936464804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b419fa50 con 0x7fe4b4100a40 2024-09-12T00:04:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.318+0000 7fe4ba401640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4100a40 0x7fe4b406a580 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00314e0 tx=0x7fe4b0031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.319+0000 7fe4ab7fe640 1 -- 172.21.15.6:0/1936464804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b003f030 con 0x7fe4b4100a40 2024-09-12T00:04:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.319+0000 7fe4ab7fe640 1 -- 172.21.15.6:0/1936464804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4b00044b0 con 0x7fe4b4100a40 2024-09-12T00:04:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.319+0000 7fe4ab7fe640 1 -- 172.21.15.6:0/1936464804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0035070 con 0x7fe4b4100a40 2024-09-12T00:04:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.319+0000 7fe4bc665640 1 -- 172.21.15.6:0/1936464804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b419fc80 con 0x7fe4b4100a40 2024-09-12T00:04:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.319+0000 7fe4bc665640 1 -- 172.21.15.6:0/1936464804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b41a01c0 con 0x7fe4b4100a40 2024-09-12T00:04:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.321+0000 7fe4ab7fe640 1 -- 172.21.15.6:0/1936464804 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fe4b0042030 con 0x7fe4b4100a40 2024-09-12T00:04:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.322+0000 7fe4bf404740 1 Processor -- start 2024-09-12T00:04:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.322+0000 7fe4bf404740 1 -- start start 2024-09-12T00:04:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.322+0000 7fe4ab7fe640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe4a00a2c00 0x7fe4a00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.322+0000 7fe4bf404740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fd9db0 0x55cd62fda1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4bf404740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fda6f0 0x55cd62fdf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4bac02640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe4a00a2c00 0x7fe4a00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4bf404740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fdf780 0x55cd62fe1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4bf404740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55cd62f392f0 con 0x55cd62fda6f0 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4bf404740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55cd62ee1270 con 0x55cd62fdf780 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4bf404740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cd62f352b0 con 0x55cd62fd9db0 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4ab7fe640 1 -- 172.21.15.6:0/1936464804 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fe4b00ef950 con 0x7fe4b4100a40 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4b9c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fda6f0 0x55cd62fdf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4b9c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fda6f0 0x55cd62fdf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56568/0 (socket says 172.21.15.6:56568) 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4b9c00640 1 -- 172.21.15.6:0/2937758062 learned_addr learned my addr 172.21.15.6:0/2937758062 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4bac02640 1 --2- 172.21.15.6:0/2937758062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fdf780 0x55cd62fe1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4ba401640 1 --2- 172.21.15.6:0/2937758062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fd9db0 0x55cd62fda1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4b9c00640 1 -- 172.21.15.6:0/2937758062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fd9db0 msgr2=0x55cd62fda1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4b9c00640 1 --2- 172.21.15.6:0/2937758062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fd9db0 0x55cd62fda1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4b9c00640 1 -- 172.21.15.6:0/2937758062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fdf780 msgr2=0x55cd62fe1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4b9c00640 1 --2- 172.21.15.6:0/2937758062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fdf780 0x55cd62fe1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4b9c00640 1 -- 172.21.15.6:0/2937758062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd62ee0340 con 0x55cd62fda6f0 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4bac02640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe4a00a2c00 0x7fe4a00a50c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac005fd0 tx=0x7fe4ac014bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.323+0000 7fe4b9c00640 1 --2- 172.21.15.6:0/2937758062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fda6f0 0x55cd62fdf1b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009c20 tx=0x7fe4a40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ac6af37293db99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.324+0000 7fe4a8bfe640 1 -- 172.21.15.6:0/2937758062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4012450 con 0x55cd62fda6f0 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.324+0000 7fe4a8bfe640 1 -- 172.21.15.6:0/2937758062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4a4012aa0 con 0x55cd62fda6f0 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.324+0000 7fe4a8bfe640 1 -- 172.21.15.6:0/2937758062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a400fa40 con 0x55cd62fda6f0 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.324+0000 7fe4bf404740 1 -- 172.21.15.6:0/2937758062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fda6f0 msgr2=0x55cd62fdf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.324+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2937758062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fda6f0 0x55cd62fdf1b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009c20 tx=0x7fe4a40117b0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.324+0000 7fe4bf404740 1 -- 172.21.15.6:0/2937758062 shutdown_connections 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.324+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2937758062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fdf780 0x55cd62fe1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.324+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2937758062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fda6f0 0x55cd62fdf1b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.324+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2937758062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fd9db0 0x55cd62fda1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.324+0000 7fe4bf404740 1 -- 172.21.15.6:0/2937758062 >> 172.21.15.6:0/2937758062 conn(0x55cd62fd1010 msgr2=0x55cd62fd1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4bf404740 1 -- 172.21.15.6:0/2937758062 shutdown_connections 2024-09-12T00:04:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4bf404740 1 -- 172.21.15.6:0/2937758062 wait complete. 2024-09-12T00:04:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4bf404740 1 -- start start 2024-09-12T00:04:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4bf404740 1 Processor -- start 2024-09-12T00:04:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4bf404740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 0x55cd62fe3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4bf404740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fda6f0 0x55cd62fe44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4bf404740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fdf780 0x55cd62feb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4bf404740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55cd62fe2750 con 0x55cd62fd9db0 2024-09-12T00:04:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4bf404740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55cd62ec2290 con 0x55cd62fdf780 2024-09-12T00:04:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4bf404740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cd62fe28d0 con 0x55cd62fda6f0 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4ba401640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 0x55cd62fe3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4ba401640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 0x55cd62fe3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56578/0 (socket says 172.21.15.6:56578) 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4ba401640 1 -- 172.21.15.6:0/2985199605 learned_addr learned my addr 172.21.15.6:0/2985199605 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.325+0000 7fe4bf404740 10 client.0 _ll_register_callbacks cb 0x55cd62ef3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe4bac02640 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fdf780 0x55cd62feb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe4b9c00640 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fda6f0 0x55cd62fe44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe4ba401640 1 -- 172.21.15.6:0/2985199605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fda6f0 msgr2=0x55cd62fe44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe4ba401640 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fda6f0 0x55cd62fe44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe4ba401640 1 -- 172.21.15.6:0/2985199605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fdf780 msgr2=0x55cd62feb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe4ba401640 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fdf780 0x55cd62feb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe4ba401640 1 -- 172.21.15.6:0/2985199605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd62c4c210 con 0x55cd62fd9db0 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe4bac02640 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fdf780 0x55cd62feb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe4ba401640 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 0x55cd62fe3fa0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0000c00 tx=0x7fe4b00bb9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22557cadabba9ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe49dffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe49dffb640 1 -- 172.21.15.6:0/2985199605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0049040 con 0x55cd62fd9db0 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe49dffb640 1 -- 172.21.15.6:0/2985199605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fe4b007d4f0 con 0x55cd62fd9db0 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe4bf404740 1 -- 172.21.15.6:0/2985199605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4a4012aa0 con 0x55cd62fd9db0 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe49dffb640 1 -- 172.21.15.6:0/2985199605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe4b00bc4c0 con 0x55cd62fd9db0 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe4bf404740 10 client.15792 fetch_fsmap learned FSMap version 33 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe4bf404740 1 -- 172.21.15.6:0/2985199605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cd62d18620 con 0x55cd62fd9db0 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.326+0000 7fe49dffb640 1 -- 172.21.15.6:0/2985199605 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4a4012aa0 con 0x55cd62fd9db0 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.327+0000 7fe49dffb640 1 -- 172.21.15.6:0/2985199605 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fe4b00bc020 con 0x55cd62fd9db0 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.327+0000 7fe4bf404740 10 client.15792 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.327+0000 7fe4bf404740 10 client.15792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.327+0000 7fe4bf404740 20 client.15792 populate_metadata read hostname 'smithi006' 2024-09-12T00:04:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.327+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd62fefca0 0x55cd62ff20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.327+0000 7fe4bf404740 4 client.15792 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.327+0000 7fe4bf404740 1 -- 172.21.15.6:0/2985199605 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd62f46a20 con 0x55cd62fefca0 2024-09-12T00:04:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.327+0000 7fe4b9c00640 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd62fefca0 0x55cd62ff20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.327+0000 7fe4b9c00640 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd62fefca0 0x55cd62ff20d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3942dbedc410dab server_cookie=2ad2b2453221862b in_seq=0 out_seq=0 2024-09-12T00:04:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.327+0000 7fe49dffb640 10 client.15792 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe49dffb640 1 -- 172.21.15.6:0/2985199605 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd62f46a20 con 0x55cd62fefca0 2024-09-12T00:04:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe49dffb640 10 client.15792 handle_command_reply: tid=0 2024-09-12T00:04:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe4bf404740 1 client.15792 shutdown 2024-09-12T00:04:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe4bf404740 1 -- 172.21.15.6:0/2985199605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 msgr2=0x55cd62fe3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 0x55cd62fe3fa0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0000c00 tx=0x7fe4b00bb9c0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe4bf404740 1 -- 172.21.15.6:0/2985199605 shutdown_connections 2024-09-12T00:04:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fdf780 0x55cd62feb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd62fefca0 0x55cd62ff20d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fda6f0 0x55cd62fe44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2985199605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 0x55cd62fe3fa0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe49dffb640 0 client.15792 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe4bf404740 1 -- 172.21.15.6:0/2985199605 >> 172.21.15.6:0/2985199605 conn(0x55cd62fd1010 msgr2=0x55cd62fd2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe4bf404740 1 -- 172.21.15.6:0/2985199605 shutdown_connections 2024-09-12T00:04:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.328+0000 7fe4bf404740 1 -- 172.21.15.6:0/2985199605 wait complete. 2024-09-12T00:04:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.329+0000 7fe4bf404740 20 client.15792 trim_cache size 0 max 16384 2024-09-12T00:04:55.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.343+0000 7fe4bf404740 1 Processor -- start 2024-09-12T00:04:55.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.343+0000 7fe4bf404740 1 -- start start 2024-09-12T00:04:55.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.343+0000 7fe4bf404740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 0x55cd62fe43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.343+0000 7fe4bf404740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fda6f0 0x55cd62feb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.343+0000 7fe4bf404740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fdf780 0x55cd62ff69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.343+0000 7fe4bf404740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b41a8610 con 0x55cd62fd9db0 2024-09-12T00:04:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.343+0000 7fe4bf404740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b41aa150 con 0x55cd62fda6f0 2024-09-12T00:04:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.343+0000 7fe4bf404740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b41a8ce0 con 0x55cd62fdf780 2024-09-12T00:04:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.343+0000 7fe4ba401640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 0x55cd62fe43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.343+0000 7fe4ba401640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 0x55cd62fe43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56586/0 (socket says 172.21.15.6:56586) 2024-09-12T00:04:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.343+0000 7fe4ba401640 1 -- 172.21.15.6:0/1758529246 learned_addr learned my addr 172.21.15.6:0/1758529246 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.344+0000 7fe4b9c00640 1 --2- 172.21.15.6:0/1758529246 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fda6f0 0x55cd62feb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.344+0000 7fe4bac02640 1 --2- 172.21.15.6:0/1758529246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fdf780 0x55cd62ff69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.344+0000 7fe4ba401640 1 -- 172.21.15.6:0/1758529246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fdf780 msgr2=0x55cd62ff69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.344+0000 7fe4ba401640 1 --2- 172.21.15.6:0/1758529246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fdf780 0x55cd62ff69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.344+0000 7fe4ba401640 1 -- 172.21.15.6:0/1758529246 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fda6f0 msgr2=0x55cd62feb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:55.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.344+0000 7fe4ba401640 1 --2- 172.21.15.6:0/1758529246 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fda6f0 0x55cd62feb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.344+0000 7fe4ba401640 1 -- 172.21.15.6:0/1758529246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd62fdabd0 con 0x55cd62fd9db0 2024-09-12T00:04:55.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.344+0000 7fe4ba401640 1 --2- 172.21.15.6:0/1758529246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 0x55cd62fe43c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00ed3d0 tx=0x7fe4b002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d7269e72f814a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:55.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.344+0000 7fe49ffff640 1 -- 172.21.15.6:0/1758529246 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0049070 con 0x55cd62fd9db0 2024-09-12T00:04:55.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.344+0000 7fe49ffff640 1 -- 172.21.15.6:0/1758529246 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4b00bbdc0 con 0x55cd62fd9db0 2024-09-12T00:04:55.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.344+0000 7fe49ffff640 1 -- 172.21.15.6:0/1758529246 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b003bae0 con 0x55cd62fd9db0 2024-09-12T00:04:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.345+0000 7fe4bf404740 1 -- 172.21.15.6:0/1758529246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 msgr2=0x55cd62fe43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.345+0000 7fe4bf404740 1 --2- 172.21.15.6:0/1758529246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 0x55cd62fe43c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00ed3d0 tx=0x7fe4b002a410 comp rx=0 tx=0).stop 2024-09-12T00:04:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.345+0000 7fe4bf404740 1 -- 172.21.15.6:0/1758529246 shutdown_connections 2024-09-12T00:04:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.345+0000 7fe4bf404740 1 --2- 172.21.15.6:0/1758529246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fdf780 0x55cd62ff69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.345+0000 7fe4bf404740 1 --2- 172.21.15.6:0/1758529246 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fda6f0 0x55cd62feb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.345+0000 7fe4bf404740 1 --2- 172.21.15.6:0/1758529246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fd9db0 0x55cd62fe43c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.345+0000 7fe4bf404740 1 -- 172.21.15.6:0/1758529246 >> 172.21.15.6:0/1758529246 conn(0x55cd62fd1010 msgr2=0x55cd62fd01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.345+0000 7fe4bf404740 1 -- 172.21.15.6:0/1758529246 shutdown_connections 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.345+0000 7fe4bf404740 1 -- 172.21.15.6:0/1758529246 wait complete. 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bf404740 1 -- start start 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bf404740 1 Processor -- start 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bf404740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fd9db0 0x55cd62fead30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bf404740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fda6f0 0x55cd62feb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bf404740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fdf780 0x55cd62fe9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bf404740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b41a9a80 con 0x55cd62fdf780 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bf404740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b41a93b0 con 0x55cd62fda6f0 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bf404740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b41a65f0 con 0x55cd62fd9db0 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bf404740 10 client.0 _ll_register_callbacks cb 0x7fe4b0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bac02640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fdf780 0x55cd62fe9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bac02640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fdf780 0x55cd62fe9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56590/0 (socket says 172.21.15.6:56590) 2024-09-12T00:04:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bac02640 1 -- 172.21.15.6:0/2628480456 learned_addr learned my addr 172.21.15.6:0/2628480456 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:04:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4ba401640 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fd9db0 0x55cd62fead30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4b9c00640 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fda6f0 0x55cd62feb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bac02640 1 -- 172.21.15.6:0/2628480456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fd9db0 msgr2=0x55cd62fead30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bac02640 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fd9db0 0x55cd62fead30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.346+0000 7fe4bac02640 1 -- 172.21.15.6:0/2628480456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fda6f0 msgr2=0x55cd62feb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.347+0000 7fe4bac02640 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fda6f0 0x55cd62feb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.347+0000 7fe4bac02640 1 -- 172.21.15.6:0/2628480456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd62fe9a50 con 0x55cd62fdf780 2024-09-12T00:04:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.347+0000 7fe4b9c00640 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fda6f0 0x55cd62feb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:04:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.347+0000 7fe4bac02640 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fdf780 0x55cd62fe9340 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac012f40 tx=0x7fe4ac01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4d6d5d995aceef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.347+0000 7fe49dffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:04:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.347+0000 7fe49dffb640 1 -- 172.21.15.6:0/2628480456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac003b70 con 0x55cd62fdf780 2024-09-12T00:04:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.347+0000 7fe49dffb640 1 -- 172.21.15.6:0/2628480456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fe4ac003d10 con 0x55cd62fdf780 2024-09-12T00:04:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.347+0000 7fe4bf404740 1 -- 172.21.15.6:0/2628480456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4b00bbdc0 con 0x55cd62fdf780 2024-09-12T00:04:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.347+0000 7fe49dffb640 1 -- 172.21.15.6:0/2628480456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe4ac036050 con 0x55cd62fdf780 2024-09-12T00:04:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.347+0000 7fe4bf404740 10 client.15798 fetch_fsmap learned FSMap version 33 2024-09-12T00:04:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.347+0000 7fe4bf404740 1 -- 172.21.15.6:0/2628480456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cd6305b430 con 0x55cd62fdf780 2024-09-12T00:04:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.347+0000 7fe49dffb640 1 -- 172.21.15.6:0/2628480456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4b00bbdc0 con 0x55cd62fdf780 2024-09-12T00:04:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.348+0000 7fe49dffb640 1 -- 172.21.15.6:0/2628480456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fe4ac02a070 con 0x55cd62fdf780 2024-09-12T00:04:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.348+0000 7fe4bf404740 10 client.15798 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:04:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.348+0000 7fe4bf404740 10 client.15798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:04:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.348+0000 7fe4bf404740 20 client.15798 populate_metadata read hostname 'smithi006' 2024-09-12T00:04:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.348+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd6305bdd0 0x55cd6305e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.348+0000 7fe4bf404740 4 client.15798 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:04:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.348+0000 7fe4bf404740 1 -- 172.21.15.6:0/2628480456 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd62f40d70 con 0x55cd6305bdd0 2024-09-12T00:04:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.349+0000 7fe4ba401640 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd6305bdd0 0x55cd6305e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.350+0000 7fe4ba401640 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd6305bdd0 0x55cd6305e1c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ce2208d10083ddf server_cookie=aaa52249544a0054 in_seq=0 out_seq=0 2024-09-12T00:04:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.350+0000 7fe49dffb640 10 client.15798 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe49dffb640 1 -- 172.21.15.6:0/2628480456 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cd62f40d70 con 0x55cd6305bdd0 2024-09-12T00:04:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe49dffb640 10 client.15798 handle_command_reply: tid=0 2024-09-12T00:04:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe4bf404740 1 client.15798 shutdown 2024-09-12T00:04:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe4bf404740 1 -- 172.21.15.6:0/2628480456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fdf780 msgr2=0x55cd62fe9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fdf780 0x55cd62fe9340 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac012f40 tx=0x7fe4ac01a000 comp rx=0 tx=0).stop 2024-09-12T00:04:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe4bf404740 1 -- 172.21.15.6:0/2628480456 shutdown_connections 2024-09-12T00:04:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd62fdf780 0x55cd62fe9340 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd62fda6f0 0x55cd62feb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55cd6305bdd0 0x55cd6305e1c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe4bf404740 1 --2- 172.21.15.6:0/2628480456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cd62fd9db0 0x55cd62fead30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe49dffb640 0 client.15798 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:04:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe4bf404740 1 -- 172.21.15.6:0/2628480456 >> 172.21.15.6:0/2628480456 conn(0x55cd62fd1010 msgr2=0x55cd62fd1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe4bf404740 1 -- 172.21.15.6:0/2628480456 shutdown_connections 2024-09-12T00:04:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe4bf404740 1 -- 172.21.15.6:0/2628480456 wait complete. 2024-09-12T00:04:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.365+0000 7fe4bf404740 20 client.15798 trim_cache size 0 max 16384 2024-09-12T00:04:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:04:55.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:04:55.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:04:55.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:04:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.366+0000 7fe4bc665640 1 -- 172.21.15.6:0/1936464804 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe4a00a2c00 msgr2=0x7fe4a00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.366+0000 7fe4bc665640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe4a00a2c00 0x7fe4a00a50c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac005fd0 tx=0x7fe4ac014bf0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.366+0000 7fe4bc665640 1 -- 172.21.15.6:0/1936464804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4100a40 msgr2=0x7fe4b406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.366+0000 7fe4bc665640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4100a40 0x7fe4b406a580 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00314e0 tx=0x7fe4b0031a30 comp rx=0 tx=0).stop 2024-09-12T00:04:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.366+0000 7fe4bc665640 1 -- 172.21.15.6:0/1936464804 shutdown_connections 2024-09-12T00:04:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.366+0000 7fe4bc665640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe4a00a2c00 0x7fe4a00a50c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.366+0000 7fe4bc665640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4b41025f0 0x7fe4b419f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.366+0000 7fe4bc665640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4b4101c30 0x7fe4b419cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.366+0000 7fe4bc665640 1 --2- 172.21.15.6:0/1936464804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4100a40 0x7fe4b406a580 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.366+0000 7fe4bc665640 1 -- 172.21.15.6:0/1936464804 >> 172.21.15.6:0/1936464804 conn(0x7fe4b40fc1c0 msgr2=0x7fe4b41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.366+0000 7fe4bc665640 1 -- 172.21.15.6:0/1936464804 shutdown_connections 2024-09-12T00:04:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:04:55.366+0000 7fe4bc665640 1 -- 172.21.15.6:0/1936464804 wait complete. 2024-09-12T00:04:56.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:56 smithi039 ceph-mon[34543]: pgmap v527: 129 pgs: 129 active+clean; 6.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:04:56.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:56 smithi006 ceph-mon[30947]: pgmap v527: 129 pgs: 129 active+clean; 6.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:04:56.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:56 smithi134 ceph-mon[34893]: pgmap v527: 129 pgs: 129 active+clean; 6.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:04:58.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:04:58 smithi039 ceph-mon[34543]: pgmap v528: 129 pgs: 129 active+clean; 6.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:04:58.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:04:58 smithi006 ceph-mon[30947]: pgmap v528: 129 pgs: 129 active+clean; 6.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:04:58.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:04:58 smithi134 ceph-mon[34893]: pgmap v528: 129 pgs: 129 active+clean; 6.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:05:00.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:00 smithi039 ceph-mon[34543]: pgmap v529: 129 pgs: 129 active+clean; 6.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:05:00.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:00 smithi006 ceph-mon[30947]: pgmap v529: 129 pgs: 129 active+clean; 6.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:05:00.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:00 smithi134 ceph-mon[34893]: pgmap v529: 129 pgs: 129 active+clean; 6.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:05:02.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:02 smithi039 ceph-mon[34543]: pgmap v530: 129 pgs: 129 active+clean; 6.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:05:02.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:02 smithi006 ceph-mon[30947]: pgmap v530: 129 pgs: 129 active+clean; 6.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:05:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:02 smithi134 ceph-mon[34893]: pgmap v530: 129 pgs: 129 active+clean; 6.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:05:04.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:04 smithi039 ceph-mon[34543]: pgmap v531: 129 pgs: 129 active+clean; 6.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-12T00:05:04.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:04 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:05:04.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:04 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:05:04.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:04 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:05:04.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:04 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:05:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:04 smithi006 ceph-mon[30947]: pgmap v531: 129 pgs: 129 active+clean; 6.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-12T00:05:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:05:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:05:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:05:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:05:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:04 smithi134 ceph-mon[34893]: pgmap v531: 129 pgs: 129 active+clean; 6.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-12T00:05:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:04 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:05:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:04 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:05:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:04 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:05:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:04 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:05:06.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:06 smithi039 ceph-mon[34543]: pgmap v532: 129 pgs: 129 active+clean; 6.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:05:06.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:06 smithi006 ceph-mon[30947]: pgmap v532: 129 pgs: 129 active+clean; 6.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:05:06.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:06 smithi134 ceph-mon[34893]: pgmap v532: 129 pgs: 129 active+clean; 6.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 26 op/s 2024-09-12T00:05:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.460+0000 7fac3541e640 1 -- 172.21.15.6:0/662645889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac30107840 msgr2=0x7fac30109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.460+0000 7fac3541e640 1 --2- 172.21.15.6:0/662645889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac30107840 0x7fac30109cb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fac28009ca0 tx=0x7fac2802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.460+0000 7fac3541e640 1 -- 172.21.15.6:0/662645889 shutdown_connections 2024-09-12T00:05:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.460+0000 7fac3541e640 1 --2- 172.21.15.6:0/662645889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac30107840 0x7fac30109cb0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.460+0000 7fac3541e640 1 --2- 172.21.15.6:0/662645889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac30104f10 0x7fac30107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.460+0000 7fac3541e640 1 --2- 172.21.15.6:0/662645889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac301025e0 0x7fac301049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.460+0000 7fac3541e640 1 -- 172.21.15.6:0/662645889 >> 172.21.15.6:0/662645889 conn(0x7fac300fc1c0 msgr2=0x7fac300fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.460+0000 7fac3541e640 1 -- 172.21.15.6:0/662645889 shutdown_connections 2024-09-12T00:05:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.460+0000 7fac3541e640 1 -- 172.21.15.6:0/662645889 wait complete. 2024-09-12T00:05:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.461+0000 7fac3541e640 1 Processor -- start 2024-09-12T00:05:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.461+0000 7fac3541e640 1 -- start start 2024-09-12T00:05:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.461+0000 7fac3541e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac301025e0 0x7fac30197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.461+0000 7fac3541e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac30104f10 0x7fac30198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.461+0000 7fac3541e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac30107840 0x7fac3019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.461+0000 7fac3541e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fac3010d700 con 0x7fac30107840 2024-09-12T00:05:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.461+0000 7fac3541e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fac3010d580 con 0x7fac30104f10 2024-09-12T00:05:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.461+0000 7fac3541e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fac3010d880 con 0x7fac301025e0 2024-09-12T00:05:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.461+0000 7fac2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac30107840 0x7fac3019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.461+0000 7fac2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac30107840 0x7fac3019f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34234/0 (socket says 172.21.15.6:34234) 2024-09-12T00:05:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.461+0000 7fac2f7fe640 1 -- 172.21.15.6:0/1287473274 learned_addr learned my addr 172.21.15.6:0/1287473274 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac30104f10 0x7fac30198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac2effd640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac301025e0 0x7fac30197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac2f7fe640 1 -- 172.21.15.6:0/1287473274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac301025e0 msgr2=0x7fac30197cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac2f7fe640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac301025e0 0x7fac30197cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac2f7fe640 1 -- 172.21.15.6:0/1287473274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac30104f10 msgr2=0x7fac30198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac2f7fe640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac30104f10 0x7fac30198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac2f7fe640 1 -- 172.21.15.6:0/1287473274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3019f900 con 0x7fac30107840 2024-09-12T00:05:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac30104f10 0x7fac30198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac2f7fe640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac30107840 0x7fac3019f260 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fac28031040 tx=0x7fac28003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac17fff640 1 -- 172.21.15.6:0/1287473274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28004040 con 0x7fac30107840 2024-09-12T00:05:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac3541e640 1 -- 172.21.15.6:0/1287473274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3019fb90 con 0x7fac30107840 2024-09-12T00:05:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac17fff640 1 -- 172.21.15.6:0/1287473274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac28004690 con 0x7fac30107840 2024-09-12T00:05:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac17fff640 1 -- 172.21.15.6:0/1287473274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2803b410 con 0x7fac30107840 2024-09-12T00:05:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.462+0000 7fac3541e640 1 -- 172.21.15.6:0/1287473274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac301a0130 con 0x7fac30107840 2024-09-12T00:05:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.465+0000 7fac17fff640 1 -- 172.21.15.6:0/1287473274 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fac280305c0 con 0x7fac30107840 2024-09-12T00:05:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.465+0000 7fac37dfd740 1 Processor -- start 2024-09-12T00:05:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.465+0000 7fac37dfd740 1 -- start start 2024-09-12T00:05:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.465+0000 7fac17fff640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fac180a2c00 0x7fac180a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.465+0000 7fac37dfd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e0db0 0x55c5125e11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.465+0000 7fac37dfd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e16f0 0x55c5125e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.465+0000 7fac37dfd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e6780 0x55c5125e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac37dfd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c5125402f0 con 0x55c5125e6780 2024-09-12T00:05:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac37dfd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c5124e8270 con 0x55c5125e0db0 2024-09-12T00:05:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac37dfd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c51253c2b0 con 0x55c5125e16f0 2024-09-12T00:05:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac17fff640 1 -- 172.21.15.6:0/1287473274 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fac280f0ca0 con 0x7fac30107840 2024-09-12T00:05:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e0db0 0x55c5125e11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e6780 0x55c5125e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e0db0 0x55c5125e11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:40806/0 (socket says 172.21.15.6:40806) 2024-09-12T00:05:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2effd640 1 -- 172.21.15.6:0/4123057822 learned_addr learned my addr 172.21.15.6:0/4123057822 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fac180a2c00 0x7fac180a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/4123057822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e16f0 0x55c5125e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2effd640 1 -- 172.21.15.6:0/4123057822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e16f0 msgr2=0x55c5125e61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2effd640 1 --2- 172.21.15.6:0/4123057822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e16f0 0x55c5125e61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2effd640 1 -- 172.21.15.6:0/4123057822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e6780 msgr2=0x55c5125e8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2effd640 1 --2- 172.21.15.6:0/4123057822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e6780 0x55c5125e8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2effd640 1 -- 172.21.15.6:0/4123057822 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5124e7340 con 0x55c5125e0db0 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fac180a2c00 0x7fac180a50c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55c5125e2120 tx=0x7fac2400a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.466+0000 7fac2effd640 1 --2- 172.21.15.6:0/4123057822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e0db0 0x55c5125e11b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac2000ac80 tx=0x7fac2000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=948dc43afc674dfa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.467+0000 7fac157fa640 1 -- 172.21.15.6:0/4123057822 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2001d070 con 0x55c5125e0db0 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.467+0000 7fac157fa640 1 -- 172.21.15.6:0/4123057822 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac20018af0 con 0x55c5125e0db0 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.467+0000 7fac157fa640 1 -- 172.21.15.6:0/4123057822 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20010aa0 con 0x55c5125e0db0 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.467+0000 7fac37dfd740 1 -- 172.21.15.6:0/4123057822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e0db0 msgr2=0x55c5125e11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.467+0000 7fac37dfd740 1 --2- 172.21.15.6:0/4123057822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e0db0 0x55c5125e11b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac2000ac80 tx=0x7fac2000f790 comp rx=0 tx=0).stop 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.467+0000 7fac37dfd740 1 -- 172.21.15.6:0/4123057822 shutdown_connections 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.467+0000 7fac37dfd740 1 --2- 172.21.15.6:0/4123057822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e6780 0x55c5125e8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.467+0000 7fac37dfd740 1 --2- 172.21.15.6:0/4123057822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e16f0 0x55c5125e61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.467+0000 7fac37dfd740 1 --2- 172.21.15.6:0/4123057822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e0db0 0x55c5125e11b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.467+0000 7fac37dfd740 1 -- 172.21.15.6:0/4123057822 >> 172.21.15.6:0/4123057822 conn(0x55c5125d8010 msgr2=0x55c5125d8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.467+0000 7fac37dfd740 1 -- 172.21.15.6:0/4123057822 shutdown_connections 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.467+0000 7fac37dfd740 1 -- 172.21.15.6:0/4123057822 wait complete. 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac37dfd740 1 -- start start 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac37dfd740 1 Processor -- start 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac37dfd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 0x55c5125eb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac37dfd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e16f0 0x55c5125eb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac37dfd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e6780 0x55c5125f2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac37dfd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c5125e9750 con 0x55c5125e0db0 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac37dfd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c5124c9290 con 0x55c5125e16f0 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac37dfd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c5125e98d0 con 0x55c5125e6780 2024-09-12T00:05:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac37dfd740 10 client.0 _ll_register_callbacks cb 0x55c5124fa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac2effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 0x55c5125eb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac2effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 0x55c5125eb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34240/0 (socket says 172.21.15.6:34240) 2024-09-12T00:05:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac2effd640 1 -- 172.21.15.6:0/4243898803 learned_addr learned my addr 172.21.15.6:0/4243898803 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.468+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e16f0 0x55c5125eb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac2f7fe640 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e6780 0x55c5125f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac2effd640 1 -- 172.21.15.6:0/4243898803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e6780 msgr2=0x55c5125f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac2effd640 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e6780 0x55c5125f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac2effd640 1 -- 172.21.15.6:0/4243898803 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e16f0 msgr2=0x55c5125eb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac2effd640 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e16f0 0x55c5125eb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac2effd640 1 -- 172.21.15.6:0/4243898803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c512253210 con 0x55c5125e0db0 2024-09-12T00:05:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac2f7fe640 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e6780 0x55c5125f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e16f0 0x55c5125eb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac2effd640 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 0x55c5125eb000 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fac2000a560 tx=0x7fac20010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50507994e57bbd0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac12ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac12ff5640 1 -- 172.21.15.6:0/4243898803 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20027020 con 0x55c5125e0db0 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac12ff5640 1 -- 172.21.15.6:0/4243898803 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fac20005040 con 0x55c5125e0db0 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac37dfd740 1 -- 172.21.15.6:0/4243898803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac20018af0 con 0x55c5125e0db0 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac12ff5640 1 -- 172.21.15.6:0/4243898803 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fac20032050 con 0x55c5125e0db0 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac37dfd740 10 client.15810 fetch_fsmap learned FSMap version 33 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.469+0000 7fac37dfd740 1 -- 172.21.15.6:0/4243898803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c51231f620 con 0x55c5125e0db0 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.470+0000 7fac12ff5640 1 -- 172.21.15.6:0/4243898803 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac20018af0 con 0x55c5125e0db0 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.470+0000 7fac12ff5640 1 -- 172.21.15.6:0/4243898803 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fac200046c0 con 0x55c5125e0db0 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.470+0000 7fac37dfd740 10 client.15810 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:05:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.470+0000 7fac37dfd740 10 client.15810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:05:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.470+0000 7fac37dfd740 20 client.15810 populate_metadata read hostname 'smithi006' 2024-09-12T00:05:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.470+0000 7fac37dfd740 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55c5125f6990 0x55c5125f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.470+0000 7fac37dfd740 4 client.15810 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.470+0000 7fac37dfd740 1 -- 172.21.15.6:0/4243898803 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c51254da20 con 0x55c5125f6990 2024-09-12T00:05:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.470+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55c5125f6990 0x55c5125f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.471+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55c5125f6990 0x55c5125f8dd0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d6345694b3979fb server_cookie=bf0187807ecabdc2 in_seq=0 out_seq=0 2024-09-12T00:05:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.471+0000 7fac12ff5640 10 client.15810 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:08.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.471+0000 7fac12ff5640 1 -- 172.21.15.6:0/4243898803 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c51254da20 con 0x55c5125f6990 2024-09-12T00:05:08.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.471+0000 7fac12ff5640 10 client.15810 handle_command_reply: tid=0 2024-09-12T00:05:08.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.471+0000 7fac37dfd740 1 client.15810 shutdown 2024-09-12T00:05:08.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.472+0000 7fac37dfd740 1 -- 172.21.15.6:0/4243898803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 msgr2=0x55c5125eb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.472+0000 7fac37dfd740 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 0x55c5125eb000 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fac2000a560 tx=0x7fac20010430 comp rx=0 tx=0).stop 2024-09-12T00:05:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.472+0000 7fac37dfd740 1 -- 172.21.15.6:0/4243898803 shutdown_connections 2024-09-12T00:05:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.472+0000 7fac37dfd740 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55c5125f6990 0x55c5125f8dd0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.472+0000 7fac37dfd740 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e6780 0x55c5125f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.472+0000 7fac37dfd740 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e16f0 0x55c5125eb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.472+0000 7fac12ff5640 0 client.15810 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.472+0000 7fac37dfd740 1 --2- 172.21.15.6:0/4243898803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 0x55c5125eb000 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.472+0000 7fac37dfd740 1 -- 172.21.15.6:0/4243898803 >> 172.21.15.6:0/4243898803 conn(0x55c5125d8010 msgr2=0x55c5125d9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.472+0000 7fac37dfd740 1 -- 172.21.15.6:0/4243898803 shutdown_connections 2024-09-12T00:05:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.472+0000 7fac37dfd740 1 -- 172.21.15.6:0/4243898803 wait complete. 2024-09-12T00:05:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.472+0000 7fac37dfd740 20 client.15810 trim_cache size 0 max 16384 2024-09-12T00:05:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.492+0000 7fac37dfd740 1 Processor -- start 2024-09-12T00:05:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.492+0000 7fac37dfd740 1 -- start start 2024-09-12T00:05:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac37dfd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e0db0 0x55c5125eb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac37dfd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e16f0 0x55c5125f2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac37dfd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e6780 0x55c5125fd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac37dfd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fac301a85f0 con 0x55c5125e16f0 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac37dfd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fac301aa130 con 0x55c5125e6780 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac37dfd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fac301a8cc0 con 0x55c5125e0db0 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac2e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e16f0 0x55c5125f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac2e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e16f0 0x55c5125f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34244/0 (socket says 172.21.15.6:34244) 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac2e7fc640 1 -- 172.21.15.6:0/1144222369 learned_addr learned my addr 172.21.15.6:0/1144222369 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac2effd640 1 --2- 172.21.15.6:0/1144222369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e0db0 0x55c5125eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac2f7fe640 1 --2- 172.21.15.6:0/1144222369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e6780 0x55c5125fd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac2e7fc640 1 -- 172.21.15.6:0/1144222369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e0db0 msgr2=0x55c5125eb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/1144222369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e0db0 0x55c5125eb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac2e7fc640 1 -- 172.21.15.6:0/1144222369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e6780 msgr2=0x55c5125fd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/1144222369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e6780 0x55c5125fd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac2e7fc640 1 -- 172.21.15.6:0/1144222369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5125e2370 con 0x55c5125e16f0 2024-09-12T00:05:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac2effd640 1 --2- 172.21.15.6:0/1144222369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e0db0 0x55c5125eb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/1144222369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e16f0 0x55c5125f2510 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fac2400f960 tx=0x7fac24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494909ad0f11a4c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.493+0000 7fac14ff9640 1 -- 172.21.15.6:0/1144222369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24018070 con 0x55c5125e16f0 2024-09-12T00:05:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.494+0000 7fac14ff9640 1 -- 172.21.15.6:0/1144222369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac2401ed50 con 0x55c5125e16f0 2024-09-12T00:05:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.494+0000 7fac14ff9640 1 -- 172.21.15.6:0/1144222369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac240054d0 con 0x55c5125e16f0 2024-09-12T00:05:08.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.494+0000 7fac37dfd740 1 -- 172.21.15.6:0/1144222369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e16f0 msgr2=0x55c5125f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:08.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.494+0000 7fac37dfd740 1 --2- 172.21.15.6:0/1144222369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e16f0 0x55c5125f2510 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fac2400f960 tx=0x7fac24004730 comp rx=0 tx=0).stop 2024-09-12T00:05:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.494+0000 7fac37dfd740 1 -- 172.21.15.6:0/1144222369 shutdown_connections 2024-09-12T00:05:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.494+0000 7fac37dfd740 1 --2- 172.21.15.6:0/1144222369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e6780 0x55c5125fd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.494+0000 7fac37dfd740 1 --2- 172.21.15.6:0/1144222369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e16f0 0x55c5125f2510 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.494+0000 7fac37dfd740 1 --2- 172.21.15.6:0/1144222369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e0db0 0x55c5125eb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.494+0000 7fac37dfd740 1 -- 172.21.15.6:0/1144222369 >> 172.21.15.6:0/1144222369 conn(0x55c5125d8010 msgr2=0x55c5125d71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.494+0000 7fac37dfd740 1 -- 172.21.15.6:0/1144222369 shutdown_connections 2024-09-12T00:05:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.494+0000 7fac37dfd740 1 -- 172.21.15.6:0/1144222369 wait complete. 2024-09-12T00:05:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac37dfd740 1 -- start start 2024-09-12T00:05:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac37dfd740 1 Processor -- start 2024-09-12T00:05:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac37dfd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 0x55c5125f0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac37dfd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e16f0 0x55c5125f0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac37dfd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e6780 0x55c5125f1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac37dfd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fac301a9a60 con 0x55c5125e0db0 2024-09-12T00:05:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac37dfd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fac301a9390 con 0x55c5125e6780 2024-09-12T00:05:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac37dfd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fac301a65d0 con 0x55c5125e16f0 2024-09-12T00:05:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac37dfd740 10 client.0 _ll_register_callbacks cb 0x7fac2001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac2effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 0x55c5125f0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac2effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 0x55c5125f0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34258/0 (socket says 172.21.15.6:34258) 2024-09-12T00:05:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac2effd640 1 -- 172.21.15.6:0/600862827 learned_addr learned my addr 172.21.15.6:0/600862827 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.495+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e16f0 0x55c5125f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac2f7fe640 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e6780 0x55c5125f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac2effd640 1 -- 172.21.15.6:0/600862827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e16f0 msgr2=0x55c5125f0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac2effd640 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e16f0 0x55c5125f0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac2effd640 1 -- 172.21.15.6:0/600862827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e6780 msgr2=0x55c5125f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac2effd640 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e6780 0x55c5125f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac2effd640 1 -- 172.21.15.6:0/600862827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5125f1f90 con 0x55c5125e0db0 2024-09-12T00:05:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac2f7fe640 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e6780 0x55c5125f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac2effd640 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 0x55c5125f0430 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fac20000c00 tx=0x7fac2000a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b7babee9ad7c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac12ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:05:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac12ff5640 1 -- 172.21.15.6:0/600862827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20027070 con 0x55c5125e0db0 2024-09-12T00:05:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac12ff5640 1 -- 172.21.15.6:0/600862827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fac20018cf0 con 0x55c5125e0db0 2024-09-12T00:05:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac37dfd740 1 -- 172.21.15.6:0/600862827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac2401ed50 con 0x55c5125e0db0 2024-09-12T00:05:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac12ff5640 1 -- 172.21.15.6:0/600862827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fac2001d040 con 0x55c5125e0db0 2024-09-12T00:05:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac37dfd740 10 client.15816 fetch_fsmap learned FSMap version 33 2024-09-12T00:05:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac37dfd740 1 -- 172.21.15.6:0/600862827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c512661f20 con 0x55c5125e0db0 2024-09-12T00:05:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.496+0000 7fac12ff5640 1 -- 172.21.15.6:0/600862827 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac2401ed50 con 0x55c5125e0db0 2024-09-12T00:05:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.497+0000 7fac12ff5640 1 -- 172.21.15.6:0/600862827 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fac20004d00 con 0x55c5125e0db0 2024-09-12T00:05:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.497+0000 7fac37dfd740 10 client.15816 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:05:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.497+0000 7fac37dfd740 10 client.15816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:05:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.497+0000 7fac37dfd740 20 client.15816 populate_metadata read hostname 'smithi006' 2024-09-12T00:05:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.497+0000 7fac37dfd740 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55c5126628c0 0x55c512664cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.497+0000 7fac37dfd740 4 client.15816 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:05:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.497+0000 7fac37dfd740 1 -- 172.21.15.6:0/600862827 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c512547d70 con 0x55c5126628c0 2024-09-12T00:05:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.497+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55c5126628c0 0x55c512664cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.498+0000 7fac12ff5640 10 client.15816 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.498+0000 7fac2e7fc640 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55c5126628c0 0x55c512664cb0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1747d7ec7e7bb76 server_cookie=4f63a10fee3916a8 in_seq=0 out_seq=0 2024-09-12T00:05:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac12ff5640 1 -- 172.21.15.6:0/600862827 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c512547d70 con 0x55c5126628c0 2024-09-12T00:05:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac12ff5640 10 client.15816 handle_command_reply: tid=0 2024-09-12T00:05:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac37dfd740 1 client.15816 shutdown 2024-09-12T00:05:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac37dfd740 1 -- 172.21.15.6:0/600862827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 msgr2=0x55c5125f0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac37dfd740 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 0x55c5125f0430 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fac20000c00 tx=0x7fac2000a840 comp rx=0 tx=0).stop 2024-09-12T00:05:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac37dfd740 1 -- 172.21.15.6:0/600862827 shutdown_connections 2024-09-12T00:05:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac37dfd740 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c5125e6780 0x55c5125f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac37dfd740 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55c5126628c0 0x55c512664cb0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac37dfd740 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c5125e16f0 0x55c5125f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac37dfd740 1 --2- 172.21.15.6:0/600862827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c5125e0db0 0x55c5125f0430 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac12ff5640 0 client.15816 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac37dfd740 1 -- 172.21.15.6:0/600862827 >> 172.21.15.6:0/600862827 conn(0x55c5125d8010 msgr2=0x55c5125d71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac37dfd740 1 -- 172.21.15.6:0/600862827 shutdown_connections 2024-09-12T00:05:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac37dfd740 1 -- 172.21.15.6:0/600862827 wait complete. 2024-09-12T00:05:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.515+0000 7fac37dfd740 20 client.15816 trim_cache size 0 max 16384 2024-09-12T00:05:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:05:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:05:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:05:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:05:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.516+0000 7fac3541e640 1 -- 172.21.15.6:0/1287473274 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fac180a2c00 msgr2=0x7fac180a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.516+0000 7fac3541e640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fac180a2c00 0x7fac180a50c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55c5125e2120 tx=0x7fac2400a590 comp rx=0 tx=0).stop 2024-09-12T00:05:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.516+0000 7fac3541e640 1 -- 172.21.15.6:0/1287473274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac30107840 msgr2=0x7fac3019f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.516+0000 7fac3541e640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac30107840 0x7fac3019f260 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fac28031040 tx=0x7fac28003c10 comp rx=0 tx=0).stop 2024-09-12T00:05:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.516+0000 7fac3541e640 1 -- 172.21.15.6:0/1287473274 shutdown_connections 2024-09-12T00:05:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.516+0000 7fac3541e640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fac180a2c00 0x7fac180a50c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.516+0000 7fac3541e640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac30107840 0x7fac3019f260 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.516+0000 7fac3541e640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac30104f10 0x7fac30198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.516+0000 7fac3541e640 1 --2- 172.21.15.6:0/1287473274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac301025e0 0x7fac30197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.516+0000 7fac3541e640 1 -- 172.21.15.6:0/1287473274 >> 172.21.15.6:0/1287473274 conn(0x7fac300fc1c0 msgr2=0x7fac30102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.516+0000 7fac3541e640 1 -- 172.21.15.6:0/1287473274 shutdown_connections 2024-09-12T00:05:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:08.516+0000 7fac3541e640 1 -- 172.21.15.6:0/1287473274 wait complete. 2024-09-12T00:05:08.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:08 smithi039 ceph-mon[34543]: pgmap v533: 129 pgs: 129 active+clean; 6.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:05:08.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:08 smithi006 ceph-mon[30947]: pgmap v533: 129 pgs: 129 active+clean; 6.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:05:08.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:08 smithi134 ceph-mon[34893]: pgmap v533: 129 pgs: 129 active+clean; 6.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:05:10.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:10 smithi006 ceph-mon[30947]: pgmap v534: 129 pgs: 129 active+clean; 6.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:05:10.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:10 smithi134 ceph-mon[34893]: pgmap v534: 129 pgs: 129 active+clean; 6.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:05:11.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:10 smithi039 ceph-mon[34543]: pgmap v534: 129 pgs: 129 active+clean; 6.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:05:12.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:12 smithi006 ceph-mon[30947]: pgmap v535: 129 pgs: 129 active+clean; 6.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 MiB/s wr, 26 op/s 2024-09-12T00:05:12.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:12 smithi134 ceph-mon[34893]: pgmap v535: 129 pgs: 129 active+clean; 6.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 MiB/s wr, 26 op/s 2024-09-12T00:05:13.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:12 smithi039 ceph-mon[34543]: pgmap v535: 129 pgs: 129 active+clean; 6.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 MiB/s wr, 26 op/s 2024-09-12T00:05:14.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:14 smithi006 ceph-mon[30947]: pgmap v536: 129 pgs: 129 active+clean; 6.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-12T00:05:14.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:14 smithi134 ceph-mon[34893]: pgmap v536: 129 pgs: 129 active+clean; 6.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-12T00:05:15.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:14 smithi039 ceph-mon[34543]: pgmap v536: 129 pgs: 129 active+clean; 6.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-12T00:05:16.846 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:16 smithi039 ceph-mon[34543]: pgmap v537: 129 pgs: 129 active+clean; 6.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:05:16.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:16 smithi006 ceph-mon[30947]: pgmap v537: 129 pgs: 129 active+clean; 6.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:05:16.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:16 smithi134 ceph-mon[34893]: pgmap v537: 129 pgs: 129 active+clean; 6.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:05:18.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:18 smithi006 ceph-mon[30947]: pgmap v538: 129 pgs: 129 active+clean; 7.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:05:18.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:18 smithi134 ceph-mon[34893]: pgmap v538: 129 pgs: 129 active+clean; 7.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:05:19.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:18 smithi039 ceph-mon[34543]: pgmap v538: 129 pgs: 129 active+clean; 7.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:05:20.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:20 smithi006 ceph-mon[30947]: pgmap v539: 129 pgs: 129 active+clean; 7.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:05:20.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:20 smithi134 ceph-mon[34893]: pgmap v539: 129 pgs: 129 active+clean; 7.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:05:21.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:20 smithi039 ceph-mon[34543]: pgmap v539: 129 pgs: 129 active+clean; 7.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:05:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.629+0000 7fbdad3b9640 1 -- 172.21.15.6:0/3103153032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda81025f0 msgr2=0x7fbda8108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.629+0000 7fbdad3b9640 1 --2- 172.21.15.6:0/3103153032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda81025f0 0x7fbda8108e80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009900 tx=0x7fbda002a410 comp rx=0 tx=0).stop 2024-09-12T00:05:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.629+0000 7fbdad3b9640 1 -- 172.21.15.6:0/3103153032 shutdown_connections 2024-09-12T00:05:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.629+0000 7fbdad3b9640 1 --2- 172.21.15.6:0/3103153032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda81025f0 0x7fbda8108e80 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.629+0000 7fbdad3b9640 1 --2- 172.21.15.6:0/3103153032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda8101c30 0x7fbda81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.629+0000 7fbdad3b9640 1 --2- 172.21.15.6:0/3103153032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbda8100a40 0x7fbda8100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.629+0000 7fbdad3b9640 1 -- 172.21.15.6:0/3103153032 >> 172.21.15.6:0/3103153032 conn(0x7fbda80fc1c0 msgr2=0x7fbda80fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.629+0000 7fbdad3b9640 1 -- 172.21.15.6:0/3103153032 shutdown_connections 2024-09-12T00:05:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.629+0000 7fbdad3b9640 1 -- 172.21.15.6:0/3103153032 wait complete. 2024-09-12T00:05:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.629+0000 7fbdad3b9640 1 Processor -- start 2024-09-12T00:05:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.629+0000 7fbdad3b9640 1 -- start start 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbdad3b9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda8100a40 0x7fbda8197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbdad3b9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbda8101c30 0x7fbda81982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbdad3b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda81025f0 0x7fbda819f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbdad3b9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbda810c570 con 0x7fbda8100a40 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbdad3b9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbda810c3f0 con 0x7fbda8101c30 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbdad3b9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbda810c6f0 con 0x7fbda81025f0 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbda6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda8100a40 0x7fbda8197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbda6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda8100a40 0x7fbda8197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58716/0 (socket says 172.21.15.6:58716) 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbda6ffd640 1 -- 172.21.15.6:0/2691217310 learned_addr learned my addr 172.21.15.6:0/2691217310 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbda77fe640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda81025f0 0x7fbda819f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbd9ffff640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbda8101c30 0x7fbda81982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbda6ffd640 1 -- 172.21.15.6:0/2691217310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda81025f0 msgr2=0x7fbda819f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda81025f0 0x7fbda819f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbda6ffd640 1 -- 172.21.15.6:0/2691217310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbda8101c30 msgr2=0x7fbda81982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbda8101c30 0x7fbda81982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.630+0000 7fbda6ffd640 1 -- 172.21.15.6:0/2691217310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda819f990 con 0x7fbda8100a40 2024-09-12T00:05:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.631+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda8100a40 0x7fbda8197d70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009fd0 tx=0x7fbd9800c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.631+0000 7fbda4ff9640 1 -- 172.21.15.6:0/2691217310 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98011470 con 0x7fbda8100a40 2024-09-12T00:05:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.631+0000 7fbdad3b9640 1 -- 172.21.15.6:0/2691217310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda8102eb0 con 0x7fbda8100a40 2024-09-12T00:05:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.631+0000 7fbda4ff9640 1 -- 172.21.15.6:0/2691217310 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd98011ac0 con 0x7fbda8100a40 2024-09-12T00:05:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.631+0000 7fbda4ff9640 1 -- 172.21.15.6:0/2691217310 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98011470 con 0x7fbda8100a40 2024-09-12T00:05:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.631+0000 7fbdad3b9640 1 -- 172.21.15.6:0/2691217310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda8103450 con 0x7fbda8100a40 2024-09-12T00:05:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.633+0000 7fbda4ff9640 1 -- 172.21.15.6:0/2691217310 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fbd98011c70 con 0x7fbda8100a40 2024-09-12T00:05:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.634+0000 7fbdb0228740 1 Processor -- start 2024-09-12T00:05:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.634+0000 7fbdb0228740 1 -- start start 2024-09-12T00:05:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.634+0000 7fbda4ff9640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbd940a2d80 0x7fbd940a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.634+0000 7fbda4ff9640 1 -- 172.21.15.6:0/2691217310 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fbd980cf5f0 con 0x7fbda8100a40 2024-09-12T00:05:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.634+0000 7fbda77fe640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbd940a2d80 0x7fbd940a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.634+0000 7fbdb0228740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 0x5648924e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.634+0000 7fbdb0228740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 0x5648924eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.634+0000 7fbdb0228740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924ef370 0x5648924f1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbdb0228740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56489244d2f0 con 0x5648924e99a0 2024-09-12T00:05:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbdb0228740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5648923f5270 con 0x5648924ef370 2024-09-12T00:05:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbdb0228740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5648924492b0 con 0x5648924ea2e0 2024-09-12T00:05:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbda6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 0x5648924e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbda6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 0x5648924e9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58722/0 (socket says 172.21.15.6:58722) 2024-09-12T00:05:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbda6ffd640 1 -- 172.21.15.6:0/2410414594 learned_addr learned my addr 172.21.15.6:0/2410414594 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbd9ffff640 1 --2- 172.21.15.6:0/2410414594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 0x5648924eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbda77fe640 1 --2- 172.21.15.6:0/2410414594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924ef370 0x5648924f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbda6ffd640 1 -- 172.21.15.6:0/2410414594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 msgr2=0x5648924eeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2410414594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 0x5648924eeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbda6ffd640 1 -- 172.21.15.6:0/2410414594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924ef370 msgr2=0x5648924f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2410414594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924ef370 0x5648924f1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbda6ffd640 1 -- 172.21.15.6:0/2410414594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648923f4340 con 0x5648924e99a0 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbda77fe640 1 --2- 172.21.15.6:0/2410414594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924ef370 0x5648924f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbda77fe640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbd940a2d80 0x7fbd940a5240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbda0006010 tx=0x7fbda0009640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2410414594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 0x5648924e9da0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbd98097ec0 tx=0x7fbd9809b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d052f380ab4b48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.635+0000 7fbd9d7fa640 1 -- 172.21.15.6:0/2410414594 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd980b4070 con 0x5648924e99a0 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.636+0000 7fbd9d7fa640 1 -- 172.21.15.6:0/2410414594 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd9809fe10 con 0x5648924e99a0 2024-09-12T00:05:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.636+0000 7fbd9d7fa640 1 -- 172.21.15.6:0/2410414594 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9809aeb0 con 0x5648924e99a0 2024-09-12T00:05:21.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.636+0000 7fbdb0228740 1 -- 172.21.15.6:0/2410414594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 msgr2=0x5648924e9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:21.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.636+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2410414594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 0x5648924e9da0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbd98097ec0 tx=0x7fbd9809b480 comp rx=0 tx=0).stop 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.636+0000 7fbdb0228740 1 -- 172.21.15.6:0/2410414594 shutdown_connections 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.636+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2410414594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924ef370 0x5648924f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.636+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2410414594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 0x5648924eeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.636+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2410414594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 0x5648924e9da0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.636+0000 7fbdb0228740 1 -- 172.21.15.6:0/2410414594 >> 172.21.15.6:0/2410414594 conn(0x5648924e5010 msgr2=0x5648924e5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.636+0000 7fbdb0228740 1 -- 172.21.15.6:0/2410414594 shutdown_connections 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.636+0000 7fbdb0228740 1 -- 172.21.15.6:0/2410414594 wait complete. 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbdb0228740 1 -- start start 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbdb0228740 1 Processor -- start 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbdb0228740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924e99a0 0x5648924f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbdb0228740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 0x5648924f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbdb0228740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ef370 0x5648924fb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbdb0228740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5648924f2340 con 0x5648924ef370 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbdb0228740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5648923d6290 con 0x5648924e99a0 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbdb0228740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5648924f24c0 con 0x5648924ea2e0 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbdb0228740 10 client.0 _ll_register_callbacks cb 0x564892407140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbda77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ef370 0x5648924fb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbda77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ef370 0x5648924fb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58728/0 (socket says 172.21.15.6:58728) 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbda77fe640 1 -- 172.21.15.6:0/2614749 learned_addr learned my addr 172.21.15.6:0/2614749 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.637+0000 7fbd9ffff640 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 0x5648924f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924e99a0 0x5648924f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbda77fe640 1 -- 172.21.15.6:0/2614749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 msgr2=0x5648924f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbda77fe640 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 0x5648924f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbda77fe640 1 -- 172.21.15.6:0/2614749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924e99a0 msgr2=0x5648924f3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbda77fe640 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924e99a0 0x5648924f3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbda77fe640 1 -- 172.21.15.6:0/2614749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564892160210 con 0x5648924ef370 2024-09-12T00:05:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924e99a0 0x5648924f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbda77fe640 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ef370 0x5648924fb1e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbda0033000 tx=0x7fbda002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0f2cdb9e59a83c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbd8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbd8e7fc640 1 -- 172.21.15.6:0/2614749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0035050 con 0x5648924ef370 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbd8e7fc640 1 -- 172.21.15.6:0/2614749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fbda00035f0 con 0x5648924ef370 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbdb0228740 1 -- 172.21.15.6:0/2614749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd9809fe10 con 0x5648924ef370 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbd8e7fc640 1 -- 172.21.15.6:0/2614749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbda0059050 con 0x5648924ef370 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbdb0228740 10 client.15828 fetch_fsmap learned FSMap version 33 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbdb0228740 1 -- 172.21.15.6:0/2614749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56489222c620 con 0x5648924ef370 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.638+0000 7fbd8e7fc640 1 -- 172.21.15.6:0/2614749 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd9809fe10 con 0x5648924ef370 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.639+0000 7fbd8e7fc640 1 -- 172.21.15.6:0/2614749 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fbda004ba20 con 0x5648924ef370 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.639+0000 7fbdb0228740 10 client.15828 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.639+0000 7fbdb0228740 10 client.15828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:05:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.639+0000 7fbdb0228740 20 client.15828 populate_metadata read hostname 'smithi006' 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.639+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5648924ff8b0 0x564892501ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.639+0000 7fbdb0228740 4 client.15828 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.639+0000 7fbdb0228740 1 -- 172.21.15.6:0/2614749 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56489245aa20 con 0x5648924ff8b0 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.639+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5648924ff8b0 0x564892501ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.640+0000 7fbd8e7fc640 10 client.15828 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.640+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5648924ff8b0 0x564892501ce0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=646d6ce2065ace96 server_cookie=9b8644afa9f855f3 in_seq=0 out_seq=0 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.640+0000 7fbd8e7fc640 1 -- 172.21.15.6:0/2614749 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56489245aa20 con 0x5648924ff8b0 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.640+0000 7fbd8e7fc640 10 client.15828 handle_command_reply: tid=0 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.640+0000 7fbdb0228740 1 client.15828 shutdown 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.641+0000 7fbdb0228740 1 -- 172.21.15.6:0/2614749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ef370 msgr2=0x5648924fb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.641+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ef370 0x5648924fb1e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbda0033000 tx=0x7fbda002a410 comp rx=0 tx=0).stop 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.641+0000 7fbdb0228740 1 -- 172.21.15.6:0/2614749 shutdown_connections 2024-09-12T00:05:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.641+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ef370 0x5648924fb1e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.641+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5648924ff8b0 0x564892501ce0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.641+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 0x5648924f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.641+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2614749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924e99a0 0x5648924f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.641+0000 7fbd8e7fc640 0 client.15828 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:21.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.641+0000 7fbdb0228740 1 -- 172.21.15.6:0/2614749 >> 172.21.15.6:0/2614749 conn(0x5648924e5010 msgr2=0x5648924e6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:21.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.641+0000 7fbdb0228740 1 -- 172.21.15.6:0/2614749 shutdown_connections 2024-09-12T00:05:21.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.641+0000 7fbdb0228740 1 -- 172.21.15.6:0/2614749 wait complete. 2024-09-12T00:05:21.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.641+0000 7fbdb0228740 20 client.15828 trim_cache size 0 max 16384 2024-09-12T00:05:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.661+0000 7fbdb0228740 1 Processor -- start 2024-09-12T00:05:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.661+0000 7fbdb0228740 1 -- start start 2024-09-12T00:05:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.661+0000 7fbdb0228740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 0x5648924e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.661+0000 7fbdb0228740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 0x5648924fb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.661+0000 7fbdb0228740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924ef370 0x5648924e6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.661+0000 7fbdb0228740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81a86b0 con 0x5648924e99a0 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.661+0000 7fbdb0228740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81aa1f0 con 0x5648924ef370 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.661+0000 7fbdb0228740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81a8d80 con 0x5648924ea2e0 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbda6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 0x5648924e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbda6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 0x5648924e5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58738/0 (socket says 172.21.15.6:58738) 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbda6ffd640 1 -- 172.21.15.6:0/3135661660 learned_addr learned my addr 172.21.15.6:0/3135661660 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbda77fe640 1 --2- 172.21.15.6:0/3135661660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924ef370 0x5648924e6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbd9ffff640 1 --2- 172.21.15.6:0/3135661660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 0x5648924fb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbda6ffd640 1 -- 172.21.15.6:0/3135661660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 msgr2=0x5648924fb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/3135661660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 0x5648924fb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbda6ffd640 1 -- 172.21.15.6:0/3135661660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924ef370 msgr2=0x5648924e6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/3135661660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924ef370 0x5648924e6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbda6ffd640 1 -- 172.21.15.6:0/3135661660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648924f1760 con 0x5648924e99a0 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/3135661660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 0x5648924e5ec0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbd98000f80 tx=0x7fbd9809bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf9cbf553975aae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbd9cff9640 1 -- 172.21.15.6:0/3135661660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd980b8070 con 0x5648924e99a0 2024-09-12T00:05:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbd9cff9640 1 -- 172.21.15.6:0/3135661660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd9809fe10 con 0x5648924e99a0 2024-09-12T00:05:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.662+0000 7fbd9cff9640 1 -- 172.21.15.6:0/3135661660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd980b4040 con 0x5648924e99a0 2024-09-12T00:05:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.663+0000 7fbdb0228740 1 -- 172.21.15.6:0/3135661660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 msgr2=0x5648924e5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.663+0000 7fbdb0228740 1 --2- 172.21.15.6:0/3135661660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 0x5648924e5ec0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbd98000f80 tx=0x7fbd9809bba0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.663+0000 7fbdb0228740 1 -- 172.21.15.6:0/3135661660 shutdown_connections 2024-09-12T00:05:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.663+0000 7fbdb0228740 1 --2- 172.21.15.6:0/3135661660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924ef370 0x5648924e6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.663+0000 7fbdb0228740 1 --2- 172.21.15.6:0/3135661660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ea2e0 0x5648924fb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.663+0000 7fbdb0228740 1 --2- 172.21.15.6:0/3135661660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924e99a0 0x5648924e5ec0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.663+0000 7fbdb0228740 1 -- 172.21.15.6:0/3135661660 >> 172.21.15.6:0/3135661660 conn(0x5648924e5010 msgr2=0x5648924f3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.663+0000 7fbdb0228740 1 -- 172.21.15.6:0/3135661660 shutdown_connections 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.663+0000 7fbdb0228740 1 -- 172.21.15.6:0/3135661660 wait complete. 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.663+0000 7fbdb0228740 1 -- start start 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbdb0228740 1 Processor -- start 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbdb0228740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924e99a0 0x5648924f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbdb0228740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ea2e0 0x5648924f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbdb0228740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ef370 0x5648924f9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbdb0228740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81a9b20 con 0x5648924ea2e0 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbdb0228740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81a9450 con 0x5648924e99a0 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbdb0228740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81a6690 con 0x5648924ef370 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbdb0228740 10 client.0 _ll_register_callbacks cb 0x7fbda0009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbd9ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ea2e0 0x5648924f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbd9ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ea2e0 0x5648924f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58742/0 (socket says 172.21.15.6:58742) 2024-09-12T00:05:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbd9ffff640 1 -- 172.21.15.6:0/2883768842 learned_addr learned my addr 172.21.15.6:0/2883768842 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924e99a0 0x5648924f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbda77fe640 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ef370 0x5648924f9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbd9ffff640 1 -- 172.21.15.6:0/2883768842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ef370 msgr2=0x5648924f9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbd9ffff640 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ef370 0x5648924f9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbd9ffff640 1 -- 172.21.15.6:0/2883768842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924e99a0 msgr2=0x5648924f8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbd9ffff640 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924e99a0 0x5648924f8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbd9ffff640 1 -- 172.21.15.6:0/2883768842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648924fa570 con 0x5648924ea2e0 2024-09-12T00:05:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbda77fe640 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ef370 0x5648924f9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.664+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924e99a0 0x5648924f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbd9ffff640 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ea2e0 0x5648924f8f50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbd90005fd0 tx=0x7fbd90003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4dffa0ce5ba533 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbd8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbd8e7fc640 1 -- 172.21.15.6:0/2883768842 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd90021070 con 0x5648924ea2e0 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbd8e7fc640 1 -- 172.21.15.6:0/2883768842 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fbd9001bca0 con 0x5648924ea2e0 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbdb0228740 1 -- 172.21.15.6:0/2883768842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd9809fe10 con 0x5648924ea2e0 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbd8e7fc640 1 -- 172.21.15.6:0/2883768842 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbd9002e050 con 0x5648924ea2e0 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbdb0228740 10 client.15834 fetch_fsmap learned FSMap version 33 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbdb0228740 1 -- 172.21.15.6:0/2883768842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56489256a7b0 con 0x5648924ea2e0 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbd8e7fc640 1 -- 172.21.15.6:0/2883768842 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd9809fe10 con 0x5648924ea2e0 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbd8e7fc640 1 -- 172.21.15.6:0/2883768842 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fbd90004a30 con 0x5648924ea2e0 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbdb0228740 10 client.15834 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbdb0228740 10 client.15834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.665+0000 7fbdb0228740 20 client.15834 populate_metadata read hostname 'smithi006' 2024-09-12T00:05:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.666+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56489256b1c0 0x56489256d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:21.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.666+0000 7fbdb0228740 4 client.15834 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:05:21.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.666+0000 7fbdb0228740 1 -- 172.21.15.6:0/2883768842 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564892454d70 con 0x56489256b1c0 2024-09-12T00:05:21.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.666+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56489256b1c0 0x56489256d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:21.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.666+0000 7fbda6ffd640 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56489256b1c0 0x56489256d5e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aa06f742b6aed45 server_cookie=6ccd35a5f5c72bd5 in_seq=0 out_seq=0 2024-09-12T00:05:21.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.666+0000 7fbd8e7fc640 10 client.15834 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbd8e7fc640 1 -- 172.21.15.6:0/2883768842 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564892454d70 con 0x56489256b1c0 2024-09-12T00:05:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbd8e7fc640 10 client.15834 handle_command_reply: tid=0 2024-09-12T00:05:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbdb0228740 1 client.15834 shutdown 2024-09-12T00:05:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbdb0228740 1 -- 172.21.15.6:0/2883768842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ea2e0 msgr2=0x5648924f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ea2e0 0x5648924f8f50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbd90005fd0 tx=0x7fbd90003d00 comp rx=0 tx=0).stop 2024-09-12T00:05:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbdb0228740 1 -- 172.21.15.6:0/2883768842 shutdown_connections 2024-09-12T00:05:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56489256b1c0 0x56489256d5e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648924ef370 0x5648924f9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbd8e7fc640 0 client.15834 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648924ea2e0 0x5648924f8f50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbdb0228740 1 --2- 172.21.15.6:0/2883768842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648924e99a0 0x5648924f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbdb0228740 1 -- 172.21.15.6:0/2883768842 >> 172.21.15.6:0/2883768842 conn(0x5648924e5010 msgr2=0x5648924f3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbdb0228740 1 -- 172.21.15.6:0/2883768842 shutdown_connections 2024-09-12T00:05:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbdb0228740 1 -- 172.21.15.6:0/2883768842 wait complete. 2024-09-12T00:05:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.683+0000 7fbdb0228740 20 client.15834 trim_cache size 0 max 16384 2024-09-12T00:05:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:05:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:05:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:05:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:05:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.684+0000 7fbdad3b9640 1 -- 172.21.15.6:0/2691217310 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbd940a2d80 msgr2=0x7fbd940a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.684+0000 7fbdad3b9640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbd940a2d80 0x7fbd940a5240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbda0006010 tx=0x7fbda0009640 comp rx=0 tx=0).stop 2024-09-12T00:05:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.684+0000 7fbdad3b9640 1 -- 172.21.15.6:0/2691217310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda8100a40 msgr2=0x7fbda8197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.684+0000 7fbdad3b9640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda8100a40 0x7fbda8197d70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009fd0 tx=0x7fbd9800c270 comp rx=0 tx=0).stop 2024-09-12T00:05:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.684+0000 7fbdad3b9640 1 -- 172.21.15.6:0/2691217310 shutdown_connections 2024-09-12T00:05:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.684+0000 7fbdad3b9640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fbd940a2d80 0x7fbd940a5240 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.684+0000 7fbdad3b9640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda81025f0 0x7fbda819f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.684+0000 7fbdad3b9640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbda8101c30 0x7fbda81982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.684+0000 7fbdad3b9640 1 --2- 172.21.15.6:0/2691217310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda8100a40 0x7fbda8197d70 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.684+0000 7fbdad3b9640 1 -- 172.21.15.6:0/2691217310 >> 172.21.15.6:0/2691217310 conn(0x7fbda80fc1c0 msgr2=0x7fbda8069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.684+0000 7fbdad3b9640 1 -- 172.21.15.6:0/2691217310 shutdown_connections 2024-09-12T00:05:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:21.684+0000 7fbdad3b9640 1 -- 172.21.15.6:0/2691217310 wait complete. 2024-09-12T00:05:22.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:22 smithi006 ceph-mon[30947]: pgmap v540: 129 pgs: 129 active+clean; 7.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:05:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:22 smithi134 ceph-mon[34893]: pgmap v540: 129 pgs: 129 active+clean; 7.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:05:23.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:22 smithi039 ceph-mon[34543]: pgmap v540: 129 pgs: 129 active+clean; 7.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:05:24.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:24 smithi006 ceph-mon[30947]: pgmap v541: 129 pgs: 129 active+clean; 7.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-09-12T00:05:24.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:24 smithi134 ceph-mon[34893]: pgmap v541: 129 pgs: 129 active+clean; 7.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-09-12T00:05:25.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:24 smithi039 ceph-mon[34543]: pgmap v541: 129 pgs: 129 active+clean; 7.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-09-12T00:05:26.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:26 smithi006 ceph-mon[30947]: pgmap v542: 129 pgs: 129 active+clean; 7.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:05:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:26 smithi134 ceph-mon[34893]: pgmap v542: 129 pgs: 129 active+clean; 7.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:05:27.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:26 smithi039 ceph-mon[34543]: pgmap v542: 129 pgs: 129 active+clean; 7.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:05:28.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:28 smithi006 ceph-mon[30947]: pgmap v543: 129 pgs: 129 active+clean; 7.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:05:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:28 smithi134 ceph-mon[34893]: pgmap v543: 129 pgs: 129 active+clean; 7.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:05:29.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:28 smithi039 ceph-mon[34543]: pgmap v543: 129 pgs: 129 active+clean; 7.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:05:30.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:30 smithi006 ceph-mon[30947]: pgmap v544: 129 pgs: 129 active+clean; 7.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:05:30.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:30 smithi134 ceph-mon[34893]: pgmap v544: 129 pgs: 129 active+clean; 7.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:05:31.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:30 smithi039 ceph-mon[34543]: pgmap v544: 129 pgs: 129 active+clean; 7.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:05:32.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:32 smithi006 ceph-mon[30947]: pgmap v545: 129 pgs: 129 active+clean; 7.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:05:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:32 smithi134 ceph-mon[34893]: pgmap v545: 129 pgs: 129 active+clean; 7.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:05:33.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:32 smithi039 ceph-mon[34543]: pgmap v545: 129 pgs: 129 active+clean; 7.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:05:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.776+0000 7fc3f5d03640 1 -- 172.21.15.6:0/1028365713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f0100a40 msgr2=0x7fc3f0100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.776+0000 7fc3f5d03640 1 --2- 172.21.15.6:0/1028365713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f0100a40 0x7fc3f0100e40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009900 tx=0x7fc3e002a410 comp rx=0 tx=0).stop 2024-09-12T00:05:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.776+0000 7fc3f5d03640 1 -- 172.21.15.6:0/1028365713 shutdown_connections 2024-09-12T00:05:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.776+0000 7fc3f5d03640 1 --2- 172.21.15.6:0/1028365713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3f01025f0 0x7fc3f0108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.776+0000 7fc3f5d03640 1 --2- 172.21.15.6:0/1028365713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3f0101c30 0x7fc3f01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.776+0000 7fc3f5d03640 1 --2- 172.21.15.6:0/1028365713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f0100a40 0x7fc3f0100e40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.776+0000 7fc3f5d03640 1 -- 172.21.15.6:0/1028365713 >> 172.21.15.6:0/1028365713 conn(0x7fc3f00fc1c0 msgr2=0x7fc3f00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.776+0000 7fc3f5d03640 1 -- 172.21.15.6:0/1028365713 shutdown_connections 2024-09-12T00:05:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.776+0000 7fc3f5d03640 1 -- 172.21.15.6:0/1028365713 wait complete. 2024-09-12T00:05:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.777+0000 7fc3f5d03640 1 Processor -- start 2024-09-12T00:05:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.777+0000 7fc3f5d03640 1 -- start start 2024-09-12T00:05:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.777+0000 7fc3f5d03640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3f0100a40 0x7fc3f01049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.777+0000 7fc3f5d03640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f0101c30 0x7fc3f0103010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.777+0000 7fc3f5d03640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3f01025f0 0x7fc3f0103550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.777+0000 7fc3f5d03640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f010c550 con 0x7fc3f0101c30 2024-09-12T00:05:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.777+0000 7fc3f5d03640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f010c3d0 con 0x7fc3f0100a40 2024-09-12T00:05:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.777+0000 7fc3f5d03640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f010c6d0 con 0x7fc3f01025f0 2024-09-12T00:05:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.777+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f0101c30 0x7fc3f0103010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.777+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f0101c30 0x7fc3f0103010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45240/0 (socket says 172.21.15.6:45240) 2024-09-12T00:05:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.777+0000 7fc3eeffd640 1 -- 172.21.15.6:0/702690067 learned_addr learned my addr 172.21.15.6:0/702690067 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3f0100a40 0x7fc3f01049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3effff640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3f01025f0 0x7fc3f0103550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3eeffd640 1 -- 172.21.15.6:0/702690067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3f01025f0 msgr2=0x7fc3f0103550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3f01025f0 0x7fc3f0103550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3eeffd640 1 -- 172.21.15.6:0/702690067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3f0100a40 msgr2=0x7fc3f01049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3f0100a40 0x7fc3f01049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3eeffd640 1 -- 172.21.15.6:0/702690067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f0103de0 con 0x7fc3f0101c30 2024-09-12T00:05:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3f0100a40 0x7fc3f01049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f0101c30 0x7fc3f0103010 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400c890 tx=0x7fc3e400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3ecff9640 1 -- 172.21.15.6:0/702690067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4004220 con 0x7fc3f0101c30 2024-09-12T00:05:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3ecff9640 1 -- 172.21.15.6:0/702690067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3e40043c0 con 0x7fc3f0101c30 2024-09-12T00:05:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3f5d03640 1 -- 172.21.15.6:0/702690067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f01a1f30 con 0x7fc3f0101c30 2024-09-12T00:05:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3ecff9640 1 -- 172.21.15.6:0/702690067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4004a00 con 0x7fc3f0101c30 2024-09-12T00:05:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.778+0000 7fc3f5d03640 1 -- 172.21.15.6:0/702690067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f01a23a0 con 0x7fc3f0101c30 2024-09-12T00:05:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3f8a98740 1 Processor -- start 2024-09-12T00:05:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3f8a98740 1 -- start start 2024-09-12T00:05:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3f8a98740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84f9a0 0x56034b84fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3f8a98740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b8502e0 0x56034b854da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3f8a98740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b855370 0x56034b857830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3f8a98740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56034b7b32f0 con 0x56034b855370 2024-09-12T00:05:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3f8a98740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56034b75b270 con 0x56034b8502e0 2024-09-12T00:05:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3f8a98740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56034b7af2b0 con 0x56034b84f9a0 2024-09-12T00:05:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3ecff9640 1 -- 172.21.15.6:0/702690067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fc3e4004ba0 con 0x7fc3f0101c30 2024-09-12T00:05:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b855370 0x56034b857830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3effff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84f9a0 0x56034b84fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b855370 0x56034b857830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45256/0 (socket says 172.21.15.6:45256) 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3eeffd640 1 -- 172.21.15.6:0/1328734210 learned_addr learned my addr 172.21.15.6:0/1328734210 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.781+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/1328734210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b8502e0 0x56034b854da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.782+0000 7fc3eeffd640 1 -- 172.21.15.6:0/1328734210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84f9a0 msgr2=0x56034b84fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.782+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/1328734210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84f9a0 0x56034b84fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.782+0000 7fc3eeffd640 1 -- 172.21.15.6:0/1328734210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b8502e0 msgr2=0x56034b854da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.782+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/1328734210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b8502e0 0x56034b854da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.782+0000 7fc3eeffd640 1 -- 172.21.15.6:0/1328734210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56034b75a340 con 0x56034b855370 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.782+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/1328734210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b855370 0x56034b857830 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40d72f0 tx=0x7fc3e40d77b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7407c8ff8647ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.782+0000 7fc3ecff9640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3d80a2c00 0x7fc3d80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.782+0000 7fc3d5ffb640 1 -- 172.21.15.6:0/1328734210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40e2070 con 0x56034b855370 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.782+0000 7fc3effff640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3d80a2c00 0x7fc3d80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.782+0000 7fc3ecff9640 1 -- 172.21.15.6:0/702690067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fc3e40cf100 con 0x7fc3f0101c30 2024-09-12T00:05:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.782+0000 7fc3d5ffb640 1 -- 172.21.15.6:0/1328734210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3e409bc70 con 0x56034b855370 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.782+0000 7fc3d5ffb640 1 -- 172.21.15.6:0/1328734210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4097810 con 0x56034b855370 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.783+0000 7fc3f8a98740 1 -- 172.21.15.6:0/1328734210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b855370 msgr2=0x56034b857830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.783+0000 7fc3effff640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3d80a2c00 0x7fc3d80a50c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8005fd0 tx=0x7fc3e8009740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.783+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/1328734210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b855370 0x56034b857830 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40d72f0 tx=0x7fc3e40d77b0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.783+0000 7fc3f8a98740 1 -- 172.21.15.6:0/1328734210 shutdown_connections 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.783+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/1328734210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b855370 0x56034b857830 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.783+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/1328734210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b8502e0 0x56034b854da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.783+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/1328734210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84f9a0 0x56034b84fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.783+0000 7fc3f8a98740 1 -- 172.21.15.6:0/1328734210 >> 172.21.15.6:0/1328734210 conn(0x56034b84b010 msgr2=0x56034b84b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.783+0000 7fc3f8a98740 1 -- 172.21.15.6:0/1328734210 shutdown_connections 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.783+0000 7fc3f8a98740 1 -- 172.21.15.6:0/1328734210 wait complete. 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3f8a98740 1 -- start start 2024-09-12T00:05:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3f8a98740 1 Processor -- start 2024-09-12T00:05:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3f8a98740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84f9a0 0x56034b859b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3f8a98740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b8502e0 0x56034b85a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3f8a98740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b855370 0x56034b8610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3f8a98740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56034b858340 con 0x56034b8502e0 2024-09-12T00:05:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3f8a98740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56034b73c290 con 0x56034b855370 2024-09-12T00:05:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3f8a98740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56034b8584c0 con 0x56034b84f9a0 2024-09-12T00:05:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3f8a98740 10 client.0 _ll_register_callbacks cb 0x56034b76d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b8502e0 0x56034b85a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b8502e0 0x56034b85a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45262/0 (socket says 172.21.15.6:45262) 2024-09-12T00:05:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3eeffd640 1 -- 172.21.15.6:0/3408852093 learned_addr learned my addr 172.21.15.6:0/3408852093 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.784+0000 7fc3effff640 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b855370 0x56034b8610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84f9a0 0x56034b859b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3eeffd640 1 -- 172.21.15.6:0/3408852093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84f9a0 msgr2=0x56034b859b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84f9a0 0x56034b859b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3eeffd640 1 -- 172.21.15.6:0/3408852093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b855370 msgr2=0x56034b8610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b855370 0x56034b8610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3eeffd640 1 -- 172.21.15.6:0/3408852093 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56034b4c6210 con 0x56034b8502e0 2024-09-12T00:05:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84f9a0 0x56034b859b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:05:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3effff640 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b855370 0x56034b8610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b8502e0 0x56034b85a0b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc3e409b270 tx=0x7fc3e4005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80f4717c5cf430d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:05:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3ceffd640 1 -- 172.21.15.6:0/3408852093 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e401d070 con 0x56034b8502e0 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3ceffd640 1 -- 172.21.15.6:0/3408852093 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fc3e40d12e0 con 0x56034b8502e0 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3408852093 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3e409bc70 con 0x56034b8502e0 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3ceffd640 1 -- 172.21.15.6:0/3408852093 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc3e409aed0 con 0x56034b8502e0 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3f8a98740 10 client.15846 fetch_fsmap learned FSMap version 33 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3408852093 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56034b592620 con 0x56034b8502e0 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.785+0000 7fc3ceffd640 1 -- 172.21.15.6:0/3408852093 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3e409bc70 con 0x56034b8502e0 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.786+0000 7fc3ceffd640 1 -- 172.21.15.6:0/3408852093 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fc3e409b7d0 con 0x56034b8502e0 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.786+0000 7fc3f8a98740 10 client.15846 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.786+0000 7fc3f8a98740 10 client.15846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.786+0000 7fc3f8a98740 20 client.15846 populate_metadata read hostname 'smithi006' 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.786+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56034b8653f0 0x56034b8677e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.786+0000 7fc3f8a98740 4 client.15846 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.786+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3408852093 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56034b7c0a20 con 0x56034b8653f0 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.786+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56034b8653f0 0x56034b8677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.786+0000 7fc3ceffd640 10 client.15846 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.786+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56034b8653f0 0x56034b8677e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbcc8745725b7f02 server_cookie=b7a93a5cafcb3f77 in_seq=0 out_seq=0 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.787+0000 7fc3ceffd640 1 -- 172.21.15.6:0/3408852093 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56034b7c0a20 con 0x56034b8653f0 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.787+0000 7fc3ceffd640 10 client.15846 handle_command_reply: tid=0 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.787+0000 7fc3f8a98740 1 client.15846 shutdown 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.787+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3408852093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b8502e0 msgr2=0x56034b85a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.787+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b8502e0 0x56034b85a0b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc3e409b270 tx=0x7fc3e4005760 comp rx=0 tx=0).stop 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.787+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3408852093 shutdown_connections 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.787+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b855370 0x56034b8610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.787+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b8502e0 0x56034b85a0b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.787+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56034b8653f0 0x56034b8677e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.787+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/3408852093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84f9a0 0x56034b859b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.787+0000 7fc3ceffd640 0 client.15846 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:34.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.787+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3408852093 >> 172.21.15.6:0/3408852093 conn(0x56034b84b010 msgr2=0x56034b84c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:34.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.788+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3408852093 shutdown_connections 2024-09-12T00:05:34.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.788+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3408852093 wait complete. 2024-09-12T00:05:34.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.788+0000 7fc3f8a98740 20 client.15846 trim_cache size 0 max 16384 2024-09-12T00:05:34.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.804+0000 7fc3f8a98740 1 Processor -- start 2024-09-12T00:05:34.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.804+0000 7fc3f8a98740 1 -- start start 2024-09-12T00:05:34.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3f8a98740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b84b010 0x56034b84c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3f8a98740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 0x56034b8610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3f8a98740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b8502e0 0x56034b84c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3f8a98740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f01acb10 con 0x56034b84f9a0 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3f8a98740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f01ae650 con 0x56034b84b010 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3f8a98740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f01ad1e0 con 0x56034b8502e0 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 0x56034b8610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 0x56034b8610b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45264/0 (socket says 172.21.15.6:45264) 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3eeffd640 1 -- 172.21.15.6:0/3248812996 learned_addr learned my addr 172.21.15.6:0/3248812996 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/3248812996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b84b010 0x56034b84c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3effff640 1 --2- 172.21.15.6:0/3248812996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b8502e0 0x56034b84c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3ef7fe640 1 -- 172.21.15.6:0/3248812996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b8502e0 msgr2=0x56034b84c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/3248812996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b8502e0 0x56034b84c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3ef7fe640 1 -- 172.21.15.6:0/3248812996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 msgr2=0x56034b8610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:34.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/3248812996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 0x56034b8610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3ef7fe640 1 -- 172.21.15.6:0/3248812996 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56034b8462d0 con 0x56034b84b010 2024-09-12T00:05:34.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/3248812996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 0x56034b8610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:34.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.805+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/3248812996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b84b010 0x56034b84c400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009230 tx=0x7fc3e00058b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e3ca214c4b64a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:34.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.806+0000 7fc3d57fa640 1 -- 172.21.15.6:0/3248812996 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0047020 con 0x56034b84b010 2024-09-12T00:05:34.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.806+0000 7fc3d57fa640 1 -- 172.21.15.6:0/3248812996 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3e00327a0 con 0x56034b84b010 2024-09-12T00:05:34.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.806+0000 7fc3d57fa640 1 -- 172.21.15.6:0/3248812996 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0035040 con 0x56034b84b010 2024-09-12T00:05:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.806+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3248812996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b84b010 msgr2=0x56034b84c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.806+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/3248812996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b84b010 0x56034b84c400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009230 tx=0x7fc3e00058b0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.806+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3248812996 shutdown_connections 2024-09-12T00:05:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.806+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/3248812996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b8502e0 0x56034b84c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.806+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/3248812996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 0x56034b8610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.806+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/3248812996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b84b010 0x56034b84c400 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.806+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3248812996 >> 172.21.15.6:0/3248812996 conn(0x56034b850da0 msgr2=0x56034b84a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.807+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3248812996 shutdown_connections 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.807+0000 7fc3f8a98740 1 -- 172.21.15.6:0/3248812996 wait complete. 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.807+0000 7fc3f8a98740 1 -- start start 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.807+0000 7fc3f8a98740 1 Processor -- start 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.807+0000 7fc3f8a98740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84b010 0x56034b85f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.807+0000 7fc3f8a98740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 0x56034b85f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.807+0000 7fc3f8a98740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b8502e0 0x56034b860630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.807+0000 7fc3f8a98740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f01adf80 con 0x56034b84f9a0 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.807+0000 7fc3f8a98740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f01ad8b0 con 0x56034b8502e0 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.807+0000 7fc3f8a98740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f01aaaf0 con 0x56034b84b010 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.807+0000 7fc3f8a98740 10 client.0 _ll_register_callbacks cb 0x7fc3e40e0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 0x56034b85f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 0x56034b85f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45278/0 (socket says 172.21.15.6:45278) 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3eeffd640 1 -- 172.21.15.6:0/2753788405 learned_addr learned my addr 172.21.15.6:0/2753788405 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3effff640 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b8502e0 0x56034b860630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84b010 0x56034b85f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3eeffd640 1 -- 172.21.15.6:0/2753788405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84b010 msgr2=0x56034b85f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84b010 0x56034b85f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3eeffd640 1 -- 172.21.15.6:0/2753788405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b8502e0 msgr2=0x56034b860630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b8502e0 0x56034b860630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3eeffd640 1 -- 172.21.15.6:0/2753788405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56034b860d20 con 0x56034b84f9a0 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3eeffd640 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 0x56034b85f7b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40cf440 tx=0x7fc3e40cf470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a56ea1fd704154 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3ceffd640 1 -- 172.21.15.6:0/2753788405 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e401d070 con 0x56034b84f9a0 2024-09-12T00:05:34.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3ceffd640 1 -- 172.21.15.6:0/2753788405 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fc3e40d26f0 con 0x56034b84f9a0 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3f8a98740 1 -- 172.21.15.6:0/2753788405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3e00327a0 con 0x56034b84f9a0 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3ceffd640 1 -- 172.21.15.6:0/2753788405 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc3e409b0b0 con 0x56034b84f9a0 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3f8a98740 10 client.15852 fetch_fsmap learned FSMap version 33 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.808+0000 7fc3f8a98740 1 -- 172.21.15.6:0/2753788405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56034b8d08f0 con 0x56034b84f9a0 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.809+0000 7fc3ceffd640 1 -- 172.21.15.6:0/2753788405 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3e00327a0 con 0x56034b84f9a0 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.809+0000 7fc3ceffd640 1 -- 172.21.15.6:0/2753788405 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fc3e409b7d0 con 0x56034b84f9a0 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.809+0000 7fc3f8a98740 10 client.15852 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.809+0000 7fc3f8a98740 10 client.15852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.809+0000 7fc3f8a98740 20 client.15852 populate_metadata read hostname 'smithi006' 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.809+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56034b855370 0x56034b8d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.809+0000 7fc3f8a98740 4 client.15852 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.809+0000 7fc3f8a98740 1 -- 172.21.15.6:0/2753788405 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56034b7bad70 con 0x56034b855370 2024-09-12T00:05:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.809+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56034b855370 0x56034b8d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:34.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.810+0000 7fc3ceffd640 10 client.15852 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:34.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.810+0000 7fc3ef7fe640 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56034b855370 0x56034b8d3010 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bbc5a7986c00a60 server_cookie=c7c91ff0ab7eaa70 in_seq=0 out_seq=0 2024-09-12T00:05:34.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3ceffd640 1 -- 172.21.15.6:0/2753788405 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56034b7bad70 con 0x56034b855370 2024-09-12T00:05:34.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3ceffd640 10 client.15852 handle_command_reply: tid=0 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3f8a98740 1 client.15852 shutdown 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3f8a98740 1 -- 172.21.15.6:0/2753788405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 msgr2=0x56034b85f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 0x56034b85f7b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40cf440 tx=0x7fc3e40cf470 comp rx=0 tx=0).stop 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3f8a98740 1 -- 172.21.15.6:0/2753788405 shutdown_connections 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56034b8502e0 0x56034b860630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56034b84f9a0 0x56034b85f7b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x56034b855370 0x56034b8d3010 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3f8a98740 1 --2- 172.21.15.6:0/2753788405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56034b84b010 0x56034b85f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3f8a98740 1 -- 172.21.15.6:0/2753788405 >> 172.21.15.6:0/2753788405 conn(0x56034b850da0 msgr2=0x56034b84b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3ceffd640 0 client.15852 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3f8a98740 1 -- 172.21.15.6:0/2753788405 shutdown_connections 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.825+0000 7fc3f8a98740 1 -- 172.21.15.6:0/2753788405 wait complete. 2024-09-12T00:05:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f8a98740 20 client.15852 trim_cache size 0 max 16384 2024-09-12T00:05:34.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:05:34.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:05:34.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:05:34.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:05:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f5d03640 1 -- 172.21.15.6:0/702690067 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3d80a2c00 msgr2=0x7fc3d80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f5d03640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3d80a2c00 0x7fc3d80a50c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8005fd0 tx=0x7fc3e8009740 comp rx=0 tx=0).stop 2024-09-12T00:05:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f5d03640 1 -- 172.21.15.6:0/702690067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f0101c30 msgr2=0x7fc3f0103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f5d03640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f0101c30 0x7fc3f0103010 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400c890 tx=0x7fc3e400cd50 comp rx=0 tx=0).stop 2024-09-12T00:05:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f5d03640 1 -- 172.21.15.6:0/702690067 shutdown_connections 2024-09-12T00:05:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f5d03640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3d80a2c00 0x7fc3d80a50c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f5d03640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3f01025f0 0x7fc3f0103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f5d03640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f0101c30 0x7fc3f0103010 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f5d03640 1 --2- 172.21.15.6:0/702690067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3f0100a40 0x7fc3f01049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f5d03640 1 -- 172.21.15.6:0/702690067 >> 172.21.15.6:0/702690067 conn(0x7fc3f00fc1c0 msgr2=0x7fc3f0069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f5d03640 1 -- 172.21.15.6:0/702690067 shutdown_connections 2024-09-12T00:05:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:34.826+0000 7fc3f5d03640 1 -- 172.21.15.6:0/702690067 wait complete. 2024-09-12T00:05:34.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:34 smithi006 ceph-mon[30947]: pgmap v546: 129 pgs: 129 active+clean; 7.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:05:34.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:34 smithi134 ceph-mon[34893]: pgmap v546: 129 pgs: 129 active+clean; 7.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:05:35.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:34 smithi039 ceph-mon[34543]: pgmap v546: 129 pgs: 129 active+clean; 7.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:05:36.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:36 smithi006 ceph-mon[30947]: pgmap v547: 129 pgs: 129 active+clean; 7.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:05:36.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:36 smithi134 ceph-mon[34893]: pgmap v547: 129 pgs: 129 active+clean; 7.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:05:37.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:36 smithi039 ceph-mon[34543]: pgmap v547: 129 pgs: 129 active+clean; 7.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:05:38.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:38 smithi006 ceph-mon[30947]: pgmap v548: 129 pgs: 129 active+clean; 7.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:05:38.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:38 smithi134 ceph-mon[34893]: pgmap v548: 129 pgs: 129 active+clean; 7.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:05:39.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:38 smithi039 ceph-mon[34543]: pgmap v548: 129 pgs: 129 active+clean; 7.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:05:40.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:40 smithi006 ceph-mon[30947]: pgmap v549: 129 pgs: 129 active+clean; 7.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:05:40.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:40 smithi134 ceph-mon[34893]: pgmap v549: 129 pgs: 129 active+clean; 7.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:05:41.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:40 smithi039 ceph-mon[34543]: pgmap v549: 129 pgs: 129 active+clean; 7.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:05:42.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:42 smithi006 ceph-mon[30947]: pgmap v550: 129 pgs: 129 active+clean; 7.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:05:42.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:42 smithi134 ceph-mon[34893]: pgmap v550: 129 pgs: 129 active+clean; 7.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:05:43.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:42 smithi039 ceph-mon[34543]: pgmap v550: 129 pgs: 129 active+clean; 7.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:05:44.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:44 smithi006 ceph-mon[30947]: pgmap v551: 129 pgs: 129 active+clean; 7.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:05:44.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:44 smithi134 ceph-mon[34893]: pgmap v551: 129 pgs: 129 active+clean; 7.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:05:45.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:44 smithi039 ceph-mon[34543]: pgmap v551: 129 pgs: 129 active+clean; 7.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:05:46.846 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:46 smithi039 ceph-mon[34543]: pgmap v552: 129 pgs: 129 active+clean; 7.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:05:46.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:46 smithi006 ceph-mon[30947]: pgmap v552: 129 pgs: 129 active+clean; 7.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:05:46.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:46 smithi134 ceph-mon[34893]: pgmap v552: 129 pgs: 129 active+clean; 7.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:05:47.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.933+0000 7fc2945b9640 1 -- 172.21.15.6:0/3515330823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c102610 msgr2=0x7fc28c104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:47.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.933+0000 7fc2945b9640 1 --2- 172.21.15.6:0/3515330823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c102610 0x7fc28c104a00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc288009900 tx=0x7fc28802a410 comp rx=0 tx=0).stop 2024-09-12T00:05:47.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.933+0000 7fc2945b9640 1 -- 172.21.15.6:0/3515330823 shutdown_connections 2024-09-12T00:05:47.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.933+0000 7fc2945b9640 1 --2- 172.21.15.6:0/3515330823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc28c107870 0x7fc28c109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.933+0000 7fc2945b9640 1 --2- 172.21.15.6:0/3515330823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc28c104f40 0x7fc28c107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.933+0000 7fc2945b9640 1 --2- 172.21.15.6:0/3515330823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c102610 0x7fc28c104a00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.933+0000 7fc2945b9640 1 -- 172.21.15.6:0/3515330823 >> 172.21.15.6:0/3515330823 conn(0x7fc28c0fc190 msgr2=0x7fc28c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.933+0000 7fc2945b9640 1 -- 172.21.15.6:0/3515330823 shutdown_connections 2024-09-12T00:05:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.933+0000 7fc2945b9640 1 -- 172.21.15.6:0/3515330823 wait complete. 2024-09-12T00:05:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.933+0000 7fc2945b9640 1 Processor -- start 2024-09-12T00:05:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc2945b9640 1 -- start start 2024-09-12T00:05:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc2945b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc28c102610 0x7fc28c101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc2945b9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c104f40 0x7fc28c1005c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc2945b9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc28c107870 0x7fc28c100b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc2945b9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c10d6b0 con 0x7fc28c104f40 2024-09-12T00:05:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc2945b9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c10d530 con 0x7fc28c107870 2024-09-12T00:05:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc2945b9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c10d830 con 0x7fc28c102610 2024-09-12T00:05:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc291b54640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c104f40 0x7fc28c1005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc291b54640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c104f40 0x7fc28c1005c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42358/0 (socket says 172.21.15.6:42358) 2024-09-12T00:05:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc291b54640 1 -- 172.21.15.6:0/145561715 learned_addr learned my addr 172.21.15.6:0/145561715 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc292b56640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc28c107870 0x7fc28c100b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc291b54640 1 -- 172.21.15.6:0/145561715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc28c102610 msgr2=0x7fc28c101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc291b54640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc28c102610 0x7fc28c101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc291b54640 1 -- 172.21.15.6:0/145561715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc28c107870 msgr2=0x7fc28c100b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc291b54640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc28c107870 0x7fc28c100b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc291b54640 1 -- 172.21.15.6:0/145561715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c101390 con 0x7fc28c104f40 2024-09-12T00:05:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.934+0000 7fc291b54640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c104f40 0x7fc28c1005c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00e9c0 tx=0x7fc27c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.935+0000 7fc2837fe640 1 -- 172.21.15.6:0/145561715 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c00cd80 con 0x7fc28c104f40 2024-09-12T00:05:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.935+0000 7fc2837fe640 1 -- 172.21.15.6:0/145561715 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc27c0054d0 con 0x7fc28c104f40 2024-09-12T00:05:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.935+0000 7fc2945b9640 1 -- 172.21.15.6:0/145561715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28c1a1ec0 con 0x7fc28c104f40 2024-09-12T00:05:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.935+0000 7fc2837fe640 1 -- 172.21.15.6:0/145561715 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c010430 con 0x7fc28c104f40 2024-09-12T00:05:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.935+0000 7fc2945b9640 1 -- 172.21.15.6:0/145561715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc28c1a2320 con 0x7fc28c104f40 2024-09-12T00:05:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.938+0000 7fc2837fe640 1 -- 172.21.15.6:0/145561715 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fc27c004fd0 con 0x7fc28c104f40 2024-09-12T00:05:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.938+0000 7fc297428740 1 Processor -- start 2024-09-12T00:05:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.938+0000 7fc297428740 1 -- start start 2024-09-12T00:05:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc297428740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c6229a0 0x55fc7c622da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc297428740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 0x55fc7c627da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc297428740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c628370 0x55fc7c62a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc297428740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fc7c5862f0 con 0x55fc7c6232e0 2024-09-12T00:05:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc297428740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55fc7c52e270 con 0x55fc7c6229a0 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc297428740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fc7c5822b0 con 0x55fc7c628370 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc292355640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 0x55fc7c627da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc292b56640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c6229a0 0x55fc7c622da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc292b56640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c6229a0 0x55fc7c622da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:44938/0 (socket says 172.21.15.6:44938) 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc292355640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 0x55fc7c627da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42374/0 (socket says 172.21.15.6:42374) 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc292b56640 1 -- 172.21.15.6:0/2334644833 learned_addr learned my addr 172.21.15.6:0/2334644833 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc292b56640 1 -- 172.21.15.6:0/2334644833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c628370 msgr2=0x55fc7c62a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc292b56640 1 --2- 172.21.15.6:0/2334644833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c628370 0x55fc7c62a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc292b56640 1 -- 172.21.15.6:0/2334644833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 msgr2=0x55fc7c627da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc292b56640 1 --2- 172.21.15.6:0/2334644833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 0x55fc7c627da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc292b56640 1 -- 172.21.15.6:0/2334644833 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc7c52d340 con 0x55fc7c6229a0 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc2837fe640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2780a2b80 0x7fc2780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc292b56640 1 --2- 172.21.15.6:0/2334644833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c6229a0 0x55fc7c622da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc284007e20 tx=0x7fc28400e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d31d187eea19619 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.939+0000 7fc292355640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2780a2b80 0x7fc2780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.940+0000 7fc2837fe640 1 -- 172.21.15.6:0/145561715 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fc27c0cf940 con 0x7fc28c104f40 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.940+0000 7fc280bfe640 1 -- 172.21.15.6:0/2334644833 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284014070 con 0x55fc7c6229a0 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.940+0000 7fc280bfe640 1 -- 172.21.15.6:0/2334644833 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc284004d20 con 0x55fc7c6229a0 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.940+0000 7fc280bfe640 1 -- 172.21.15.6:0/2334644833 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840053a0 con 0x55fc7c6229a0 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.940+0000 7fc297428740 1 -- 172.21.15.6:0/2334644833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c6229a0 msgr2=0x55fc7c622da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.940+0000 7fc297428740 1 --2- 172.21.15.6:0/2334644833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c6229a0 0x55fc7c622da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc284007e20 tx=0x7fc28400e720 comp rx=0 tx=0).stop 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.940+0000 7fc292355640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2780a2b80 0x7fc2780a5040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc288005730 tx=0x7fc2880314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.940+0000 7fc297428740 1 -- 172.21.15.6:0/2334644833 shutdown_connections 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.940+0000 7fc297428740 1 --2- 172.21.15.6:0/2334644833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c628370 0x55fc7c62a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.940+0000 7fc297428740 1 --2- 172.21.15.6:0/2334644833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 0x55fc7c627da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.940+0000 7fc297428740 1 --2- 172.21.15.6:0/2334644833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c6229a0 0x55fc7c622da0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.940+0000 7fc297428740 1 -- 172.21.15.6:0/2334644833 >> 172.21.15.6:0/2334644833 conn(0x55fc7c61e010 msgr2=0x55fc7c61e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc297428740 1 -- 172.21.15.6:0/2334644833 shutdown_connections 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc297428740 1 -- 172.21.15.6:0/2334644833 wait complete. 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc297428740 1 -- start start 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc297428740 1 Processor -- start 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc297428740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6229a0 0x55fc7c62cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc297428740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6232e0 0x55fc7c62d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc297428740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c628370 0x55fc7c634220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc297428740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fc7c62b340 con 0x55fc7c6229a0 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc297428740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55fc7c50f290 con 0x55fc7c628370 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc297428740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fc7c62b4c0 con 0x55fc7c6232e0 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc297428740 10 client.0 _ll_register_callbacks cb 0x55fc7c540140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc292355640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6229a0 0x55fc7c62cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.941+0000 7fc292355640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6229a0 0x55fc7c62cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42384/0 (socket says 172.21.15.6:42384) 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc292355640 1 -- 172.21.15.6:0/2111231074 learned_addr learned my addr 172.21.15.6:0/2111231074 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc292b56640 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c628370 0x55fc7c634220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc291b54640 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6232e0 0x55fc7c62d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc292355640 1 -- 172.21.15.6:0/2111231074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6232e0 msgr2=0x55fc7c62d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc292355640 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6232e0 0x55fc7c62d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc292355640 1 -- 172.21.15.6:0/2111231074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c628370 msgr2=0x55fc7c634220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc292355640 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c628370 0x55fc7c634220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc292355640 1 -- 172.21.15.6:0/2111231074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc7c299210 con 0x55fc7c6229a0 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc291b54640 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6232e0 0x55fc7c62d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc292b56640 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c628370 0x55fc7c634220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc292355640 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6229a0 0x55fc7c62cd10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc288009900 tx=0x7fc288005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5d7cee27f4ecbd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc275ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:05:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc275ffb640 1 -- 172.21.15.6:0/2111231074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28804c020 con 0x55fc7c6229a0 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc275ffb640 1 -- 172.21.15.6:0/2111231074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fc288004260 con 0x55fc7c6229a0 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc297428740 1 -- 172.21.15.6:0/2111231074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc284004d20 con 0x55fc7c6229a0 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc275ffb640 1 -- 172.21.15.6:0/2111231074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc288057050 con 0x55fc7c6229a0 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc297428740 10 client.15864 fetch_fsmap learned FSMap version 33 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.942+0000 7fc297428740 1 -- 172.21.15.6:0/2111231074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fc7c365620 con 0x55fc7c6229a0 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.943+0000 7fc275ffb640 1 -- 172.21.15.6:0/2111231074 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc284004d20 con 0x55fc7c6229a0 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.943+0000 7fc275ffb640 1 -- 172.21.15.6:0/2111231074 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fc288004a90 con 0x55fc7c6229a0 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.943+0000 7fc297428740 10 client.15864 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.943+0000 7fc297428740 10 client.15864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.943+0000 7fc297428740 20 client.15864 populate_metadata read hostname 'smithi006' 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.943+0000 7fc297428740 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fc7c638980 0x55fc7c63ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.943+0000 7fc297428740 4 client.15864 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.943+0000 7fc297428740 1 -- 172.21.15.6:0/2111231074 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc7c593a20 con 0x55fc7c638980 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.943+0000 7fc291b54640 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fc7c638980 0x55fc7c63ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.944+0000 7fc291b54640 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fc7c638980 0x55fc7c63ade0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6b98be2c43a613d server_cookie=7a691063a5c3aeb7 in_seq=0 out_seq=0 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.944+0000 7fc275ffb640 10 client.15864 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.944+0000 7fc275ffb640 1 -- 172.21.15.6:0/2111231074 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc7c593a20 con 0x55fc7c638980 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.944+0000 7fc275ffb640 10 client.15864 handle_command_reply: tid=0 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.944+0000 7fc297428740 1 client.15864 shutdown 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.944+0000 7fc297428740 1 -- 172.21.15.6:0/2111231074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6229a0 msgr2=0x55fc7c62cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.944+0000 7fc297428740 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6229a0 0x55fc7c62cd10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc288009900 tx=0x7fc288005fd0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.944+0000 7fc297428740 1 -- 172.21.15.6:0/2111231074 shutdown_connections 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.944+0000 7fc297428740 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c628370 0x55fc7c634220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.944+0000 7fc297428740 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fc7c638980 0x55fc7c63ade0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.945+0000 7fc275ffb640 0 client.15864 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.944+0000 7fc297428740 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6232e0 0x55fc7c62d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.945+0000 7fc297428740 1 --2- 172.21.15.6:0/2111231074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6229a0 0x55fc7c62cd10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.945+0000 7fc297428740 1 -- 172.21.15.6:0/2111231074 >> 172.21.15.6:0/2111231074 conn(0x55fc7c61e010 msgr2=0x55fc7c61f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.945+0000 7fc297428740 1 -- 172.21.15.6:0/2111231074 shutdown_connections 2024-09-12T00:05:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.945+0000 7fc297428740 1 -- 172.21.15.6:0/2111231074 wait complete. 2024-09-12T00:05:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.945+0000 7fc297428740 20 client.15864 trim_cache size 0 max 16384 2024-09-12T00:05:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.959+0000 7fc297428740 1 Processor -- start 2024-09-12T00:05:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.959+0000 7fc297428740 1 -- start start 2024-09-12T00:05:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.959+0000 7fc297428740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6229a0 0x55fc7c62d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.959+0000 7fc297428740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 0x55fc7c6341e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.959+0000 7fc297428740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c628370 0x55fc7c627c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.959+0000 7fc297428740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c1acad0 con 0x55fc7c6232e0 2024-09-12T00:05:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.959+0000 7fc297428740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c1ae610 con 0x55fc7c628370 2024-09-12T00:05:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.959+0000 7fc297428740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c1ad1a0 con 0x55fc7c6229a0 2024-09-12T00:05:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.959+0000 7fc291b54640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 0x55fc7c6341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.959+0000 7fc291b54640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 0x55fc7c6341e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42398/0 (socket says 172.21.15.6:42398) 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.959+0000 7fc291b54640 1 -- 172.21.15.6:0/2881671414 learned_addr learned my addr 172.21.15.6:0/2881671414 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.960+0000 7fc292355640 1 --2- 172.21.15.6:0/2881671414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6229a0 0x55fc7c62d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.960+0000 7fc292b56640 1 --2- 172.21.15.6:0/2881671414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c628370 0x55fc7c627c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.960+0000 7fc291b54640 1 -- 172.21.15.6:0/2881671414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6229a0 msgr2=0x55fc7c62d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.960+0000 7fc291b54640 1 --2- 172.21.15.6:0/2881671414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6229a0 0x55fc7c62d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.960+0000 7fc291b54640 1 -- 172.21.15.6:0/2881671414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c628370 msgr2=0x55fc7c627c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.960+0000 7fc291b54640 1 --2- 172.21.15.6:0/2881671414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c628370 0x55fc7c627c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.960+0000 7fc291b54640 1 -- 172.21.15.6:0/2881671414 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc7c62c850 con 0x55fc7c6232e0 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.960+0000 7fc291b54640 1 --2- 172.21.15.6:0/2881671414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 0x55fc7c6341e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0047e0 tx=0x7fc27c009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f584620f367614f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.960+0000 7fc277fff640 1 -- 172.21.15.6:0/2881671414 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c09bdb0 con 0x55fc7c6232e0 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.960+0000 7fc277fff640 1 -- 172.21.15.6:0/2881671414 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc27c09f070 con 0x55fc7c6232e0 2024-09-12T00:05:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.960+0000 7fc277fff640 1 -- 172.21.15.6:0/2881671414 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c016e10 con 0x55fc7c6232e0 2024-09-12T00:05:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.961+0000 7fc297428740 1 -- 172.21.15.6:0/2881671414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 msgr2=0x55fc7c6341e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.961+0000 7fc297428740 1 --2- 172.21.15.6:0/2881671414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 0x55fc7c6341e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0047e0 tx=0x7fc27c009700 comp rx=0 tx=0).stop 2024-09-12T00:05:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.961+0000 7fc297428740 1 -- 172.21.15.6:0/2881671414 shutdown_connections 2024-09-12T00:05:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.961+0000 7fc297428740 1 --2- 172.21.15.6:0/2881671414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c628370 0x55fc7c627c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.961+0000 7fc297428740 1 --2- 172.21.15.6:0/2881671414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c6232e0 0x55fc7c6341e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.961+0000 7fc297428740 1 --2- 172.21.15.6:0/2881671414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6229a0 0x55fc7c62d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.961+0000 7fc297428740 1 -- 172.21.15.6:0/2881671414 >> 172.21.15.6:0/2881671414 conn(0x55fc7c61e010 msgr2=0x55fc7c61d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.961+0000 7fc297428740 1 -- 172.21.15.6:0/2881671414 shutdown_connections 2024-09-12T00:05:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.961+0000 7fc297428740 1 -- 172.21.15.6:0/2881671414 wait complete. 2024-09-12T00:05:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.961+0000 7fc297428740 1 -- start start 2024-09-12T00:05:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc297428740 1 Processor -- start 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc297428740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6229a0 0x55fc7c6314f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc297428740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c6232e0 0x55fc7c631a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc297428740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c628370 0x55fc7c632a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc297428740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c1adf40 con 0x55fc7c628370 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc297428740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c1ad870 con 0x55fc7c6232e0 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc297428740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c1aaab0 con 0x55fc7c6229a0 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc297428740 10 client.0 _ll_register_callbacks cb 0x7fc288040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc292b56640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c628370 0x55fc7c632a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc292b56640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c628370 0x55fc7c632a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42404/0 (socket says 172.21.15.6:42404) 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc292b56640 1 -- 172.21.15.6:0/4131819626 learned_addr learned my addr 172.21.15.6:0/4131819626 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc292355640 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6229a0 0x55fc7c6314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc291b54640 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c6232e0 0x55fc7c631a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc292b56640 1 -- 172.21.15.6:0/4131819626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6229a0 msgr2=0x55fc7c6314f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc292b56640 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6229a0 0x55fc7c6314f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc292b56640 1 -- 172.21.15.6:0/4131819626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c6232e0 msgr2=0x55fc7c631a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc292b56640 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c6232e0 0x55fc7c631a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc292b56640 1 -- 172.21.15.6:0/4131819626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc7c633050 con 0x55fc7c628370 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc292b56640 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c628370 0x55fc7c632a40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc284007df0 tx=0x7fc284012890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0b1fbd16768b51 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.962+0000 7fc275ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc275ffb640 1 -- 172.21.15.6:0/4131819626 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284029060 con 0x55fc7c628370 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc275ffb640 1 -- 172.21.15.6:0/4131819626 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fc284012a00 con 0x55fc7c628370 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc297428740 1 -- 172.21.15.6:0/4131819626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc27c09f070 con 0x55fc7c628370 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc275ffb640 1 -- 172.21.15.6:0/4131819626 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc284030050 con 0x55fc7c628370 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc297428740 10 client.15870 fetch_fsmap learned FSMap version 33 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc297428740 1 -- 172.21.15.6:0/4131819626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fc7c634360 con 0x55fc7c628370 2024-09-12T00:05:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc275ffb640 1 -- 172.21.15.6:0/4131819626 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc27c09f070 con 0x55fc7c628370 2024-09-12T00:05:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc275ffb640 1 -- 172.21.15.6:0/4131819626 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fc2840050b0 con 0x55fc7c628370 2024-09-12T00:05:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc297428740 10 client.15870 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:05:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc297428740 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:05:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc297428740 20 client.15870 populate_metadata read hostname 'smithi006' 2024-09-12T00:05:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc297428740 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fc7c638980 0x55fc7c6a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc297428740 4 client.15870 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:05:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.963+0000 7fc297428740 1 -- 172.21.15.6:0/4131819626 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fc7c58dd70 con 0x55fc7c638980 2024-09-12T00:05:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.964+0000 7fc292355640 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fc7c638980 0x55fc7c6a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.964+0000 7fc275ffb640 10 client.15870 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.964+0000 7fc292355640 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fc7c638980 0x55fc7c6a59c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36c95dfee14f6435 server_cookie=22e975f98edb6dbb in_seq=0 out_seq=0 2024-09-12T00:05:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.981+0000 7fc275ffb640 1 -- 172.21.15.6:0/4131819626 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fc7c58dd70 con 0x55fc7c638980 2024-09-12T00:05:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.981+0000 7fc275ffb640 10 client.15870 handle_command_reply: tid=0 2024-09-12T00:05:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc297428740 1 client.15870 shutdown 2024-09-12T00:05:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc297428740 1 -- 172.21.15.6:0/4131819626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c628370 msgr2=0x55fc7c632a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc297428740 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c628370 0x55fc7c632a40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc284007df0 tx=0x7fc284012890 comp rx=0 tx=0).stop 2024-09-12T00:05:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc297428740 1 -- 172.21.15.6:0/4131819626 shutdown_connections 2024-09-12T00:05:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc297428740 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc7c628370 0x55fc7c632a40 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc297428740 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fc7c6232e0 0x55fc7c631a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc297428740 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fc7c638980 0x55fc7c6a59c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc297428740 1 --2- 172.21.15.6:0/4131819626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fc7c6229a0 0x55fc7c6314f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc275ffb640 0 client.15870 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:05:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc297428740 1 -- 172.21.15.6:0/4131819626 >> 172.21.15.6:0/4131819626 conn(0x55fc7c61e010 msgr2=0x55fc7c61d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc297428740 1 -- 172.21.15.6:0/4131819626 shutdown_connections 2024-09-12T00:05:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc297428740 1 -- 172.21.15.6:0/4131819626 wait complete. 2024-09-12T00:05:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.982+0000 7fc297428740 20 client.15870 trim_cache size 0 max 16384 2024-09-12T00:05:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:05:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:05:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:05:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:05:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.983+0000 7fc2945b9640 1 -- 172.21.15.6:0/145561715 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2780a2b80 msgr2=0x7fc2780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.983+0000 7fc2945b9640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2780a2b80 0x7fc2780a5040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc288005730 tx=0x7fc2880314a0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.983+0000 7fc2945b9640 1 -- 172.21.15.6:0/145561715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c104f40 msgr2=0x7fc28c1005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.983+0000 7fc2945b9640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c104f40 0x7fc28c1005c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00e9c0 tx=0x7fc27c00ee80 comp rx=0 tx=0).stop 2024-09-12T00:05:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.983+0000 7fc2945b9640 1 -- 172.21.15.6:0/145561715 shutdown_connections 2024-09-12T00:05:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.983+0000 7fc2945b9640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc2780a2b80 0x7fc2780a5040 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.983+0000 7fc2945b9640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc28c107870 0x7fc28c100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.983+0000 7fc2945b9640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c104f40 0x7fc28c1005c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.983+0000 7fc2945b9640 1 --2- 172.21.15.6:0/145561715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc28c102610 0x7fc28c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.983+0000 7fc2945b9640 1 -- 172.21.15.6:0/145561715 >> 172.21.15.6:0/145561715 conn(0x7fc28c0fc190 msgr2=0x7fc28c102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.983+0000 7fc2945b9640 1 -- 172.21.15.6:0/145561715 shutdown_connections 2024-09-12T00:05:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:05:47.983+0000 7fc2945b9640 1 -- 172.21.15.6:0/145561715 wait complete. 2024-09-12T00:05:48.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:48 smithi006 ceph-mon[30947]: pgmap v553: 129 pgs: 129 active+clean; 7.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:05:48.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:48 smithi134 ceph-mon[34893]: pgmap v553: 129 pgs: 129 active+clean; 7.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:05:49.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:48 smithi039 ceph-mon[34543]: pgmap v553: 129 pgs: 129 active+clean; 7.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:05:50.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:50 smithi006 ceph-mon[30947]: pgmap v554: 129 pgs: 129 active+clean; 7.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:05:50.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:50 smithi134 ceph-mon[34893]: pgmap v554: 129 pgs: 129 active+clean; 7.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:05:51.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:50 smithi039 ceph-mon[34543]: pgmap v554: 129 pgs: 129 active+clean; 7.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:05:52.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:52 smithi006 ceph-mon[30947]: pgmap v555: 129 pgs: 129 active+clean; 7.9 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:05:52.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:52 smithi134 ceph-mon[34893]: pgmap v555: 129 pgs: 129 active+clean; 7.9 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:05:53.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:52 smithi039 ceph-mon[34543]: pgmap v555: 129 pgs: 129 active+clean; 7.9 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:05:54.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:54 smithi006 ceph-mon[30947]: pgmap v556: 129 pgs: 129 active+clean; 7.9 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 MiB/s wr, 22 op/s 2024-09-12T00:05:54.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:54 smithi134 ceph-mon[34893]: pgmap v556: 129 pgs: 129 active+clean; 7.9 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 MiB/s wr, 22 op/s 2024-09-12T00:05:55.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:54 smithi039 ceph-mon[34543]: pgmap v556: 129 pgs: 129 active+clean; 7.9 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 MiB/s wr, 22 op/s 2024-09-12T00:05:56.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:56 smithi006 ceph-mon[30947]: pgmap v557: 129 pgs: 129 active+clean; 8.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:05:56.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:56 smithi134 ceph-mon[34893]: pgmap v557: 129 pgs: 129 active+clean; 8.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:05:57.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:56 smithi039 ceph-mon[34543]: pgmap v557: 129 pgs: 129 active+clean; 8.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:05:58.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:05:58 smithi006 ceph-mon[30947]: pgmap v558: 129 pgs: 129 active+clean; 8.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:05:58.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:05:58 smithi134 ceph-mon[34893]: pgmap v558: 129 pgs: 129 active+clean; 8.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:05:59.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:05:58 smithi039 ceph-mon[34543]: pgmap v558: 129 pgs: 129 active+clean; 8.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:06:00.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:00 smithi006 ceph-mon[30947]: pgmap v559: 129 pgs: 129 active+clean; 8.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:06:00.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:00 smithi134 ceph-mon[34893]: pgmap v559: 129 pgs: 129 active+clean; 8.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:06:01.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:00 smithi039 ceph-mon[34543]: pgmap v559: 129 pgs: 129 active+clean; 8.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:06:01.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.079+0000 7f9fd8f42640 1 -- 172.21.15.6:0/2190929957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fd4102010 msgr2=0x7f9fd4102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:01.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.079+0000 7f9fd8f42640 1 --2- 172.21.15.6:0/2190929957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fd4102010 0x7f9fd4102410 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009900 tx=0x7f9fc402a410 comp rx=0 tx=0).stop 2024-09-12T00:06:01.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.079+0000 7f9fd8f42640 1 -- 172.21.15.6:0/2190929957 shutdown_connections 2024-09-12T00:06:01.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.079+0000 7f9fd8f42640 1 --2- 172.21.15.6:0/2190929957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fd4101670 0x7f9fd4108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.079+0000 7f9fd8f42640 1 --2- 172.21.15.6:0/2190929957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd4100cb0 0x7f9fd4101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.079+0000 7f9fd8f42640 1 --2- 172.21.15.6:0/2190929957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fd4102010 0x7f9fd4102410 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.079+0000 7f9fd8f42640 1 -- 172.21.15.6:0/2190929957 >> 172.21.15.6:0/2190929957 conn(0x7f9fd40fb930 msgr2=0x7f9fd40fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:01.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.079+0000 7f9fd8f42640 1 -- 172.21.15.6:0/2190929957 shutdown_connections 2024-09-12T00:06:01.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.079+0000 7f9fd8f42640 1 -- 172.21.15.6:0/2190929957 wait complete. 2024-09-12T00:06:01.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd8f42640 1 Processor -- start 2024-09-12T00:06:01.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd8f42640 1 -- start start 2024-09-12T00:06:01.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd8f42640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fd4100cb0 0x7f9fd4104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd8f42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fd4101670 0x7f9fd4103330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd8f42640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd4102010 0x7f9fd4103870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd8f42640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd410c570 con 0x7f9fd4100cb0 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd8f42640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd410c3f0 con 0x7f9fd4102010 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd8f42640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd410c6f0 con 0x7f9fd4101670 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fd4100cb0 0x7f9fd4104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fd4100cb0 0x7f9fd4104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58428/0 (socket says 172.21.15.6:58428) 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd259c640 1 -- 172.21.15.6:0/1619367499 learned_addr learned my addr 172.21.15.6:0/1619367499 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd1d9b640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fd4101670 0x7f9fd4103330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd2d9d640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd4102010 0x7f9fd4103870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd259c640 1 -- 172.21.15.6:0/1619367499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fd4101670 msgr2=0x7f9fd4103330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd259c640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fd4101670 0x7f9fd4103330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd259c640 1 -- 172.21.15.6:0/1619367499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd4102010 msgr2=0x7f9fd4103870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:01.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd259c640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd4102010 0x7f9fd4103870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.080+0000 7f9fd259c640 1 -- 172.21.15.6:0/1619367499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd4104100 con 0x7f9fd4100cb0 2024-09-12T00:06:01.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.081+0000 7f9fd259c640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fd4100cb0 0x7f9fd4104cf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40314e0 tx=0x7f9fc4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:01.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.081+0000 7f9fc37fe640 1 -- 172.21.15.6:0/1619367499 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc403f030 con 0x7f9fd4100cb0 2024-09-12T00:06:01.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.081+0000 7f9fc37fe640 1 -- 172.21.15.6:0/1619367499 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9fc4003cb0 con 0x7f9fd4100cb0 2024-09-12T00:06:01.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.081+0000 7f9fd8f42640 1 -- 172.21.15.6:0/1619367499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd41a1e70 con 0x7f9fd4100cb0 2024-09-12T00:06:01.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.081+0000 7f9fc37fe640 1 -- 172.21.15.6:0/1619367499 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4035070 con 0x7f9fd4100cb0 2024-09-12T00:06:01.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.081+0000 7f9fd8f42640 1 -- 172.21.15.6:0/1619367499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd41a2280 con 0x7f9fd4100cb0 2024-09-12T00:06:01.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.084+0000 7f9fc37fe640 1 -- 172.21.15.6:0/1619367499 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f9fc4042030 con 0x7f9fd4100cb0 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.084+0000 7f9fdbcda740 1 Processor -- start 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.084+0000 7f9fdbcda740 1 -- start start 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.084+0000 7f9fdbcda740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 0x564982c7ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.084+0000 7f9fdbcda740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7b2e0 0x564982c7fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.084+0000 7f9fdbcda740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c82830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fdbcda740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564982bde2f0 con 0x564982c7a9a0 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fdbcda740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564982b86270 con 0x564982c80370 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fdbcda740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564982bda2b0 con 0x564982c7b2e0 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fd2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 0x564982c7ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fd2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 0x564982c7ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58444/0 (socket says 172.21.15.6:58444) 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fd2d9d640 1 -- 172.21.15.6:0/3775632797 learned_addr learned my addr 172.21.15.6:0/3775632797 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fd259c640 1 --2- 172.21.15.6:0/3775632797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7b2e0 0x564982c7fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fc37fe640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9fbc0a2b80 0x7f9fbc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fd1d9b640 1 --2- 172.21.15.6:0/3775632797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c82830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fd2d9d640 1 -- 172.21.15.6:0/3775632797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7b2e0 msgr2=0x564982c7fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fd2d9d640 1 --2- 172.21.15.6:0/3775632797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7b2e0 0x564982c7fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fd2d9d640 1 -- 172.21.15.6:0/3775632797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 msgr2=0x564982c82830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fd2d9d640 1 --2- 172.21.15.6:0/3775632797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c82830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fd2d9d640 1 -- 172.21.15.6:0/3775632797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564982b85340 con 0x564982c7a9a0 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fd2d9d640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9fbc0a2b80 0x7f9fbc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fc37fe640 1 -- 172.21.15.6:0/1619367499 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f9fc40ef950 con 0x7f9fd4100cb0 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.085+0000 7f9fd2d9d640 1 --2- 172.21.15.6:0/3775632797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 0x564982c7ada0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc010440 tx=0x7f9fcc010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc02e3cc73a17f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.086+0000 7f9fc0ff9640 1 -- 172.21.15.6:0/3775632797 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc01d400 con 0x564982c7a9a0 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.086+0000 7f9fc0ff9640 1 -- 172.21.15.6:0/3775632797 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9fcc0134c0 con 0x564982c7a9a0 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.086+0000 7f9fc0ff9640 1 -- 172.21.15.6:0/3775632797 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc011760 con 0x564982c7a9a0 2024-09-12T00:06:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.086+0000 7f9fd2d9d640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9fbc0a2b80 0x7f9fbc0a5040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc021000 tx=0x7f9fcc01e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:01.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.086+0000 7f9fdbcda740 1 -- 172.21.15.6:0/3775632797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 msgr2=0x564982c7ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.086+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/3775632797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 0x564982c7ada0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc010440 tx=0x7f9fcc010900 comp rx=0 tx=0).stop 2024-09-12T00:06:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.086+0000 7f9fdbcda740 1 -- 172.21.15.6:0/3775632797 shutdown_connections 2024-09-12T00:06:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.086+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/3775632797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c82830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.086+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/3775632797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7b2e0 0x564982c7fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.086+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/3775632797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 0x564982c7ada0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.086+0000 7f9fdbcda740 1 -- 172.21.15.6:0/3775632797 >> 172.21.15.6:0/3775632797 conn(0x564982c76010 msgr2=0x564982c76410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.087+0000 7f9fdbcda740 1 -- 172.21.15.6:0/3775632797 shutdown_connections 2024-09-12T00:06:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.087+0000 7f9fdbcda740 1 -- 172.21.15.6:0/3775632797 wait complete. 2024-09-12T00:06:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.087+0000 7f9fdbcda740 1 -- start start 2024-09-12T00:06:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.087+0000 7f9fdbcda740 1 Processor -- start 2024-09-12T00:06:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.087+0000 7f9fdbcda740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7a9a0 0x564982c84bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.087+0000 7f9fdbcda740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c7b2e0 0x564982c850f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.087+0000 7f9fdbcda740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c80370 0x564982c8c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.087+0000 7f9fdbcda740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564982c83340 con 0x564982c80370 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.087+0000 7f9fdbcda740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564982b67290 con 0x564982c7b2e0 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.087+0000 7f9fdbcda740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564982c834c0 con 0x564982c7a9a0 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.087+0000 7f9fdbcda740 10 client.0 _ll_register_callbacks cb 0x564982b98140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fd2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c80370 0x564982c8c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fd2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c80370 0x564982c8c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58458/0 (socket says 172.21.15.6:58458) 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fd2d9d640 1 -- 172.21.15.6:0/4246937391 learned_addr learned my addr 172.21.15.6:0/4246937391 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fd1d9b640 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c7b2e0 0x564982c850f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fd259c640 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7a9a0 0x564982c84bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fd2d9d640 1 -- 172.21.15.6:0/4246937391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7a9a0 msgr2=0x564982c84bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fd2d9d640 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7a9a0 0x564982c84bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fd2d9d640 1 -- 172.21.15.6:0/4246937391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c7b2e0 msgr2=0x564982c850f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fd2d9d640 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c7b2e0 0x564982c850f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fd2d9d640 1 -- 172.21.15.6:0/4246937391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649828f1210 con 0x564982c80370 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fd259c640 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7a9a0 0x564982c84bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fd2d9d640 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c80370 0x564982c8c130 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009860 tx=0x7f9fcc011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9610f8db104265c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fb9ffb640 1 -- 172.21.15.6:0/4246937391 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc003b80 con 0x564982c80370 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fb9ffb640 1 -- 172.21.15.6:0/4246937391 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f9fcc003d20 con 0x564982c80370 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fdbcda740 1 -- 172.21.15.6:0/4246937391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fcc0134c0 con 0x564982c80370 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.088+0000 7f9fb9ffb640 1 -- 172.21.15.6:0/4246937391 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9fcc01d400 con 0x564982c80370 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.089+0000 7f9fdbcda740 10 client.15882 fetch_fsmap learned FSMap version 33 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.089+0000 7f9fdbcda740 1 -- 172.21.15.6:0/4246937391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5649829bd620 con 0x564982c80370 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.089+0000 7f9fb9ffb640 1 -- 172.21.15.6:0/4246937391 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9fcc0134c0 con 0x564982c80370 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.089+0000 7f9fb9ffb640 1 -- 172.21.15.6:0/4246937391 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9fcc00f040 con 0x564982c80370 2024-09-12T00:06:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.089+0000 7f9fdbcda740 10 client.15882 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.089+0000 7f9fdbcda740 10 client.15882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.089+0000 7f9fdbcda740 20 client.15882 populate_metadata read hostname 'smithi006' 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.089+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564982c906d0 0x564982c92ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.089+0000 7f9fdbcda740 4 client.15882 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.089+0000 7f9fdbcda740 1 -- 172.21.15.6:0/4246937391 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564982beba20 con 0x564982c906d0 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.089+0000 7f9fd259c640 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564982c906d0 0x564982c92ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.090+0000 7f9fd259c640 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564982c906d0 0x564982c92ac0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90fc1a37ea4c9c73 server_cookie=539c00bb7f79850f in_seq=0 out_seq=0 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.090+0000 7f9fb9ffb640 10 client.15882 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fb9ffb640 1 -- 172.21.15.6:0/4246937391 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564982beba20 con 0x564982c906d0 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fb9ffb640 10 client.15882 handle_command_reply: tid=0 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fdbcda740 1 client.15882 shutdown 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fdbcda740 1 -- 172.21.15.6:0/4246937391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c80370 msgr2=0x564982c8c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c80370 0x564982c8c130 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009860 tx=0x7f9fcc011d20 comp rx=0 tx=0).stop 2024-09-12T00:06:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fdbcda740 1 -- 172.21.15.6:0/4246937391 shutdown_connections 2024-09-12T00:06:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c80370 0x564982c8c130 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c7b2e0 0x564982c850f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564982c906d0 0x564982c92ac0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/4246937391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7a9a0 0x564982c84bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fdbcda740 1 -- 172.21.15.6:0/4246937391 >> 172.21.15.6:0/4246937391 conn(0x564982c76010 msgr2=0x564982c77820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fb9ffb640 0 client.15882 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fdbcda740 1 -- 172.21.15.6:0/4246937391 shutdown_connections 2024-09-12T00:06:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fdbcda740 1 -- 172.21.15.6:0/4246937391 wait complete. 2024-09-12T00:06:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.091+0000 7f9fdbcda740 20 client.15882 trim_cache size 0 max 16384 2024-09-12T00:06:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.114+0000 7f9fdbcda740 1 Processor -- start 2024-09-12T00:06:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.114+0000 7f9fdbcda740 1 -- start start 2024-09-12T00:06:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.114+0000 7f9fdbcda740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7a9a0 0x564982c750b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.114+0000 7f9fdbcda740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7b2e0 0x564982c8c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.114+0000 7f9fdbcda740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c97380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.114+0000 7f9fdbcda740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd41aca70 con 0x564982c7b2e0 2024-09-12T00:06:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.114+0000 7f9fdbcda740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd41ae5b0 con 0x564982c80370 2024-09-12T00:06:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.114+0000 7f9fdbcda740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd41ad140 con 0x564982c7a9a0 2024-09-12T00:06:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.114+0000 7f9fd1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7b2e0 0x564982c8c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.114+0000 7f9fd1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7b2e0 0x564982c8c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58460/0 (socket says 172.21.15.6:58460) 2024-09-12T00:06:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.114+0000 7f9fd1d9b640 1 -- 172.21.15.6:0/3439033880 learned_addr learned my addr 172.21.15.6:0/3439033880 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.115+0000 7f9fd259c640 1 --2- 172.21.15.6:0/3439033880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7a9a0 0x564982c750b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.115+0000 7f9fd2d9d640 1 --2- 172.21.15.6:0/3439033880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c97380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.115+0000 7f9fd1d9b640 1 -- 172.21.15.6:0/3439033880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7a9a0 msgr2=0x564982c750b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.115+0000 7f9fd1d9b640 1 --2- 172.21.15.6:0/3439033880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7a9a0 0x564982c750b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.115+0000 7f9fd1d9b640 1 -- 172.21.15.6:0/3439033880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 msgr2=0x564982c97380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.115+0000 7f9fd1d9b640 1 --2- 172.21.15.6:0/3439033880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c97380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.115+0000 7f9fd1d9b640 1 -- 172.21.15.6:0/3439033880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564982c75e30 con 0x564982c7b2e0 2024-09-12T00:06:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.115+0000 7f9fd2d9d640 1 --2- 172.21.15.6:0/3439033880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c97380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.115+0000 7f9fd1d9b640 1 --2- 172.21.15.6:0/3439033880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7b2e0 0x564982c8c0f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800bce0 tx=0x7f9fc8012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8700ba7565a25c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.115+0000 7f9fbbfff640 1 -- 172.21.15.6:0/3439033880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc801f070 con 0x564982c7b2e0 2024-09-12T00:06:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.115+0000 7f9fbbfff640 1 -- 172.21.15.6:0/3439033880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9fc80047a0 con 0x564982c7b2e0 2024-09-12T00:06:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.115+0000 7f9fbbfff640 1 -- 172.21.15.6:0/3439033880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8005280 con 0x564982c7b2e0 2024-09-12T00:06:01.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.116+0000 7f9fdbcda740 1 -- 172.21.15.6:0/3439033880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7b2e0 msgr2=0x564982c8c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:01.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.116+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/3439033880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7b2e0 0x564982c8c0f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800bce0 tx=0x7f9fc8012820 comp rx=0 tx=0).stop 2024-09-12T00:06:01.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.116+0000 7f9fdbcda740 1 -- 172.21.15.6:0/3439033880 shutdown_connections 2024-09-12T00:06:01.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.116+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/3439033880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c97380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.116+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/3439033880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7b2e0 0x564982c8c0f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.116+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/3439033880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7a9a0 0x564982c750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.116+0000 7f9fdbcda740 1 -- 172.21.15.6:0/3439033880 >> 172.21.15.6:0/3439033880 conn(0x564982c76010 msgr2=0x564982c749a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.116+0000 7f9fdbcda740 1 -- 172.21.15.6:0/3439033880 shutdown_connections 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.116+0000 7f9fdbcda740 1 -- 172.21.15.6:0/3439033880 wait complete. 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.116+0000 7f9fdbcda740 1 -- start start 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.116+0000 7f9fdbcda740 1 Processor -- start 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fdbcda740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 0x564982c89460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fdbcda740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7b2e0 0x564982c899a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fdbcda740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c8a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fdbcda740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd41adee0 con 0x564982c7a9a0 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fdbcda740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd41ad810 con 0x564982c80370 2024-09-12T00:06:01.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fdbcda740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd41aaa50 con 0x564982c7b2e0 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fdbcda740 10 client.0 _ll_register_callbacks cb 0x7f9fcc013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fd259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 0x564982c89460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fd259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 0x564982c89460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58464/0 (socket says 172.21.15.6:58464) 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fd259c640 1 -- 172.21.15.6:0/2904075585 learned_addr learned my addr 172.21.15.6:0/2904075585 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fd1d9b640 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7b2e0 0x564982c899a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fd259c640 1 -- 172.21.15.6:0/2904075585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7b2e0 msgr2=0x564982c899a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fd2d9d640 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c8a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fd259c640 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7b2e0 0x564982c899a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fd259c640 1 -- 172.21.15.6:0/2904075585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 msgr2=0x564982c8a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fd259c640 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c8a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fd259c640 1 -- 172.21.15.6:0/2904075585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564982c8afc0 con 0x564982c7a9a0 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fd259c640 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 0x564982c89460 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40b82d0 tx=0x7f9fc40efb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db46e7d4ab485ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:06:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.117+0000 7f9fb9ffb640 1 -- 172.21.15.6:0/2904075585 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc40f5020 con 0x564982c7a9a0 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fb9ffb640 1 -- 172.21.15.6:0/2904075585 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f9fc40ba170 con 0x564982c7a9a0 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fdbcda740 1 -- 172.21.15.6:0/2904075585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fc80047a0 con 0x564982c7a9a0 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fb9ffb640 1 -- 172.21.15.6:0/2904075585 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9fc4049040 con 0x564982c7a9a0 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fdbcda740 10 client.15888 fetch_fsmap learned FSMap version 33 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fdbcda740 1 -- 172.21.15.6:0/2904075585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564982c8c310 con 0x564982c7a9a0 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fb9ffb640 1 -- 172.21.15.6:0/2904075585 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9fc80047a0 con 0x564982c7a9a0 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fb9ffb640 1 -- 172.21.15.6:0/2904075585 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9fc409ace0 con 0x564982c7a9a0 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fdbcda740 10 client.15888 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fdbcda740 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fdbcda740 20 client.15888 populate_metadata read hostname 'smithi006' 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564982cfb9a0 0x564982cfddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fdbcda740 4 client.15888 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.118+0000 7f9fdbcda740 1 -- 172.21.15.6:0/2904075585 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564982be5d70 con 0x564982cfb9a0 2024-09-12T00:06:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.119+0000 7f9fd1d9b640 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564982cfb9a0 0x564982cfddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:01.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.119+0000 7f9fb9ffb640 10 client.15888 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:01.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.119+0000 7f9fd1d9b640 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564982cfb9a0 0x564982cfddc0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f68a1c35f06915a server_cookie=465f6d1e2c6d3374 in_seq=0 out_seq=0 2024-09-12T00:06:01.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.134+0000 7f9fb9ffb640 1 -- 172.21.15.6:0/2904075585 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564982be5d70 con 0x564982cfb9a0 2024-09-12T00:06:01.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.134+0000 7f9fb9ffb640 10 client.15888 handle_command_reply: tid=0 2024-09-12T00:06:01.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.134+0000 7f9fdbcda740 1 client.15888 shutdown 2024-09-12T00:06:01.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.135+0000 7f9fdbcda740 1 -- 172.21.15.6:0/2904075585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 msgr2=0x564982c89460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:01.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.135+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 0x564982c89460 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40b82d0 tx=0x7f9fc40efb50 comp rx=0 tx=0).stop 2024-09-12T00:06:01.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.135+0000 7f9fdbcda740 1 -- 172.21.15.6:0/2904075585 shutdown_connections 2024-09-12T00:06:01.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.135+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564982c80370 0x564982c8a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.135+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564982cfb9a0 0x564982cfddc0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.135+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564982c7b2e0 0x564982c899a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.135+0000 7f9fb9ffb640 0 client.15888 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.135+0000 7f9fdbcda740 1 --2- 172.21.15.6:0/2904075585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564982c7a9a0 0x564982c89460 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.135+0000 7f9fdbcda740 1 -- 172.21.15.6:0/2904075585 >> 172.21.15.6:0/2904075585 conn(0x564982c76010 msgr2=0x564982c751c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.135+0000 7f9fdbcda740 1 -- 172.21.15.6:0/2904075585 shutdown_connections 2024-09-12T00:06:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.135+0000 7f9fdbcda740 1 -- 172.21.15.6:0/2904075585 wait complete. 2024-09-12T00:06:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.135+0000 7f9fdbcda740 20 client.15888 trim_cache size 0 max 16384 2024-09-12T00:06:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:06:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:06:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:06:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:06:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.136+0000 7f9fd8f42640 1 -- 172.21.15.6:0/1619367499 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9fbc0a2b80 msgr2=0x7f9fbc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.136+0000 7f9fd8f42640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9fbc0a2b80 0x7f9fbc0a5040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc021000 tx=0x7f9fcc01e000 comp rx=0 tx=0).stop 2024-09-12T00:06:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.136+0000 7f9fd8f42640 1 -- 172.21.15.6:0/1619367499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fd4100cb0 msgr2=0x7f9fd4104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.136+0000 7f9fd8f42640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fd4100cb0 0x7f9fd4104cf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40314e0 tx=0x7f9fc4004270 comp rx=0 tx=0).stop 2024-09-12T00:06:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.136+0000 7f9fd8f42640 1 -- 172.21.15.6:0/1619367499 shutdown_connections 2024-09-12T00:06:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.136+0000 7f9fd8f42640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9fbc0a2b80 0x7f9fbc0a5040 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.136+0000 7f9fd8f42640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd4102010 0x7f9fd4103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.136+0000 7f9fd8f42640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fd4101670 0x7f9fd4103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.136+0000 7f9fd8f42640 1 --2- 172.21.15.6:0/1619367499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fd4100cb0 0x7f9fd4104cf0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.136+0000 7f9fd8f42640 1 -- 172.21.15.6:0/1619367499 >> 172.21.15.6:0/1619367499 conn(0x7f9fd40fb930 msgr2=0x7f9fd40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.136+0000 7f9fd8f42640 1 -- 172.21.15.6:0/1619367499 shutdown_connections 2024-09-12T00:06:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:01.136+0000 7f9fd8f42640 1 -- 172.21.15.6:0/1619367499 wait complete. 2024-09-12T00:06:02.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:02 smithi006 ceph-mon[30947]: pgmap v560: 129 pgs: 129 active+clean; 8.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:06:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:02 smithi134 ceph-mon[34893]: pgmap v560: 129 pgs: 129 active+clean; 8.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:06:03.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:02 smithi039 ceph-mon[34543]: pgmap v560: 129 pgs: 129 active+clean; 8.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:06:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:04 smithi006 ceph-mon[30947]: pgmap v561: 129 pgs: 129 active+clean; 8.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-09-12T00:06:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:04 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:06:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:04 smithi134 ceph-mon[34893]: pgmap v561: 129 pgs: 129 active+clean; 8.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-09-12T00:06:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:04 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:06:05.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:04 smithi039 ceph-mon[34543]: pgmap v561: 129 pgs: 129 active+clean; 8.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-09-12T00:06:05.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:04 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:06:05.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi039 to 176.0M 2024-09-12T00:06:05.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: Unable to set osd_memory_target on smithi039 to 184584601: error parsing value: Value '184584601' is below minimum 939524096 2024-09-12T00:06:05.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi006 to 177.0M 2024-09-12T00:06:05.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: Unable to set osd_memory_target on smithi006 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-12T00:06:05.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:06:05.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:06:05.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:06:05.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi039 to 176.0M 2024-09-12T00:06:05.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: Unable to set osd_memory_target on smithi039 to 184584601: error parsing value: Value '184584601' is below minimum 939524096 2024-09-12T00:06:05.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi006 to 177.0M 2024-09-12T00:06:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: Unable to set osd_memory_target on smithi006 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-12T00:06:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:06:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:06:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:06:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi039 to 176.0M 2024-09-12T00:06:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: Unable to set osd_memory_target on smithi039 to 184584601: error parsing value: Value '184584601' is below minimum 939524096 2024-09-12T00:06:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:06.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:06:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi006 to 177.0M 2024-09-12T00:06:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: Unable to set osd_memory_target on smithi006 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-12T00:06:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:06:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:06:06.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:06:07.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:06 smithi006 ceph-mon[30947]: pgmap v562: 129 pgs: 129 active+clean; 8.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:06:07.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:06 smithi134 ceph-mon[34893]: pgmap v562: 129 pgs: 129 active+clean; 8.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:06:07.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:06 smithi039 ceph-mon[34543]: pgmap v562: 129 pgs: 129 active+clean; 8.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:06:09.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:08 smithi006 ceph-mon[30947]: pgmap v563: 129 pgs: 129 active+clean; 8.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:06:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:08 smithi134 ceph-mon[34893]: pgmap v563: 129 pgs: 129 active+clean; 8.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:06:09.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:08 smithi039 ceph-mon[34543]: pgmap v563: 129 pgs: 129 active+clean; 8.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:06:11.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:10 smithi006 ceph-mon[30947]: pgmap v564: 129 pgs: 129 active+clean; 8.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:06:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:10 smithi134 ceph-mon[34893]: pgmap v564: 129 pgs: 129 active+clean; 8.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:06:11.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:10 smithi039 ceph-mon[34543]: pgmap v564: 129 pgs: 129 active+clean; 8.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:06:13.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:12 smithi006 ceph-mon[30947]: pgmap v565: 129 pgs: 129 active+clean; 8.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:06:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:12 smithi134 ceph-mon[34893]: pgmap v565: 129 pgs: 129 active+clean; 8.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:06:13.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:12 smithi039 ceph-mon[34543]: pgmap v565: 129 pgs: 129 active+clean; 8.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:06:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.238+0000 7f20da331640 1 -- 172.21.15.6:0/567669723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d4101c30 msgr2=0x7f20d41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.238+0000 7f20da331640 1 --2- 172.21.15.6:0/567669723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d4101c30 0x7f20d41020b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009900 tx=0x7f20bc02a410 comp rx=0 tx=0).stop 2024-09-12T00:06:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.238+0000 7f20da331640 1 -- 172.21.15.6:0/567669723 shutdown_connections 2024-09-12T00:06:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.238+0000 7f20da331640 1 --2- 172.21.15.6:0/567669723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20d41025f0 0x7f20d4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.238+0000 7f20da331640 1 --2- 172.21.15.6:0/567669723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d4101c30 0x7f20d41020b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.238+0000 7f20da331640 1 --2- 172.21.15.6:0/567669723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20d4100a40 0x7f20d4100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.238+0000 7f20da331640 1 -- 172.21.15.6:0/567669723 >> 172.21.15.6:0/567669723 conn(0x7f20d40fc1c0 msgr2=0x7f20d40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.238+0000 7f20da331640 1 -- 172.21.15.6:0/567669723 shutdown_connections 2024-09-12T00:06:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.238+0000 7f20da331640 1 -- 172.21.15.6:0/567669723 wait complete. 2024-09-12T00:06:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20da331640 1 Processor -- start 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20da331640 1 -- start start 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20da331640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20d4100a40 0x7f20d4197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20da331640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d4101c30 0x7f20d41982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20da331640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20d41025f0 0x7f20d419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20da331640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f20d410c5c0 con 0x7f20d4101c30 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20da331640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f20d410c440 con 0x7f20d4100a40 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20da331640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f20d410c740 con 0x7f20d41025f0 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d4101c30 0x7f20d41982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d4101c30 0x7f20d41982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53238/0 (socket says 172.21.15.6:53238) 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20cbfff640 1 -- 172.21.15.6:0/937526121 learned_addr learned my addr 172.21.15.6:0/937526121 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20d88ce640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20d41025f0 0x7f20d419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20d3fff640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20d4100a40 0x7f20d4197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20cbfff640 1 -- 172.21.15.6:0/937526121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20d41025f0 msgr2=0x7f20d419f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20cbfff640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20d41025f0 0x7f20d419f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20cbfff640 1 -- 172.21.15.6:0/937526121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20d4100a40 msgr2=0x7f20d4197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20cbfff640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20d4100a40 0x7f20d4197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20cbfff640 1 -- 172.21.15.6:0/937526121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d419f980 con 0x7f20d4101c30 2024-09-12T00:06:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.239+0000 7f20d3fff640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20d4100a40 0x7f20d4197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.240+0000 7f20cbfff640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d4101c30 0x7f20d41982a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0314e0 tx=0x7f20bc003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.240+0000 7f20d1ffb640 1 -- 172.21.15.6:0/937526121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc03f070 con 0x7f20d4101c30 2024-09-12T00:06:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.240+0000 7f20da331640 1 -- 172.21.15.6:0/937526121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d419fc10 con 0x7f20d4101c30 2024-09-12T00:06:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.240+0000 7f20d1ffb640 1 -- 172.21.15.6:0/937526121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20bc031e40 con 0x7f20d4101c30 2024-09-12T00:06:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.240+0000 7f20d1ffb640 1 -- 172.21.15.6:0/937526121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc035030 con 0x7f20d4101c30 2024-09-12T00:06:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.240+0000 7f20da331640 1 -- 172.21.15.6:0/937526121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d41a0100 con 0x7f20d4101c30 2024-09-12T00:06:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20dd0cf740 1 Processor -- start 2024-09-12T00:06:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20dd0cf740 1 -- start start 2024-09-12T00:06:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20d1ffb640 1 -- 172.21.15.6:0/937526121 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f20bc042070 con 0x7f20d4101c30 2024-09-12T00:06:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20dd0cf740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 0x555caa1891b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20dd0cf740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa18e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20dd0cf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa190c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20dd0cf740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555caa0e82f0 con 0x555caa1896f0 2024-09-12T00:06:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20dd0cf740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555caa090270 con 0x555caa188db0 2024-09-12T00:06:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20dd0cf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555caa0e42b0 con 0x555caa18e780 2024-09-12T00:06:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa18e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa18e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53250/0 (socket says 172.21.15.6:53250) 2024-09-12T00:06:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20d3fff640 1 -- 172.21.15.6:0/2981732890 learned_addr learned my addr 172.21.15.6:0/2981732890 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20d88ce640 1 --2- 172.21.15.6:0/2981732890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 0x555caa1891b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20cbfff640 1 --2- 172.21.15.6:0/2981732890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa190c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20d3fff640 1 -- 172.21.15.6:0/2981732890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 msgr2=0x555caa190c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20d3fff640 1 --2- 172.21.15.6:0/2981732890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa190c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20d3fff640 1 -- 172.21.15.6:0/2981732890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 msgr2=0x555caa1891b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20d3fff640 1 --2- 172.21.15.6:0/2981732890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 0x555caa1891b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20d3fff640 1 -- 172.21.15.6:0/2981732890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555caa08f340 con 0x555caa1896f0 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.243+0000 7f20cbfff640 1 --2- 172.21.15.6:0/2981732890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa190c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.244+0000 7f20d3fff640 1 --2- 172.21.15.6:0/2981732890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa18e1b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f20c400bd30 tx=0x7f20c400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbdc043883dd5cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.244+0000 7f20d1ffb640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f20c00a2b80 0x7f20c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.244+0000 7f20ca7fc640 1 -- 172.21.15.6:0/2981732890 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4015070 con 0x555caa1896f0 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.244+0000 7f20d88ce640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f20c00a2b80 0x7f20c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.244+0000 7f20ca7fc640 1 -- 172.21.15.6:0/2981732890 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20c400be20 con 0x555caa1896f0 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.244+0000 7f20ca7fc640 1 -- 172.21.15.6:0/2981732890 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4010750 con 0x555caa1896f0 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.244+0000 7f20d1ffb640 1 -- 172.21.15.6:0/937526121 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f20bc0efd30 con 0x7f20d4101c30 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.245+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2981732890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 msgr2=0x555caa18e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.245+0000 7f20d88ce640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f20c00a2b80 0x7f20c00a5040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f20cc007f80 tx=0x7f20cc007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.245+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/2981732890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa18e1b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f20c400bd30 tx=0x7f20c400f730 comp rx=0 tx=0).stop 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.245+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2981732890 shutdown_connections 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.245+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/2981732890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa190c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.245+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/2981732890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa18e1b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.245+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/2981732890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 0x555caa1891b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.245+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2981732890 >> 172.21.15.6:0/2981732890 conn(0x555caa180010 msgr2=0x555caa180410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.245+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2981732890 shutdown_connections 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.245+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2981732890 wait complete. 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.245+0000 7f20dd0cf740 1 -- start start 2024-09-12T00:06:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.245+0000 7f20dd0cf740 1 Processor -- start 2024-09-12T00:06:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20dd0cf740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 0x555caa192fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20dd0cf740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa1934e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20dd0cf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa19a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20dd0cf740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555caa191750 con 0x555caa1896f0 2024-09-12T00:06:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20dd0cf740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555caa071290 con 0x555caa188db0 2024-09-12T00:06:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20dd0cf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555caa1918d0 con 0x555caa18e780 2024-09-12T00:06:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20dd0cf740 10 client.0 _ll_register_callbacks cb 0x555caa0a2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa1934e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa1934e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53254/0 (socket says 172.21.15.6:53254) 2024-09-12T00:06:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20cbfff640 1 -- 172.21.15.6:0/1677531778 learned_addr learned my addr 172.21.15.6:0/1677531778 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20d88ce640 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20d3fff640 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 0x555caa192fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20cbfff640 1 -- 172.21.15.6:0/1677531778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 msgr2=0x555caa19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20cbfff640 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20cbfff640 1 -- 172.21.15.6:0/1677531778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 msgr2=0x555caa192fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20cbfff640 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 0x555caa192fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20cbfff640 1 -- 172.21.15.6:0/1677531778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ca9dfb210 con 0x555caa1896f0 2024-09-12T00:06:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20cbfff640 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa1934e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0c48e0 tx=0x7f20bc009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6381ebfe3f8f232 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.246+0000 7f20b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:06:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20b37fe640 1 -- 172.21.15.6:0/1677531778 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc049050 con 0x555caa1896f0 2024-09-12T00:06:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20b37fe640 1 -- 172.21.15.6:0/1677531778 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f20bc0b8810 con 0x555caa1896f0 2024-09-12T00:06:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1677531778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20c400be20 con 0x555caa1896f0 2024-09-12T00:06:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20b37fe640 1 -- 172.21.15.6:0/1677531778 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f20bc0bbb00 con 0x555caa1896f0 2024-09-12T00:06:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20dd0cf740 10 client.15900 fetch_fsmap learned FSMap version 33 2024-09-12T00:06:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1677531778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x555ca9ec7620 con 0x555caa1896f0 2024-09-12T00:06:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20b37fe640 1 -- 172.21.15.6:0/1677531778 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20c400be20 con 0x555caa1896f0 2024-09-12T00:06:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20b37fe640 1 -- 172.21.15.6:0/1677531778 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f20bc0dc0b0 con 0x555caa1896f0 2024-09-12T00:06:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20dd0cf740 10 client.15900 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:06:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20dd0cf740 10 client.15900 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:06:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20dd0cf740 20 client.15900 populate_metadata read hostname 'smithi006' 2024-09-12T00:06:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555caa19ec80 0x555caa1a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20dd0cf740 4 client.15900 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1677531778 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555caa0f5a20 con 0x555caa19ec80 2024-09-12T00:06:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.247+0000 7f20d3fff640 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555caa19ec80 0x555caa1a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.248+0000 7f20d3fff640 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555caa19ec80 0x555caa1a10d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e3b5daa3e17c3dc server_cookie=bb418d682c5226fa in_seq=0 out_seq=0 2024-09-12T00:06:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.248+0000 7f20b37fe640 10 client.15900 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20b37fe640 1 -- 172.21.15.6:0/1677531778 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555caa0f5a20 con 0x555caa19ec80 2024-09-12T00:06:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20b37fe640 10 client.15900 handle_command_reply: tid=0 2024-09-12T00:06:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20dd0cf740 1 client.15900 shutdown 2024-09-12T00:06:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1677531778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 msgr2=0x555caa1934e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa1934e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0c48e0 tx=0x7f20bc009670 comp rx=0 tx=0).stop 2024-09-12T00:06:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1677531778 shutdown_connections 2024-09-12T00:06:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555caa19ec80 0x555caa1a10d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa1934e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20b37fe640 0 client.15900 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/1677531778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 0x555caa192fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1677531778 >> 172.21.15.6:0/1677531778 conn(0x555caa180010 msgr2=0x555caa181820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1677531778 shutdown_connections 2024-09-12T00:06:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1677531778 wait complete. 2024-09-12T00:06:14.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.249+0000 7f20dd0cf740 20 client.15900 trim_cache size 0 max 16384 2024-09-12T00:06:14.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20dd0cf740 1 Processor -- start 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20dd0cf740 1 -- start start 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20dd0cf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa188db0 0x555caa180ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20dd0cf740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20dd0cf740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa18e780 0x555caa181400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20dd0cf740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f20d41a8500 con 0x555caa1896f0 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20dd0cf740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f20d41aa040 con 0x555caa18e780 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20dd0cf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f20d41a8bd0 con 0x555caa188db0 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53264/0 (socket says 172.21.15.6:53264) 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20cbfff640 1 -- 172.21.15.6:0/1686263796 learned_addr learned my addr 172.21.15.6:0/1686263796 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20d88ce640 1 --2- 172.21.15.6:0/1686263796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa18e780 0x555caa181400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20d3fff640 1 --2- 172.21.15.6:0/1686263796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa188db0 0x555caa180ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20cbfff640 1 -- 172.21.15.6:0/1686263796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa188db0 msgr2=0x555caa180ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20cbfff640 1 --2- 172.21.15.6:0/1686263796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa188db0 0x555caa180ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20cbfff640 1 -- 172.21.15.6:0/1686263796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa18e780 msgr2=0x555caa181400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20cbfff640 1 --2- 172.21.15.6:0/1686263796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa18e780 0x555caa181400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.268+0000 7f20cbfff640 1 -- 172.21.15.6:0/1686263796 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555caa191a50 con 0x555caa1896f0 2024-09-12T00:06:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.269+0000 7f20d88ce640 1 --2- 172.21.15.6:0/1686263796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa18e780 0x555caa181400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.269+0000 7f20cbfff640 1 --2- 172.21.15.6:0/1686263796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa19a4e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f20bc000c00 tx=0x7f20bc0f00e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a666bda4acdc275 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.269+0000 7f20c9ffb640 1 -- 172.21.15.6:0/1686263796 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc049030 con 0x555caa1896f0 2024-09-12T00:06:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.269+0000 7f20c9ffb640 1 -- 172.21.15.6:0/1686263796 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20bc0bc8a0 con 0x555caa1896f0 2024-09-12T00:06:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.269+0000 7f20c9ffb640 1 -- 172.21.15.6:0/1686263796 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0dc0c0 con 0x555caa1896f0 2024-09-12T00:06:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1686263796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 msgr2=0x555caa19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/1686263796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa19a4e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f20bc000c00 tx=0x7f20bc0f00e0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1686263796 shutdown_connections 2024-09-12T00:06:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/1686263796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa18e780 0x555caa181400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/1686263796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa19a4e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/1686263796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa188db0 0x555caa180ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1686263796 >> 172.21.15.6:0/1686263796 conn(0x555caa180010 msgr2=0x555caa192fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1686263796 shutdown_connections 2024-09-12T00:06:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 -- 172.21.15.6:0/1686263796 wait complete. 2024-09-12T00:06:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 -- start start 2024-09-12T00:06:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 Processor -- start 2024-09-12T00:06:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 0x555caa197c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa199180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f20d41a9970 con 0x555caa1896f0 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f20d41a92a0 con 0x555caa188db0 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f20d41a64e0 con 0x555caa18e780 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.270+0000 7f20dd0cf740 10 client.0 _ll_register_callbacks cb 0x7f20bc003e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa1981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53272/0 (socket says 172.21.15.6:53272) 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20cbfff640 1 -- 172.21.15.6:0/2800158212 learned_addr learned my addr 172.21.15.6:0/2800158212 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20d3fff640 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 0x555caa197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20d88ce640 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20cbfff640 1 -- 172.21.15.6:0/2800158212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 msgr2=0x555caa199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20cbfff640 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20cbfff640 1 -- 172.21.15.6:0/2800158212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 msgr2=0x555caa197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20cbfff640 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 0x555caa197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20cbfff640 1 -- 172.21.15.6:0/2800158212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555caa199790 con 0x555caa1896f0 2024-09-12T00:06:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20d88ce640 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20cbfff640 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa1981c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f20bc02a9d0 tx=0x7f20bc0f3390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99329f853045d5c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:06:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20b37fe640 1 -- 172.21.15.6:0/2800158212 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc049070 con 0x555caa1896f0 2024-09-12T00:06:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20b37fe640 1 -- 172.21.15.6:0/2800158212 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f20bc0c4b80 con 0x555caa1896f0 2024-09-12T00:06:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2800158212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20bc0bc8a0 con 0x555caa1896f0 2024-09-12T00:06:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20b37fe640 1 -- 172.21.15.6:0/2800158212 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f20bc0bbf70 con 0x555caa1896f0 2024-09-12T00:06:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20dd0cf740 10 client.15906 fetch_fsmap learned FSMap version 33 2024-09-12T00:06:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.271+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2800158212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x555caa199790 con 0x555caa1896f0 2024-09-12T00:06:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.272+0000 7f20b37fe640 1 -- 172.21.15.6:0/2800158212 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20bc0bc8a0 con 0x555caa1896f0 2024-09-12T00:06:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.272+0000 7f20b37fe640 1 -- 172.21.15.6:0/2800158212 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f20bc0bb5f0 con 0x555caa1896f0 2024-09-12T00:06:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.272+0000 7f20dd0cf740 10 client.15906 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:06:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.272+0000 7f20dd0cf740 10 client.15906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:06:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.272+0000 7f20dd0cf740 20 client.15906 populate_metadata read hostname 'smithi006' 2024-09-12T00:06:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.272+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555caa20a000 0x555caa20c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.272+0000 7f20dd0cf740 4 client.15906 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:06:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.272+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2800158212 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555caa0efd70 con 0x555caa20a000 2024-09-12T00:06:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.272+0000 7f20d3fff640 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555caa20a000 0x555caa20c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.273+0000 7f20b37fe640 10 client.15906 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.273+0000 7f20d3fff640 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555caa20a000 0x555caa20c420 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=108b8f6a32bb0543 server_cookie=7b503d7e34ab48cd in_seq=0 out_seq=0 2024-09-12T00:06:14.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20b37fe640 1 -- 172.21.15.6:0/2800158212 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555caa0efd70 con 0x555caa20a000 2024-09-12T00:06:14.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20b37fe640 10 client.15906 handle_command_reply: tid=0 2024-09-12T00:06:14.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20dd0cf740 1 client.15906 shutdown 2024-09-12T00:06:14.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2800158212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 msgr2=0x555caa1981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:14.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa1981c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f20bc02a9d0 tx=0x7f20bc0f3390 comp rx=0 tx=0).stop 2024-09-12T00:06:14.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2800158212 shutdown_connections 2024-09-12T00:06:14.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x555caa20a000 0x555caa20c420 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555caa18e780 0x555caa199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555caa1896f0 0x555caa1981c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20b37fe640 0 client.15906 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20dd0cf740 1 --2- 172.21.15.6:0/2800158212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555caa188db0 0x555caa197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2800158212 >> 172.21.15.6:0/2800158212 conn(0x555caa180010 msgr2=0x555caa17e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2800158212 shutdown_connections 2024-09-12T00:06:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20dd0cf740 1 -- 172.21.15.6:0/2800158212 wait complete. 2024-09-12T00:06:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.291+0000 7f20dd0cf740 20 client.15906 trim_cache size 0 max 16384 2024-09-12T00:06:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:06:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:06:14.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:06:14.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:06:14.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.292+0000 7f20da331640 1 -- 172.21.15.6:0/937526121 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f20c00a2b80 msgr2=0x7f20c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:14.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.292+0000 7f20da331640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f20c00a2b80 0x7f20c00a5040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f20cc007f80 tx=0x7f20cc007520 comp rx=0 tx=0).stop 2024-09-12T00:06:14.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.292+0000 7f20da331640 1 -- 172.21.15.6:0/937526121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d4101c30 msgr2=0x7f20d41982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:14.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.292+0000 7f20da331640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d4101c30 0x7f20d41982a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0314e0 tx=0x7f20bc003c80 comp rx=0 tx=0).stop 2024-09-12T00:06:14.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.292+0000 7f20da331640 1 -- 172.21.15.6:0/937526121 shutdown_connections 2024-09-12T00:06:14.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.292+0000 7f20da331640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f20c00a2b80 0x7f20c00a5040 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.292+0000 7f20da331640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20d41025f0 0x7f20d419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.292+0000 7f20da331640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d4101c30 0x7f20d41982a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.292+0000 7f20da331640 1 --2- 172.21.15.6:0/937526121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20d4100a40 0x7f20d4197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:14.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.292+0000 7f20da331640 1 -- 172.21.15.6:0/937526121 >> 172.21.15.6:0/937526121 conn(0x7f20d40fc1c0 msgr2=0x7f20d4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:14.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.292+0000 7f20da331640 1 -- 172.21.15.6:0/937526121 shutdown_connections 2024-09-12T00:06:14.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:14.292+0000 7f20da331640 1 -- 172.21.15.6:0/937526121 wait complete. 2024-09-12T00:06:15.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:14 smithi006 ceph-mon[30947]: pgmap v566: 129 pgs: 129 active+clean; 8.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 22 op/s 2024-09-12T00:06:15.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:14 smithi134 ceph-mon[34893]: pgmap v566: 129 pgs: 129 active+clean; 8.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 22 op/s 2024-09-12T00:06:15.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:14 smithi039 ceph-mon[34543]: pgmap v566: 129 pgs: 129 active+clean; 8.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 22 op/s 2024-09-12T00:06:17.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:16 smithi006 ceph-mon[30947]: pgmap v567: 129 pgs: 129 active+clean; 8.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:06:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:16 smithi134 ceph-mon[34893]: pgmap v567: 129 pgs: 129 active+clean; 8.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:06:17.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:16 smithi039 ceph-mon[34543]: pgmap v567: 129 pgs: 129 active+clean; 8.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:06:19.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:18 smithi006 ceph-mon[30947]: pgmap v568: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:06:19.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:18 smithi134 ceph-mon[34893]: pgmap v568: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:06:19.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:18 smithi039 ceph-mon[34543]: pgmap v568: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:06:21.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:20 smithi006 ceph-mon[30947]: pgmap v569: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:06:21.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:20 smithi134 ceph-mon[34893]: pgmap v569: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:06:21.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:20 smithi039 ceph-mon[34543]: pgmap v569: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-12T00:06:23.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:22 smithi006 ceph-mon[30947]: pgmap v570: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:06:23.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:22 smithi134 ceph-mon[34893]: pgmap v570: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:06:23.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:22 smithi039 ceph-mon[34543]: pgmap v570: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:06:25.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:24 smithi006 ceph-mon[30947]: pgmap v571: 129 pgs: 129 active+clean; 8.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:06:25.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:24 smithi134 ceph-mon[34893]: pgmap v571: 129 pgs: 129 active+clean; 8.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:06:25.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:24 smithi039 ceph-mon[34543]: pgmap v571: 129 pgs: 129 active+clean; 8.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:06:27.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:26 smithi006 ceph-mon[30947]: pgmap v572: 129 pgs: 129 active+clean; 8.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:06:27.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:26 smithi134 ceph-mon[34893]: pgmap v572: 129 pgs: 129 active+clean; 8.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:06:27.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:26 smithi039 ceph-mon[34543]: pgmap v572: 129 pgs: 129 active+clean; 8.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:06:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.387+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2297774172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12d0107820 msgr2=0x7f12d0109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.387+0000 7f12d5d6d640 1 --2- 172.21.15.6:0/2297774172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12d0107820 0x7f12d0109c90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009ca0 tx=0x7f12c802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.387+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2297774172 shutdown_connections 2024-09-12T00:06:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.387+0000 7f12d5d6d640 1 --2- 172.21.15.6:0/2297774172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12d0107820 0x7f12d0109c90 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.387+0000 7f12d5d6d640 1 --2- 172.21.15.6:0/2297774172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d0104ef0 0x7f12d01072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.387+0000 7f12d5d6d640 1 --2- 172.21.15.6:0/2297774172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12d01025c0 0x7f12d01049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.387+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2297774172 >> 172.21.15.6:0/2297774172 conn(0x7f12d00fc1c0 msgr2=0x7f12d00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.387+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2297774172 shutdown_connections 2024-09-12T00:06:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.387+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2297774172 wait complete. 2024-09-12T00:06:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.387+0000 7f12d5d6d640 1 Processor -- start 2024-09-12T00:06:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.387+0000 7f12d5d6d640 1 -- start start 2024-09-12T00:06:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12d5d6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12d01025c0 0x7f12d0197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12d5d6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d0104ef0 0x7f12d0198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12d5d6d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12d0107820 0x7f12d019f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12d5d6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f12d010d6b0 con 0x7f12d01025c0 2024-09-12T00:06:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12d5d6d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f12d010d530 con 0x7f12d0107820 2024-09-12T00:06:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12d5d6d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12d010d830 con 0x7f12d0104ef0 2024-09-12T00:06:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12cf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12d01025c0 0x7f12d0197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12cf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12d01025c0 0x7f12d0197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46662/0 (socket says 172.21.15.6:46662) 2024-09-12T00:06:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12cf7fe640 1 -- 172.21.15.6:0/2692573311 learned_addr learned my addr 172.21.15.6:0/2692573311 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12cffff640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12d0107820 0x7f12d019f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12ceffd640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d0104ef0 0x7f12d0198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12cf7fe640 1 -- 172.21.15.6:0/2692573311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d0104ef0 msgr2=0x7f12d0198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12cf7fe640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d0104ef0 0x7f12d0198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12cf7fe640 1 -- 172.21.15.6:0/2692573311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12d0107820 msgr2=0x7f12d019f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12cf7fe640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12d0107820 0x7f12d019f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12cf7fe640 1 -- 172.21.15.6:0/2692573311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d019fa10 con 0x7f12d01025c0 2024-09-12T00:06:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12ceffd640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d0104ef0 0x7f12d0198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.388+0000 7f12cf7fe640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12d01025c0 0x7f12d0197df0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f12c000e9f0 tx=0x7f12c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.389+0000 7f12ccff9640 1 -- 172.21.15.6:0/2692573311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c000cd80 con 0x7f12d01025c0 2024-09-12T00:06:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.389+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2692573311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d019fd00 con 0x7f12d01025c0 2024-09-12T00:06:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.389+0000 7f12ccff9640 1 -- 172.21.15.6:0/2692573311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12c00108e0 con 0x7f12d01025c0 2024-09-12T00:06:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.389+0000 7f12ccff9640 1 -- 172.21.15.6:0/2692573311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c0018920 con 0x7f12d01025c0 2024-09-12T00:06:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.389+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2692573311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d01a0190 con 0x7f12d01025c0 2024-09-12T00:06:27.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.391+0000 7f12ccff9640 1 -- 172.21.15.6:0/2692573311 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f12c0010a90 con 0x7f12d01025c0 2024-09-12T00:06:27.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12d8be5740 1 Processor -- start 2024-09-12T00:06:27.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12d8be5740 1 -- start start 2024-09-12T00:06:27.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12d8be5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddb2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12d8be5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddb7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12d8be5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb8370 0x55ff1ddba830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12d8be5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ff1dd162f0 con 0x55ff1ddb29a0 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12d8be5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ff1dcbe270 con 0x55ff1ddb8370 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12d8be5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ff1dd122b0 con 0x55ff1ddb32e0 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddb2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12ccff9640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f12b80a2b80 0x7f12b80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddb2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46670/0 (socket says 172.21.15.6:46670) 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12cffff640 1 -- 172.21.15.6:0/1231914104 learned_addr learned my addr 172.21.15.6:0/1231914104 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12cf7fe640 1 --2- 172.21.15.6:0/1231914104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddb7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12cffff640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f12b80a2b80 0x7f12b80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12ceffd640 1 --2- 172.21.15.6:0/1231914104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb8370 0x55ff1ddba830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.392+0000 7f12ccff9640 1 -- 172.21.15.6:0/2692573311 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f12c00cf7b0 con 0x7f12d01025c0 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.393+0000 7f12cffff640 1 -- 172.21.15.6:0/1231914104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb32e0 msgr2=0x55ff1ddb7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.393+0000 7f12cffff640 1 --2- 172.21.15.6:0/1231914104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddb7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.393+0000 7f12cffff640 1 -- 172.21.15.6:0/1231914104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb8370 msgr2=0x55ff1ddba830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.393+0000 7f12cffff640 1 --2- 172.21.15.6:0/1231914104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb8370 0x55ff1ddba830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.393+0000 7f12cffff640 1 -- 172.21.15.6:0/1231914104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff1dcbd340 con 0x55ff1ddb29a0 2024-09-12T00:06:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.393+0000 7f12cffff640 1 --2- 172.21.15.6:0/1231914104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddb2da0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009ca0 tx=0x7f12c8031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cec3628dc005ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.393+0000 7f12cffff640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f12b80a2b80 0x7f12b80a5040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f12c804c000 tx=0x7f12c804e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.393+0000 7f12b5ffb640 1 -- 172.21.15.6:0/1231914104 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8031e20 con 0x55ff1ddb29a0 2024-09-12T00:06:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.393+0000 7f12b5ffb640 1 -- 172.21.15.6:0/1231914104 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12c8036070 con 0x55ff1ddb29a0 2024-09-12T00:06:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.393+0000 7f12b5ffb640 1 -- 172.21.15.6:0/1231914104 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c80308b0 con 0x55ff1ddb29a0 2024-09-12T00:06:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.394+0000 7f12d8be5740 1 -- 172.21.15.6:0/1231914104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb29a0 msgr2=0x55ff1ddb2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.394+0000 7f12d8be5740 1 --2- 172.21.15.6:0/1231914104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddb2da0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009ca0 tx=0x7f12c8031660 comp rx=0 tx=0).stop 2024-09-12T00:06:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.394+0000 7f12d8be5740 1 -- 172.21.15.6:0/1231914104 shutdown_connections 2024-09-12T00:06:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.394+0000 7f12d8be5740 1 --2- 172.21.15.6:0/1231914104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb8370 0x55ff1ddba830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.394+0000 7f12d8be5740 1 --2- 172.21.15.6:0/1231914104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddb7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.394+0000 7f12d8be5740 1 --2- 172.21.15.6:0/1231914104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddb2da0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.394+0000 7f12d8be5740 1 -- 172.21.15.6:0/1231914104 >> 172.21.15.6:0/1231914104 conn(0x55ff1ddae010 msgr2=0x55ff1ddae410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.394+0000 7f12d8be5740 1 -- 172.21.15.6:0/1231914104 shutdown_connections 2024-09-12T00:06:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.394+0000 7f12d8be5740 1 -- 172.21.15.6:0/1231914104 wait complete. 2024-09-12T00:06:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.394+0000 7f12d8be5740 1 -- start start 2024-09-12T00:06:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12d8be5740 1 Processor -- start 2024-09-12T00:06:27.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12d8be5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddbc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12d8be5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddbcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12d8be5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb8370 0x55ff1ddc3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12d8be5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ff1ddbb100 con 0x55ff1ddb32e0 2024-09-12T00:06:27.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12d8be5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ff1dc9f290 con 0x55ff1ddb8370 2024-09-12T00:06:27.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12d8be5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ff1ddbb280 con 0x55ff1ddb29a0 2024-09-12T00:06:27.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12d8be5740 10 client.0 _ll_register_callbacks cb 0x55ff1dcd0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:27.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12ceffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddbcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12ceffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddbcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46682/0 (socket says 172.21.15.6:46682) 2024-09-12T00:06:27.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12ceffd640 1 -- 172.21.15.6:0/4109150797 learned_addr learned my addr 172.21.15.6:0/4109150797 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:27.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12cf7fe640 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddbc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12cffff640 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb8370 0x55ff1ddc3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12ceffd640 1 -- 172.21.15.6:0/4109150797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb29a0 msgr2=0x55ff1ddbc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12ceffd640 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddbc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12ceffd640 1 -- 172.21.15.6:0/4109150797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb8370 msgr2=0x55ff1ddc3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12ceffd640 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb8370 0x55ff1ddc3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.395+0000 7f12ceffd640 1 -- 172.21.15.6:0/4109150797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff1da29210 con 0x55ff1ddb32e0 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.396+0000 7f12cffff640 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb8370 0x55ff1ddc3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.396+0000 7f12ceffd640 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddbcef0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f12c4013790 tx=0x7f12c4013c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f763aa0982d5d324 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.396+0000 7f12aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.396+0000 7f12aeffd640 1 -- 172.21.15.6:0/4109150797 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4020060 con 0x55ff1ddb32e0 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.396+0000 7f12d8be5740 1 -- 172.21.15.6:0/4109150797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12c8036070 con 0x55ff1ddb32e0 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.396+0000 7f12aeffd640 1 -- 172.21.15.6:0/4109150797 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f12c4011dd0 con 0x55ff1ddb32e0 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.396+0000 7f12aeffd640 1 -- 172.21.15.6:0/4109150797 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f12c4027050 con 0x55ff1ddb32e0 2024-09-12T00:06:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.396+0000 7f12d8be5740 10 client.15918 fetch_fsmap learned FSMap version 33 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.396+0000 7f12d8be5740 1 -- 172.21.15.6:0/4109150797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ff1daf5620 con 0x55ff1ddb32e0 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.396+0000 7f12aeffd640 1 -- 172.21.15.6:0/4109150797 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12c8036070 con 0x55ff1ddb32e0 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.396+0000 7f12aeffd640 1 -- 172.21.15.6:0/4109150797 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f12c401a030 con 0x55ff1ddb32e0 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.397+0000 7f12d8be5740 10 client.15918 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.397+0000 7f12d8be5740 10 client.15918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.397+0000 7f12d8be5740 20 client.15918 populate_metadata read hostname 'smithi006' 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.397+0000 7f12d8be5740 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ff1ddc8720 0x55ff1ddcab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.397+0000 7f12d8be5740 4 client.15918 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.397+0000 7f12d8be5740 1 -- 172.21.15.6:0/4109150797 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff1dd23a20 con 0x55ff1ddc8720 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.397+0000 7f12cf7fe640 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ff1ddc8720 0x55ff1ddcab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.397+0000 7f12cf7fe640 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ff1ddc8720 0x55ff1ddcab30 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32bb999329d154d4 server_cookie=64baefb446b41599 in_seq=0 out_seq=0 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.397+0000 7f12aeffd640 10 client.15918 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.398+0000 7f12aeffd640 1 -- 172.21.15.6:0/4109150797 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff1dd23a20 con 0x55ff1ddc8720 2024-09-12T00:06:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.398+0000 7f12aeffd640 10 client.15918 handle_command_reply: tid=0 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.398+0000 7f12d8be5740 1 client.15918 shutdown 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.398+0000 7f12d8be5740 1 -- 172.21.15.6:0/4109150797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb32e0 msgr2=0x55ff1ddbcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.398+0000 7f12d8be5740 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddbcef0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f12c4013790 tx=0x7f12c4013c50 comp rx=0 tx=0).stop 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.399+0000 7f12d8be5740 1 -- 172.21.15.6:0/4109150797 shutdown_connections 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.399+0000 7f12d8be5740 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb8370 0x55ff1ddc3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.399+0000 7f12d8be5740 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddbcef0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.399+0000 7f12d8be5740 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ff1ddc8720 0x55ff1ddcab30 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.399+0000 7f12d8be5740 1 --2- 172.21.15.6:0/4109150797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddbc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.399+0000 7f12d8be5740 1 -- 172.21.15.6:0/4109150797 >> 172.21.15.6:0/4109150797 conn(0x55ff1ddae010 msgr2=0x55ff1ddaf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.399+0000 7f12aeffd640 0 client.15918 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.399+0000 7f12d8be5740 1 -- 172.21.15.6:0/4109150797 shutdown_connections 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.399+0000 7f12d8be5740 1 -- 172.21.15.6:0/4109150797 wait complete. 2024-09-12T00:06:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.399+0000 7f12d8be5740 20 client.15918 trim_cache size 0 max 16384 2024-09-12T00:06:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.413+0000 7f12d8be5740 1 Processor -- start 2024-09-12T00:06:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.413+0000 7f12d8be5740 1 -- start start 2024-09-12T00:06:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12d8be5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12d8be5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddc3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12d8be5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 0x55ff1ddaf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12d8be5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01a8610 con 0x55ff1ddb8370 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12d8be5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01aa150 con 0x55ff1ddb32e0 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12d8be5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01a8ce0 con 0x55ff1ddb29a0 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 0x55ff1ddaf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 0x55ff1ddaf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46692/0 (socket says 172.21.15.6:46692) 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12cffff640 1 -- 172.21.15.6:0/1392313741 learned_addr learned my addr 172.21.15.6:0/1392313741 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12ceffd640 1 --2- 172.21.15.6:0/1392313741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddc3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12cf7fe640 1 --2- 172.21.15.6:0/1392313741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12cffff640 1 -- 172.21.15.6:0/1392313741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb29a0 msgr2=0x55ff1ddad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12cffff640 1 --2- 172.21.15.6:0/1392313741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12cffff640 1 -- 172.21.15.6:0/1392313741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb32e0 msgr2=0x55ff1ddc3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12cffff640 1 --2- 172.21.15.6:0/1392313741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddc3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12cffff640 1 -- 172.21.15.6:0/1392313741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff1dda92d0 con 0x55ff1ddb8370 2024-09-12T00:06:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12cf7fe640 1 --2- 172.21.15.6:0/1392313741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12cffff640 1 --2- 172.21.15.6:0/1392313741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 0x55ff1ddaf400 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009ca0 tx=0x7f12c80317d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d89de11967ecdc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12b57fa640 1 -- 172.21.15.6:0/1392313741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c805c020 con 0x55ff1ddb8370 2024-09-12T00:06:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12b57fa640 1 -- 172.21.15.6:0/1392313741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12c8036050 con 0x55ff1ddb8370 2024-09-12T00:06:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.414+0000 7f12b57fa640 1 -- 172.21.15.6:0/1392313741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8048780 con 0x55ff1ddb8370 2024-09-12T00:06:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.415+0000 7f12d8be5740 1 -- 172.21.15.6:0/1392313741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 msgr2=0x55ff1ddaf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.415+0000 7f12d8be5740 1 --2- 172.21.15.6:0/1392313741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 0x55ff1ddaf400 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009ca0 tx=0x7f12c80317d0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.415+0000 7f12d8be5740 1 -- 172.21.15.6:0/1392313741 shutdown_connections 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.415+0000 7f12d8be5740 1 --2- 172.21.15.6:0/1392313741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 0x55ff1ddaf400 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.415+0000 7f12d8be5740 1 --2- 172.21.15.6:0/1392313741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddc3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.415+0000 7f12d8be5740 1 --2- 172.21.15.6:0/1392313741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.415+0000 7f12d8be5740 1 -- 172.21.15.6:0/1392313741 >> 172.21.15.6:0/1392313741 conn(0x55ff1ddae010 msgr2=0x55ff1ddac9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.415+0000 7f12d8be5740 1 -- 172.21.15.6:0/1392313741 shutdown_connections 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.415+0000 7f12d8be5740 1 -- 172.21.15.6:0/1392313741 wait complete. 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.415+0000 7f12d8be5740 1 -- start start 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12d8be5740 1 Processor -- start 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12d8be5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddc1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12d8be5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddc1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12d8be5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 0x55ff1ddc2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12d8be5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01a9a80 con 0x55ff1ddb8370 2024-09-12T00:06:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12d8be5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01a93b0 con 0x55ff1ddb29a0 2024-09-12T00:06:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12d8be5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01a65f0 con 0x55ff1ddb32e0 2024-09-12T00:06:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12d8be5740 10 client.0 _ll_register_callbacks cb 0x7f12c4009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 0x55ff1ddc2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12cf7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddc1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 0x55ff1ddc2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46708/0 (socket says 172.21.15.6:46708) 2024-09-12T00:06:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12cffff640 1 -- 172.21.15.6:0/2906976468 learned_addr learned my addr 172.21.15.6:0/2906976468 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12ceffd640 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddc1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12cffff640 1 -- 172.21.15.6:0/2906976468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb32e0 msgr2=0x55ff1ddc1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12cffff640 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddc1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12cffff640 1 -- 172.21.15.6:0/2906976468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb29a0 msgr2=0x55ff1ddc1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12cffff640 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddc1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.416+0000 7f12cffff640 1 -- 172.21.15.6:0/2906976468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff1ddc3490 con 0x55ff1ddb8370 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12cf7fe640 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddc1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12cffff640 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 0x55ff1ddc2e80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f12c8052040 tx=0x7f12c8009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722e24411de57b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12aeffd640 1 -- 172.21.15.6:0/2906976468 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8065020 con 0x55ff1ddb8370 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12aeffd640 1 -- 172.21.15.6:0/2906976468 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f12c8004040 con 0x55ff1ddb8370 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12d8be5740 1 -- 172.21.15.6:0/2906976468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12c8036050 con 0x55ff1ddb8370 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12aeffd640 1 -- 172.21.15.6:0/2906976468 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f12c8070050 con 0x55ff1ddb8370 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12d8be5740 10 client.15924 fetch_fsmap learned FSMap version 33 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12d8be5740 1 -- 172.21.15.6:0/2906976468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ff1de33730 con 0x55ff1ddb8370 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12aeffd640 1 -- 172.21.15.6:0/2906976468 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12c8036050 con 0x55ff1ddb8370 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12aeffd640 1 -- 172.21.15.6:0/2906976468 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f12c804f040 con 0x55ff1ddb8370 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12d8be5740 10 client.15924 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:06:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.417+0000 7f12d8be5740 10 client.15924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:06:27.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.418+0000 7f12d8be5740 20 client.15924 populate_metadata read hostname 'smithi006' 2024-09-12T00:06:27.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.418+0000 7f12d8be5740 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ff1de33e50 0x55ff1de36270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:27.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.418+0000 7f12d8be5740 4 client.15924 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:06:27.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.418+0000 7f12d8be5740 1 -- 172.21.15.6:0/2906976468 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ff1dd1dd70 con 0x55ff1de33e50 2024-09-12T00:06:27.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.418+0000 7f12cf7fe640 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ff1de33e50 0x55ff1de36270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:27.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.418+0000 7f12cf7fe640 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ff1de33e50 0x55ff1de36270 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ebc4b2cfd2452f server_cookie=13160ec3cdeee5e3 in_seq=0 out_seq=0 2024-09-12T00:06:27.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.418+0000 7f12aeffd640 10 client.15924 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12aeffd640 1 -- 172.21.15.6:0/2906976468 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ff1dd1dd70 con 0x55ff1de33e50 2024-09-12T00:06:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12aeffd640 10 client.15924 handle_command_reply: tid=0 2024-09-12T00:06:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12d8be5740 1 client.15924 shutdown 2024-09-12T00:06:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12d8be5740 1 -- 172.21.15.6:0/2906976468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 msgr2=0x55ff1ddc2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12d8be5740 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 0x55ff1ddc2e80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f12c8052040 tx=0x7f12c8009540 comp rx=0 tx=0).stop 2024-09-12T00:06:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12d8be5740 1 -- 172.21.15.6:0/2906976468 shutdown_connections 2024-09-12T00:06:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12d8be5740 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ff1ddb8370 0x55ff1ddc2e80 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12d8be5740 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ff1de33e50 0x55ff1de36270 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12d8be5740 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff1ddb32e0 0x55ff1ddc1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12d8be5740 1 --2- 172.21.15.6:0/2906976468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff1ddb29a0 0x55ff1ddc1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12aeffd640 0 client.15924 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12d8be5740 1 -- 172.21.15.6:0/2906976468 >> 172.21.15.6:0/2906976468 conn(0x55ff1ddae010 msgr2=0x55ff1ddad1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12d8be5740 1 -- 172.21.15.6:0/2906976468 shutdown_connections 2024-09-12T00:06:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12d8be5740 1 -- 172.21.15.6:0/2906976468 wait complete. 2024-09-12T00:06:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.435+0000 7f12d8be5740 20 client.15924 trim_cache size 0 max 16384 2024-09-12T00:06:27.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:06:27.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:06:27.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:06:27.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:06:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.436+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2692573311 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f12b80a2b80 msgr2=0x7f12b80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.436+0000 7f12d5d6d640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f12b80a2b80 0x7f12b80a5040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f12c804c000 tx=0x7f12c804e000 comp rx=0 tx=0).stop 2024-09-12T00:06:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.436+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2692573311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12d01025c0 msgr2=0x7f12d0197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.436+0000 7f12d5d6d640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12d01025c0 0x7f12d0197df0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f12c000e9f0 tx=0x7f12c000eeb0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.436+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2692573311 shutdown_connections 2024-09-12T00:06:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.436+0000 7f12d5d6d640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f12b80a2b80 0x7f12b80a5040 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.436+0000 7f12d5d6d640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12d0107820 0x7f12d019f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.436+0000 7f12d5d6d640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d0104ef0 0x7f12d0198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.436+0000 7f12d5d6d640 1 --2- 172.21.15.6:0/2692573311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12d01025c0 0x7f12d0197df0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:27.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.436+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2692573311 >> 172.21.15.6:0/2692573311 conn(0x7f12d00fc1c0 msgr2=0x7f12d0102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:27.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.436+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2692573311 shutdown_connections 2024-09-12T00:06:27.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:27.436+0000 7f12d5d6d640 1 -- 172.21.15.6:0/2692573311 wait complete. 2024-09-12T00:06:29.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:28 smithi006 ceph-mon[30947]: pgmap v573: 129 pgs: 129 active+clean; 8.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:06:29.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:28 smithi134 ceph-mon[34893]: pgmap v573: 129 pgs: 129 active+clean; 8.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:06:29.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:28 smithi039 ceph-mon[34543]: pgmap v573: 129 pgs: 129 active+clean; 8.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:06:31.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:30 smithi006 ceph-mon[30947]: pgmap v574: 129 pgs: 129 active+clean; 8.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:06:31.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:30 smithi134 ceph-mon[34893]: pgmap v574: 129 pgs: 129 active+clean; 8.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:06:31.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:30 smithi039 ceph-mon[34543]: pgmap v574: 129 pgs: 129 active+clean; 8.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:06:33.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:32 smithi006 ceph-mon[30947]: pgmap v575: 129 pgs: 129 active+clean; 8.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:06:33.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:32 smithi134 ceph-mon[34893]: pgmap v575: 129 pgs: 129 active+clean; 8.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:06:33.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:32 smithi039 ceph-mon[34543]: pgmap v575: 129 pgs: 129 active+clean; 8.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:06:35.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:34 smithi134 ceph-mon[34893]: pgmap v576: 129 pgs: 129 active+clean; 8.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-12T00:06:35.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:34 smithi039 ceph-mon[34543]: pgmap v576: 129 pgs: 129 active+clean; 8.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-12T00:06:35.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:34 smithi006 ceph-mon[30947]: pgmap v576: 129 pgs: 129 active+clean; 8.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-12T00:06:37.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:36 smithi134 ceph-mon[34893]: pgmap v577: 129 pgs: 129 active+clean; 9.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:06:37.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:36 smithi039 ceph-mon[34543]: pgmap v577: 129 pgs: 129 active+clean; 9.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:06:37.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:36 smithi006 ceph-mon[30947]: pgmap v577: 129 pgs: 129 active+clean; 9.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:06:39.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:38 smithi134 ceph-mon[34893]: pgmap v578: 129 pgs: 129 active+clean; 9.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:06:39.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:38 smithi039 ceph-mon[34543]: pgmap v578: 129 pgs: 129 active+clean; 9.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:06:39.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:38 smithi006 ceph-mon[30947]: pgmap v578: 129 pgs: 129 active+clean; 9.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:06:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.530+0000 7fb98f65e640 1 -- 172.21.15.6:0/405378289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988103710 msgr2=0x7fb988109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.530+0000 7fb98f65e640 1 --2- 172.21.15.6:0/405378289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988103710 0x7fb988109fa0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb980009ca0 tx=0x7fb98002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.530+0000 7fb98f65e640 1 -- 172.21.15.6:0/405378289 shutdown_connections 2024-09-12T00:06:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.530+0000 7fb98f65e640 1 --2- 172.21.15.6:0/405378289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988103710 0x7fb988109fa0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.530+0000 7fb98f65e640 1 --2- 172.21.15.6:0/405378289 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb988102d50 0x7fb9881031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.530+0000 7fb98f65e640 1 --2- 172.21.15.6:0/405378289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb988101b60 0x7fb988101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.530+0000 7fb98f65e640 1 -- 172.21.15.6:0/405378289 >> 172.21.15.6:0/405378289 conn(0x7fb9880fd2e0 msgr2=0x7fb9880ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.530+0000 7fb98f65e640 1 -- 172.21.15.6:0/405378289 shutdown_connections 2024-09-12T00:06:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.530+0000 7fb98f65e640 1 -- 172.21.15.6:0/405378289 wait complete. 2024-09-12T00:06:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98f65e640 1 Processor -- start 2024-09-12T00:06:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98f65e640 1 -- start start 2024-09-12T00:06:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98f65e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb988101b60 0x7fb988197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98f65e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988102d50 0x7fb9881982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98f65e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb988103710 0x7fb98819f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98f65e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb98810d6e0 con 0x7fb988102d50 2024-09-12T00:06:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98f65e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb98810d560 con 0x7fb988101b60 2024-09-12T00:06:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98f65e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb98810d860 con 0x7fb988103710 2024-09-12T00:06:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98cbf9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988102d50 0x7fb9881982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98cbf9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988102d50 0x7fb9881982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35732/0 (socket says 172.21.15.6:35732) 2024-09-12T00:06:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98cbf9640 1 -- 172.21.15.6:0/246237086 learned_addr learned my addr 172.21.15.6:0/246237086 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98dbfb640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb988103710 0x7fb98819f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb988101b60 0x7fb988197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98cbf9640 1 -- 172.21.15.6:0/246237086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb988103710 msgr2=0x7fb98819f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98cbf9640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb988103710 0x7fb98819f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98cbf9640 1 -- 172.21.15.6:0/246237086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb988101b60 msgr2=0x7fb988197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98cbf9640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb988101b60 0x7fb988197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98cbf9640 1 -- 172.21.15.6:0/246237086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98819f9c0 con 0x7fb988102d50 2024-09-12T00:06:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.531+0000 7fb98cbf9640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988102d50 0x7fb9881982f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb97800d950 tx=0x7fb97800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.532+0000 7fb97e7fc640 1 -- 172.21.15.6:0/246237086 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978017030 con 0x7fb988102d50 2024-09-12T00:06:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.532+0000 7fb98f65e640 1 -- 172.21.15.6:0/246237086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98819fcb0 con 0x7fb988102d50 2024-09-12T00:06:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.532+0000 7fb97e7fc640 1 -- 172.21.15.6:0/246237086 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb978004020 con 0x7fb988102d50 2024-09-12T00:06:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.532+0000 7fb97e7fc640 1 -- 172.21.15.6:0/246237086 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9780047a0 con 0x7fb988102d50 2024-09-12T00:06:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.532+0000 7fb98f65e640 1 -- 172.21.15.6:0/246237086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9881a01b0 con 0x7fb988102d50 2024-09-12T00:06:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.535+0000 7fb97e7fc640 1 -- 172.21.15.6:0/246237086 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fb9780041d0 con 0x7fb988102d50 2024-09-12T00:06:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.535+0000 7fb9923f7740 1 Processor -- start 2024-09-12T00:06:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.535+0000 7fb9923f7740 1 -- start start 2024-09-12T00:06:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.535+0000 7fb9923f7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf49a0 0x556bf1cf4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.535+0000 7fb9923f7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf52e0 0x556bf1cf9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.535+0000 7fb9923f7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1cfc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.535+0000 7fb9923f7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x556bf1c582f0 con 0x556bf1cf52e0 2024-09-12T00:06:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.535+0000 7fb9923f7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556bf1c00270 con 0x556bf1cfa370 2024-09-12T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.535+0000 7fb9923f7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556bf1c542b0 con 0x556bf1cf49a0 2024-09-12T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.535+0000 7fb97e7fc640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb9740a2b80 0x7fb9740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98d3fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf52e0 0x556bf1cf9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98d3fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf52e0 0x556bf1cf9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35744/0 (socket says 172.21.15.6:35744) 2024-09-12T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98d3fa640 1 -- 172.21.15.6:0/1201657235 learned_addr learned my addr 172.21.15.6:0/1201657235 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98cbf9640 1 --2- 172.21.15.6:0/1201657235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1cfc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98dbfb640 1 --2- 172.21.15.6:0/1201657235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf49a0 0x556bf1cf4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb97e7fc640 1 -- 172.21.15.6:0/246237086 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fb9780cf000 con 0x7fb988102d50 2024-09-12T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98dbfb640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb9740a2b80 0x7fb9740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98d3fa640 1 -- 172.21.15.6:0/1201657235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf49a0 msgr2=0x556bf1cf4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/1201657235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf49a0 0x556bf1cf4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98d3fa640 1 -- 172.21.15.6:0/1201657235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 msgr2=0x556bf1cfc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/1201657235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1cfc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98d3fa640 1 -- 172.21.15.6:0/1201657235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bf1bff340 con 0x556bf1cf52e0 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/1201657235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf52e0 0x556bf1cf9da0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb984009bf0 tx=0x7fb9840117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8b757d296f9c12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb98dbfb640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb9740a2b80 0x7fb9740a5040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb980031aa0 tx=0x7fb9800095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb9737fe640 1 -- 172.21.15.6:0/1201657235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984012450 con 0x556bf1cf52e0 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb9737fe640 1 -- 172.21.15.6:0/1201657235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb984012aa0 con 0x556bf1cf52e0 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.536+0000 7fb9737fe640 1 -- 172.21.15.6:0/1201657235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98400fae0 con 0x556bf1cf52e0 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.537+0000 7fb9923f7740 1 -- 172.21.15.6:0/1201657235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf52e0 msgr2=0x556bf1cf9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.537+0000 7fb9923f7740 1 --2- 172.21.15.6:0/1201657235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf52e0 0x556bf1cf9da0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb984009bf0 tx=0x7fb9840117b0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.537+0000 7fb9923f7740 1 -- 172.21.15.6:0/1201657235 shutdown_connections 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.537+0000 7fb9923f7740 1 --2- 172.21.15.6:0/1201657235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1cfc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.537+0000 7fb9923f7740 1 --2- 172.21.15.6:0/1201657235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf52e0 0x556bf1cf9da0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.537+0000 7fb9923f7740 1 --2- 172.21.15.6:0/1201657235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf49a0 0x556bf1cf4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.537+0000 7fb9923f7740 1 -- 172.21.15.6:0/1201657235 >> 172.21.15.6:0/1201657235 conn(0x556bf1cf0010 msgr2=0x556bf1cf0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.537+0000 7fb9923f7740 1 -- 172.21.15.6:0/1201657235 shutdown_connections 2024-09-12T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.537+0000 7fb9923f7740 1 -- 172.21.15.6:0/1201657235 wait complete. 2024-09-12T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb9923f7740 1 -- start start 2024-09-12T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb9923f7740 1 Processor -- start 2024-09-12T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb9923f7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 0x556bf1cfeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb9923f7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1cff080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb9923f7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1d060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb9923f7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x556bf1cfd340 con 0x556bf1cf49a0 2024-09-12T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb9923f7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556bf1be1290 con 0x556bf1cfa370 2024-09-12T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb9923f7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556bf1cfd4c0 con 0x556bf1cf52e0 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb9923f7740 10 client.0 _ll_register_callbacks cb 0x556bf1c12140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb98d3fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 0x556bf1cfeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb98d3fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 0x556bf1cfeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35748/0 (socket says 172.21.15.6:35748) 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb98d3fa640 1 -- 172.21.15.6:0/3145123893 learned_addr learned my addr 172.21.15.6:0/3145123893 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb98dbfb640 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1d060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.538+0000 7fb98cbf9640 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1cff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb98d3fa640 1 -- 172.21.15.6:0/3145123893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 msgr2=0x556bf1cff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1cff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb98d3fa640 1 -- 172.21.15.6:0/3145123893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 msgr2=0x556bf1d060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1d060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb98d3fa640 1 -- 172.21.15.6:0/3145123893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bf196b210 con 0x556bf1cf49a0 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb98cbf9640 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1cff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb98dbfb640 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1d060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 0x556bf1cfeb40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb984009bc0 tx=0x7fb984012f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5145df623f8353f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb970ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb970ff9640 1 -- 172.21.15.6:0/3145123893 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984028020 con 0x556bf1cf49a0 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb970ff9640 1 -- 172.21.15.6:0/3145123893 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fb984012450 con 0x556bf1cf49a0 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb9923f7740 1 -- 172.21.15.6:0/3145123893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb984012aa0 con 0x556bf1cf49a0 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb970ff9640 1 -- 172.21.15.6:0/3145123893 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb984033050 con 0x556bf1cf49a0 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb9923f7740 10 client.15936 fetch_fsmap learned FSMap version 33 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb9923f7740 1 -- 172.21.15.6:0/3145123893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556bf1a37620 con 0x556bf1cf49a0 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.539+0000 7fb970ff9640 1 -- 172.21.15.6:0/3145123893 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb984012aa0 con 0x556bf1cf49a0 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.540+0000 7fb970ff9640 1 -- 172.21.15.6:0/3145123893 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb98400f860 con 0x556bf1cf49a0 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.540+0000 7fb9923f7740 10 client.15936 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.540+0000 7fb9923f7740 10 client.15936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:06:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.540+0000 7fb9923f7740 20 client.15936 populate_metadata read hostname 'smithi006' 2024-09-12T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.540+0000 7fb9923f7740 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556bf1d0a530 0x556bf1d0c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.540+0000 7fb9923f7740 4 client.15936 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.540+0000 7fb9923f7740 1 -- 172.21.15.6:0/3145123893 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bf1c65a20 con 0x556bf1d0a530 2024-09-12T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.540+0000 7fb98cbf9640 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556bf1d0a530 0x556bf1d0c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.540+0000 7fb970ff9640 10 client.15936 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.540+0000 7fb98cbf9640 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556bf1d0a530 0x556bf1d0c990 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e38fc158578916d server_cookie=8c81f8ee9ff65c1c in_seq=0 out_seq=0 2024-09-12T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.541+0000 7fb970ff9640 1 -- 172.21.15.6:0/3145123893 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556bf1c65a20 con 0x556bf1d0a530 2024-09-12T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.541+0000 7fb970ff9640 10 client.15936 handle_command_reply: tid=0 2024-09-12T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.541+0000 7fb9923f7740 1 client.15936 shutdown 2024-09-12T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.541+0000 7fb9923f7740 1 -- 172.21.15.6:0/3145123893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 msgr2=0x556bf1cfeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.541+0000 7fb9923f7740 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 0x556bf1cfeb40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb984009bc0 tx=0x7fb984012f00 comp rx=0 tx=0).stop 2024-09-12T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.541+0000 7fb9923f7740 1 -- 172.21.15.6:0/3145123893 shutdown_connections 2024-09-12T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.541+0000 7fb9923f7740 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1d060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.541+0000 7fb9923f7740 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556bf1d0a530 0x556bf1d0c990 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.541+0000 7fb9923f7740 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1cff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.541+0000 7fb9923f7740 1 --2- 172.21.15.6:0/3145123893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 0x556bf1cfeb40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.541+0000 7fb9923f7740 1 -- 172.21.15.6:0/3145123893 >> 172.21.15.6:0/3145123893 conn(0x556bf1cf0010 msgr2=0x556bf1cf1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.541+0000 7fb970ff9640 0 client.15936 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.542+0000 7fb9923f7740 1 -- 172.21.15.6:0/3145123893 shutdown_connections 2024-09-12T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.542+0000 7fb9923f7740 1 -- 172.21.15.6:0/3145123893 wait complete. 2024-09-12T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.542+0000 7fb9923f7740 20 client.15936 trim_cache size 0 max 16384 2024-09-12T00:06:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.558+0000 7fb9923f7740 1 Processor -- start 2024-09-12T00:06:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.558+0000 7fb9923f7740 1 -- start start 2024-09-12T00:06:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.558+0000 7fb9923f7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 0x556bf1cfef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.558+0000 7fb9923f7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1d05fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.558+0000 7fb9923f7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1cf1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.558+0000 7fb9923f7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881aa880 con 0x556bf1cf49a0 2024-09-12T00:06:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.558+0000 7fb9923f7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881ac3c0 con 0x556bf1cfa370 2024-09-12T00:06:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.558+0000 7fb9923f7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881aaf50 con 0x556bf1cf52e0 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.558+0000 7fb98d3fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 0x556bf1cfef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb98d3fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 0x556bf1cfef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35756/0 (socket says 172.21.15.6:35756) 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb98d3fa640 1 -- 172.21.15.6:0/433584823 learned_addr learned my addr 172.21.15.6:0/433584823 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb98cbf9640 1 --2- 172.21.15.6:0/433584823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1d05fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb98dbfb640 1 --2- 172.21.15.6:0/433584823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1cf1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb98d3fa640 1 -- 172.21.15.6:0/433584823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 msgr2=0x556bf1d05fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/433584823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1d05fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb98d3fa640 1 -- 172.21.15.6:0/433584823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 msgr2=0x556bf1cf1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/433584823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1cf1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb98d3fa640 1 -- 172.21.15.6:0/433584823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bf1cf57c0 con 0x556bf1cf49a0 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/433584823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 0x556bf1cfef60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb9840096b0 tx=0x7fb984005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af8be8ff56c1920 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb972ffd640 1 -- 172.21.15.6:0/433584823 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98403c070 con 0x556bf1cf49a0 2024-09-12T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb972ffd640 1 -- 172.21.15.6:0/433584823 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb984011cb0 con 0x556bf1cf49a0 2024-09-12T00:06:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.559+0000 7fb972ffd640 1 -- 172.21.15.6:0/433584823 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984028070 con 0x556bf1cf49a0 2024-09-12T00:06:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.560+0000 7fb9923f7740 1 -- 172.21.15.6:0/433584823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 msgr2=0x556bf1cfef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.560+0000 7fb9923f7740 1 --2- 172.21.15.6:0/433584823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 0x556bf1cfef60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb9840096b0 tx=0x7fb984005850 comp rx=0 tx=0).stop 2024-09-12T00:06:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.560+0000 7fb9923f7740 1 -- 172.21.15.6:0/433584823 shutdown_connections 2024-09-12T00:06:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.560+0000 7fb9923f7740 1 --2- 172.21.15.6:0/433584823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cfa370 0x556bf1cf1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.560+0000 7fb9923f7740 1 --2- 172.21.15.6:0/433584823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1d05fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.560+0000 7fb9923f7740 1 --2- 172.21.15.6:0/433584823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cf49a0 0x556bf1cfef60 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.560+0000 7fb9923f7740 1 -- 172.21.15.6:0/433584823 >> 172.21.15.6:0/433584823 conn(0x556bf1cf0010 msgr2=0x556bf1cef1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.560+0000 7fb9923f7740 1 -- 172.21.15.6:0/433584823 shutdown_connections 2024-09-12T00:06:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.560+0000 7fb9923f7740 1 -- 172.21.15.6:0/433584823 wait complete. 2024-09-12T00:06:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.560+0000 7fb9923f7740 1 -- start start 2024-09-12T00:06:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.560+0000 7fb9923f7740 1 Processor -- start 2024-09-12T00:06:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb9923f7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cf49a0 0x556bf1d03200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb9923f7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1d03740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb9923f7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cfa370 0x556bf1d04750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb9923f7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881abcf0 con 0x556bf1cfa370 2024-09-12T00:06:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb9923f7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881ab620 con 0x556bf1cf49a0 2024-09-12T00:06:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb9923f7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881a8860 con 0x556bf1cf52e0 2024-09-12T00:06:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb9923f7740 10 client.0 _ll_register_callbacks cb 0x7fb978095f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb98dbfb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cfa370 0x556bf1d04750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb98dbfb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cfa370 0x556bf1d04750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35760/0 (socket says 172.21.15.6:35760) 2024-09-12T00:06:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb98d3fa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cf49a0 0x556bf1d03200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb98dbfb640 1 -- 172.21.15.6:0/2370316951 learned_addr learned my addr 172.21.15.6:0/2370316951 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb98cbf9640 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1d03740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb98dbfb640 1 -- 172.21.15.6:0/2370316951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 msgr2=0x556bf1d03740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb98dbfb640 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1d03740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb98dbfb640 1 -- 172.21.15.6:0/2370316951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cf49a0 msgr2=0x556bf1d03200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb98dbfb640 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cf49a0 0x556bf1d03200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb98dbfb640 1 -- 172.21.15.6:0/2370316951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bf1d04d60 con 0x556bf1cfa370 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.561+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cf49a0 0x556bf1d03200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb98dbfb640 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cfa370 0x556bf1d04750 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb98002aeb0 tx=0x7fb98002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0734c8e81bf4d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb970ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb970ff9640 1 -- 172.21.15.6:0/2370316951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980044070 con 0x556bf1cfa370 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb970ff9640 1 -- 172.21.15.6:0/2370316951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fb980004790 con 0x556bf1cfa370 2024-09-12T00:06:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb9923f7740 1 -- 172.21.15.6:0/2370316951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb984011cb0 con 0x556bf1cfa370 2024-09-12T00:06:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb970ff9640 1 -- 172.21.15.6:0/2370316951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb9800305c0 con 0x556bf1cfa370 2024-09-12T00:06:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb9923f7740 10 client.15942 fetch_fsmap learned FSMap version 33 2024-09-12T00:06:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb9923f7740 1 -- 172.21.15.6:0/2370316951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556bf1d060e0 con 0x556bf1cfa370 2024-09-12T00:06:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb970ff9640 1 -- 172.21.15.6:0/2370316951 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb984011cb0 con 0x556bf1cfa370 2024-09-12T00:06:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb970ff9640 1 -- 172.21.15.6:0/2370316951 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb98003d620 con 0x556bf1cfa370 2024-09-12T00:06:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb9923f7740 10 client.15942 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:06:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb9923f7740 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:06:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb9923f7740 20 client.15942 populate_metadata read hostname 'smithi006' 2024-09-12T00:06:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb9923f7740 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556bf1d75800 0x556bf1d77c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb9923f7740 4 client.15942 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:06:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.562+0000 7fb9923f7740 1 -- 172.21.15.6:0/2370316951 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556bf1c5fd70 con 0x556bf1d75800 2024-09-12T00:06:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.563+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556bf1d75800 0x556bf1d77c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.563+0000 7fb98d3fa640 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556bf1d75800 0x556bf1d77c20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2473a38cb61ed4cd server_cookie=c97b766c6b4c5b2 in_seq=0 out_seq=0 2024-09-12T00:06:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.563+0000 7fb970ff9640 10 client.15942 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.579+0000 7fb970ff9640 1 -- 172.21.15.6:0/2370316951 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556bf1c5fd70 con 0x556bf1d75800 2024-09-12T00:06:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.579+0000 7fb970ff9640 10 client.15942 handle_command_reply: tid=0 2024-09-12T00:06:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.579+0000 7fb9923f7740 1 client.15942 shutdown 2024-09-12T00:06:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.579+0000 7fb9923f7740 1 -- 172.21.15.6:0/2370316951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cfa370 msgr2=0x556bf1d04750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.579+0000 7fb9923f7740 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cfa370 0x556bf1d04750 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb98002aeb0 tx=0x7fb98002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.579+0000 7fb9923f7740 1 -- 172.21.15.6:0/2370316951 shutdown_connections 2024-09-12T00:06:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.579+0000 7fb9923f7740 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556bf1cfa370 0x556bf1d04750 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.579+0000 7fb9923f7740 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556bf1d75800 0x556bf1d77c20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb9923f7740 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bf1cf52e0 0x556bf1d03740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb9923f7740 1 --2- 172.21.15.6:0/2370316951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556bf1cf49a0 0x556bf1d03200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb970ff9640 0 client.15942 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb9923f7740 1 -- 172.21.15.6:0/2370316951 >> 172.21.15.6:0/2370316951 conn(0x556bf1cf0010 msgr2=0x556bf1cf03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb9923f7740 1 -- 172.21.15.6:0/2370316951 shutdown_connections 2024-09-12T00:06:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb9923f7740 1 -- 172.21.15.6:0/2370316951 wait complete. 2024-09-12T00:06:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb9923f7740 20 client.15942 trim_cache size 0 max 16384 2024-09-12T00:06:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:06:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:06:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:06:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:06:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb98f65e640 1 -- 172.21.15.6:0/246237086 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb9740a2b80 msgr2=0x7fb9740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb98f65e640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb9740a2b80 0x7fb9740a5040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb980031aa0 tx=0x7fb9800095c0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb98f65e640 1 -- 172.21.15.6:0/246237086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988102d50 msgr2=0x7fb9881982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb98f65e640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988102d50 0x7fb9881982f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb97800d950 tx=0x7fb97800de10 comp rx=0 tx=0).stop 2024-09-12T00:06:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb98f65e640 1 -- 172.21.15.6:0/246237086 shutdown_connections 2024-09-12T00:06:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb98f65e640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb9740a2b80 0x7fb9740a5040 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb98f65e640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb988103710 0x7fb98819f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb98f65e640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988102d50 0x7fb9881982f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb98f65e640 1 --2- 172.21.15.6:0/246237086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb988101b60 0x7fb988197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.580+0000 7fb98f65e640 1 -- 172.21.15.6:0/246237086 >> 172.21.15.6:0/246237086 conn(0x7fb9880fd2e0 msgr2=0x7fb9881061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.581+0000 7fb98f65e640 1 -- 172.21.15.6:0/246237086 shutdown_connections 2024-09-12T00:06:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:40.581+0000 7fb98f65e640 1 -- 172.21.15.6:0/246237086 wait complete. 2024-09-12T00:06:41.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:40 smithi134 ceph-mon[34893]: pgmap v579: 129 pgs: 129 active+clean; 9.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:06:41.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:40 smithi039 ceph-mon[34543]: pgmap v579: 129 pgs: 129 active+clean; 9.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:06:41.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:40 smithi006 ceph-mon[30947]: pgmap v579: 129 pgs: 129 active+clean; 9.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:06:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:42 smithi134 ceph-mon[34893]: pgmap v580: 129 pgs: 129 active+clean; 9.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:06:43.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:42 smithi039 ceph-mon[34543]: pgmap v580: 129 pgs: 129 active+clean; 9.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:06:43.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:42 smithi006 ceph-mon[30947]: pgmap v580: 129 pgs: 129 active+clean; 9.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-09-12T00:06:45.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:44 smithi134 ceph-mon[34893]: pgmap v581: 129 pgs: 129 active+clean; 9.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 21 op/s 2024-09-12T00:06:45.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:44 smithi039 ceph-mon[34543]: pgmap v581: 129 pgs: 129 active+clean; 9.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 21 op/s 2024-09-12T00:06:45.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:44 smithi006 ceph-mon[30947]: pgmap v581: 129 pgs: 129 active+clean; 9.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 21 op/s 2024-09-12T00:06:47.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:46 smithi134 ceph-mon[34893]: pgmap v582: 129 pgs: 129 active+clean; 9.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:06:47.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:46 smithi039 ceph-mon[34543]: pgmap v582: 129 pgs: 129 active+clean; 9.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:06:47.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:46 smithi006 ceph-mon[30947]: pgmap v582: 129 pgs: 129 active+clean; 9.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:06:49.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:48 smithi134 ceph-mon[34893]: pgmap v583: 129 pgs: 129 active+clean; 9.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:06:49.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:48 smithi039 ceph-mon[34543]: pgmap v583: 129 pgs: 129 active+clean; 9.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:06:49.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:48 smithi006 ceph-mon[30947]: pgmap v583: 129 pgs: 129 active+clean; 9.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:06:51.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:50 smithi134 ceph-mon[34893]: pgmap v584: 129 pgs: 129 active+clean; 9.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:06:51.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:50 smithi039 ceph-mon[34543]: pgmap v584: 129 pgs: 129 active+clean; 9.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:06:51.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:50 smithi006 ceph-mon[30947]: pgmap v584: 129 pgs: 129 active+clean; 9.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:06:53.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:52 smithi134 ceph-mon[34893]: pgmap v585: 129 pgs: 129 active+clean; 9.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 27 op/s 2024-09-12T00:06:53.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:52 smithi039 ceph-mon[34543]: pgmap v585: 129 pgs: 129 active+clean; 9.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 27 op/s 2024-09-12T00:06:53.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:52 smithi006 ceph-mon[30947]: pgmap v585: 129 pgs: 129 active+clean; 9.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 27 op/s 2024-09-12T00:06:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.681+0000 7f085ae0e640 1 -- 172.21.15.6:0/3872287213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854101c30 msgr2=0x7f08541020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.681+0000 7f085ae0e640 1 --2- 172.21.15.6:0/3872287213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854101c30 0x7f08541020b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0840009900 tx=0x7f084002a410 comp rx=0 tx=0).stop 2024-09-12T00:06:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.681+0000 7f085ae0e640 1 -- 172.21.15.6:0/3872287213 shutdown_connections 2024-09-12T00:06:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.681+0000 7f085ae0e640 1 --2- 172.21.15.6:0/3872287213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08541025f0 0x7f0854108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.681+0000 7f085ae0e640 1 --2- 172.21.15.6:0/3872287213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854101c30 0x7f08541020b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.681+0000 7f085ae0e640 1 --2- 172.21.15.6:0/3872287213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0854100a40 0x7f0854100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.681+0000 7f085ae0e640 1 -- 172.21.15.6:0/3872287213 >> 172.21.15.6:0/3872287213 conn(0x7f08540fc1c0 msgr2=0x7f08540fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.681+0000 7f085ae0e640 1 -- 172.21.15.6:0/3872287213 shutdown_connections 2024-09-12T00:06:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.681+0000 7f085ae0e640 1 -- 172.21.15.6:0/3872287213 wait complete. 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f085ae0e640 1 Processor -- start 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f085ae0e640 1 -- start start 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f085ae0e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854100a40 0x7f0854197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f085ae0e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0854101c30 0x7f08541982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f085ae0e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08541025f0 0x7f085419f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f085ae0e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f085410c570 con 0x7f0854100a40 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f085ae0e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f085410c3f0 con 0x7f0854101c30 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f085ae0e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f085410c6f0 con 0x7f08541025f0 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f0858baa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854100a40 0x7f0854197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f0858baa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854100a40 0x7f0854197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57496/0 (socket says 172.21.15.6:57496) 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f0858baa640 1 -- 172.21.15.6:0/1166666098 learned_addr learned my addr 172.21.15.6:0/1166666098 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f0853fff640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0854101c30 0x7f08541982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f08593ab640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08541025f0 0x7f085419f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f0858baa640 1 -- 172.21.15.6:0/1166666098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08541025f0 msgr2=0x7f085419f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f0858baa640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08541025f0 0x7f085419f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f0858baa640 1 -- 172.21.15.6:0/1166666098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0854101c30 msgr2=0x7f08541982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f0858baa640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0854101c30 0x7f08541982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f0858baa640 1 -- 172.21.15.6:0/1166666098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085419f9d0 con 0x7f0854100a40 2024-09-12T00:06:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.682+0000 7f0853fff640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0854101c30 0x7f08541982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.683+0000 7f0858baa640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854100a40 0x7f0854197db0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f084800e9c0 tx=0x7f084800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.683+0000 7f0851ffb640 1 -- 172.21.15.6:0/1166666098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084800cd80 con 0x7f0854100a40 2024-09-12T00:06:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.683+0000 7f0851ffb640 1 -- 172.21.15.6:0/1166666098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f08480035f0 con 0x7f0854100a40 2024-09-12T00:06:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.683+0000 7f0851ffb640 1 -- 172.21.15.6:0/1166666098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848010690 con 0x7f0854100a40 2024-09-12T00:06:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.683+0000 7f085ae0e640 1 -- 172.21.15.6:0/1166666098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085419fcc0 con 0x7f0854100a40 2024-09-12T00:06:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.683+0000 7f085ae0e640 1 -- 172.21.15.6:0/1166666098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08541a01c0 con 0x7f0854100a40 2024-09-12T00:06:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.686+0000 7f0851ffb640 1 -- 172.21.15.6:0/1166666098 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f08480037a0 con 0x7f0854100a40 2024-09-12T00:06:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.686+0000 7f085dc86740 1 Processor -- start 2024-09-12T00:06:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.686+0000 7f085dc86740 1 -- start start 2024-09-12T00:06:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f085dc86740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f3c9a0 0x564011f3cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f085dc86740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f41da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f085dc86740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f44830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f085dc86740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564011ea02f0 con 0x564011f3d2e0 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f085dc86740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564011e48270 con 0x564011f3c9a0 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f085dc86740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564011e9c2b0 con 0x564011f42370 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f0851ffb640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f08440a2b80 0x7f08440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f0858baa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f41da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f08593ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f3c9a0 0x564011f3cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f08593ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f3c9a0 0x564011f3cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:48754/0 (socket says 172.21.15.6:48754) 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f08593ab640 1 -- 172.21.15.6:0/461361361 learned_addr learned my addr 172.21.15.6:0/461361361 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f08593ab640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f08440a2b80 0x7f08440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f0851ffb640 1 -- 172.21.15.6:0/1166666098 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f08480cf880 con 0x7f0854100a40 2024-09-12T00:06:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f0853fff640 1 --2- 172.21.15.6:0/461361361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f44830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f08593ab640 1 -- 172.21.15.6:0/461361361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 msgr2=0x564011f44830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f08593ab640 1 --2- 172.21.15.6:0/461361361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f44830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f08593ab640 1 -- 172.21.15.6:0/461361361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 msgr2=0x564011f41da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f08593ab640 1 --2- 172.21.15.6:0/461361361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f41da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f08593ab640 1 -- 172.21.15.6:0/461361361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564011e47340 con 0x564011f3c9a0 2024-09-12T00:06:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f0853fff640 1 --2- 172.21.15.6:0/461361361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f44830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.687+0000 7f08593ab640 1 --2- 172.21.15.6:0/461361361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f3c9a0 0x564011f3cda0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f084c011e00 tx=0x7f084c00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9adc9e62a8d4dc03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.688+0000 7f08593ab640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f08440a2b80 0x7f08440a5040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f084c00fc90 tx=0x7f084c018000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.688+0000 7f083effd640 1 -- 172.21.15.6:0/461361361 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c022070 con 0x564011f3c9a0 2024-09-12T00:06:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.688+0000 7f083effd640 1 -- 172.21.15.6:0/461361361 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f084c00ed10 con 0x564011f3c9a0 2024-09-12T00:06:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.688+0000 7f083effd640 1 -- 172.21.15.6:0/461361361 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c005890 con 0x564011f3c9a0 2024-09-12T00:06:53.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.688+0000 7f085dc86740 1 -- 172.21.15.6:0/461361361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f3c9a0 msgr2=0x564011f3cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.688+0000 7f085dc86740 1 --2- 172.21.15.6:0/461361361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f3c9a0 0x564011f3cda0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f084c011e00 tx=0x7f084c00f790 comp rx=0 tx=0).stop 2024-09-12T00:06:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.689+0000 7f085dc86740 1 -- 172.21.15.6:0/461361361 shutdown_connections 2024-09-12T00:06:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.689+0000 7f085dc86740 1 --2- 172.21.15.6:0/461361361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f44830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.689+0000 7f085dc86740 1 --2- 172.21.15.6:0/461361361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f41da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.689+0000 7f085dc86740 1 --2- 172.21.15.6:0/461361361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f3c9a0 0x564011f3cda0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.689+0000 7f085dc86740 1 -- 172.21.15.6:0/461361361 >> 172.21.15.6:0/461361361 conn(0x564011f38010 msgr2=0x564011f38410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.689+0000 7f085dc86740 1 -- 172.21.15.6:0/461361361 shutdown_connections 2024-09-12T00:06:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.689+0000 7f085dc86740 1 -- 172.21.15.6:0/461361361 wait complete. 2024-09-12T00:06:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.689+0000 7f085dc86740 1 -- start start 2024-09-12T00:06:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.689+0000 7f085dc86740 1 Processor -- start 2024-09-12T00:06:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.689+0000 7f085dc86740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3c9a0 0x564011f46bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f085dc86740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f3d2e0 0x564011f47100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f085dc86740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f42370 0x564011f4e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f085dc86740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564011f452e0 con 0x564011f3c9a0 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f085dc86740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564011e29290 con 0x564011f42370 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f085dc86740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564011f45460 con 0x564011f3d2e0 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f085dc86740 10 client.0 _ll_register_callbacks cb 0x564011e5a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f0858baa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3c9a0 0x564011f46bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f0858baa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3c9a0 0x564011f46bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57512/0 (socket says 172.21.15.6:57512) 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f0858baa640 1 -- 172.21.15.6:0/182218977 learned_addr learned my addr 172.21.15.6:0/182218977 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f0853fff640 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f3d2e0 0x564011f47100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f08593ab640 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f42370 0x564011f4e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f0858baa640 1 -- 172.21.15.6:0/182218977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f3d2e0 msgr2=0x564011f47100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f0858baa640 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f3d2e0 0x564011f47100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f0858baa640 1 -- 172.21.15.6:0/182218977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f42370 msgr2=0x564011f4e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f0858baa640 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f42370 0x564011f4e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f0858baa640 1 -- 172.21.15.6:0/182218977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564011bb3210 con 0x564011f3c9a0 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f08593ab640 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f42370 0x564011f4e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f0833fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f0858baa640 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3c9a0 0x564011f46bc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f08480986c0 tx=0x7f084806ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87f20b4827f2fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.690+0000 7f0833fff640 1 -- 172.21.15.6:0/182218977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08480b0b40 con 0x564011f3c9a0 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f0833fff640 1 -- 172.21.15.6:0/182218977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f08480a44d0 con 0x564011f3c9a0 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f085dc86740 1 -- 172.21.15.6:0/182218977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f084c00ed10 con 0x564011f3c9a0 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f0833fff640 1 -- 172.21.15.6:0/182218977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f084809c3f0 con 0x564011f3c9a0 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f085dc86740 10 client.15954 fetch_fsmap learned FSMap version 33 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f085dc86740 1 -- 172.21.15.6:0/182218977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564011c7f620 con 0x564011f3c9a0 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f0833fff640 1 -- 172.21.15.6:0/182218977 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f084c00ed10 con 0x564011f3c9a0 2024-09-12T00:06:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f0833fff640 1 -- 172.21.15.6:0/182218977 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f0848097a40 con 0x564011f3c9a0 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f085dc86740 10 client.15954 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f085dc86740 10 client.15954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f085dc86740 20 client.15954 populate_metadata read hostname 'smithi006' 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f085dc86740 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564011f52730 0x564011f54b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f085dc86740 4 client.15954 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.691+0000 7f085dc86740 1 -- 172.21.15.6:0/182218977 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564011eada20 con 0x564011f52730 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.692+0000 7f0853fff640 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564011f52730 0x564011f54b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.692+0000 7f0853fff640 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564011f52730 0x564011f54b20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13c66b54c047db82 server_cookie=87588976edf1f7c6 in_seq=0 out_seq=0 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.692+0000 7f0833fff640 10 client.15954 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f0833fff640 1 -- 172.21.15.6:0/182218977 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564011eada20 con 0x564011f52730 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f0833fff640 10 client.15954 handle_command_reply: tid=0 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f085dc86740 1 client.15954 shutdown 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f085dc86740 1 -- 172.21.15.6:0/182218977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3c9a0 msgr2=0x564011f46bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f085dc86740 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3c9a0 0x564011f46bc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f08480986c0 tx=0x7f084806ac70 comp rx=0 tx=0).stop 2024-09-12T00:06:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f085dc86740 1 -- 172.21.15.6:0/182218977 shutdown_connections 2024-09-12T00:06:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f085dc86740 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f42370 0x564011f4e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f085dc86740 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564011f52730 0x564011f54b20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f085dc86740 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f3d2e0 0x564011f47100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f085dc86740 1 --2- 172.21.15.6:0/182218977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3c9a0 0x564011f46bc0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f0833fff640 0 client.15954 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f085dc86740 1 -- 172.21.15.6:0/182218977 >> 172.21.15.6:0/182218977 conn(0x564011f38010 msgr2=0x564011f39820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f085dc86740 1 -- 172.21.15.6:0/182218977 shutdown_connections 2024-09-12T00:06:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f085dc86740 1 -- 172.21.15.6:0/182218977 wait complete. 2024-09-12T00:06:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.693+0000 7f085dc86740 20 client.15954 trim_cache size 0 max 16384 2024-09-12T00:06:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.709+0000 7f085dc86740 1 Processor -- start 2024-09-12T00:06:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.709+0000 7f085dc86740 1 -- start start 2024-09-12T00:06:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.709+0000 7f085dc86740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f47080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.709+0000 7f085dc86740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f4e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.709+0000 7f085dc86740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f38f20 0x564011f39380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.709+0000 7f085dc86740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f08541aaa40 con 0x564011f3d2e0 2024-09-12T00:06:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.709+0000 7f085dc86740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f08541ac580 con 0x564011f38f20 2024-09-12T00:06:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.709+0000 7f085dc86740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08541ab110 con 0x564011f42370 2024-09-12T00:06:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.709+0000 7f0858baa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f47080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.709+0000 7f0858baa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f47080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57524/0 (socket says 172.21.15.6:57524) 2024-09-12T00:06:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.709+0000 7f0858baa640 1 -- 172.21.15.6:0/2823777168 learned_addr learned my addr 172.21.15.6:0/2823777168 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.709+0000 7f0853fff640 1 --2- 172.21.15.6:0/2823777168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f4e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.710+0000 7f0858baa640 1 -- 172.21.15.6:0/2823777168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 msgr2=0x564011f4e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.710+0000 7f0858baa640 1 --2- 172.21.15.6:0/2823777168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f4e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.710+0000 7f0858baa640 1 -- 172.21.15.6:0/2823777168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f38f20 msgr2=0x564011f39380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.710+0000 7f0858baa640 1 --2- 172.21.15.6:0/2823777168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f38f20 0x564011f39380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.710+0000 7f0858baa640 1 -- 172.21.15.6:0/2823777168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564011f46700 con 0x564011f3d2e0 2024-09-12T00:06:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.710+0000 7f0853fff640 1 --2- 172.21.15.6:0/2823777168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f4e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.710+0000 7f0858baa640 1 --2- 172.21.15.6:0/2823777168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f47080 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f084809b9f0 tx=0x7f084809a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6f13b76d3508a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.710+0000 7f083e7fc640 1 -- 172.21.15.6:0/2823777168 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084809bac0 con 0x564011f3d2e0 2024-09-12T00:06:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.710+0000 7f083e7fc640 1 -- 172.21.15.6:0/2823777168 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f084809bcf0 con 0x564011f3d2e0 2024-09-12T00:06:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.710+0000 7f083e7fc640 1 -- 172.21.15.6:0/2823777168 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08480a4730 con 0x564011f3d2e0 2024-09-12T00:06:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.711+0000 7f085dc86740 1 -- 172.21.15.6:0/2823777168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 msgr2=0x564011f47080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.711+0000 7f085dc86740 1 --2- 172.21.15.6:0/2823777168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f47080 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f084809b9f0 tx=0x7f084809a200 comp rx=0 tx=0).stop 2024-09-12T00:06:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.711+0000 7f085dc86740 1 -- 172.21.15.6:0/2823777168 shutdown_connections 2024-09-12T00:06:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.711+0000 7f085dc86740 1 --2- 172.21.15.6:0/2823777168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f38f20 0x564011f39380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.711+0000 7f085dc86740 1 --2- 172.21.15.6:0/2823777168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f4e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.711+0000 7f085dc86740 1 --2- 172.21.15.6:0/2823777168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f47080 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.711+0000 7f085dc86740 1 -- 172.21.15.6:0/2823777168 >> 172.21.15.6:0/2823777168 conn(0x564011f38010 msgr2=0x564011f46970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.711+0000 7f085dc86740 1 -- 172.21.15.6:0/2823777168 shutdown_connections 2024-09-12T00:06:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.711+0000 7f085dc86740 1 -- 172.21.15.6:0/2823777168 wait complete. 2024-09-12T00:06:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.711+0000 7f085dc86740 1 -- start start 2024-09-12T00:06:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.711+0000 7f085dc86740 1 Processor -- start 2024-09-12T00:06:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f085dc86740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f38f20 0x564011f4bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f085dc86740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f4c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f085dc86740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f4d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f085dc86740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f08541abeb0 con 0x564011f3d2e0 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f085dc86740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f08541ab7e0 con 0x564011f38f20 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f085dc86740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08541a8a20 con 0x564011f42370 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f085dc86740 10 client.0 _ll_register_callbacks cb 0x7f0848003d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f0853fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f4c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f0853fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f4c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57532/0 (socket says 172.21.15.6:57532) 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f0853fff640 1 -- 172.21.15.6:0/3220234713 learned_addr learned my addr 172.21.15.6:0/3220234713 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f0858baa640 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f38f20 0x564011f4bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f08593ab640 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f4d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f0853fff640 1 -- 172.21.15.6:0/3220234713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 msgr2=0x564011f4d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f0853fff640 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f4d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f0853fff640 1 -- 172.21.15.6:0/3220234713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f38f20 msgr2=0x564011f4bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f0853fff640 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f38f20 0x564011f4bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f0853fff640 1 -- 172.21.15.6:0/3220234713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564011f4d950 con 0x564011f3d2e0 2024-09-12T00:06:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f08593ab640 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f4d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f0858baa640 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f38f20 0x564011f4bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f0853fff640 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f4c330 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0840009900 tx=0x7f0840009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc0205a001aca87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.712+0000 7f0833fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:06:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f0833fff640 1 -- 172.21.15.6:0/3220234713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0840035040 con 0x564011f3d2e0 2024-09-12T00:06:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f0833fff640 1 -- 172.21.15.6:0/3220234713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f0840004250 con 0x564011f3d2e0 2024-09-12T00:06:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f085dc86740 1 -- 172.21.15.6:0/3220234713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f084809bcf0 con 0x564011f3d2e0 2024-09-12T00:06:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f0833fff640 1 -- 172.21.15.6:0/3220234713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0840051050 con 0x564011f3d2e0 2024-09-12T00:06:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f085dc86740 10 client.15960 fetch_fsmap learned FSMap version 33 2024-09-12T00:06:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f085dc86740 1 -- 172.21.15.6:0/3220234713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564011fbd9a0 con 0x564011f3d2e0 2024-09-12T00:06:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f0833fff640 1 -- 172.21.15.6:0/3220234713 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f084809bcf0 con 0x564011f3d2e0 2024-09-12T00:06:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f0833fff640 1 -- 172.21.15.6:0/3220234713 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f0840004a80 con 0x564011f3d2e0 2024-09-12T00:06:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f085dc86740 10 client.15960 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:06:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f085dc86740 10 client.15960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:06:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f085dc86740 20 client.15960 populate_metadata read hostname 'smithi006' 2024-09-12T00:06:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f085dc86740 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564011fbe3d0 0x564011fc07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f085dc86740 4 client.15960 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:06:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.713+0000 7f085dc86740 1 -- 172.21.15.6:0/3220234713 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564011ea7d70 con 0x564011fbe3d0 2024-09-12T00:06:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.714+0000 7f0858baa640 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564011fbe3d0 0x564011fc07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.714+0000 7f0833fff640 10 client.15960 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.714+0000 7f0858baa640 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564011fbe3d0 0x564011fc07f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=398e746888bfde0b server_cookie=9340f5474e4cdfc2 in_seq=0 out_seq=0 2024-09-12T00:06:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f0833fff640 1 -- 172.21.15.6:0/3220234713 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564011ea7d70 con 0x564011fbe3d0 2024-09-12T00:06:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f0833fff640 10 client.15960 handle_command_reply: tid=0 2024-09-12T00:06:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f085dc86740 1 client.15960 shutdown 2024-09-12T00:06:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f085dc86740 1 -- 172.21.15.6:0/3220234713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 msgr2=0x564011f4c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f085dc86740 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f4c330 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0840009900 tx=0x7f0840009520 comp rx=0 tx=0).stop 2024-09-12T00:06:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f085dc86740 1 -- 172.21.15.6:0/3220234713 shutdown_connections 2024-09-12T00:06:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f085dc86740 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x564011fbe3d0 0x564011fc07f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f085dc86740 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564011f42370 0x564011f4d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f085dc86740 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564011f3d2e0 0x564011f4c330 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f085dc86740 1 --2- 172.21.15.6:0/3220234713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564011f38f20 0x564011f4bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f085dc86740 1 -- 172.21.15.6:0/3220234713 >> 172.21.15.6:0/3220234713 conn(0x564011f38010 msgr2=0x564011f39320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:53.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f0833fff640 0 client.15960 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:06:53.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f085dc86740 1 -- 172.21.15.6:0/3220234713 shutdown_connections 2024-09-12T00:06:53.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f085dc86740 1 -- 172.21.15.6:0/3220234713 wait complete. 2024-09-12T00:06:53.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.730+0000 7f085dc86740 20 client.15960 trim_cache size 0 max 16384 2024-09-12T00:06:53.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:06:53.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:06:53.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:06:53.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:06:53.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.731+0000 7f085ae0e640 1 -- 172.21.15.6:0/1166666098 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f08440a2b80 msgr2=0x7f08440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:53.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.731+0000 7f085ae0e640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f08440a2b80 0x7f08440a5040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f084c00fc90 tx=0x7f084c018000 comp rx=0 tx=0).stop 2024-09-12T00:06:53.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.731+0000 7f085ae0e640 1 -- 172.21.15.6:0/1166666098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854100a40 msgr2=0x7f0854197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:53.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.731+0000 7f085ae0e640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854100a40 0x7f0854197db0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f084800e9c0 tx=0x7f084800ee80 comp rx=0 tx=0).stop 2024-09-12T00:06:53.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.731+0000 7f085ae0e640 1 -- 172.21.15.6:0/1166666098 shutdown_connections 2024-09-12T00:06:53.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.731+0000 7f085ae0e640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f08440a2b80 0x7f08440a5040 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.731+0000 7f085ae0e640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08541025f0 0x7f085419f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.731+0000 7f085ae0e640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0854101c30 0x7f08541982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.731+0000 7f085ae0e640 1 --2- 172.21.15.6:0/1166666098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854100a40 0x7f0854197db0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:53.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.731+0000 7f085ae0e640 1 -- 172.21.15.6:0/1166666098 >> 172.21.15.6:0/1166666098 conn(0x7f08540fc1c0 msgr2=0x7f0854069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:53.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.731+0000 7f085ae0e640 1 -- 172.21.15.6:0/1166666098 shutdown_connections 2024-09-12T00:06:53.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:06:53.731+0000 7f085ae0e640 1 -- 172.21.15.6:0/1166666098 wait complete. 2024-09-12T00:06:55.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:54 smithi134 ceph-mon[34893]: pgmap v586: 129 pgs: 129 active+clean; 9.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:06:55.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:54 smithi039 ceph-mon[34543]: pgmap v586: 129 pgs: 129 active+clean; 9.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:06:55.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:54 smithi006 ceph-mon[30947]: pgmap v586: 129 pgs: 129 active+clean; 9.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:06:57.169 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:56 smithi006 ceph-mon[30947]: pgmap v587: 129 pgs: 129 active+clean; 9.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:06:57.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:56 smithi134 ceph-mon[34893]: pgmap v587: 129 pgs: 129 active+clean; 9.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:06:57.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:56 smithi039 ceph-mon[34543]: pgmap v587: 129 pgs: 129 active+clean; 9.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:06:59.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:06:58 smithi134 ceph-mon[34893]: pgmap v588: 129 pgs: 129 active+clean; 9.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:06:59.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:06:58 smithi039 ceph-mon[34543]: pgmap v588: 129 pgs: 129 active+clean; 9.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:06:59.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:06:58 smithi006 ceph-mon[30947]: pgmap v588: 129 pgs: 129 active+clean; 9.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:07:01.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:00 smithi134 ceph-mon[34893]: pgmap v589: 129 pgs: 129 active+clean; 9.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:07:01.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:00 smithi039 ceph-mon[34543]: pgmap v589: 129 pgs: 129 active+clean; 9.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:07:01.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:00 smithi006 ceph-mon[30947]: pgmap v589: 129 pgs: 129 active+clean; 9.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:07:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:02 smithi134 ceph-mon[34893]: pgmap v590: 129 pgs: 129 active+clean; 9.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:07:03.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:02 smithi039 ceph-mon[34543]: pgmap v590: 129 pgs: 129 active+clean; 9.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:07:03.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:02 smithi006 ceph-mon[30947]: pgmap v590: 129 pgs: 129 active+clean; 9.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:07:05.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:04 smithi134 ceph-mon[34893]: pgmap v591: 129 pgs: 129 active+clean; 9.7 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:07:05.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:04 smithi039 ceph-mon[34543]: pgmap v591: 129 pgs: 129 active+clean; 9.7 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:07:05.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:04 smithi006 ceph-mon[30947]: pgmap v591: 129 pgs: 129 active+clean; 9.7 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:07:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:07:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:07:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:07:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:07:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:07:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:07:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:07:06.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:07:06.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:07:06.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:07:06.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:07:06.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:07:06.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:07:06.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:07:06.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:07:06.297 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:07:06.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:07:06.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:07:06.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:07:06.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:07:06.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:07:06.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:07:06.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:07:06.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:07:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.830+0000 7fac9c00e640 1 -- 172.21.15.6:0/2040588191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac940ffdf0 msgr2=0x7fac941001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.830+0000 7fac9c00e640 1 --2- 172.21.15.6:0/2040588191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac940ffdf0 0x7fac941001f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fac90009900 tx=0x7fac9002a410 comp rx=0 tx=0).stop 2024-09-12T00:07:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.830+0000 7fac9c00e640 1 -- 172.21.15.6:0/2040588191 shutdown_connections 2024-09-12T00:07:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.830+0000 7fac9c00e640 1 --2- 172.21.15.6:0/2040588191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac94103780 0x7fac9410a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.830+0000 7fac9c00e640 1 --2- 172.21.15.6:0/2040588191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac94102dc0 0x7fac94103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.830+0000 7fac9c00e640 1 --2- 172.21.15.6:0/2040588191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac940ffdf0 0x7fac941001f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.830+0000 7fac9c00e640 1 -- 172.21.15.6:0/2040588191 >> 172.21.15.6:0/2040588191 conn(0x7fac940fb930 msgr2=0x7fac940fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.830+0000 7fac9c00e640 1 -- 172.21.15.6:0/2040588191 shutdown_connections 2024-09-12T00:07:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.830+0000 7fac9c00e640 1 -- 172.21.15.6:0/2040588191 wait complete. 2024-09-12T00:07:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac9c00e640 1 Processor -- start 2024-09-12T00:07:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac9c00e640 1 -- start start 2024-09-12T00:07:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac9c00e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac940ffdf0 0x7fac94197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac9c00e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac94102dc0 0x7fac94198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac9c00e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac94103780 0x7fac9419f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac9c00e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fac9410d6a0 con 0x7fac940ffdf0 2024-09-12T00:07:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac9c00e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fac9410d520 con 0x7fac94102dc0 2024-09-12T00:07:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac9c00e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fac9410d820 con 0x7fac94103780 2024-09-12T00:07:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac99daa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac940ffdf0 0x7fac94197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac99daa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac940ffdf0 0x7fac94197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39272/0 (socket says 172.21.15.6:39272) 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac99daa640 1 -- 172.21.15.6:0/2708232520 learned_addr learned my addr 172.21.15.6:0/2708232520 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac995a9640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac94102dc0 0x7fac94198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac9a5ab640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac94103780 0x7fac9419f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac99daa640 1 -- 172.21.15.6:0/2708232520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac94103780 msgr2=0x7fac9419f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac99daa640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac94103780 0x7fac9419f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac99daa640 1 -- 172.21.15.6:0/2708232520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac94102dc0 msgr2=0x7fac94198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac99daa640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac94102dc0 0x7fac94198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac99daa640 1 -- 172.21.15.6:0/2708232520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9419fa10 con 0x7fac940ffdf0 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.831+0000 7fac9a5ab640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac94103780 0x7fac9419f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.832+0000 7fac99daa640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac940ffdf0 0x7fac94197df0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fac900314e0 tx=0x7fac90003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.832+0000 7fac8affd640 1 -- 172.21.15.6:0/2708232520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9003f070 con 0x7fac940ffdf0 2024-09-12T00:07:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.832+0000 7fac9c00e640 1 -- 172.21.15.6:0/2708232520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9419fca0 con 0x7fac940ffdf0 2024-09-12T00:07:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.832+0000 7fac8affd640 1 -- 172.21.15.6:0/2708232520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac90031e40 con 0x7fac940ffdf0 2024-09-12T00:07:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.832+0000 7fac8affd640 1 -- 172.21.15.6:0/2708232520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90035030 con 0x7fac940ffdf0 2024-09-12T00:07:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.832+0000 7fac9c00e640 1 -- 172.21.15.6:0/2708232520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac941a0190 con 0x7fac940ffdf0 2024-09-12T00:07:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.835+0000 7fac9ee86740 1 Processor -- start 2024-09-12T00:07:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.835+0000 7fac8affd640 1 -- 172.21.15.6:0/2708232520 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fac90042070 con 0x7fac940ffdf0 2024-09-12T00:07:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.835+0000 7fac9ee86740 1 -- start start 2024-09-12T00:07:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.835+0000 7fac9ee86740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 0x55bede2f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.835+0000 7fac9ee86740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f32e0 0x55bede2f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.835+0000 7fac9ee86740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f8370 0x55bede2fa830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.835+0000 7fac9ee86740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55bede2562f0 con 0x55bede2f29a0 2024-09-12T00:07:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.835+0000 7fac9ee86740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bede1fe270 con 0x55bede2f8370 2024-09-12T00:07:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.835+0000 7fac9ee86740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bede2522b0 con 0x55bede2f32e0 2024-09-12T00:07:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.835+0000 7fac9a5ab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 0x55bede2f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.835+0000 7fac9a5ab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 0x55bede2f2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39288/0 (socket says 172.21.15.6:39288) 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.835+0000 7fac9a5ab640 1 -- 172.21.15.6:0/624479836 learned_addr learned my addr 172.21.15.6:0/624479836 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac995a9640 1 --2- 172.21.15.6:0/624479836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f8370 0x55bede2fa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac99daa640 1 --2- 172.21.15.6:0/624479836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f32e0 0x55bede2f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac8affd640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fac800a2b80 0x7fac800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac9a5ab640 1 -- 172.21.15.6:0/624479836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f32e0 msgr2=0x55bede2f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac9a5ab640 1 --2- 172.21.15.6:0/624479836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f32e0 0x55bede2f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac9a5ab640 1 -- 172.21.15.6:0/624479836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f8370 msgr2=0x55bede2fa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac9a5ab640 1 --2- 172.21.15.6:0/624479836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f8370 0x55bede2fa830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac9a5ab640 1 -- 172.21.15.6:0/624479836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede1fd340 con 0x55bede2f29a0 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac995a9640 1 --2- 172.21.15.6:0/624479836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f8370 0x55bede2fa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac8affd640 1 -- 172.21.15.6:0/2708232520 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fac900efd30 con 0x7fac940ffdf0 2024-09-12T00:07:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac9a5ab640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fac800a2b80 0x7fac800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac9a5ab640 1 --2- 172.21.15.6:0/624479836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 0x55bede2f2da0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00f410 tx=0x7fac8c00f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0a853d673cc18f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.836+0000 7fac7ffff640 1 -- 172.21.15.6:0/624479836 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c021070 con 0x55bede2f29a0 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.837+0000 7fac7ffff640 1 -- 172.21.15.6:0/624479836 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac8c01be30 con 0x55bede2f29a0 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.837+0000 7fac7ffff640 1 -- 172.21.15.6:0/624479836 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c015070 con 0x55bede2f29a0 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.837+0000 7fac9ee86740 1 -- 172.21.15.6:0/624479836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 msgr2=0x55bede2f2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.837+0000 7fac9ee86740 1 --2- 172.21.15.6:0/624479836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 0x55bede2f2da0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00f410 tx=0x7fac8c00f8d0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.837+0000 7fac9a5ab640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fac800a2b80 0x7fac800a5040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fac8c01e000 tx=0x7fac8c021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.837+0000 7fac9ee86740 1 -- 172.21.15.6:0/624479836 shutdown_connections 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.837+0000 7fac9ee86740 1 --2- 172.21.15.6:0/624479836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f8370 0x55bede2fa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.837+0000 7fac9ee86740 1 --2- 172.21.15.6:0/624479836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f32e0 0x55bede2f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.837+0000 7fac9ee86740 1 --2- 172.21.15.6:0/624479836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 0x55bede2f2da0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.837+0000 7fac9ee86740 1 -- 172.21.15.6:0/624479836 >> 172.21.15.6:0/624479836 conn(0x55bede2ee010 msgr2=0x55bede2ee410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.837+0000 7fac9ee86740 1 -- 172.21.15.6:0/624479836 shutdown_connections 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.837+0000 7fac9ee86740 1 -- 172.21.15.6:0/624479836 wait complete. 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.838+0000 7fac9ee86740 1 -- start start 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.838+0000 7fac9ee86740 1 Processor -- start 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.838+0000 7fac9ee86740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f29a0 0x55bede2fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.838+0000 7fac9ee86740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f32e0 0x55bede2fd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.838+0000 7fac9ee86740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 0x55bede3041a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.838+0000 7fac9ee86740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55bede2fb340 con 0x55bede2f8370 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.838+0000 7fac9ee86740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bede1df290 con 0x55bede2f29a0 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.838+0000 7fac9ee86740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bede2fb4c0 con 0x55bede2f32e0 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.838+0000 7fac9ee86740 10 client.0 _ll_register_callbacks cb 0x55bede210140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.838+0000 7fac9a5ab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 0x55bede3041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac9a5ab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 0x55bede3041a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39300/0 (socket says 172.21.15.6:39300) 2024-09-12T00:07:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac9a5ab640 1 -- 172.21.15.6:0/1947885576 learned_addr learned my addr 172.21.15.6:0/1947885576 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac995a9640 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f32e0 0x55bede2fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac99daa640 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f29a0 0x55bede2fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac9a5ab640 1 -- 172.21.15.6:0/1947885576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f32e0 msgr2=0x55bede2fd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac9a5ab640 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f32e0 0x55bede2fd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac9a5ab640 1 -- 172.21.15.6:0/1947885576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f29a0 msgr2=0x55bede2fcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac9a5ab640 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f29a0 0x55bede2fcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac9a5ab640 1 -- 172.21.15.6:0/1947885576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beddf69210 con 0x55bede2f8370 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac9a5ab640 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 0x55bede3041a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fac8c010600 tx=0x7fac8c010630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97baa679df26f472 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac7d7fa640 1 -- 172.21.15.6:0/1947885576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c033060 con 0x55bede2f8370 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac9ee86740 1 -- 172.21.15.6:0/1947885576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac8c01be30 con 0x55bede2f8370 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.839+0000 7fac7d7fa640 1 -- 172.21.15.6:0/1947885576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fac8c004bf0 con 0x55bede2f8370 2024-09-12T00:07:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.840+0000 7fac7d7fa640 1 -- 172.21.15.6:0/1947885576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fac8c03a050 con 0x55bede2f8370 2024-09-12T00:07:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.840+0000 7fac9ee86740 10 client.15972 fetch_fsmap learned FSMap version 33 2024-09-12T00:07:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.840+0000 7fac9ee86740 1 -- 172.21.15.6:0/1947885576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55bede035620 con 0x55bede2f8370 2024-09-12T00:07:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.840+0000 7fac7d7fa640 1 -- 172.21.15.6:0/1947885576 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac8c01be30 con 0x55bede2f8370 2024-09-12T00:07:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.840+0000 7fac7d7fa640 1 -- 172.21.15.6:0/1947885576 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fac8c02d030 con 0x55bede2f8370 2024-09-12T00:07:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.840+0000 7fac9ee86740 10 client.15972 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:07:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.840+0000 7fac9ee86740 10 client.15972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:07:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.840+0000 7fac9ee86740 20 client.15972 populate_metadata read hostname 'smithi006' 2024-09-12T00:07:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.840+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bede308670 0x55bede30aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.840+0000 7fac9ee86740 4 client.15972 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.840+0000 7fac9ee86740 1 -- 172.21.15.6:0/1947885576 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bede263a20 con 0x55bede308670 2024-09-12T00:07:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.840+0000 7fac99daa640 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bede308670 0x55bede30aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.841+0000 7fac99daa640 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bede308670 0x55bede30aad0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb03846e5bcca70e server_cookie=debf563ccc73999b in_seq=0 out_seq=0 2024-09-12T00:07:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.841+0000 7fac7d7fa640 10 client.15972 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.841+0000 7fac7d7fa640 1 -- 172.21.15.6:0/1947885576 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bede263a20 con 0x55bede308670 2024-09-12T00:07:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.841+0000 7fac7d7fa640 10 client.15972 handle_command_reply: tid=0 2024-09-12T00:07:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.841+0000 7fac9ee86740 1 client.15972 shutdown 2024-09-12T00:07:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.841+0000 7fac9ee86740 1 -- 172.21.15.6:0/1947885576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 msgr2=0x55bede3041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.841+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 0x55bede3041a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fac8c010600 tx=0x7fac8c010630 comp rx=0 tx=0).stop 2024-09-12T00:07:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.842+0000 7fac9ee86740 1 -- 172.21.15.6:0/1947885576 shutdown_connections 2024-09-12T00:07:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.842+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 0x55bede3041a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.842+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bede308670 0x55bede30aad0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.842+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f32e0 0x55bede2fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.842+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1947885576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f29a0 0x55bede2fcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.842+0000 7fac7d7fa640 0 client.15972 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.842+0000 7fac9ee86740 1 -- 172.21.15.6:0/1947885576 >> 172.21.15.6:0/1947885576 conn(0x55bede2ee010 msgr2=0x55bede2ef820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.842+0000 7fac9ee86740 1 -- 172.21.15.6:0/1947885576 shutdown_connections 2024-09-12T00:07:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.842+0000 7fac9ee86740 1 -- 172.21.15.6:0/1947885576 wait complete. 2024-09-12T00:07:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.842+0000 7fac9ee86740 20 client.15972 trim_cache size 0 max 16384 2024-09-12T00:07:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.858+0000 7fac9ee86740 1 Processor -- start 2024-09-12T00:07:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.858+0000 7fac9ee86740 1 -- start start 2024-09-12T00:07:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.858+0000 7fac9ee86740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f29a0 0x55bede2fbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.858+0000 7fac9ee86740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f32e0 0x55bede2ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.858+0000 7fac9ee86740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 0x55bede30f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.858+0000 7fac9ee86740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fac941aa840 con 0x55bede2f8370 2024-09-12T00:07:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.858+0000 7fac9ee86740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fac941ac380 con 0x55bede2f32e0 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.858+0000 7fac9ee86740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fac941aaf10 con 0x55bede2f29a0 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac9a5ab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 0x55bede30f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac9a5ab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 0x55bede30f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39314/0 (socket says 172.21.15.6:39314) 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac9a5ab640 1 -- 172.21.15.6:0/1447540069 learned_addr learned my addr 172.21.15.6:0/1447540069 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac995a9640 1 --2- 172.21.15.6:0/1447540069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f32e0 0x55bede2ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac99daa640 1 --2- 172.21.15.6:0/1447540069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f29a0 0x55bede2fbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac995a9640 1 -- 172.21.15.6:0/1447540069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f29a0 msgr2=0x55bede2fbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac995a9640 1 --2- 172.21.15.6:0/1447540069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f29a0 0x55bede2fbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac995a9640 1 -- 172.21.15.6:0/1447540069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 msgr2=0x55bede30f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac995a9640 1 --2- 172.21.15.6:0/1447540069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 0x55bede30f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac995a9640 1 -- 172.21.15.6:0/1447540069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede2fb220 con 0x55bede2f32e0 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac9a5ab640 1 --2- 172.21.15.6:0/1447540069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 0x55bede30f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac995a9640 1 --2- 172.21.15.6:0/1447540069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f32e0 0x55bede2ed0b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55bede2fe100 tx=0x7fac8400bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fed0e3b88d140ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac7f7fe640 1 -- 172.21.15.6:0/1447540069 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84003ac0 con 0x55bede2f32e0 2024-09-12T00:07:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac7f7fe640 1 -- 172.21.15.6:0/1447540069 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac84020070 con 0x55bede2f32e0 2024-09-12T00:07:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.859+0000 7fac7f7fe640 1 -- 172.21.15.6:0/1447540069 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8401b400 con 0x55bede2f32e0 2024-09-12T00:07:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.860+0000 7fac9ee86740 1 -- 172.21.15.6:0/1447540069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f32e0 msgr2=0x55bede2ed0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.860+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1447540069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f32e0 0x55bede2ed0b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55bede2fe100 tx=0x7fac8400bb20 comp rx=0 tx=0).stop 2024-09-12T00:07:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.860+0000 7fac9ee86740 1 -- 172.21.15.6:0/1447540069 shutdown_connections 2024-09-12T00:07:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.860+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1447540069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f8370 0x55bede30f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.860+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1447540069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f32e0 0x55bede2ed0b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.860+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1447540069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f29a0 0x55bede2fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.860+0000 7fac9ee86740 1 -- 172.21.15.6:0/1447540069 >> 172.21.15.6:0/1447540069 conn(0x55bede2ee010 msgr2=0x55bede2ec9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.860+0000 7fac9ee86740 1 -- 172.21.15.6:0/1447540069 shutdown_connections 2024-09-12T00:07:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.860+0000 7fac9ee86740 1 -- 172.21.15.6:0/1447540069 wait complete. 2024-09-12T00:07:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.860+0000 7fac9ee86740 1 -- start start 2024-09-12T00:07:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac9ee86740 1 Processor -- start 2024-09-12T00:07:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac9ee86740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 0x55bede36e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac9ee86740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f32e0 0x55bede36ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac9ee86740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f8370 0x55bede375e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac9ee86740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fac941abcb0 con 0x55bede2f29a0 2024-09-12T00:07:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac9ee86740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fac941ab5e0 con 0x55bede2f32e0 2024-09-12T00:07:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac9ee86740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fac941a8820 con 0x55bede2f8370 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac9ee86740 10 client.0 _ll_register_callbacks cb 0x7fac8c01f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac99daa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 0x55bede36e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac99daa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 0x55bede36e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39320/0 (socket says 172.21.15.6:39320) 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac99daa640 1 -- 172.21.15.6:0/1537072128 learned_addr learned my addr 172.21.15.6:0/1537072128 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac995a9640 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f32e0 0x55bede36ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac9a5ab640 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f8370 0x55bede375e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac99daa640 1 -- 172.21.15.6:0/1537072128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f8370 msgr2=0x55bede375e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac99daa640 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f8370 0x55bede375e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac99daa640 1 -- 172.21.15.6:0/1537072128 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f32e0 msgr2=0x55bede36ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac99daa640 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f32e0 0x55bede36ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.861+0000 7fac99daa640 1 -- 172.21.15.6:0/1537072128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bede376490 con 0x55bede2f29a0 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac99daa640 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 0x55bede36e900 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fac900b8b70 tx=0x7fac9002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffd1853629d7dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac7d7fa640 1 -- 172.21.15.6:0/1537072128 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90049040 con 0x55bede2f29a0 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac7d7fa640 1 -- 172.21.15.6:0/1537072128 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fac900ba4a0 con 0x55bede2f29a0 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac9ee86740 1 -- 172.21.15.6:0/1537072128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac84020070 con 0x55bede2f29a0 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac7d7fa640 1 -- 172.21.15.6:0/1537072128 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fac900bc1a0 con 0x55bede2f29a0 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac9ee86740 10 client.15978 fetch_fsmap learned FSMap version 33 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac9ee86740 1 -- 172.21.15.6:0/1537072128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55bede377870 con 0x55bede2f29a0 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac7d7fa640 1 -- 172.21.15.6:0/1537072128 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac84020070 con 0x55bede2f29a0 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac7d7fa640 1 -- 172.21.15.6:0/1537072128 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fac9003b640 con 0x55bede2f29a0 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac9ee86740 10 client.15978 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac9ee86740 10 client.15978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.862+0000 7fac9ee86740 20 client.15978 populate_metadata read hostname 'smithi006' 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.863+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bede3781c0 0x55bede37a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.863+0000 7fac9ee86740 4 client.15978 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:07:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.863+0000 7fac9ee86740 1 -- 172.21.15.6:0/1537072128 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bede25dd70 con 0x55bede3781c0 2024-09-12T00:07:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.863+0000 7fac995a9640 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bede3781c0 0x55bede37a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.863+0000 7fac7d7fa640 10 client.15978 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.863+0000 7fac995a9640 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bede3781c0 0x55bede37a5b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58ec2e558ffc8706 server_cookie=afa198f775ff9f63 in_seq=0 out_seq=0 2024-09-12T00:07:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac7d7fa640 1 -- 172.21.15.6:0/1537072128 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bede25dd70 con 0x55bede3781c0 2024-09-12T00:07:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac7d7fa640 10 client.15978 handle_command_reply: tid=0 2024-09-12T00:07:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac9ee86740 1 client.15978 shutdown 2024-09-12T00:07:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac9ee86740 1 -- 172.21.15.6:0/1537072128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 msgr2=0x55bede36e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 0x55bede36e900 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fac900b8b70 tx=0x7fac9002a410 comp rx=0 tx=0).stop 2024-09-12T00:07:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac9ee86740 1 -- 172.21.15.6:0/1537072128 shutdown_connections 2024-09-12T00:07:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bede3781c0 0x55bede37a5b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bede2f8370 0x55bede375e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac7d7fa640 0 client.15978 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bede2f32e0 0x55bede36ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac9ee86740 1 --2- 172.21.15.6:0/1537072128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bede2f29a0 0x55bede36e900 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac9ee86740 1 -- 172.21.15.6:0/1537072128 >> 172.21.15.6:0/1537072128 conn(0x55bede2ee010 msgr2=0x55bede2ed1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac9ee86740 1 -- 172.21.15.6:0/1537072128 shutdown_connections 2024-09-12T00:07:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.879+0000 7fac9ee86740 1 -- 172.21.15.6:0/1537072128 wait complete. 2024-09-12T00:07:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9ee86740 20 client.15978 trim_cache size 0 max 16384 2024-09-12T00:07:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:07:06.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:07:06.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:07:06.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:07:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9c00e640 1 -- 172.21.15.6:0/2708232520 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fac800a2b80 msgr2=0x7fac800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9c00e640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fac800a2b80 0x7fac800a5040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fac8c01e000 tx=0x7fac8c021000 comp rx=0 tx=0).stop 2024-09-12T00:07:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9c00e640 1 -- 172.21.15.6:0/2708232520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac940ffdf0 msgr2=0x7fac94197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9c00e640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac940ffdf0 0x7fac94197df0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fac900314e0 tx=0x7fac90003c80 comp rx=0 tx=0).stop 2024-09-12T00:07:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9c00e640 1 -- 172.21.15.6:0/2708232520 shutdown_connections 2024-09-12T00:07:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9c00e640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fac800a2b80 0x7fac800a5040 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9c00e640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac94103780 0x7fac9419f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9c00e640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac94102dc0 0x7fac94198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9c00e640 1 --2- 172.21.15.6:0/2708232520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac940ffdf0 0x7fac94197df0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9c00e640 1 -- 172.21.15.6:0/2708232520 >> 172.21.15.6:0/2708232520 conn(0x7fac940fb930 msgr2=0x7fac94106280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9c00e640 1 -- 172.21.15.6:0/2708232520 shutdown_connections 2024-09-12T00:07:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:06.880+0000 7fac9c00e640 1 -- 172.21.15.6:0/2708232520 wait complete. 2024-09-12T00:07:07.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:06 smithi134 ceph-mon[34893]: pgmap v592: 129 pgs: 129 active+clean; 9.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:07:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:06 smithi134 ceph-mon[34893]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-09-12T00:07:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:06 smithi134 ceph-mon[34893]: Unable to set osd_memory_target on smithi134 to 184584601: error parsing value: Value '184584601' is below minimum 939524096 2024-09-12T00:07:07.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:06 smithi039 ceph-mon[34543]: pgmap v592: 129 pgs: 129 active+clean; 9.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:07:07.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:06 smithi039 ceph-mon[34543]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-09-12T00:07:07.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:06 smithi039 ceph-mon[34543]: Unable to set osd_memory_target on smithi134 to 184584601: error parsing value: Value '184584601' is below minimum 939524096 2024-09-12T00:07:07.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:06 smithi006 ceph-mon[30947]: pgmap v592: 129 pgs: 129 active+clean; 9.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:07:07.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:06 smithi006 ceph-mon[30947]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-09-12T00:07:07.376 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:06 smithi006 ceph-mon[30947]: Unable to set osd_memory_target on smithi134 to 184584601: error parsing value: Value '184584601' is below minimum 939524096 2024-09-12T00:07:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:08 smithi134 ceph-mon[34893]: pgmap v593: 129 pgs: 129 active+clean; 9.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:07:09.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:08 smithi039 ceph-mon[34543]: pgmap v593: 129 pgs: 129 active+clean; 9.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:07:09.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:08 smithi006 ceph-mon[30947]: pgmap v593: 129 pgs: 129 active+clean; 9.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T00:07:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:10 smithi134 ceph-mon[34893]: pgmap v594: 129 pgs: 129 active+clean; 9.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:07:11.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:10 smithi039 ceph-mon[34543]: pgmap v594: 129 pgs: 129 active+clean; 9.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:07:11.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:10 smithi006 ceph-mon[30947]: pgmap v594: 129 pgs: 129 active+clean; 9.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-12T00:07:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:12 smithi134 ceph-mon[34893]: pgmap v595: 129 pgs: 129 active+clean; 9.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:07:13.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:12 smithi039 ceph-mon[34543]: pgmap v595: 129 pgs: 129 active+clean; 9.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:07:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:12 smithi006 ceph-mon[30947]: pgmap v595: 129 pgs: 129 active+clean; 9.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:07:15.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:14 smithi134 ceph-mon[34893]: pgmap v596: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:07:15.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:14 smithi039 ceph-mon[34543]: pgmap v596: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:07:15.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:14 smithi006 ceph-mon[30947]: pgmap v596: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:07:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:16 smithi134 ceph-mon[34893]: pgmap v597: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:07:17.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:16 smithi039 ceph-mon[34543]: pgmap v597: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:07:17.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:16 smithi006 ceph-mon[30947]: pgmap v597: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:07:19.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:18 smithi134 ceph-mon[34893]: pgmap v598: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:07:19.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:18 smithi039 ceph-mon[34543]: pgmap v598: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:07:19.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:18 smithi006 ceph-mon[30947]: pgmap v598: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:07:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.981+0000 7fdd872f1640 1 -- 172.21.15.6:0/1602331450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd80101b60 msgr2=0x7fdd80101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.981+0000 7fdd872f1640 1 --2- 172.21.15.6:0/1602331450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd80101b60 0x7fdd80101f60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009900 tx=0x7fdd7c02a410 comp rx=0 tx=0).stop 2024-09-12T00:07:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.981+0000 7fdd872f1640 1 -- 172.21.15.6:0/1602331450 shutdown_connections 2024-09-12T00:07:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.981+0000 7fdd872f1640 1 --2- 172.21.15.6:0/1602331450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd80103710 0x7fdd80109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.981+0000 7fdd872f1640 1 --2- 172.21.15.6:0/1602331450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd80102d50 0x7fdd801031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.981+0000 7fdd872f1640 1 --2- 172.21.15.6:0/1602331450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd80101b60 0x7fdd80101f60 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.981+0000 7fdd872f1640 1 -- 172.21.15.6:0/1602331450 >> 172.21.15.6:0/1602331450 conn(0x7fdd800fd2e0 msgr2=0x7fdd800ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.981+0000 7fdd872f1640 1 -- 172.21.15.6:0/1602331450 shutdown_connections 2024-09-12T00:07:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.981+0000 7fdd872f1640 1 -- 172.21.15.6:0/1602331450 wait complete. 2024-09-12T00:07:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.982+0000 7fdd872f1640 1 Processor -- start 2024-09-12T00:07:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.982+0000 7fdd872f1640 1 -- start start 2024-09-12T00:07:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.982+0000 7fdd872f1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd80101b60 0x7fdd8019a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.982+0000 7fdd872f1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd80102d50 0x7fdd8019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.982+0000 7fdd872f1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd80103710 0x7fdd801a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.982+0000 7fdd872f1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8010d6c0 con 0x7fdd80102d50 2024-09-12T00:07:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.982+0000 7fdd872f1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8010d540 con 0x7fdd80101b60 2024-09-12T00:07:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.982+0000 7fdd872f1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8010d840 con 0x7fdd80103710 2024-09-12T00:07:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.982+0000 7fdd8488c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd80102d50 0x7fdd8019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd8488c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd80102d50 0x7fdd8019a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53826/0 (socket says 172.21.15.6:53826) 2024-09-12T00:07:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd8488c640 1 -- 172.21.15.6:0/587699302 learned_addr learned my addr 172.21.15.6:0/587699302 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd8508d640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd80101b60 0x7fdd8019a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd8588e640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd80103710 0x7fdd801a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd8488c640 1 -- 172.21.15.6:0/587699302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd80103710 msgr2=0x7fdd801a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd8488c640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd80103710 0x7fdd801a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd8488c640 1 -- 172.21.15.6:0/587699302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd80101b60 msgr2=0x7fdd8019a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd8488c640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd80101b60 0x7fdd8019a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd8488c640 1 -- 172.21.15.6:0/587699302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd801a1c40 con 0x7fdd80102d50 2024-09-12T00:07:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd8508d640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd80101b60 0x7fdd8019a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd8488c640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd80102d50 0x7fdd8019a560 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000d950 tx=0x7fdd7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd767fc640 1 -- 172.21.15.6:0/587699302 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70017070 con 0x7fdd80102d50 2024-09-12T00:07:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd872f1640 1 -- 172.21.15.6:0/587699302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd801a1f30 con 0x7fdd80102d50 2024-09-12T00:07:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.983+0000 7fdd767fc640 1 -- 172.21.15.6:0/587699302 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd70009c30 con 0x7fdd80102d50 2024-09-12T00:07:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.984+0000 7fdd767fc640 1 -- 172.21.15.6:0/587699302 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7000f620 con 0x7fdd80102d50 2024-09-12T00:07:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.984+0000 7fdd872f1640 1 -- 172.21.15.6:0/587699302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd801a2440 con 0x7fdd80102d50 2024-09-12T00:07:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.987+0000 7fdd8a08b740 1 Processor -- start 2024-09-12T00:07:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.987+0000 7fdd767fc640 1 -- 172.21.15.6:0/587699302 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fdd700109a0 con 0x7fdd80102d50 2024-09-12T00:07:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.987+0000 7fdd8a08b740 1 -- start start 2024-09-12T00:07:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.987+0000 7fdd8a08b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bbffada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8a08b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bbfffda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8a08b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bc002830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8a08b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d0bbf5e2f0 con 0x55d0bc000370 2024-09-12T00:07:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8a08b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d0bbf06270 con 0x55d0bbffa9a0 2024-09-12T00:07:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8a08b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d0bbf5a2b0 con 0x55d0bbffb2e0 2024-09-12T00:07:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8508d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bbfffda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8588e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bbffada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8508d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bbfffda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:53410/0 (socket says 172.21.15.6:53410) 2024-09-12T00:07:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8508d640 1 -- 172.21.15.6:0/1092711466 learned_addr learned my addr 172.21.15.6:0/1092711466 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8588e640 1 --2- 172.21.15.6:0/1092711466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bbffada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:53308/0 (socket says 172.21.15.6:53308) 2024-09-12T00:07:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8488c640 1 --2- 172.21.15.6:0/1092711466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bc002830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8508d640 1 -- 172.21.15.6:0/1092711466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 msgr2=0x55d0bbffada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8508d640 1 --2- 172.21.15.6:0/1092711466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bbffada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8508d640 1 -- 172.21.15.6:0/1092711466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 msgr2=0x55d0bc002830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8508d640 1 --2- 172.21.15.6:0/1092711466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bc002830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8508d640 1 -- 172.21.15.6:0/1092711466 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0bbf05340 con 0x55d0bbffb2e0 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8588e640 1 --2- 172.21.15.6:0/1092711466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bbffada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd767fc640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdd6c0a2c00 0x7fdd6c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.988+0000 7fdd8508d640 1 --2- 172.21.15.6:0/1092711466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bbfffda0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c006010 tx=0x7fdd7c0045b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41cf47469764f7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.989+0000 7fdd8588e640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdd6c0a2c00 0x7fdd6c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.989+0000 7fdd767fc640 1 -- 172.21.15.6:0/587699302 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fdd700ceff0 con 0x7fdd80102d50 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.989+0000 7fdd6b7fe640 1 -- 172.21.15.6:0/1092711466 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c040070 con 0x55d0bbffb2e0 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.989+0000 7fdd6b7fe640 1 -- 172.21.15.6:0/1092711466 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd7c003e20 con 0x55d0bbffb2e0 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.989+0000 7fdd6b7fe640 1 -- 172.21.15.6:0/1092711466 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c035040 con 0x55d0bbffb2e0 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.990+0000 7fdd8a08b740 1 -- 172.21.15.6:0/1092711466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 msgr2=0x55d0bbfffda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.990+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/1092711466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bbfffda0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c006010 tx=0x7fdd7c0045b0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.990+0000 7fdd8588e640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdd6c0a2c00 0x7fdd6c0a50c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdd78005fd0 tx=0x7fdd78009740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.990+0000 7fdd8a08b740 1 -- 172.21.15.6:0/1092711466 shutdown_connections 2024-09-12T00:07:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.990+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/1092711466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bc002830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.990+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/1092711466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bbfffda0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.990+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/1092711466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bbffada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.990+0000 7fdd8a08b740 1 -- 172.21.15.6:0/1092711466 >> 172.21.15.6:0/1092711466 conn(0x55d0bbff6010 msgr2=0x55d0bbff6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.990+0000 7fdd8a08b740 1 -- 172.21.15.6:0/1092711466 shutdown_connections 2024-09-12T00:07:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.990+0000 7fdd8a08b740 1 -- 172.21.15.6:0/1092711466 wait complete. 2024-09-12T00:07:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.990+0000 7fdd8a08b740 1 -- start start 2024-09-12T00:07:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8a08b740 1 Processor -- start 2024-09-12T00:07:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8a08b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8a08b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8a08b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bc00c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8a08b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d0bc0032e0 con 0x55d0bc000370 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8a08b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d0bbee7290 con 0x55d0bbffa9a0 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8a08b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d0bc003460 con 0x55d0bbffb2e0 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8a08b740 10 client.0 _ll_register_callbacks cb 0x55d0bbf18140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8588e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bc00c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8588e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bc00c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53846/0 (socket says 172.21.15.6:53846) 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8588e640 1 -- 172.21.15.6:0/142423546 learned_addr learned my addr 172.21.15.6:0/142423546 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8488c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8508d640 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8488c640 1 -- 172.21.15.6:0/142423546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 msgr2=0x55d0bc004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8488c640 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bc004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8488c640 1 -- 172.21.15.6:0/142423546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 msgr2=0x55d0bc00c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8488c640 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bc00c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8488c640 1 -- 172.21.15.6:0/142423546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0bbc71210 con 0x55d0bbffb2e0 2024-09-12T00:07:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.991+0000 7fdd8588e640 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bc00c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd8488c640 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc005130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd700cc6e0 tx=0x7fdd700976e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b2ac7b59e90eeaa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:07:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd68ff9640 1 -- 172.21.15.6:0/142423546 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70020070 con 0x55d0bbffb2e0 2024-09-12T00:07:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd8a08b740 1 -- 172.21.15.6:0/142423546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd7c003e20 con 0x55d0bbffb2e0 2024-09-12T00:07:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd68ff9640 1 -- 172.21.15.6:0/142423546 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fdd70097ab0 con 0x55d0bbffb2e0 2024-09-12T00:07:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd68ff9640 1 -- 172.21.15.6:0/142423546 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdd7009ada0 con 0x55d0bbffb2e0 2024-09-12T00:07:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd8a08b740 10 client.25591 fetch_fsmap learned FSMap version 33 2024-09-12T00:07:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd8a08b740 1 -- 172.21.15.6:0/142423546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d0bbd3d620 con 0x55d0bbffb2e0 2024-09-12T00:07:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd68ff9640 1 -- 172.21.15.6:0/142423546 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd7c003e20 con 0x55d0bbffb2e0 2024-09-12T00:07:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd68ff9640 1 -- 172.21.15.6:0/142423546 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fdd700a3c20 con 0x55d0bbffb2e0 2024-09-12T00:07:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd8a08b740 10 client.25591 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd8a08b740 10 client.25591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.992+0000 7fdd8a08b740 20 client.25591 populate_metadata read hostname 'smithi006' 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.993+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d0bc0108d0 0x55d0bc012cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.993+0000 7fdd8a08b740 4 client.25591 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.993+0000 7fdd8a08b740 1 -- 172.21.15.6:0/142423546 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0bbf6ba20 con 0x55d0bc0108d0 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.993+0000 7fdd8508d640 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d0bc0108d0 0x55d0bc012cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.993+0000 7fdd8508d640 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d0bc0108d0 0x55d0bc012cc0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94bf4b6a62e5b068 server_cookie=a341601ba5168f19 in_seq=0 out_seq=0 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.993+0000 7fdd68ff9640 10 client.25591 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd68ff9640 1 -- 172.21.15.6:0/142423546 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0bbf6ba20 con 0x55d0bc0108d0 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd68ff9640 10 client.25591 handle_command_reply: tid=0 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd8a08b740 1 client.25591 shutdown 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd8a08b740 1 -- 172.21.15.6:0/142423546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 msgr2=0x55d0bc005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc005130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd700cc6e0 tx=0x7fdd700976e0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd8a08b740 1 -- 172.21.15.6:0/142423546 shutdown_connections 2024-09-12T00:07:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bc00c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d0bc0108d0 0x55d0bc012cc0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc005130 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/142423546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bc004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd68ff9640 0 client.25591 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd8a08b740 1 -- 172.21.15.6:0/142423546 >> 172.21.15.6:0/142423546 conn(0x55d0bbff6010 msgr2=0x55d0bbff7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd8a08b740 1 -- 172.21.15.6:0/142423546 shutdown_connections 2024-09-12T00:07:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd8a08b740 1 -- 172.21.15.6:0/142423546 wait complete. 2024-09-12T00:07:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:19.994+0000 7fdd8a08b740 20 client.25591 trim_cache size 0 max 16384 2024-09-12T00:07:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8a08b740 1 Processor -- start 2024-09-12T00:07:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8a08b740 1 -- start start 2024-09-12T00:07:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8a08b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bbff6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8a08b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc00c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8a08b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bbff7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8a08b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801aca70 con 0x55d0bc000370 2024-09-12T00:07:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8a08b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801ae5b0 con 0x55d0bbffa9a0 2024-09-12T00:07:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8a08b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801ad140 con 0x55d0bbffb2e0 2024-09-12T00:07:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8488c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc00c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8588e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bbff7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8488c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc00c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:53418/0 (socket says 172.21.15.6:53418) 2024-09-12T00:07:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8488c640 1 -- 172.21.15.6:0/2036376242 learned_addr learned my addr 172.21.15.6:0/2036376242 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8508d640 1 --2- 172.21.15.6:0/2036376242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bbff6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8488c640 1 -- 172.21.15.6:0/2036376242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 msgr2=0x55d0bbff6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8488c640 1 --2- 172.21.15.6:0/2036376242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bbff6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8488c640 1 -- 172.21.15.6:0/2036376242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 msgr2=0x55d0bbff7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8488c640 1 --2- 172.21.15.6:0/2036376242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bbff7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8488c640 1 -- 172.21.15.6:0/2036376242 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0bc013030 con 0x55d0bbffb2e0 2024-09-12T00:07:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.013+0000 7fdd8588e640 1 --2- 172.21.15.6:0/2036376242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bbff7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.014+0000 7fdd8488c640 1 --2- 172.21.15.6:0/2036376242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc00c130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdd700d26d0 tx=0x7fdd70099950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b840ac825afb6f69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.014+0000 7fdd6affd640 1 -- 172.21.15.6:0/2036376242 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70020070 con 0x55d0bbffb2e0 2024-09-12T00:07:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.014+0000 7fdd6affd640 1 -- 172.21.15.6:0/2036376242 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd70015070 con 0x55d0bbffb2e0 2024-09-12T00:07:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.014+0000 7fdd6affd640 1 -- 172.21.15.6:0/2036376242 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7009b440 con 0x55d0bbffb2e0 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.015+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2036376242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 msgr2=0x55d0bc00c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.015+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/2036376242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc00c130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdd700d26d0 tx=0x7fdd70099950 comp rx=0 tx=0).stop 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.015+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2036376242 shutdown_connections 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.015+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/2036376242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bc000370 0x55d0bbff7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.015+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/2036376242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc00c130 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.015+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/2036376242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bbffa9a0 0x55d0bbff6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.015+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2036376242 >> 172.21.15.6:0/2036376242 conn(0x55d0bbff6010 msgr2=0x55d0bbffc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.015+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2036376242 shutdown_connections 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.015+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2036376242 wait complete. 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.015+0000 7fdd8a08b740 1 -- start start 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.015+0000 7fdd8a08b740 1 Processor -- start 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8a08b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bbffa9a0 0x55d0bc008fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8a08b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc009510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8a08b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bc000370 0x55d0bc0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8a08b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801adee0 con 0x55d0bbffa9a0 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8a08b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801ad810 con 0x55d0bc000370 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8a08b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801aaa50 con 0x55d0bbffb2e0 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8508d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bbffa9a0 0x55d0bc008fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8a08b740 10 client.0 _ll_register_callbacks cb 0x7fdd7000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8508d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bbffa9a0 0x55d0bc008fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53856/0 (socket says 172.21.15.6:53856) 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8508d640 1 -- 172.21.15.6:0/2485677329 learned_addr learned my addr 172.21.15.6:0/2485677329 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8488c640 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc009510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8588e640 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bc000370 0x55d0bc0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8488c640 1 -- 172.21.15.6:0/2485677329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bc000370 msgr2=0x55d0bc0794d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8488c640 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bc000370 0x55d0bc0794d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8488c640 1 -- 172.21.15.6:0/2485677329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bbffa9a0 msgr2=0x55d0bc008fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8488c640 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bbffa9a0 0x55d0bc008fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8488c640 1 -- 172.21.15.6:0/2485677329 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0bc079a10 con 0x55d0bbffb2e0 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8508d640 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bbffa9a0 0x55d0bc008fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd8488c640 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc009510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd7009b140 tx=0x7fdd700a3e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eef055c08d5e125f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.016+0000 7fdd68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd68ff9640 1 -- 172.21.15.6:0/2485677329 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70020050 con 0x55d0bbffb2e0 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2485677329 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd70015070 con 0x55d0bbffb2e0 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd68ff9640 1 -- 172.21.15.6:0/2485677329 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fdd70097190 con 0x55d0bbffb2e0 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd68ff9640 1 -- 172.21.15.6:0/2485677329 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdd700d2a70 con 0x55d0bbffb2e0 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd8a08b740 10 client.25597 fetch_fsmap learned FSMap version 33 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2485677329 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d0bc07acf0 con 0x55d0bbffb2e0 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd68ff9640 1 -- 172.21.15.6:0/2485677329 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd70015070 con 0x55d0bbffb2e0 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd68ff9640 1 -- 172.21.15.6:0/2485677329 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fdd700d2040 con 0x55d0bbffb2e0 2024-09-12T00:07:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd8a08b740 10 client.25597 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:07:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd8a08b740 10 client.25597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:07:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd8a08b740 20 client.25597 populate_metadata read hostname 'smithi006' 2024-09-12T00:07:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d0bc07b4c0 0x55d0bc07d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd8a08b740 4 client.25597 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:07:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.017+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2485677329 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0bbf65d70 con 0x55d0bc07b4c0 2024-09-12T00:07:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.018+0000 7fdd8508d640 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d0bc07b4c0 0x55d0bc07d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.018+0000 7fdd8508d640 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d0bc07b4c0 0x55d0bc07d8e0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1d465a5776c8a79 server_cookie=d0df70b1b744ce8c in_seq=0 out_seq=0 2024-09-12T00:07:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.018+0000 7fdd68ff9640 10 client.25597 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.035+0000 7fdd68ff9640 1 -- 172.21.15.6:0/2485677329 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d0bbf65d70 con 0x55d0bc07b4c0 2024-09-12T00:07:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.035+0000 7fdd68ff9640 10 client.25597 handle_command_reply: tid=0 2024-09-12T00:07:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.035+0000 7fdd8a08b740 1 client.25597 shutdown 2024-09-12T00:07:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.035+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2485677329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 msgr2=0x55d0bc009510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.035+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc009510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd7009b140 tx=0x7fdd700a3e50 comp rx=0 tx=0).stop 2024-09-12T00:07:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.035+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2485677329 shutdown_connections 2024-09-12T00:07:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.035+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d0bc000370 0x55d0bc0794d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.035+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d0bc07b4c0 0x55d0bc07d8e0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.035+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0bbffb2e0 0x55d0bc009510 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.035+0000 7fdd68ff9640 0 client.25597 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.035+0000 7fdd8a08b740 1 --2- 172.21.15.6:0/2485677329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0bbffa9a0 0x55d0bc008fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.035+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2485677329 >> 172.21.15.6:0/2485677329 conn(0x55d0bbff6010 msgr2=0x55d0bbff49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2485677329 shutdown_connections 2024-09-12T00:07:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd8a08b740 1 -- 172.21.15.6:0/2485677329 wait complete. 2024-09-12T00:07:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd8a08b740 20 client.25597 trim_cache size 0 max 16384 2024-09-12T00:07:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:07:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:07:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:07:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:07:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd872f1640 1 -- 172.21.15.6:0/587699302 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdd6c0a2c00 msgr2=0x7fdd6c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd872f1640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdd6c0a2c00 0x7fdd6c0a50c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdd78005fd0 tx=0x7fdd78009740 comp rx=0 tx=0).stop 2024-09-12T00:07:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd872f1640 1 -- 172.21.15.6:0/587699302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd80102d50 msgr2=0x7fdd8019a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd872f1640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd80102d50 0x7fdd8019a560 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000d950 tx=0x7fdd7000de10 comp rx=0 tx=0).stop 2024-09-12T00:07:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd872f1640 1 -- 172.21.15.6:0/587699302 shutdown_connections 2024-09-12T00:07:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd872f1640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdd6c0a2c00 0x7fdd6c0a50c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd872f1640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd80103710 0x7fdd801a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd872f1640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd80102d50 0x7fdd8019a560 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd872f1640 1 --2- 172.21.15.6:0/587699302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd80101b60 0x7fdd8019a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.036+0000 7fdd872f1640 1 -- 172.21.15.6:0/587699302 >> 172.21.15.6:0/587699302 conn(0x7fdd800fd2e0 msgr2=0x7fdd80108540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.037+0000 7fdd872f1640 1 -- 172.21.15.6:0/587699302 shutdown_connections 2024-09-12T00:07:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:20.037+0000 7fdd872f1640 1 -- 172.21.15.6:0/587699302 wait complete. 2024-09-12T00:07:21.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:20 smithi134 ceph-mon[34893]: pgmap v599: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:07:21.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:20 smithi039 ceph-mon[34543]: pgmap v599: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:07:21.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:20 smithi006 ceph-mon[30947]: pgmap v599: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:07:23.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:22 smithi134 ceph-mon[34893]: pgmap v600: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 28 op/s 2024-09-12T00:07:23.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:22 smithi039 ceph-mon[34543]: pgmap v600: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 28 op/s 2024-09-12T00:07:23.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:22 smithi006 ceph-mon[30947]: pgmap v600: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 28 op/s 2024-09-12T00:07:25.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:24 smithi134 ceph-mon[34893]: pgmap v601: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:07:25.296 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:24 smithi039 ceph-mon[34543]: pgmap v601: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:07:25.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:24 smithi006 ceph-mon[30947]: pgmap v601: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:07:27.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:26 smithi134 ceph-mon[34893]: pgmap v602: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:07:27.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:26 smithi039 ceph-mon[34543]: pgmap v602: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:07:27.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:26 smithi006 ceph-mon[30947]: pgmap v602: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 26 op/s 2024-09-12T00:07:29.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:28 smithi134 ceph-mon[34893]: pgmap v603: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:07:29.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:28 smithi039 ceph-mon[34543]: pgmap v603: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:07:29.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:28 smithi006 ceph-mon[30947]: pgmap v603: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 26 op/s 2024-09-12T00:07:31.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:30 smithi134 ceph-mon[34893]: pgmap v604: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:07:31.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:30 smithi039 ceph-mon[34543]: pgmap v604: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:07:31.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:30 smithi006 ceph-mon[30947]: pgmap v604: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:07:33.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:32 smithi134 ceph-mon[34893]: pgmap v605: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-12T00:07:33.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:32 smithi039 ceph-mon[34543]: pgmap v605: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-12T00:07:33.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:32 smithi006 ceph-mon[30947]: pgmap v605: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-12T00:07:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.425+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1614225329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e841016f0 msgr2=0x7f7e84101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.425+0000 7f7e8bb4b640 1 --2- 172.21.15.6:0/1614225329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e841016f0 0x7f7e84101ba0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009ca0 tx=0x7f7e7c02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.425+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1614225329 shutdown_connections 2024-09-12T00:07:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.425+0000 7f7e8bb4b640 1 --2- 172.21.15.6:0/1614225329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e841016f0 0x7f7e84101ba0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.425+0000 7f7e8bb4b640 1 --2- 172.21.15.6:0/1614225329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e84100d50 0x7f7e841011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.425+0000 7f7e8bb4b640 1 --2- 172.21.15.6:0/1614225329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e84100410 0x7f7e84100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.425+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1614225329 >> 172.21.15.6:0/1614225329 conn(0x7f7e840fc1c0 msgr2=0x7f7e840fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.425+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1614225329 shutdown_connections 2024-09-12T00:07:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.425+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1614225329 wait complete. 2024-09-12T00:07:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.426+0000 7f7e8bb4b640 1 Processor -- start 2024-09-12T00:07:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.426+0000 7f7e8bb4b640 1 -- start start 2024-09-12T00:07:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.426+0000 7f7e8bb4b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e84100410 0x7f7e84199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.426+0000 7f7e8bb4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e84100d50 0x7f7e8419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.426+0000 7f7e8bb4b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e841016f0 0x7f7e841a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.426+0000 7f7e8bb4b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8410f800 con 0x7f7e841016f0 2024-09-12T00:07:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.426+0000 7f7e8bb4b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8410f680 con 0x7f7e84100410 2024-09-12T00:07:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.426+0000 7f7e8bb4b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8410f980 con 0x7f7e84100d50 2024-09-12T00:07:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.426+0000 7f7e8a0e8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e841016f0 0x7f7e841a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.426+0000 7f7e8a0e8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e841016f0 0x7f7e841a14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57430/0 (socket says 172.21.15.6:57430) 2024-09-12T00:07:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.426+0000 7f7e8a0e8640 1 -- 172.21.15.6:0/1175989000 learned_addr learned my addr 172.21.15.6:0/1175989000 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.426+0000 7f7e890e6640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e84100d50 0x7f7e8419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.427+0000 7f7e898e7640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e84100410 0x7f7e84199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.427+0000 7f7e8a0e8640 1 -- 172.21.15.6:0/1175989000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e84100d50 msgr2=0x7f7e8419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.427+0000 7f7e8a0e8640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e84100d50 0x7f7e8419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.427+0000 7f7e8a0e8640 1 -- 172.21.15.6:0/1175989000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e84100410 msgr2=0x7f7e84199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.427+0000 7f7e8a0e8640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e84100410 0x7f7e84199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.427+0000 7f7e8a0e8640 1 -- 172.21.15.6:0/1175989000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e841a1b60 con 0x7f7e841016f0 2024-09-12T00:07:33.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.427+0000 7f7e8a0e8640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e841016f0 0x7f7e841a14f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009dc0 tx=0x7f7e7c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:33.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.427+0000 7f7e7affd640 1 -- 172.21.15.6:0/1175989000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0317c0 con 0x7f7e841016f0 2024-09-12T00:07:33.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.427+0000 7f7e7affd640 1 -- 172.21.15.6:0/1175989000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e7c02f380 con 0x7f7e841016f0 2024-09-12T00:07:33.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.427+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1175989000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e841a1df0 con 0x7f7e841016f0 2024-09-12T00:07:33.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.427+0000 7f7e7affd640 1 -- 172.21.15.6:0/1175989000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c030c10 con 0x7f7e841016f0 2024-09-12T00:07:33.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.427+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1175989000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e841a22b0 con 0x7f7e841016f0 2024-09-12T00:07:33.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.430+0000 7f7e7affd640 1 -- 172.21.15.6:0/1175989000 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f7e7c004240 con 0x7f7e841016f0 2024-09-12T00:07:33.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.430+0000 7f7e7affd640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7e700a2b80 0x7f7e700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.430+0000 7f7e898e7640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7e700a2b80 0x7f7e700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.430+0000 7f7e7affd640 1 -- 172.21.15.6:0/1175989000 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f7e7c0f0ba0 con 0x7f7e841016f0 2024-09-12T00:07:33.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.431+0000 7f7e898e7640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7e700a2b80 0x7f7e700a5040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7e80005fd0 tx=0x7f7e80005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.445+0000 7f7e8e9c7740 1 Processor -- start 2024-09-12T00:07:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.445+0000 7f7e8e9c7740 1 -- start start 2024-09-12T00:07:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.445+0000 7f7e8e9c7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 0x5578e5072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.445+0000 7f7e8e9c7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e50732e0 0x5578e5077da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.445+0000 7f7e8e9c7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e5078370 0x5578e507a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.445+0000 7f7e8e9c7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5578e4fd62f0 con 0x5578e50729a0 2024-09-12T00:07:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.445+0000 7f7e8e9c7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5578e4f7e270 con 0x5578e50732e0 2024-09-12T00:07:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.445+0000 7f7e8e9c7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5578e4fd22b0 con 0x5578e5078370 2024-09-12T00:07:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.445+0000 7f7e898e7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 0x5578e5072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e898e7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 0x5578e5072da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57442/0 (socket says 172.21.15.6:57442) 2024-09-12T00:07:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e898e7640 1 -- 172.21.15.6:0/4249494578 learned_addr learned my addr 172.21.15.6:0/4249494578 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e890e6640 1 --2- 172.21.15.6:0/4249494578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e50732e0 0x5578e5077da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e8a0e8640 1 --2- 172.21.15.6:0/4249494578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e5078370 0x5578e507a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e898e7640 1 -- 172.21.15.6:0/4249494578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e5078370 msgr2=0x5578e507a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e898e7640 1 --2- 172.21.15.6:0/4249494578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e5078370 0x5578e507a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e898e7640 1 -- 172.21.15.6:0/4249494578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e50732e0 msgr2=0x5578e5077da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e898e7640 1 --2- 172.21.15.6:0/4249494578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e50732e0 0x5578e5077da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e898e7640 1 -- 172.21.15.6:0/4249494578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e4f7d340 con 0x5578e50729a0 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e898e7640 1 --2- 172.21.15.6:0/4249494578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 0x5578e5072da0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000feb0 tx=0x7f7e80012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebba88ae97e091e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e6ffff640 1 -- 172.21.15.6:0/4249494578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e80022070 con 0x5578e50729a0 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e6ffff640 1 -- 172.21.15.6:0/4249494578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e80011e50 con 0x5578e50729a0 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.446+0000 7f7e6ffff640 1 -- 172.21.15.6:0/4249494578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e80010940 con 0x5578e50729a0 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.447+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/4249494578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 msgr2=0x5578e5072da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.447+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/4249494578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 0x5578e5072da0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000feb0 tx=0x7f7e80012000 comp rx=0 tx=0).stop 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.447+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/4249494578 shutdown_connections 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.447+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/4249494578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e5078370 0x5578e507a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.447+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/4249494578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e50732e0 0x5578e5077da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.447+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/4249494578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 0x5578e5072da0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.447+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/4249494578 >> 172.21.15.6:0/4249494578 conn(0x5578e506e010 msgr2=0x5578e506e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.447+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/4249494578 shutdown_connections 2024-09-12T00:07:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.447+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/4249494578 wait complete. 2024-09-12T00:07:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e8e9c7740 1 -- start start 2024-09-12T00:07:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e8e9c7740 1 Processor -- start 2024-09-12T00:07:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e8e9c7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e50729a0 0x5578e507cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e8e9c7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 0x5578e507d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e8e9c7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e5078370 0x5578e5084120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e8e9c7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5578e507b340 con 0x5578e50732e0 2024-09-12T00:07:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e8e9c7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5578e4f5f290 con 0x5578e5078370 2024-09-12T00:07:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e8e9c7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5578e507b4c0 con 0x5578e50729a0 2024-09-12T00:07:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e8e9c7740 10 client.0 _ll_register_callbacks cb 0x5578e4f90140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e890e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 0x5578e507d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e890e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 0x5578e507d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57450/0 (socket says 172.21.15.6:57450) 2024-09-12T00:07:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e890e6640 1 -- 172.21.15.6:0/3668917610 learned_addr learned my addr 172.21.15.6:0/3668917610 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.448+0000 7f7e8a0e8640 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e5078370 0x5578e5084120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e898e7640 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e50729a0 0x5578e507cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e890e6640 1 -- 172.21.15.6:0/3668917610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e50729a0 msgr2=0x5578e507cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e890e6640 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e50729a0 0x5578e507cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e890e6640 1 -- 172.21.15.6:0/3668917610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e5078370 msgr2=0x5578e5084120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e890e6640 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e5078370 0x5578e5084120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e890e6640 1 -- 172.21.15.6:0/3668917610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e4ce9210 con 0x5578e50732e0 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e898e7640 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e50729a0 0x5578e507cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e8a0e8640 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e5078370 0x5578e5084120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e890e6640 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 0x5578e507d0e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400bf50 tx=0x7f7e740118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68718d1ccc0a131d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e6d7fa640 1 -- 172.21.15.6:0/3668917610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74004020 con 0x5578e50732e0 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e6d7fa640 1 -- 172.21.15.6:0/3668917610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f7e740041c0 con 0x5578e50732e0 2024-09-12T00:07:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3668917610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e80011e50 con 0x5578e50732e0 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e6d7fa640 1 -- 172.21.15.6:0/3668917610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7e74024050 con 0x5578e50732e0 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e8e9c7740 10 client.16008 fetch_fsmap learned FSMap version 33 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3668917610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5578e4db5620 con 0x5578e50732e0 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.449+0000 7f7e6d7fa640 1 -- 172.21.15.6:0/3668917610 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e80011e50 con 0x5578e50732e0 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.450+0000 7f7e6d7fa640 1 -- 172.21.15.6:0/3668917610 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f7e740037a0 con 0x5578e50732e0 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.450+0000 7f7e8e9c7740 10 client.16008 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.450+0000 7f7e8e9c7740 10 client.16008 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.450+0000 7f7e8e9c7740 20 client.16008 populate_metadata read hostname 'smithi006' 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.450+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5578e50888d0 0x5578e508ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.450+0000 7f7e8e9c7740 4 client.16008 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.450+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3668917610 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578e4fe3a20 con 0x5578e50888d0 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.450+0000 7f7e898e7640 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5578e50888d0 0x5578e508ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.451+0000 7f7e6d7fa640 10 client.16008 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.451+0000 7f7e898e7640 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5578e50888d0 0x5578e508ad30 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fc0fa1b4dc5b6db server_cookie=c74007055c1cf350 in_seq=0 out_seq=0 2024-09-12T00:07:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.451+0000 7f7e6d7fa640 1 -- 172.21.15.6:0/3668917610 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5578e4fe3a20 con 0x5578e50888d0 2024-09-12T00:07:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.451+0000 7f7e6d7fa640 10 client.16008 handle_command_reply: tid=0 2024-09-12T00:07:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.451+0000 7f7e8e9c7740 1 client.16008 shutdown 2024-09-12T00:07:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.452+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3668917610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 msgr2=0x5578e507d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.452+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 0x5578e507d0e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400bf50 tx=0x7f7e740118d0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.452+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3668917610 shutdown_connections 2024-09-12T00:07:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.452+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e5078370 0x5578e5084120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.452+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 0x5578e507d0e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.452+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5578e50888d0 0x5578e508ad30 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.452+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/3668917610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e50729a0 0x5578e507cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.452+0000 7f7e6d7fa640 0 client.16008 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.452+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3668917610 >> 172.21.15.6:0/3668917610 conn(0x5578e506e010 msgr2=0x5578e506f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.452+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3668917610 shutdown_connections 2024-09-12T00:07:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.452+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3668917610 wait complete. 2024-09-12T00:07:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.452+0000 7f7e8e9c7740 20 client.16008 trim_cache size 0 max 16384 2024-09-12T00:07:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e8e9c7740 1 Processor -- start 2024-09-12T00:07:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e8e9c7740 1 -- start start 2024-09-12T00:07:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e8e9c7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 0x5578e506f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e8e9c7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e50732e0 0x5578e50840e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e8e9c7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e5078370 0x5578e506f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e8e9c7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841aca10 con 0x5578e50729a0 2024-09-12T00:07:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e8e9c7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841ae550 con 0x5578e5078370 2024-09-12T00:07:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e8e9c7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841ad0e0 con 0x5578e50732e0 2024-09-12T00:07:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e898e7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 0x5578e506f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e898e7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 0x5578e506f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57466/0 (socket says 172.21.15.6:57466) 2024-09-12T00:07:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e890e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e50732e0 0x5578e50840e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e898e7640 1 -- 172.21.15.6:0/3171836423 learned_addr learned my addr 172.21.15.6:0/3171836423 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.471+0000 7f7e8a0e8640 1 --2- 172.21.15.6:0/3171836423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e5078370 0x5578e506f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.472+0000 7f7e890e6640 1 -- 172.21.15.6:0/3171836423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e5078370 msgr2=0x5578e506f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.472+0000 7f7e890e6640 1 --2- 172.21.15.6:0/3171836423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e5078370 0x5578e506f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.472+0000 7f7e890e6640 1 -- 172.21.15.6:0/3171836423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 msgr2=0x5578e506f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.472+0000 7f7e890e6640 1 --2- 172.21.15.6:0/3171836423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 0x5578e506f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.472+0000 7f7e890e6640 1 -- 172.21.15.6:0/3171836423 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e50737c0 con 0x5578e50732e0 2024-09-12T00:07:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.472+0000 7f7e8a0e8640 1 --2- 172.21.15.6:0/3171836423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e5078370 0x5578e506f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.472+0000 7f7e890e6640 1 --2- 172.21.15.6:0/3171836423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e50732e0 0x5578e50840e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e74005d00 tx=0x7f7e7400b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d47b14e76749ebdc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.472+0000 7f7e6f7fe640 1 -- 172.21.15.6:0/3171836423 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74000e60 con 0x5578e50732e0 2024-09-12T00:07:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.472+0000 7f7e6f7fe640 1 -- 172.21.15.6:0/3171836423 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e7401a3f0 con 0x5578e50732e0 2024-09-12T00:07:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.472+0000 7f7e6f7fe640 1 -- 172.21.15.6:0/3171836423 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7402c070 con 0x5578e50732e0 2024-09-12T00:07:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.473+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3171836423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e50732e0 msgr2=0x5578e50840e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.473+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/3171836423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e50732e0 0x5578e50840e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e74005d00 tx=0x7f7e7400b8c0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.473+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3171836423 shutdown_connections 2024-09-12T00:07:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.473+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/3171836423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e5078370 0x5578e506f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.473+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/3171836423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e50732e0 0x5578e50840e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.473+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/3171836423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50729a0 0x5578e506f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.473+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3171836423 >> 172.21.15.6:0/3171836423 conn(0x5578e506e010 msgr2=0x5578e506d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.473+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3171836423 shutdown_connections 2024-09-12T00:07:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.473+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/3171836423 wait complete. 2024-09-12T00:07:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.473+0000 7f7e8e9c7740 1 -- start start 2024-09-12T00:07:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e8e9c7740 1 Processor -- start 2024-09-12T00:07:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e8e9c7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e50729a0 0x5578e5081550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e8e9c7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 0x5578e5081a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e8e9c7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e5078370 0x5578e5082a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e8e9c7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841ade80 con 0x5578e50732e0 2024-09-12T00:07:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e8e9c7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841ad7b0 con 0x5578e50729a0 2024-09-12T00:07:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e8e9c7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841aa9f0 con 0x5578e5078370 2024-09-12T00:07:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e8e9c7740 10 client.0 _ll_register_callbacks cb 0x7f7e7400bb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e890e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 0x5578e5081a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e890e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 0x5578e5081a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57472/0 (socket says 172.21.15.6:57472) 2024-09-12T00:07:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e890e6640 1 -- 172.21.15.6:0/657160337 learned_addr learned my addr 172.21.15.6:0/657160337 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e898e7640 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e50729a0 0x5578e5081550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e8a0e8640 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e5078370 0x5578e5082a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e890e6640 1 -- 172.21.15.6:0/657160337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e5078370 msgr2=0x5578e5082a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e890e6640 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e5078370 0x5578e5082a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e890e6640 1 -- 172.21.15.6:0/657160337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e50729a0 msgr2=0x5578e5081550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e890e6640 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e50729a0 0x5578e5081550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.474+0000 7f7e890e6640 1 -- 172.21.15.6:0/657160337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e5083040 con 0x5578e50732e0 2024-09-12T00:07:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.475+0000 7f7e890e6640 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 0x5578e5081a90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7e74011910 tx=0x7f7e74003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0b0b43adf87dce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.475+0000 7f7e6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:07:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.475+0000 7f7e6d7fa640 1 -- 172.21.15.6:0/657160337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74034070 con 0x5578e50732e0 2024-09-12T00:07:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.475+0000 7f7e6d7fa640 1 -- 172.21.15.6:0/657160337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f7e74003fc0 con 0x5578e50732e0 2024-09-12T00:07:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.475+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/657160337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e7401a3f0 con 0x5578e50732e0 2024-09-12T00:07:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.475+0000 7f7e6d7fa640 1 -- 172.21.15.6:0/657160337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7e74040050 con 0x5578e50732e0 2024-09-12T00:07:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.475+0000 7f7e8e9c7740 10 client.16014 fetch_fsmap learned FSMap version 33 2024-09-12T00:07:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.475+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/657160337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5578e5084350 con 0x5578e50732e0 2024-09-12T00:07:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.475+0000 7f7e6d7fa640 1 -- 172.21.15.6:0/657160337 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e7401a3f0 con 0x5578e50732e0 2024-09-12T00:07:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.475+0000 7f7e6d7fa640 1 -- 172.21.15.6:0/657160337 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f7e7401a5d0 con 0x5578e50732e0 2024-09-12T00:07:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.476+0000 7f7e8e9c7740 10 client.16014 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:07:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.476+0000 7f7e8e9c7740 10 client.16014 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:07:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.476+0000 7f7e8e9c7740 20 client.16014 populate_metadata read hostname 'smithi006' 2024-09-12T00:07:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.476+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5578e50f3c80 0x5578e50f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.476+0000 7f7e8e9c7740 4 client.16014 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:07:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.476+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/657160337 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5578e4fddd70 con 0x5578e50f3c80 2024-09-12T00:07:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.476+0000 7f7e898e7640 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5578e50f3c80 0x5578e50f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.476+0000 7f7e6d7fa640 10 client.16014 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.476+0000 7f7e898e7640 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5578e50f3c80 0x5578e50f60a0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=169a8e119f605e65 server_cookie=c8b49f55f1c26f39 in_seq=0 out_seq=0 2024-09-12T00:07:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e6d7fa640 1 -- 172.21.15.6:0/657160337 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5578e4fddd70 con 0x5578e50f3c80 2024-09-12T00:07:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e6d7fa640 10 client.16014 handle_command_reply: tid=0 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e8e9c7740 1 client.16014 shutdown 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/657160337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 msgr2=0x5578e5081a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 0x5578e5081a90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7e74011910 tx=0x7f7e74003820 comp rx=0 tx=0).stop 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/657160337 shutdown_connections 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x5578e50f3c80 0x5578e50f60a0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578e5078370 0x5578e5082a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578e50732e0 0x5578e5081a90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e8e9c7740 1 --2- 172.21.15.6:0/657160337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5578e50729a0 0x5578e5081550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/657160337 >> 172.21.15.6:0/657160337 conn(0x5578e506e010 msgr2=0x5578e506d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e6d7fa640 0 client.16014 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/657160337 shutdown_connections 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.494+0000 7f7e8e9c7740 1 -- 172.21.15.6:0/657160337 wait complete. 2024-09-12T00:07:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8e9c7740 20 client.16014 trim_cache size 0 max 16384 2024-09-12T00:07:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:07:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:07:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:07:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:07:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1175989000 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7e700a2b80 msgr2=0x7f7e700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8bb4b640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7e700a2b80 0x7f7e700a5040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7e80005fd0 tx=0x7f7e80005850 comp rx=0 tx=0).stop 2024-09-12T00:07:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1175989000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e841016f0 msgr2=0x7f7e841a14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8bb4b640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e841016f0 0x7f7e841a14f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009dc0 tx=0x7f7e7c003c20 comp rx=0 tx=0).stop 2024-09-12T00:07:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1175989000 shutdown_connections 2024-09-12T00:07:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8bb4b640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7e700a2b80 0x7f7e700a5040 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8bb4b640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e841016f0 0x7f7e841a14f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8bb4b640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e84100d50 0x7f7e8419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8bb4b640 1 --2- 172.21.15.6:0/1175989000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e84100410 0x7f7e84199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1175989000 >> 172.21.15.6:0/1175989000 conn(0x7f7e840fc1c0 msgr2=0x7f7e840fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1175989000 shutdown_connections 2024-09-12T00:07:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:33.495+0000 7f7e8bb4b640 1 -- 172.21.15.6:0/1175989000 wait complete. 2024-09-12T00:07:35.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:34 smithi134 ceph-mon[34893]: pgmap v606: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:07:35.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:34 smithi039 ceph-mon[34543]: pgmap v606: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:07:35.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:34 smithi006 ceph-mon[30947]: pgmap v606: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 23 op/s 2024-09-12T00:07:37.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:36 smithi134 ceph-mon[34893]: pgmap v607: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:07:37.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:36 smithi039 ceph-mon[34543]: pgmap v607: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:07:37.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:36 smithi006 ceph-mon[30947]: pgmap v607: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 25 op/s 2024-09-12T00:07:39.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:38 smithi134 ceph-mon[34893]: pgmap v608: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:07:39.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:38 smithi039 ceph-mon[34543]: pgmap v608: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:07:39.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:38 smithi006 ceph-mon[30947]: pgmap v608: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:07:41.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:40 smithi134 ceph-mon[34893]: pgmap v609: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-09-12T00:07:41.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:40 smithi039 ceph-mon[34543]: pgmap v609: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-09-12T00:07:41.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:40 smithi006 ceph-mon[30947]: pgmap v609: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-09-12T00:07:43.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:42 smithi039 ceph-mon[34543]: pgmap v610: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 29 op/s 2024-09-12T00:07:43.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:42 smithi006 ceph-mon[30947]: pgmap v610: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 29 op/s 2024-09-12T00:07:43.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:42 smithi134 ceph-mon[34893]: pgmap v610: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 29 op/s 2024-09-12T00:07:45.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:44 smithi039 ceph-mon[34543]: pgmap v611: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:07:45.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:44 smithi006 ceph-mon[30947]: pgmap v611: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:07:45.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:44 smithi134 ceph-mon[34893]: pgmap v611: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:07:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.601+0000 7f5648afa640 1 -- 172.21.15.6:0/3655061423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5644107880 msgr2=0x7f5644109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.601+0000 7f5648afa640 1 --2- 172.21.15.6:0/3655061423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5644107880 0x7f5644109c90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f563c009ca0 tx=0x7f563c02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.601+0000 7f5648afa640 1 -- 172.21.15.6:0/3655061423 shutdown_connections 2024-09-12T00:07:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.601+0000 7f5648afa640 1 --2- 172.21.15.6:0/3655061423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5644107880 0x7f5644109c90 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.601+0000 7f5648afa640 1 --2- 172.21.15.6:0/3655061423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5644104f50 0x7f5644107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.601+0000 7f5648afa640 1 --2- 172.21.15.6:0/3655061423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5644102620 0x7f5644104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.601+0000 7f5648afa640 1 -- 172.21.15.6:0/3655061423 >> 172.21.15.6:0/3655061423 conn(0x7f56440fc1c0 msgr2=0x7f56440fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.601+0000 7f5648afa640 1 -- 172.21.15.6:0/3655061423 shutdown_connections 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.601+0000 7f5648afa640 1 -- 172.21.15.6:0/3655061423 wait complete. 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.602+0000 7f5648afa640 1 Processor -- start 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.602+0000 7f5648afa640 1 -- start start 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.602+0000 7f5648afa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5644102620 0x7f5644101f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.602+0000 7f5648afa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5644104f50 0x7f56441005d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.602+0000 7f5648afa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5644107880 0x7f5644100b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.602+0000 7f5648afa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f564410d700 con 0x7f5644104f50 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.602+0000 7f5648afa640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f564410d580 con 0x7f5644102620 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.602+0000 7f5648afa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f564410d880 con 0x7f5644107880 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.602+0000 7f5641d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5644104f50 0x7f56441005d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.602+0000 7f5641d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5644104f50 0x7f56441005d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49604/0 (socket says 172.21.15.6:49604) 2024-09-12T00:07:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.602+0000 7f5641d9b640 1 -- 172.21.15.6:0/169364473 learned_addr learned my addr 172.21.15.6:0/169364473 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.602+0000 7f564259c640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5644102620 0x7f5644101f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.603+0000 7f5642d9d640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5644107880 0x7f5644100b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.603+0000 7f5641d9b640 1 -- 172.21.15.6:0/169364473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5644107880 msgr2=0x7f5644100b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.603+0000 7f5641d9b640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5644107880 0x7f5644100b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.603+0000 7f5641d9b640 1 -- 172.21.15.6:0/169364473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5644102620 msgr2=0x7f5644101f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.603+0000 7f5641d9b640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5644102620 0x7f5644101f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.603+0000 7f5641d9b640 1 -- 172.21.15.6:0/169364473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56441013a0 con 0x7f5644104f50 2024-09-12T00:07:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.603+0000 7f5641d9b640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5644104f50 0x7f56441005d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f563800e9f0 tx=0x7f563800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.603+0000 7f56337fe640 1 -- 172.21.15.6:0/169364473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563800ccc0 con 0x7f5644104f50 2024-09-12T00:07:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.603+0000 7f56337fe640 1 -- 172.21.15.6:0/169364473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56380054d0 con 0x7f5644104f50 2024-09-12T00:07:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.603+0000 7f5648afa640 1 -- 172.21.15.6:0/169364473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56441a1ef0 con 0x7f5644104f50 2024-09-12T00:07:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.603+0000 7f56337fe640 1 -- 172.21.15.6:0/169364473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638010430 con 0x7f5644104f50 2024-09-12T00:07:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.603+0000 7f5648afa640 1 -- 172.21.15.6:0/169364473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56441a2300 con 0x7f5644104f50 2024-09-12T00:07:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.606+0000 7f56337fe640 1 -- 172.21.15.6:0/169364473 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f5638005020 con 0x7f5644104f50 2024-09-12T00:07:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.606+0000 7f564b894740 1 Processor -- start 2024-09-12T00:07:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.606+0000 7f564b894740 1 -- start start 2024-09-12T00:07:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.606+0000 7f564b894740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a61da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.606+0000 7f564b894740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 0x561bd0a66da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.606+0000 7f564b894740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a67370 0x561bd0a69830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.606+0000 7f564b894740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561bd09c52f0 con 0x561bd0a622e0 2024-09-12T00:07:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f564b894740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561bd096d270 con 0x561bd0a619a0 2024-09-12T00:07:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f564b894740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561bd09c12b0 con 0x561bd0a67370 2024-09-12T00:07:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f564259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 0x561bd0a66da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f564259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 0x561bd0a66da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49620/0 (socket says 172.21.15.6:49620) 2024-09-12T00:07:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f564259c640 1 -- 172.21.15.6:0/90046018 learned_addr learned my addr 172.21.15.6:0/90046018 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f5642d9d640 1 --2- 172.21.15.6:0/90046018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a61da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f5641d9b640 1 --2- 172.21.15.6:0/90046018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a67370 0x561bd0a69830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f56337fe640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f562c0a2b80 0x7f562c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f564259c640 1 -- 172.21.15.6:0/90046018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a67370 msgr2=0x561bd0a69830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f564259c640 1 --2- 172.21.15.6:0/90046018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a67370 0x561bd0a69830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f564259c640 1 -- 172.21.15.6:0/90046018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 msgr2=0x561bd0a61da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f564259c640 1 --2- 172.21.15.6:0/90046018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a61da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f564259c640 1 -- 172.21.15.6:0/90046018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bd096c340 con 0x561bd0a622e0 2024-09-12T00:07:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f5642d9d640 1 --2- 172.21.15.6:0/90046018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a61da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f5642d9d640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f562c0a2b80 0x7f562c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f56337fe640 1 -- 172.21.15.6:0/169364473 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f56380cf880 con 0x7f5644104f50 2024-09-12T00:07:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.607+0000 7f564259c640 1 --2- 172.21.15.6:0/90046018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 0x561bd0a66da0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f563400bd10 tx=0x7f56340107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230e4097ed2cd98c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.608+0000 7f5630ff9640 1 -- 172.21.15.6:0/90046018 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634004030 con 0x561bd0a622e0 2024-09-12T00:07:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.608+0000 7f5630ff9640 1 -- 172.21.15.6:0/90046018 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56340035f0 con 0x561bd0a622e0 2024-09-12T00:07:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.608+0000 7f5630ff9640 1 -- 172.21.15.6:0/90046018 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634011770 con 0x561bd0a622e0 2024-09-12T00:07:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.608+0000 7f564b894740 1 -- 172.21.15.6:0/90046018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 msgr2=0x561bd0a66da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.608+0000 7f564b894740 1 --2- 172.21.15.6:0/90046018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 0x561bd0a66da0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f563400bd10 tx=0x7f56340107a0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.608+0000 7f5642d9d640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f562c0a2b80 0x7f562c0a5040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f563c006010 tx=0x7f563c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.608+0000 7f564b894740 1 -- 172.21.15.6:0/90046018 shutdown_connections 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 --2- 172.21.15.6:0/90046018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a67370 0x561bd0a69830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 --2- 172.21.15.6:0/90046018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 0x561bd0a66da0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 --2- 172.21.15.6:0/90046018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a61da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 -- 172.21.15.6:0/90046018 >> 172.21.15.6:0/90046018 conn(0x561bd0a5d010 msgr2=0x561bd0a5d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 -- 172.21.15.6:0/90046018 shutdown_connections 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 -- 172.21.15.6:0/90046018 wait complete. 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 -- start start 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 Processor -- start 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a6bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 0x561bd0a6c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a67370 0x561bd0a73120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561bd0a6a340 con 0x561bd0a622e0 2024-09-12T00:07:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561bd094e290 con 0x561bd0a619a0 2024-09-12T00:07:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561bd0a6a4c0 con 0x561bd0a67370 2024-09-12T00:07:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f564b894740 10 client.0 _ll_register_callbacks cb 0x561bd097f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f5641d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 0x561bd0a6c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.609+0000 7f5641d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 0x561bd0a6c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49632/0 (socket says 172.21.15.6:49632) 2024-09-12T00:07:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5641d9b640 1 -- 172.21.15.6:0/4100916024 learned_addr learned my addr 172.21.15.6:0/4100916024 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f564259c640 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a6bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5642d9d640 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a67370 0x561bd0a73120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5641d9b640 1 -- 172.21.15.6:0/4100916024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a67370 msgr2=0x561bd0a73120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5641d9b640 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a67370 0x561bd0a73120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5641d9b640 1 -- 172.21.15.6:0/4100916024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 msgr2=0x561bd0a6bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5641d9b640 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a6bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5641d9b640 1 -- 172.21.15.6:0/4100916024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bd06d8210 con 0x561bd0a622e0 2024-09-12T00:07:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5642d9d640 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a67370 0x561bd0a73120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5641d9b640 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 0x561bd0a6c0e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f56380ccf90 tx=0x7f563809bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d344cc8d46ac55d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5629ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:07:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5629ffb640 1 -- 172.21.15.6:0/4100916024 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563800ce60 con 0x561bd0a622e0 2024-09-12T00:07:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5629ffb640 1 -- 172.21.15.6:0/4100916024 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f56380a46d0 con 0x561bd0a622e0 2024-09-12T00:07:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f564b894740 1 -- 172.21.15.6:0/4100916024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56340035f0 con 0x561bd0a622e0 2024-09-12T00:07:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f5629ffb640 1 -- 172.21.15.6:0/4100916024 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f56380046c0 con 0x561bd0a622e0 2024-09-12T00:07:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f564b894740 10 client.16026 fetch_fsmap learned FSMap version 33 2024-09-12T00:07:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.610+0000 7f564b894740 1 -- 172.21.15.6:0/4100916024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561bd07a4620 con 0x561bd0a622e0 2024-09-12T00:07:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.611+0000 7f5629ffb640 1 -- 172.21.15.6:0/4100916024 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56340035f0 con 0x561bd0a622e0 2024-09-12T00:07:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.611+0000 7f5629ffb640 1 -- 172.21.15.6:0/4100916024 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f5638097a40 con 0x561bd0a622e0 2024-09-12T00:07:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.611+0000 7f564b894740 10 client.16026 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:07:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.611+0000 7f564b894740 10 client.16026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:07:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.611+0000 7f564b894740 20 client.16026 populate_metadata read hostname 'smithi006' 2024-09-12T00:07:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.611+0000 7f564b894740 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561bd0a77870 0x561bd0a79c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.611+0000 7f564b894740 4 client.16026 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.611+0000 7f564b894740 1 -- 172.21.15.6:0/4100916024 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bd09d2a20 con 0x561bd0a77870 2024-09-12T00:07:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.611+0000 7f564259c640 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561bd0a77870 0x561bd0a79c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.612+0000 7f5629ffb640 10 client.16026 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.612+0000 7f564259c640 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561bd0a77870 0x561bd0a79c60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff6452d3a9664563 server_cookie=9de0b0e61d7b839e in_seq=0 out_seq=0 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.612+0000 7f5629ffb640 1 -- 172.21.15.6:0/4100916024 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561bd09d2a20 con 0x561bd0a77870 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.612+0000 7f5629ffb640 10 client.16026 handle_command_reply: tid=0 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.612+0000 7f564b894740 1 client.16026 shutdown 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.612+0000 7f564b894740 1 -- 172.21.15.6:0/4100916024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 msgr2=0x561bd0a6c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.612+0000 7f564b894740 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 0x561bd0a6c0e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f56380ccf90 tx=0x7f563809bac0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.612+0000 7f564b894740 1 -- 172.21.15.6:0/4100916024 shutdown_connections 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.612+0000 7f564b894740 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561bd0a77870 0x561bd0a79c60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.612+0000 7f564b894740 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a67370 0x561bd0a73120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.613+0000 7f5629ffb640 0 client.16026 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.613+0000 7f564b894740 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a622e0 0x561bd0a6c0e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.613+0000 7f564b894740 1 --2- 172.21.15.6:0/4100916024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a6bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.613+0000 7f564b894740 1 -- 172.21.15.6:0/4100916024 >> 172.21.15.6:0/4100916024 conn(0x561bd0a5d010 msgr2=0x561bd0a5e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.613+0000 7f564b894740 1 -- 172.21.15.6:0/4100916024 shutdown_connections 2024-09-12T00:07:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.613+0000 7f564b894740 1 -- 172.21.15.6:0/4100916024 wait complete. 2024-09-12T00:07:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.613+0000 7f564b894740 20 client.16026 trim_cache size 0 max 16384 2024-09-12T00:07:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.629+0000 7f564b894740 1 Processor -- start 2024-09-12T00:07:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.629+0000 7f564b894740 1 -- start start 2024-09-12T00:07:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f564b894740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a619a0 0x561bd0a5c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f564b894740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a622e0 0x561bd0a730e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f564b894740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 0x561bd0a7e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f564b894740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56441acad0 con 0x561bd0a67370 2024-09-12T00:07:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f564b894740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f56441ae610 con 0x561bd0a622e0 2024-09-12T00:07:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f564b894740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56441ad1a0 con 0x561bd0a619a0 2024-09-12T00:07:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f5642d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 0x561bd0a7e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f5642d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 0x561bd0a7e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49648/0 (socket says 172.21.15.6:49648) 2024-09-12T00:07:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f5642d9d640 1 -- 172.21.15.6:0/1115852831 learned_addr learned my addr 172.21.15.6:0/1115852831 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f5641d9b640 1 --2- 172.21.15.6:0/1115852831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a622e0 0x561bd0a730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f564259c640 1 --2- 172.21.15.6:0/1115852831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a619a0 0x561bd0a5c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f5642d9d640 1 -- 172.21.15.6:0/1115852831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a619a0 msgr2=0x561bd0a5c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f5642d9d640 1 --2- 172.21.15.6:0/1115852831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a619a0 0x561bd0a5c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f5642d9d640 1 -- 172.21.15.6:0/1115852831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a622e0 msgr2=0x561bd0a730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f5642d9d640 1 --2- 172.21.15.6:0/1115852831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a622e0 0x561bd0a730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f5642d9d640 1 -- 172.21.15.6:0/1115852831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bd0a79fd0 con 0x561bd0a67370 2024-09-12T00:07:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f564259c640 1 --2- 172.21.15.6:0/1115852831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a619a0 0x561bd0a5c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.630+0000 7f5642d9d640 1 --2- 172.21.15.6:0/1115852831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 0x561bd0a7e4f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f563c009ca0 tx=0x7f563c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94462279bfecc8e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.631+0000 7f562bfff640 1 -- 172.21.15.6:0/1115852831 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c052070 con 0x561bd0a67370 2024-09-12T00:07:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.631+0000 7f562bfff640 1 -- 172.21.15.6:0/1115852831 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f563c036040 con 0x561bd0a67370 2024-09-12T00:07:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.631+0000 7f562bfff640 1 -- 172.21.15.6:0/1115852831 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c0305c0 con 0x561bd0a67370 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 -- 172.21.15.6:0/1115852831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 msgr2=0x561bd0a7e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 --2- 172.21.15.6:0/1115852831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 0x561bd0a7e4f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f563c009ca0 tx=0x7f563c041000 comp rx=0 tx=0).stop 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 -- 172.21.15.6:0/1115852831 shutdown_connections 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 --2- 172.21.15.6:0/1115852831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 0x561bd0a7e4f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 --2- 172.21.15.6:0/1115852831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a622e0 0x561bd0a730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 --2- 172.21.15.6:0/1115852831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a619a0 0x561bd0a5c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 -- 172.21.15.6:0/1115852831 >> 172.21.15.6:0/1115852831 conn(0x561bd0a5d010 msgr2=0x561bd0a5b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 -- 172.21.15.6:0/1115852831 shutdown_connections 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 -- 172.21.15.6:0/1115852831 wait complete. 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 -- start start 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 Processor -- start 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a622e0 0x561bd0a70df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 0x561bd0a71e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56441adf40 con 0x561bd0a67370 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f56441ad870 con 0x561bd0a619a0 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.632+0000 7f564b894740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56441aaab0 con 0x561bd0a622e0 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f564b894740 10 client.0 _ll_register_callbacks cb 0x7f563800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5642d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 0x561bd0a71e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f564259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5642d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 0x561bd0a71e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49654/0 (socket says 172.21.15.6:49654) 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5642d9d640 1 -- 172.21.15.6:0/668985077 learned_addr learned my addr 172.21.15.6:0/668985077 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5641d9b640 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a622e0 0x561bd0a70df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5642d9d640 1 -- 172.21.15.6:0/668985077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a622e0 msgr2=0x561bd0a70df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5642d9d640 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a622e0 0x561bd0a70df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5642d9d640 1 -- 172.21.15.6:0/668985077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 msgr2=0x561bd0a708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5642d9d640 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5642d9d640 1 -- 172.21.15.6:0/668985077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bd0a72410 con 0x561bd0a67370 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5641d9b640 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a622e0 0x561bd0a70df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5642d9d640 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 0x561bd0a71e00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f563c02aeb0 tx=0x7f563c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb8923780307fe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5629ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5629ffb640 1 -- 172.21.15.6:0/668985077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c05b060 con 0x561bd0a67370 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.633+0000 7f5629ffb640 1 -- 172.21.15.6:0/668985077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f563c004050 con 0x561bd0a67370 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.634+0000 7f564b894740 1 -- 172.21.15.6:0/668985077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f563c036040 con 0x561bd0a67370 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.634+0000 7f5629ffb640 1 -- 172.21.15.6:0/668985077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f563c052070 con 0x561bd0a67370 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.634+0000 7f564b894740 10 client.16032 fetch_fsmap learned FSMap version 33 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.634+0000 7f564b894740 1 -- 172.21.15.6:0/668985077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561bd0ae2590 con 0x561bd0a67370 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.634+0000 7f5629ffb640 1 -- 172.21.15.6:0/668985077 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f563c036040 con 0x561bd0a67370 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.634+0000 7f5629ffb640 1 -- 172.21.15.6:0/668985077 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f563c030d30 con 0x561bd0a67370 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.634+0000 7f564b894740 10 client.16032 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:07:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.634+0000 7f564b894740 10 client.16032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:07:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.634+0000 7f564b894740 20 client.16032 populate_metadata read hostname 'smithi006' 2024-09-12T00:07:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.634+0000 7f564b894740 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561bd0a77870 0x561bd0ae4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.634+0000 7f564b894740 4 client.16032 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:07:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.634+0000 7f564b894740 1 -- 172.21.15.6:0/668985077 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561bd09ccd70 con 0x561bd0a77870 2024-09-12T00:07:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.635+0000 7f564259c640 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561bd0a77870 0x561bd0ae4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.636+0000 7f5629ffb640 10 client.16032 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.636+0000 7f564259c640 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561bd0a77870 0x561bd0ae4f60 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2568bbd8e866bfc0 server_cookie=b8e43f733e753cbb in_seq=0 out_seq=0 2024-09-12T00:07:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f5629ffb640 1 -- 172.21.15.6:0/668985077 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561bd09ccd70 con 0x561bd0a77870 2024-09-12T00:07:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f5629ffb640 10 client.16032 handle_command_reply: tid=0 2024-09-12T00:07:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f564b894740 1 client.16032 shutdown 2024-09-12T00:07:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f564b894740 1 -- 172.21.15.6:0/668985077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 msgr2=0x561bd0a71e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f564b894740 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 0x561bd0a71e00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f563c02aeb0 tx=0x7f563c003f60 comp rx=0 tx=0).stop 2024-09-12T00:07:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f564b894740 1 -- 172.21.15.6:0/668985077 shutdown_connections 2024-09-12T00:07:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f564b894740 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561bd0a67370 0x561bd0a71e00 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f564b894740 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561bd0a77870 0x561bd0ae4f60 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f564b894740 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561bd0a622e0 0x561bd0a70df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f564b894740 1 --2- 172.21.15.6:0/668985077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bd0a619a0 0x561bd0a708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f564b894740 1 -- 172.21.15.6:0/668985077 >> 172.21.15.6:0/668985077 conn(0x561bd0a5d010 msgr2=0x561bd0a5e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f5629ffb640 0 client.16032 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f564b894740 1 -- 172.21.15.6:0/668985077 shutdown_connections 2024-09-12T00:07:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f564b894740 1 -- 172.21.15.6:0/668985077 wait complete. 2024-09-12T00:07:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.654+0000 7f564b894740 20 client.16032 trim_cache size 0 max 16384 2024-09-12T00:07:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:07:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:07:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:07:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:07:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.655+0000 7f5648afa640 1 -- 172.21.15.6:0/169364473 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f562c0a2b80 msgr2=0x7f562c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.655+0000 7f5648afa640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f562c0a2b80 0x7f562c0a5040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f563c006010 tx=0x7f563c0095c0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.655+0000 7f5648afa640 1 -- 172.21.15.6:0/169364473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5644104f50 msgr2=0x7f56441005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.655+0000 7f5648afa640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5644104f50 0x7f56441005d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f563800e9f0 tx=0x7f563800eeb0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.655+0000 7f5648afa640 1 -- 172.21.15.6:0/169364473 shutdown_connections 2024-09-12T00:07:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.655+0000 7f5648afa640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f562c0a2b80 0x7f562c0a5040 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.655+0000 7f5648afa640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5644107880 0x7f5644100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.655+0000 7f5648afa640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5644104f50 0x7f56441005d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.655+0000 7f5648afa640 1 --2- 172.21.15.6:0/169364473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5644102620 0x7f5644101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.655+0000 7f5648afa640 1 -- 172.21.15.6:0/169364473 >> 172.21.15.6:0/169364473 conn(0x7f56440fc1c0 msgr2=0x7f5644102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.655+0000 7f5648afa640 1 -- 172.21.15.6:0/169364473 shutdown_connections 2024-09-12T00:07:46.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:46.655+0000 7f5648afa640 1 -- 172.21.15.6:0/169364473 wait complete. 2024-09-12T00:07:47.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:46 smithi039 ceph-mon[34543]: pgmap v612: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:07:47.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:46 smithi006 ceph-mon[30947]: pgmap v612: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:07:47.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:46 smithi134 ceph-mon[34893]: pgmap v612: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-12T00:07:49.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:48 smithi039 ceph-mon[34543]: pgmap v613: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:07:49.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:48 smithi006 ceph-mon[30947]: pgmap v613: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:07:49.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:48 smithi134 ceph-mon[34893]: pgmap v613: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:07:51.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:50 smithi039 ceph-mon[34543]: pgmap v614: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-09-12T00:07:51.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:50 smithi006 ceph-mon[30947]: pgmap v614: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-09-12T00:07:51.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:50 smithi134 ceph-mon[34893]: pgmap v614: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-09-12T00:07:53.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:52 smithi039 ceph-mon[34543]: pgmap v615: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 27 op/s 2024-09-12T00:07:53.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:52 smithi006 ceph-mon[30947]: pgmap v615: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 27 op/s 2024-09-12T00:07:53.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:52 smithi134 ceph-mon[34893]: pgmap v615: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 27 op/s 2024-09-12T00:07:55.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:54 smithi039 ceph-mon[34543]: pgmap v616: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 23 op/s 2024-09-12T00:07:55.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:54 smithi006 ceph-mon[30947]: pgmap v616: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 23 op/s 2024-09-12T00:07:55.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:54 smithi134 ceph-mon[34893]: pgmap v616: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 23 op/s 2024-09-12T00:07:57.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:56 smithi039 ceph-mon[34543]: pgmap v617: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:07:57.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:56 smithi006 ceph-mon[30947]: pgmap v617: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:07:57.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:56 smithi134 ceph-mon[34893]: pgmap v617: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:07:59.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:07:58 smithi039 ceph-mon[34543]: pgmap v618: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-12T00:07:59.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:07:58 smithi006 ceph-mon[30947]: pgmap v618: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-12T00:07:59.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:07:58 smithi134 ceph-mon[34893]: pgmap v618: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-12T00:07:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.753+0000 7f754acd0640 1 -- 172.21.15.6:0/1406015106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75441025f0 msgr2=0x7f7544108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.753+0000 7f754acd0640 1 --2- 172.21.15.6:0/1406015106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75441025f0 0x7f7544108e80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f753c009ca0 tx=0x7f753c02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 -- 172.21.15.6:0/1406015106 shutdown_connections 2024-09-12T00:07:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 --2- 172.21.15.6:0/1406015106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75441025f0 0x7f7544108e80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 --2- 172.21.15.6:0/1406015106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7544101c30 0x7f75441020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 --2- 172.21.15.6:0/1406015106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7544100a40 0x7f7544100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 -- 172.21.15.6:0/1406015106 >> 172.21.15.6:0/1406015106 conn(0x7f75440fc1c0 msgr2=0x7f75440fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 -- 172.21.15.6:0/1406015106 shutdown_connections 2024-09-12T00:07:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 -- 172.21.15.6:0/1406015106 wait complete. 2024-09-12T00:07:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 Processor -- start 2024-09-12T00:07:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 -- start start 2024-09-12T00:07:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7544100a40 0x7f754406a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7544101c30 0x7f754419ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75441025f0 0x7f754419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f754410c550 con 0x7f7544100a40 2024-09-12T00:07:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f754410c3d0 con 0x7f7544101c30 2024-09-12T00:07:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.754+0000 7f754acd0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f754410c6d0 con 0x7f75441025f0 2024-09-12T00:07:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7548a6c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7544100a40 0x7f754406a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7548a6c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7544100a40 0x7f754406a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56406/0 (socket says 172.21.15.6:56406) 2024-09-12T00:07:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7548a6c640 1 -- 172.21.15.6:0/2844679151 learned_addr learned my addr 172.21.15.6:0/2844679151 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7543fff640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7544101c30 0x7f754419ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f754926d640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75441025f0 0x7f754419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7548a6c640 1 -- 172.21.15.6:0/2844679151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75441025f0 msgr2=0x7f754419f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7548a6c640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75441025f0 0x7f754419f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7548a6c640 1 -- 172.21.15.6:0/2844679151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7544101c30 msgr2=0x7f754419ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7548a6c640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7544101c30 0x7f754419ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7548a6c640 1 -- 172.21.15.6:0/2844679151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754419f960 con 0x7f7544100a40 2024-09-12T00:07:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7543fff640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7544101c30 0x7f754419ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7548a6c640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7544100a40 0x7f754406a5c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f753800e9c0 tx=0x7f753800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7541ffb640 1 -- 172.21.15.6:0/2844679151 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753800cd80 con 0x7f7544100a40 2024-09-12T00:07:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f754acd0640 1 -- 172.21.15.6:0/2844679151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754419fc50 con 0x7f7544100a40 2024-09-12T00:07:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7541ffb640 1 -- 172.21.15.6:0/2844679151 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75380035f0 con 0x7f7544100a40 2024-09-12T00:07:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.755+0000 7f7541ffb640 1 -- 172.21.15.6:0/2844679151 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538010690 con 0x7f7544100a40 2024-09-12T00:07:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.756+0000 7f754acd0640 1 -- 172.21.15.6:0/2844679151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75441a01a0 con 0x7f7544100a40 2024-09-12T00:07:59.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.758+0000 7f7541ffb640 1 -- 172.21.15.6:0/2844679151 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f75380037a0 con 0x7f7544100a40 2024-09-12T00:07:59.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f754da69740 1 Processor -- start 2024-09-12T00:07:59.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f754da69740 1 -- start start 2024-09-12T00:07:59.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f754da69740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabbdb0 0x55955eabc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f754da69740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eac11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f754da69740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eac1780 0x55955eac3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f754da69740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55955ea1b2f0 con 0x55955eabc6f0 2024-09-12T00:07:59.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f754da69740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55955e9c3270 con 0x55955eabbdb0 2024-09-12T00:07:59.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f754da69740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55955ea172b0 con 0x55955eac1780 2024-09-12T00:07:59.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f7548a6c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eac11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f7548a6c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eac11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56414/0 (socket says 172.21.15.6:56414) 2024-09-12T00:07:59.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f7548a6c640 1 -- 172.21.15.6:0/2213331590 learned_addr learned my addr 172.21.15.6:0/2213331590 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:59.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f7541ffb640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75340a2b80 0x7f75340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.759+0000 7f754926d640 1 --2- 172.21.15.6:0/2213331590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabbdb0 0x55955eabc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f7543fff640 1 --2- 172.21.15.6:0/2213331590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eac1780 0x55955eac3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f754926d640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75340a2b80 0x7f75340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f7541ffb640 1 -- 172.21.15.6:0/2844679151 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f75380cf950 con 0x7f7544100a40 2024-09-12T00:07:59.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f7548a6c640 1 -- 172.21.15.6:0/2213331590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eac1780 msgr2=0x55955eac3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:59.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f7548a6c640 1 --2- 172.21.15.6:0/2213331590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eac1780 0x55955eac3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f7548a6c640 1 -- 172.21.15.6:0/2213331590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabbdb0 msgr2=0x55955eabc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:59.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f7548a6c640 1 --2- 172.21.15.6:0/2213331590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabbdb0 0x55955eabc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f7548a6c640 1 -- 172.21.15.6:0/2213331590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55955e9c2340 con 0x55955eabc6f0 2024-09-12T00:07:59.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f7548a6c640 1 --2- 172.21.15.6:0/2213331590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eac11b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f753809bac0 tx=0x7f7538003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6d652a3c66cd48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:59.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f752effd640 1 -- 172.21.15.6:0/2213331590 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753809b720 con 0x55955eabc6f0 2024-09-12T00:07:59.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f752effd640 1 -- 172.21.15.6:0/2213331590 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7538003b30 con 0x55955eabc6f0 2024-09-12T00:07:59.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f754926d640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75340a2b80 0x7f75340a5040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f753c031aa0 tx=0x7f753c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.760+0000 7f752effd640 1 -- 172.21.15.6:0/2213331590 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753809a0c0 con 0x55955eabc6f0 2024-09-12T00:07:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.761+0000 7f754da69740 1 -- 172.21.15.6:0/2213331590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 msgr2=0x55955eac11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.761+0000 7f754da69740 1 --2- 172.21.15.6:0/2213331590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eac11b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f753809bac0 tx=0x7f7538003e30 comp rx=0 tx=0).stop 2024-09-12T00:07:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.761+0000 7f754da69740 1 -- 172.21.15.6:0/2213331590 shutdown_connections 2024-09-12T00:07:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.761+0000 7f754da69740 1 --2- 172.21.15.6:0/2213331590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eac1780 0x55955eac3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.761+0000 7f754da69740 1 --2- 172.21.15.6:0/2213331590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eac11b0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.761+0000 7f754da69740 1 --2- 172.21.15.6:0/2213331590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabbdb0 0x55955eabc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.761+0000 7f754da69740 1 -- 172.21.15.6:0/2213331590 >> 172.21.15.6:0/2213331590 conn(0x55955eab7420 msgr2=0x55955eab7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.761+0000 7f754da69740 1 -- 172.21.15.6:0/2213331590 shutdown_connections 2024-09-12T00:07:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.761+0000 7f754da69740 1 -- 172.21.15.6:0/2213331590 wait complete. 2024-09-12T00:07:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.761+0000 7f754da69740 1 -- start start 2024-09-12T00:07:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.761+0000 7f754da69740 1 Processor -- start 2024-09-12T00:07:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f754da69740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eabbdb0 0x55955eac5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f754da69740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eac64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f754da69740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eac1780 0x55955eacd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f754da69740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55955eac46f0 con 0x55955eabc6f0 2024-09-12T00:07:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f754da69740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55955e9a4290 con 0x55955eac1780 2024-09-12T00:07:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f754da69740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55955eac4870 con 0x55955eabbdb0 2024-09-12T00:07:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f754da69740 10 client.0 _ll_register_callbacks cb 0x55955e9d5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f7543fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eac64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f7543fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eac64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56426/0 (socket says 172.21.15.6:56426) 2024-09-12T00:07:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f7548a6c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eabbdb0 0x55955eac5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f7543fff640 1 -- 172.21.15.6:0/4122264983 learned_addr learned my addr 172.21.15.6:0/4122264983 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f754926d640 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eac1780 0x55955eacd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f7543fff640 1 -- 172.21.15.6:0/4122264983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eabbdb0 msgr2=0x55955eac5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f7543fff640 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eabbdb0 0x55955eac5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f7543fff640 1 -- 172.21.15.6:0/4122264983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eac1780 msgr2=0x55955eacd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f7543fff640 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eac1780 0x55955eacd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f7543fff640 1 -- 172.21.15.6:0/4122264983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55955e72e210 con 0x55955eabc6f0 2024-09-12T00:07:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.762+0000 7f754926d640 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eac1780 0x55955eacd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.763+0000 7f7543fff640 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eac64b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f753000bec0 tx=0x7f75300117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8805d4abcd859324 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.763+0000 7f7523fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:07:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.763+0000 7f7523fff640 1 -- 172.21.15.6:0/4122264983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530004440 con 0x55955eabc6f0 2024-09-12T00:07:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.763+0000 7f7523fff640 1 -- 172.21.15.6:0/4122264983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f75300035f0 con 0x55955eabc6f0 2024-09-12T00:07:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.763+0000 7f754da69740 1 -- 172.21.15.6:0/4122264983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55955ea28a20 con 0x55955eabc6f0 2024-09-12T00:07:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.763+0000 7f7523fff640 1 -- 172.21.15.6:0/4122264983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7530024050 con 0x55955eabc6f0 2024-09-12T00:07:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.763+0000 7f754da69740 10 client.16044 fetch_fsmap learned FSMap version 33 2024-09-12T00:07:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.763+0000 7f754da69740 1 -- 172.21.15.6:0/4122264983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55955e7fa620 con 0x55955eabc6f0 2024-09-12T00:07:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.763+0000 7f7523fff640 1 -- 172.21.15.6:0/4122264983 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55955ea28a20 con 0x55955eabc6f0 2024-09-12T00:07:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.763+0000 7f7523fff640 1 -- 172.21.15.6:0/4122264983 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f753001ba20 con 0x55955eabc6f0 2024-09-12T00:07:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.763+0000 7f754da69740 10 client.16044 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:07:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.764+0000 7f754da69740 10 client.16044 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:07:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.764+0000 7f754da69740 20 client.16044 populate_metadata read hostname 'smithi006' 2024-09-12T00:07:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.764+0000 7f754da69740 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55955ead1c90 0x55955ead40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.764+0000 7f754da69740 4 client.16044 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.764+0000 7f754da69740 1 -- 172.21.15.6:0/4122264983 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55955ea22d70 con 0x55955ead1c90 2024-09-12T00:07:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.764+0000 7f7548a6c640 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55955ead1c90 0x55955ead40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.764+0000 7f7548a6c640 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55955ead1c90 0x55955ead40e0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=431b85d27b727d6 server_cookie=8e3f15e0667091d9 in_seq=0 out_seq=0 2024-09-12T00:07:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.764+0000 7f7523fff640 10 client.16044 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f7523fff640 1 -- 172.21.15.6:0/4122264983 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55955ea22d70 con 0x55955ead1c90 2024-09-12T00:07:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f7523fff640 10 client.16044 handle_command_reply: tid=0 2024-09-12T00:07:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f754da69740 1 client.16044 shutdown 2024-09-12T00:07:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f754da69740 1 -- 172.21.15.6:0/4122264983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 msgr2=0x55955eac64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f754da69740 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eac64b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f753000bec0 tx=0x7f75300117b0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f754da69740 1 -- 172.21.15.6:0/4122264983 shutdown_connections 2024-09-12T00:07:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f754da69740 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eac1780 0x55955eacd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f754da69740 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eac64b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f754da69740 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55955ead1c90 0x55955ead40e0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f754da69740 1 --2- 172.21.15.6:0/4122264983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eabbdb0 0x55955eac5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f7523fff640 0 client.16044 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f754da69740 1 -- 172.21.15.6:0/4122264983 >> 172.21.15.6:0/4122264983 conn(0x55955eab7420 msgr2=0x55955eab8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f754da69740 1 -- 172.21.15.6:0/4122264983 shutdown_connections 2024-09-12T00:07:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f754da69740 1 -- 172.21.15.6:0/4122264983 wait complete. 2024-09-12T00:07:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.765+0000 7f754da69740 20 client.16044 trim_cache size 0 max 16384 2024-09-12T00:07:59.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.789+0000 7f754da69740 1 Processor -- start 2024-09-12T00:07:59.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f754da69740 1 -- start start 2024-09-12T00:07:59.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f754da69740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabbdb0 0x55955eab8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f754da69740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eacd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f754da69740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eac1780 0x55955eab8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f754da69740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f75441a86d0 con 0x55955eabc6f0 2024-09-12T00:07:59.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f754da69740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f75441aa210 con 0x55955eabbdb0 2024-09-12T00:07:59.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f754da69740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75441a8da0 con 0x55955eac1780 2024-09-12T00:07:59.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f7543fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eacd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f7543fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eacd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56436/0 (socket says 172.21.15.6:56436) 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f7543fff640 1 -- 172.21.15.6:0/2928697220 learned_addr learned my addr 172.21.15.6:0/2928697220 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f7548a6c640 1 --2- 172.21.15.6:0/2928697220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabbdb0 0x55955eab8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f754926d640 1 --2- 172.21.15.6:0/2928697220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eac1780 0x55955eab8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f7543fff640 1 -- 172.21.15.6:0/2928697220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eac1780 msgr2=0x55955eab8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f7543fff640 1 --2- 172.21.15.6:0/2928697220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eac1780 0x55955eab8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f7543fff640 1 -- 172.21.15.6:0/2928697220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabbdb0 msgr2=0x55955eab8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f7543fff640 1 --2- 172.21.15.6:0/2928697220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabbdb0 0x55955eab8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f7543fff640 1 -- 172.21.15.6:0/2928697220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55955eab7240 con 0x55955eabc6f0 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f7548a6c640 1 --2- 172.21.15.6:0/2928697220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabbdb0 0x55955eab8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.790+0000 7f754926d640 1 --2- 172.21.15.6:0/2928697220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eac1780 0x55955eab8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.791+0000 7f7543fff640 1 --2- 172.21.15.6:0/2928697220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eacd4b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f753001bdf0 tx=0x7f753000bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11257c94a39653aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.791+0000 7f752e7fc640 1 -- 172.21.15.6:0/2928697220 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530012450 con 0x55955eabc6f0 2024-09-12T00:07:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.791+0000 7f752e7fc640 1 -- 172.21.15.6:0/2928697220 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7530016070 con 0x55955eabc6f0 2024-09-12T00:07:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.791+0000 7f752e7fc640 1 -- 172.21.15.6:0/2928697220 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75300052a0 con 0x55955eabc6f0 2024-09-12T00:07:59.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.792+0000 7f754da69740 1 -- 172.21.15.6:0/2928697220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 msgr2=0x55955eacd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:59.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.792+0000 7f754da69740 1 --2- 172.21.15.6:0/2928697220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eacd4b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f753001bdf0 tx=0x7f753000bb30 comp rx=0 tx=0).stop 2024-09-12T00:07:59.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.792+0000 7f754da69740 1 -- 172.21.15.6:0/2928697220 shutdown_connections 2024-09-12T00:07:59.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.792+0000 7f754da69740 1 --2- 172.21.15.6:0/2928697220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eac1780 0x55955eab8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.792+0000 7f754da69740 1 --2- 172.21.15.6:0/2928697220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eabc6f0 0x55955eacd4b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.792+0000 7f754da69740 1 --2- 172.21.15.6:0/2928697220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabbdb0 0x55955eab8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.792+0000 7f754da69740 1 -- 172.21.15.6:0/2928697220 >> 172.21.15.6:0/2928697220 conn(0x55955eab7420 msgr2=0x55955eabd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:59.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.792+0000 7f754da69740 1 -- 172.21.15.6:0/2928697220 shutdown_connections 2024-09-12T00:07:59.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.792+0000 7f754da69740 1 -- 172.21.15.6:0/2928697220 wait complete. 2024-09-12T00:07:59.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.792+0000 7f754da69740 1 -- start start 2024-09-12T00:07:59.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.792+0000 7f754da69740 1 Processor -- start 2024-09-12T00:07:59.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.792+0000 7f754da69740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eabbdb0 0x55955eacac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754da69740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabc6f0 0x55955eacb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754da69740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eac1780 0x55955eacc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754da69740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f75441a9b40 con 0x55955eac1780 2024-09-12T00:07:59.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754da69740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f75441a9470 con 0x55955eabc6f0 2024-09-12T00:07:59.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754da69740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75441a66b0 con 0x55955eabbdb0 2024-09-12T00:07:59.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754da69740 10 client.0 _ll_register_callbacks cb 0x7f753000b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:59.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754926d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eac1780 0x55955eacc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754926d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eac1780 0x55955eacc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56438/0 (socket says 172.21.15.6:56438) 2024-09-12T00:07:59.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754926d640 1 -- 172.21.15.6:0/4238584887 learned_addr learned my addr 172.21.15.6:0/4238584887 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:07:59.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f7548a6c640 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eabbdb0 0x55955eacac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f7543fff640 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabc6f0 0x55955eacb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754926d640 1 -- 172.21.15.6:0/4238584887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eabbdb0 msgr2=0x55955eacac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:59.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754926d640 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eabbdb0 0x55955eacac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754926d640 1 -- 172.21.15.6:0/4238584887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabc6f0 msgr2=0x55955eacb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:59.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754926d640 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabc6f0 0x55955eacb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754926d640 1 -- 172.21.15.6:0/4238584887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55955eacc750 con 0x55955eac1780 2024-09-12T00:07:59.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f7548a6c640 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eabbdb0 0x55955eacac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:59.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f754926d640 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eac1780 0x55955eacc140 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f753c009410 tx=0x7f753c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e22708dd58e9a34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:59.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.793+0000 7f7523fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:07:59.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f7523fff640 1 -- 172.21.15.6:0/4238584887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c044070 con 0x55955eac1780 2024-09-12T00:07:59.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f7523fff640 1 -- 172.21.15.6:0/4238584887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f753c004720 con 0x55955eac1780 2024-09-12T00:07:59.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f754da69740 1 -- 172.21.15.6:0/4238584887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7530016070 con 0x55955eac1780 2024-09-12T00:07:59.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f7523fff640 1 -- 172.21.15.6:0/4238584887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f753c0305c0 con 0x55955eac1780 2024-09-12T00:07:59.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f754da69740 10 client.16050 fetch_fsmap learned FSMap version 33 2024-09-12T00:07:59.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f754da69740 1 -- 172.21.15.6:0/4238584887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55955eb3c9c0 con 0x55955eac1780 2024-09-12T00:07:59.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f7523fff640 1 -- 172.21.15.6:0/4238584887 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7530016070 con 0x55955eac1780 2024-09-12T00:07:59.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f7523fff640 1 -- 172.21.15.6:0/4238584887 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f753c047030 con 0x55955eac1780 2024-09-12T00:07:59.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f754da69740 10 client.16050 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:07:59.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f754da69740 10 client.16050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:07:59.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f754da69740 20 client.16050 populate_metadata read hostname 'smithi006' 2024-09-12T00:07:59.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f754da69740 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55955eb3d2b0 0x55955eb3f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:59.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f754da69740 4 client.16050 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:07:59.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.794+0000 7f754da69740 1 -- 172.21.15.6:0/4238584887 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55955ead4470 con 0x55955eb3d2b0 2024-09-12T00:07:59.803 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.795+0000 7f7548a6c640 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55955eb3d2b0 0x55955eb3f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:59.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.795+0000 7f7548a6c640 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55955eb3d2b0 0x55955eb3f6d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6af3c1dd26abd6d5 server_cookie=47a62cf4bf0b6c44 in_seq=0 out_seq=0 2024-09-12T00:07:59.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.795+0000 7f7523fff640 10 client.16050 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:59.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f7523fff640 1 -- 172.21.15.6:0/4238584887 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55955ead4470 con 0x55955eb3d2b0 2024-09-12T00:07:59.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f7523fff640 10 client.16050 handle_command_reply: tid=0 2024-09-12T00:07:59.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f754da69740 1 client.16050 shutdown 2024-09-12T00:07:59.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f754da69740 1 -- 172.21.15.6:0/4238584887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eac1780 msgr2=0x55955eacc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:59.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f754da69740 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eac1780 0x55955eacc140 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f753c009410 tx=0x7f753c02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f754da69740 1 -- 172.21.15.6:0/4238584887 shutdown_connections 2024-09-12T00:07:59.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f754da69740 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955eac1780 0x55955eacc140 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f754da69740 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55955eabc6f0 0x55955eacb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f754da69740 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55955eb3d2b0 0x55955eb3f6d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f754da69740 1 --2- 172.21.15.6:0/4238584887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55955eabbdb0 0x55955eacac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f754da69740 1 -- 172.21.15.6:0/4238584887 >> 172.21.15.6:0/4238584887 conn(0x55955eab7420 msgr2=0x55955eab19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:59.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f7523fff640 0 client.16050 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:07:59.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f754da69740 1 -- 172.21.15.6:0/4238584887 shutdown_connections 2024-09-12T00:07:59.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f754da69740 1 -- 172.21.15.6:0/4238584887 wait complete. 2024-09-12T00:07:59.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.812+0000 7f754da69740 20 client.16050 trim_cache size 0 max 16384 2024-09-12T00:07:59.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:07:59.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:07:59.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:07:59.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:07:59.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.813+0000 7f754acd0640 1 -- 172.21.15.6:0/2844679151 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75340a2b80 msgr2=0x7f75340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:59.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.813+0000 7f754acd0640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75340a2b80 0x7f75340a5040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f753c031aa0 tx=0x7f753c0095c0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.813+0000 7f754acd0640 1 -- 172.21.15.6:0/2844679151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7544100a40 msgr2=0x7f754406a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:59.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.813+0000 7f754acd0640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7544100a40 0x7f754406a5c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f753800e9c0 tx=0x7f753800ee80 comp rx=0 tx=0).stop 2024-09-12T00:07:59.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.813+0000 7f754acd0640 1 -- 172.21.15.6:0/2844679151 shutdown_connections 2024-09-12T00:07:59.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.813+0000 7f754acd0640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75340a2b80 0x7f75340a5040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.813+0000 7f754acd0640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75441025f0 0x7f754419f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.813+0000 7f754acd0640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7544101c30 0x7f754419ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.813+0000 7f754acd0640 1 --2- 172.21.15.6:0/2844679151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7544100a40 0x7f754406a5c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:59.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.813+0000 7f754acd0640 1 -- 172.21.15.6:0/2844679151 >> 172.21.15.6:0/2844679151 conn(0x7f75440fc1c0 msgr2=0x7f7544105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:59.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.813+0000 7f754acd0640 1 -- 172.21.15.6:0/2844679151 shutdown_connections 2024-09-12T00:07:59.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:07:59.813+0000 7f754acd0640 1 -- 172.21.15.6:0/2844679151 wait complete. 2024-09-12T00:08:01.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:00 smithi039 ceph-mon[34543]: pgmap v619: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:08:01.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:00 smithi006 ceph-mon[30947]: pgmap v619: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:08:01.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:00 smithi134 ceph-mon[34893]: pgmap v619: 129 pgs: 129 active+clean; 11 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:08:03.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:02 smithi039 ceph-mon[34543]: pgmap v620: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-12T00:08:03.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:02 smithi006 ceph-mon[30947]: pgmap v620: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-12T00:08:03.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:02 smithi134 ceph-mon[34893]: pgmap v620: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-12T00:08:05.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:04 smithi039 ceph-mon[34543]: pgmap v621: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-09-12T00:08:05.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:04 smithi006 ceph-mon[30947]: pgmap v621: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-09-12T00:08:05.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:04 smithi134 ceph-mon[34893]: pgmap v621: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-09-12T00:08:06.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:05 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:08:06.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:05 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:08:06.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:05 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:08:07.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:06 smithi039 ceph-mon[34543]: pgmap v622: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-09-12T00:08:07.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:08:07.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:08:07.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:06 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:08:07.354 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:06 smithi134 ceph-mon[34893]: pgmap v622: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-09-12T00:08:07.354 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:08:07.354 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:08:07.354 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:06 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:08:07.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:06 smithi006 ceph-mon[30947]: pgmap v622: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-09-12T00:08:07.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:08:07.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:08:07.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:06 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:08:09.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:08 smithi039 ceph-mon[34543]: pgmap v623: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:08:09.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:08 smithi006 ceph-mon[30947]: pgmap v623: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:08:09.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:08 smithi134 ceph-mon[34893]: pgmap v623: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:08:11.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:10 smithi039 ceph-mon[34543]: pgmap v624: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-09-12T00:08:11.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:10 smithi006 ceph-mon[30947]: pgmap v624: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-09-12T00:08:11.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:10 smithi134 ceph-mon[34893]: pgmap v624: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-09-12T00:08:12.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:12 smithi039 ceph-mon[34543]: pgmap v625: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 28 op/s 2024-09-12T00:08:12.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:12 smithi006 ceph-mon[30947]: pgmap v625: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 28 op/s 2024-09-12T00:08:12.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:12 smithi134 ceph-mon[34893]: pgmap v625: 129 pgs: 129 active+clean; 11 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 28 op/s 2024-09-12T00:08:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.911+0000 7feac78d7640 1 -- 172.21.15.6:0/1820411295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feac01025f0 msgr2=0x7feac0108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.911+0000 7feac78d7640 1 --2- 172.21.15.6:0/1820411295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feac01025f0 0x7feac0108e80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7feab8009ca0 tx=0x7feab802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.911+0000 7feac78d7640 1 -- 172.21.15.6:0/1820411295 shutdown_connections 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.911+0000 7feac78d7640 1 --2- 172.21.15.6:0/1820411295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feac01025f0 0x7feac0108e80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.911+0000 7feac78d7640 1 --2- 172.21.15.6:0/1820411295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feac0101c30 0x7feac01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.911+0000 7feac78d7640 1 --2- 172.21.15.6:0/1820411295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feac0100a40 0x7feac0100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.911+0000 7feac78d7640 1 -- 172.21.15.6:0/1820411295 >> 172.21.15.6:0/1820411295 conn(0x7feac00fc1c0 msgr2=0x7feac00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.911+0000 7feac78d7640 1 -- 172.21.15.6:0/1820411295 shutdown_connections 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.911+0000 7feac78d7640 1 -- 172.21.15.6:0/1820411295 wait complete. 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac78d7640 1 Processor -- start 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac78d7640 1 -- start start 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac78d7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feac0100a40 0x7feac0199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac78d7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feac0101c30 0x7feac019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac78d7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feac01025f0 0x7feac01a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac78d7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7feac010c570 con 0x7feac0100a40 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac78d7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feac010c3f0 con 0x7feac0101c30 2024-09-12T00:08:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac78d7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feac010c6f0 con 0x7feac01025f0 2024-09-12T00:08:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac5673640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feac0100a40 0x7feac0199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac5673640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feac0100a40 0x7feac0199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58946/0 (socket says 172.21.15.6:58946) 2024-09-12T00:08:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac5673640 1 -- 172.21.15.6:0/3906566350 learned_addr learned my addr 172.21.15.6:0/3906566350 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac5e74640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feac01025f0 0x7feac01a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.912+0000 7feac4e72640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feac0101c30 0x7feac019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.913+0000 7feac5673640 1 -- 172.21.15.6:0/3906566350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feac01025f0 msgr2=0x7feac01a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.913+0000 7feac5673640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feac01025f0 0x7feac01a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.913+0000 7feac5673640 1 -- 172.21.15.6:0/3906566350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feac0101c30 msgr2=0x7feac019a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.913+0000 7feac5673640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feac0101c30 0x7feac019a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.913+0000 7feac5673640 1 -- 172.21.15.6:0/3906566350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac01a1b10 con 0x7feac0100a40 2024-09-12T00:08:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.913+0000 7feac4e72640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feac0101c30 0x7feac019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.913+0000 7feac5673640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feac0100a40 0x7feac0199ef0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7feabc00c970 tx=0x7feabc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.913+0000 7feab67fc640 1 -- 172.21.15.6:0/3906566350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc007c10 con 0x7feac0100a40 2024-09-12T00:08:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.913+0000 7feab67fc640 1 -- 172.21.15.6:0/3906566350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feabc007db0 con 0x7feac0100a40 2024-09-12T00:08:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.913+0000 7feab67fc640 1 -- 172.21.15.6:0/3906566350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc00f870 con 0x7feac0100a40 2024-09-12T00:08:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.913+0000 7feac78d7640 1 -- 172.21.15.6:0/3906566350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac01a1e00 con 0x7feac0100a40 2024-09-12T00:08:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.913+0000 7feac78d7640 1 -- 172.21.15.6:0/3906566350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac01a2260 con 0x7feac0100a40 2024-09-12T00:08:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.916+0000 7feab67fc640 1 -- 172.21.15.6:0/3906566350 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7feabc00fa10 con 0x7feac0100a40 2024-09-12T00:08:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.916+0000 7feaca670740 1 Processor -- start 2024-09-12T00:08:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.916+0000 7feaca670740 1 -- start start 2024-09-12T00:08:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feaca670740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1539a0 0x55b2cf153da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feaca670740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1542e0 0x55b2cf158da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feaca670740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf159370 0x55b2cf15b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feaca670740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b2cf0b72f0 con 0x55b2cf1539a0 2024-09-12T00:08:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feaca670740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b2cf05f270 con 0x55b2cf159370 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feaca670740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b2cf0b32b0 con 0x55b2cf1542e0 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feab67fc640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7feaac0a2b80 0x7feaac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feac5e74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1539a0 0x55b2cf153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feac5e74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1539a0 0x55b2cf153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58958/0 (socket says 172.21.15.6:58958) 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feac5e74640 1 -- 172.21.15.6:0/3527742196 learned_addr learned my addr 172.21.15.6:0/3527742196 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feac4e72640 1 --2- 172.21.15.6:0/3527742196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf159370 0x55b2cf15b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feac5e74640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7feaac0a2b80 0x7feaac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feac5673640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1542e0 0x55b2cf158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feab67fc640 1 -- 172.21.15.6:0/3906566350 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7feabc0cf830 con 0x7feac0100a40 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feac4e72640 1 -- 172.21.15.6:0/3527742196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1542e0 msgr2=0x55b2cf158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feac4e72640 1 --2- 172.21.15.6:0/3527742196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1542e0 0x55b2cf158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feac4e72640 1 -- 172.21.15.6:0/3527742196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1539a0 msgr2=0x55b2cf153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feac4e72640 1 --2- 172.21.15.6:0/3527742196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1539a0 0x55b2cf153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feac4e72640 1 -- 172.21.15.6:0/3527742196 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2cf05e340 con 0x55b2cf159370 2024-09-12T00:08:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.917+0000 7feac5673640 1 --2- 172.21.15.6:0/3527742196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1542e0 0x55b2cf158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.918+0000 7feac4e72640 1 --2- 172.21.15.6:0/3527742196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf159370 0x55b2cf15b830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feab0009c00 tx=0x7feab00117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75e0cba29b30c5a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.918+0000 7feac5e74640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7feaac0a2b80 0x7feaac0a5040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7feab8009430 tx=0x7feab8005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.918+0000 7feaab7fe640 1 -- 172.21.15.6:0/3527742196 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0005020 con 0x55b2cf159370 2024-09-12T00:08:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.918+0000 7feaab7fe640 1 -- 172.21.15.6:0/3527742196 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feab00047a0 con 0x55b2cf159370 2024-09-12T00:08:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.918+0000 7feaab7fe640 1 -- 172.21.15.6:0/3527742196 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0012690 con 0x55b2cf159370 2024-09-12T00:08:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.919+0000 7feaca670740 1 -- 172.21.15.6:0/3527742196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf159370 msgr2=0x55b2cf15b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.919+0000 7feaca670740 1 --2- 172.21.15.6:0/3527742196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf159370 0x55b2cf15b830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feab0009c00 tx=0x7feab00117b0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.919+0000 7feaca670740 1 -- 172.21.15.6:0/3527742196 shutdown_connections 2024-09-12T00:08:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.919+0000 7feaca670740 1 --2- 172.21.15.6:0/3527742196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf159370 0x55b2cf15b830 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.919+0000 7feaca670740 1 --2- 172.21.15.6:0/3527742196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1542e0 0x55b2cf158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.919+0000 7feaca670740 1 --2- 172.21.15.6:0/3527742196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1539a0 0x55b2cf153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.919+0000 7feaca670740 1 -- 172.21.15.6:0/3527742196 >> 172.21.15.6:0/3527742196 conn(0x55b2cf14f010 msgr2=0x55b2cf14f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.919+0000 7feaca670740 1 -- 172.21.15.6:0/3527742196 shutdown_connections 2024-09-12T00:08:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.919+0000 7feaca670740 1 -- 172.21.15.6:0/3527742196 wait complete. 2024-09-12T00:08:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.919+0000 7feaca670740 1 -- start start 2024-09-12T00:08:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feaca670740 1 Processor -- start 2024-09-12T00:08:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feaca670740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1539a0 0x55b2cf15db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feaca670740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1542e0 0x55b2cf15e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feaca670740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf159370 0x55b2cf1650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feaca670740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b2cf15c340 con 0x55b2cf1542e0 2024-09-12T00:08:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feaca670740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b2cf040290 con 0x55b2cf1539a0 2024-09-12T00:08:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feaca670740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b2cf15c4c0 con 0x55b2cf159370 2024-09-12T00:08:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feaca670740 10 client.0 _ll_register_callbacks cb 0x55b2cf071140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feac4e72640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1542e0 0x55b2cf15e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feac4e72640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1542e0 0x55b2cf15e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58960/0 (socket says 172.21.15.6:58960) 2024-09-12T00:08:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feac4e72640 1 -- 172.21.15.6:0/2006158299 learned_addr learned my addr 172.21.15.6:0/2006158299 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feac5673640 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1539a0 0x55b2cf15db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.920+0000 7feac5e74640 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf159370 0x55b2cf1650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feac4e72640 1 -- 172.21.15.6:0/2006158299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf159370 msgr2=0x55b2cf1650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feac4e72640 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf159370 0x55b2cf1650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feac4e72640 1 -- 172.21.15.6:0/2006158299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1539a0 msgr2=0x55b2cf15db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feac4e72640 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1539a0 0x55b2cf15db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feac4e72640 1 -- 172.21.15.6:0/2006158299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2cedca210 con 0x55b2cf1542e0 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feac4e72640 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1542e0 0x55b2cf15e080 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7feab0004e10 tx=0x7feab0004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b7177345efa458 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feaa8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feaa8ff9640 1 -- 172.21.15.6:0/2006158299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0028020 con 0x55b2cf1542e0 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feaa8ff9640 1 -- 172.21.15.6:0/2006158299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7feab0009cf0 con 0x55b2cf1542e0 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feaca670740 1 -- 172.21.15.6:0/2006158299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feab00047a0 con 0x55b2cf1542e0 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feaa8ff9640 1 -- 172.21.15.6:0/2006158299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7feab0033050 con 0x55b2cf1542e0 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feaca670740 10 client.16062 fetch_fsmap learned FSMap version 33 2024-09-12T00:08:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.921+0000 7feaca670740 1 -- 172.21.15.6:0/2006158299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b2cee96620 con 0x55b2cf1542e0 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.922+0000 7feaa8ff9640 1 -- 172.21.15.6:0/2006158299 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feab00047a0 con 0x55b2cf1542e0 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.922+0000 7feaa8ff9640 1 -- 172.21.15.6:0/2006158299 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7feab0012450 con 0x55b2cf1542e0 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.922+0000 7feaca670740 10 client.16062 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.922+0000 7feaca670740 10 client.16062 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.922+0000 7feaca670740 20 client.16062 populate_metadata read hostname 'smithi006' 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.922+0000 7feaca670740 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b2cf1694d0 0x55b2cf16b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.922+0000 7feaca670740 4 client.16062 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.922+0000 7feaca670740 1 -- 172.21.15.6:0/2006158299 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2cf0c4a20 con 0x55b2cf1694d0 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.922+0000 7feac5673640 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b2cf1694d0 0x55b2cf16b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.923+0000 7feac5673640 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b2cf1694d0 0x55b2cf16b8c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73cba0f92c3db1ff server_cookie=ac6aacfb6d5d713f in_seq=0 out_seq=0 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.923+0000 7feaa8ff9640 10 client.16062 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.923+0000 7feaa8ff9640 1 -- 172.21.15.6:0/2006158299 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2cf0c4a20 con 0x55b2cf1694d0 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.923+0000 7feaa8ff9640 10 client.16062 handle_command_reply: tid=0 2024-09-12T00:08:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.923+0000 7feaca670740 1 client.16062 shutdown 2024-09-12T00:08:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.924+0000 7feaca670740 1 -- 172.21.15.6:0/2006158299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1542e0 msgr2=0x55b2cf15e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.924+0000 7feaca670740 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1542e0 0x55b2cf15e080 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7feab0004e10 tx=0x7feab0004e40 comp rx=0 tx=0).stop 2024-09-12T00:08:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.924+0000 7feaca670740 1 -- 172.21.15.6:0/2006158299 shutdown_connections 2024-09-12T00:08:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.924+0000 7feaca670740 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b2cf1694d0 0x55b2cf16b8c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.924+0000 7feaca670740 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf159370 0x55b2cf1650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.924+0000 7feaca670740 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf1542e0 0x55b2cf15e080 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.924+0000 7feaca670740 1 --2- 172.21.15.6:0/2006158299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1539a0 0x55b2cf15db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.924+0000 7feaca670740 1 -- 172.21.15.6:0/2006158299 >> 172.21.15.6:0/2006158299 conn(0x55b2cf14f010 msgr2=0x55b2cf150820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.924+0000 7feaa8ff9640 0 client.16062 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.924+0000 7feaca670740 1 -- 172.21.15.6:0/2006158299 shutdown_connections 2024-09-12T00:08:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.924+0000 7feaca670740 1 -- 172.21.15.6:0/2006158299 wait complete. 2024-09-12T00:08:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.924+0000 7feaca670740 20 client.16062 trim_cache size 0 max 16384 2024-09-12T00:08:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feaca670740 1 Processor -- start 2024-09-12T00:08:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feaca670740 1 -- start start 2024-09-12T00:08:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feaca670740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1539a0 0x55b2cf150400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feaca670740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1542e0 0x55b2cf165080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feaca670740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 0x55b2cf150940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feaca670740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7feac01ac8e0 con 0x55b2cf159370 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feaca670740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feac01ae420 con 0x55b2cf1539a0 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feaca670740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feac01acfb0 con 0x55b2cf1542e0 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feac5e74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 0x55b2cf150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feac5673640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1539a0 0x55b2cf150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feac5e74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 0x55b2cf150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58968/0 (socket says 172.21.15.6:58968) 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feac5e74640 1 -- 172.21.15.6:0/3378256226 learned_addr learned my addr 172.21.15.6:0/3378256226 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feac5e74640 1 -- 172.21.15.6:0/3378256226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1542e0 msgr2=0x55b2cf165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feac5e74640 1 --2- 172.21.15.6:0/3378256226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1542e0 0x55b2cf165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feac5e74640 1 -- 172.21.15.6:0/3378256226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1539a0 msgr2=0x55b2cf150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feac5e74640 1 --2- 172.21.15.6:0/3378256226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1539a0 0x55b2cf150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feac5e74640 1 -- 172.21.15.6:0/3378256226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2cf15bba0 con 0x55b2cf159370 2024-09-12T00:08:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.940+0000 7feac5673640 1 --2- 172.21.15.6:0/3378256226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1539a0 0x55b2cf150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.941+0000 7feac5e74640 1 --2- 172.21.15.6:0/3378256226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 0x55b2cf150940 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7feab80317f0 tx=0x7feab8005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8a3f093c392bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.941+0000 7feaaaffd640 1 -- 172.21.15.6:0/3378256226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8003b70 con 0x55b2cf159370 2024-09-12T00:08:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.941+0000 7feaaaffd640 1 -- 172.21.15.6:0/3378256226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feab8036070 con 0x55b2cf159370 2024-09-12T00:08:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.941+0000 7feaaaffd640 1 -- 172.21.15.6:0/3378256226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8030820 con 0x55b2cf159370 2024-09-12T00:08:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.942+0000 7feaca670740 1 -- 172.21.15.6:0/3378256226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 msgr2=0x55b2cf150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.942+0000 7feaca670740 1 --2- 172.21.15.6:0/3378256226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 0x55b2cf150940 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7feab80317f0 tx=0x7feab8005df0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.942+0000 7feaca670740 1 -- 172.21.15.6:0/3378256226 shutdown_connections 2024-09-12T00:08:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.942+0000 7feaca670740 1 --2- 172.21.15.6:0/3378256226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 0x55b2cf150940 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.942+0000 7feaca670740 1 --2- 172.21.15.6:0/3378256226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1542e0 0x55b2cf165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.942+0000 7feaca670740 1 --2- 172.21.15.6:0/3378256226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1539a0 0x55b2cf150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.942+0000 7feaca670740 1 -- 172.21.15.6:0/3378256226 >> 172.21.15.6:0/3378256226 conn(0x55b2cf14f010 msgr2=0x55b2cf14e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.942+0000 7feaca670740 1 -- 172.21.15.6:0/3378256226 shutdown_connections 2024-09-12T00:08:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.942+0000 7feaca670740 1 -- 172.21.15.6:0/3378256226 wait complete. 2024-09-12T00:08:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feaca670740 1 -- start start 2024-09-12T00:08:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feaca670740 1 Processor -- start 2024-09-12T00:08:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feaca670740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1539a0 0x55b2cf162030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feaca670740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1542e0 0x55b2cf162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feaca670740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 0x55b2cf1d20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feaca670740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7feac01add50 con 0x55b2cf159370 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feaca670740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feac01ad680 con 0x55b2cf1542e0 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feaca670740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feac01aa8c0 con 0x55b2cf1539a0 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feaca670740 10 client.0 _ll_register_callbacks cb 0x7feab8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feac5e74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 0x55b2cf1d20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feac5673640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1539a0 0x55b2cf162030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feac5e74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 0x55b2cf1d20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58972/0 (socket says 172.21.15.6:58972) 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feac5e74640 1 -- 172.21.15.6:0/3372569501 learned_addr learned my addr 172.21.15.6:0/3372569501 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.943+0000 7feac4e72640 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1542e0 0x55b2cf162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feac5673640 1 -- 172.21.15.6:0/3372569501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1542e0 msgr2=0x55b2cf162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feac5673640 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1542e0 0x55b2cf162570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feac5673640 1 -- 172.21.15.6:0/3372569501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 msgr2=0x55b2cf1d20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feac5673640 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 0x55b2cf1d20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feac5673640 1 -- 172.21.15.6:0/3372569501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2cf1d2640 con 0x55b2cf1539a0 2024-09-12T00:08:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feac5e74640 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 0x55b2cf1d20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feac5673640 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1539a0 0x55b2cf162030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feabc0a4380 tx=0x7feabc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=371b21d8502a4de8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feaa8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:08:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feaa8ff9640 1 -- 172.21.15.6:0/3372569501 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc098340 con 0x55b2cf1539a0 2024-09-12T00:08:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feaca670740 1 -- 172.21.15.6:0/3372569501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feab8036070 con 0x55b2cf1539a0 2024-09-12T00:08:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feaa8ff9640 1 -- 172.21.15.6:0/3372569501 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7feabc0963a0 con 0x55b2cf1539a0 2024-09-12T00:08:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feaa8ff9640 1 -- 172.21.15.6:0/3372569501 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7feabc07f050 con 0x55b2cf1539a0 2024-09-12T00:08:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feaca670740 10 client.25663 fetch_fsmap learned FSMap version 33 2024-09-12T00:08:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.944+0000 7feaca670740 1 -- 172.21.15.6:0/3372569501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b2cf1d3a20 con 0x55b2cf1539a0 2024-09-12T00:08:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.945+0000 7feaa8ff9640 1 -- 172.21.15.6:0/3372569501 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feab8036070 con 0x55b2cf1539a0 2024-09-12T00:08:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.945+0000 7feaa8ff9640 1 -- 172.21.15.6:0/3372569501 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7feabc0a4420 con 0x55b2cf1539a0 2024-09-12T00:08:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.945+0000 7feaca670740 10 client.25663 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:08:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.945+0000 7feaca670740 10 client.25663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:08:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.945+0000 7feaca670740 20 client.25663 populate_metadata read hostname 'smithi006' 2024-09-12T00:08:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.945+0000 7feaca670740 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b2cf1d43a0 0x55b2cf1d67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.945+0000 7feaca670740 4 client.25663 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:08:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.945+0000 7feaca670740 1 -- 172.21.15.6:0/3372569501 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b2cf0bed70 con 0x55b2cf1d43a0 2024-09-12T00:08:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.945+0000 7feac4e72640 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b2cf1d43a0 0x55b2cf1d67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.946+0000 7feaa8ff9640 10 client.25663 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.946+0000 7feac4e72640 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b2cf1d43a0 0x55b2cf1d67c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3daa95481db40303 server_cookie=cf9439a45a5b3c77 in_seq=0 out_seq=0 2024-09-12T00:08:12.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.962+0000 7feaa8ff9640 1 -- 172.21.15.6:0/3372569501 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b2cf0bed70 con 0x55b2cf1d43a0 2024-09-12T00:08:12.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaa8ff9640 10 client.25663 handle_command_reply: tid=0 2024-09-12T00:08:12.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaca670740 1 client.25663 shutdown 2024-09-12T00:08:12.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaca670740 1 -- 172.21.15.6:0/3372569501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1539a0 msgr2=0x55b2cf162030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:12.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaca670740 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1539a0 0x55b2cf162030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feabc0a4380 tx=0x7feabc000bc0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaca670740 1 -- 172.21.15.6:0/3372569501 shutdown_connections 2024-09-12T00:08:12.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaca670740 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2cf159370 0x55b2cf1d20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaca670740 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b2cf1542e0 0x55b2cf162570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaca670740 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b2cf1d43a0 0x55b2cf1d67c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaca670740 1 --2- 172.21.15.6:0/3372569501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2cf1539a0 0x55b2cf162030 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaa8ff9640 0 client.25663 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:12.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaca670740 1 -- 172.21.15.6:0/3372569501 >> 172.21.15.6:0/3372569501 conn(0x55b2cf14f010 msgr2=0x55b2cf14f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:12.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaca670740 1 -- 172.21.15.6:0/3372569501 shutdown_connections 2024-09-12T00:08:12.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaca670740 1 -- 172.21.15.6:0/3372569501 wait complete. 2024-09-12T00:08:12.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.963+0000 7feaca670740 20 client.25663 trim_cache size 0 max 16384 2024-09-12T00:08:12.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:08:12.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:08:12.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:08:12.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:08:12.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.964+0000 7feac78d7640 1 -- 172.21.15.6:0/3906566350 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7feaac0a2b80 msgr2=0x7feaac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:12.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.964+0000 7feac78d7640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7feaac0a2b80 0x7feaac0a5040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7feab8009430 tx=0x7feab8005d80 comp rx=0 tx=0).stop 2024-09-12T00:08:12.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.964+0000 7feac78d7640 1 -- 172.21.15.6:0/3906566350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feac0100a40 msgr2=0x7feac0199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:12.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.964+0000 7feac78d7640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feac0100a40 0x7feac0199ef0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7feabc00c970 tx=0x7feabc00ce30 comp rx=0 tx=0).stop 2024-09-12T00:08:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.964+0000 7feac78d7640 1 -- 172.21.15.6:0/3906566350 shutdown_connections 2024-09-12T00:08:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.964+0000 7feac78d7640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7feaac0a2b80 0x7feaac0a5040 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.964+0000 7feac78d7640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feac01025f0 0x7feac01a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.964+0000 7feac78d7640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feac0101c30 0x7feac019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.964+0000 7feac78d7640 1 --2- 172.21.15.6:0/3906566350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feac0100a40 0x7feac0199ef0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.964+0000 7feac78d7640 1 -- 172.21.15.6:0/3906566350 >> 172.21.15.6:0/3906566350 conn(0x7feac00fc1c0 msgr2=0x7feac0069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.964+0000 7feac78d7640 1 -- 172.21.15.6:0/3906566350 shutdown_connections 2024-09-12T00:08:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:12.964+0000 7feac78d7640 1 -- 172.21.15.6:0/3906566350 wait complete. 2024-09-12T00:08:14.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:14 smithi134 ceph-mon[34893]: pgmap v626: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-09-12T00:08:14.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:14 smithi039 ceph-mon[34543]: pgmap v626: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-09-12T00:08:14.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:14 smithi006 ceph-mon[30947]: pgmap v626: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-09-12T00:08:16.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:16 smithi134 ceph-mon[34893]: pgmap v627: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 21 op/s 2024-09-12T00:08:16.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:16 smithi039 ceph-mon[34543]: pgmap v627: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 21 op/s 2024-09-12T00:08:16.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:16 smithi006 ceph-mon[30947]: pgmap v627: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 21 op/s 2024-09-12T00:08:18.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:18 smithi134 ceph-mon[34893]: pgmap v628: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-12T00:08:18.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:18 smithi039 ceph-mon[34543]: pgmap v628: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-12T00:08:18.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:18 smithi006 ceph-mon[30947]: pgmap v628: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-12T00:08:20.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:20 smithi134 ceph-mon[34893]: pgmap v629: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-09-12T00:08:20.545 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:20 smithi039 ceph-mon[34543]: pgmap v629: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-09-12T00:08:20.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:20 smithi006 ceph-mon[30947]: pgmap v629: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-09-12T00:08:22.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:22 smithi134 ceph-mon[34893]: pgmap v630: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 27 op/s 2024-09-12T00:08:22.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:22 smithi039 ceph-mon[34543]: pgmap v630: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 27 op/s 2024-09-12T00:08:22.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:22 smithi006 ceph-mon[30947]: pgmap v630: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 27 op/s 2024-09-12T00:08:24.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:24 smithi134 ceph-mon[34893]: pgmap v631: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:08:24.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:24 smithi039 ceph-mon[34543]: pgmap v631: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:08:24.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:24 smithi006 ceph-mon[30947]: pgmap v631: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:08:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.075+0000 7f7b6959f640 1 -- 172.21.15.6:0/279592117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b64104db0 msgr2=0x7f7b641071a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.075+0000 7f7b6959f640 1 --2- 172.21.15.6:0/279592117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b64104db0 0x7f7b641071a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009900 tx=0x7f7b5802a410 comp rx=0 tx=0).stop 2024-09-12T00:08:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.075+0000 7f7b6959f640 1 -- 172.21.15.6:0/279592117 shutdown_connections 2024-09-12T00:08:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.075+0000 7f7b6959f640 1 --2- 172.21.15.6:0/279592117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641076e0 0x7f7b64109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.075+0000 7f7b6959f640 1 --2- 172.21.15.6:0/279592117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b64104db0 0x7f7b641071a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.075+0000 7f7b6959f640 1 --2- 172.21.15.6:0/279592117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b64102480 0x7f7b64104870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.075+0000 7f7b6959f640 1 -- 172.21.15.6:0/279592117 >> 172.21.15.6:0/279592117 conn(0x7f7b640fc040 msgr2=0x7f7b640fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.075+0000 7f7b6959f640 1 -- 172.21.15.6:0/279592117 shutdown_connections 2024-09-12T00:08:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.075+0000 7f7b6959f640 1 -- 172.21.15.6:0/279592117 wait complete. 2024-09-12T00:08:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.076+0000 7f7b6959f640 1 Processor -- start 2024-09-12T00:08:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.076+0000 7f7b6959f640 1 -- start start 2024-09-12T00:08:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b6959f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b64102480 0x7f7b64199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b6959f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b64104db0 0x7f7b6419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b6959f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641076e0 0x7f7b641a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b6959f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6410d510 con 0x7f7b64104db0 2024-09-12T00:08:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b6959f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6410d390 con 0x7f7b641076e0 2024-09-12T00:08:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b6959f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6410d690 con 0x7f7b64102480 2024-09-12T00:08:26.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b637fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b64104db0 0x7f7b6419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b63fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b64102480 0x7f7b64199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b637fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b64104db0 0x7f7b6419a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39064/0 (socket says 172.21.15.6:39064) 2024-09-12T00:08:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b637fe640 1 -- 172.21.15.6:0/3673862462 learned_addr learned my addr 172.21.15.6:0/3673862462 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b68d9e640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641076e0 0x7f7b641a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b637fe640 1 -- 172.21.15.6:0/3673862462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b64102480 msgr2=0x7f7b64199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b637fe640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b64102480 0x7f7b64199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b637fe640 1 -- 172.21.15.6:0/3673862462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641076e0 msgr2=0x7f7b641a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b637fe640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641076e0 0x7f7b641a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b637fe640 1 -- 172.21.15.6:0/3673862462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b641a1aa0 con 0x7f7b64104db0 2024-09-12T00:08:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b63fff640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b64102480 0x7f7b64199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.077+0000 7f7b637fe640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b64104db0 0x7f7b6419a3c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7b580314e0 tx=0x7f7b580042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.078+0000 7f7b617fa640 1 -- 172.21.15.6:0/3673862462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5803f030 con 0x7f7b64104db0 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.078+0000 7f7b617fa640 1 -- 172.21.15.6:0/3673862462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7b58003cb0 con 0x7f7b64104db0 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.078+0000 7f7b6959f640 1 -- 172.21.15.6:0/3673862462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b641a1d30 con 0x7f7b64104db0 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.078+0000 7f7b617fa640 1 -- 172.21.15.6:0/3673862462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b58035070 con 0x7f7b64104db0 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.078+0000 7f7b6959f640 1 -- 172.21.15.6:0/3673862462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b641a21d0 con 0x7f7b64104db0 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.080+0000 7f7b617fa640 1 -- 172.21.15.6:0/3673862462 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f7b58042030 con 0x7f7b64104db0 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.080+0000 7f7b6d673740 1 Processor -- start 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.080+0000 7f7b6d673740 1 -- start start 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.080+0000 7f7b6d673740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff9074f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.080+0000 7f7b6d673740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9079f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.080+0000 7f7b6d673740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff907a540 0x55bff907ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b6d673740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55bff8fd82f0 con 0x55bff907a540 2024-09-12T00:08:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b6d673740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bff8f80270 con 0x55bff90754b0 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b6d673740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bff8fd42b0 con 0x55bff9074b70 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b637fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff907a540 0x55bff907ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b63fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9079f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b637fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff907a540 0x55bff907ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39066/0 (socket says 172.21.15.6:39066) 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b637fe640 1 -- 172.21.15.6:0/381990989 learned_addr learned my addr 172.21.15.6:0/381990989 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b68d9e640 1 --2- 172.21.15.6:0/381990989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff9074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b63fff640 1 -- 172.21.15.6:0/381990989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 msgr2=0x55bff9074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b617fa640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7b4c0a2b70 0x7f7b4c0a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b63fff640 1 --2- 172.21.15.6:0/381990989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff9074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b63fff640 1 -- 172.21.15.6:0/381990989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff907a540 msgr2=0x55bff907ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b63fff640 1 --2- 172.21.15.6:0/381990989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff907a540 0x55bff907ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b63fff640 1 -- 172.21.15.6:0/381990989 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bff8f7f340 con 0x55bff90754b0 2024-09-12T00:08:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b68d9e640 1 --2- 172.21.15.6:0/381990989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff9074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b68d9e640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7b4c0a2b70 0x7f7b4c0a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b63fff640 1 --2- 172.21.15.6:0/381990989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9079f70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b540103d0 tx=0x7f7b54010890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=368c883eae585a77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b617fa640 1 -- 172.21.15.6:0/3673862462 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f7b580ef9b0 con 0x7f7b64104db0 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.081+0000 7f7b4a7fc640 1 -- 172.21.15.6:0/381990989 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54011700 con 0x55bff90754b0 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.082+0000 7f7b4a7fc640 1 -- 172.21.15.6:0/381990989 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7b54011d50 con 0x55bff90754b0 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.082+0000 7f7b4a7fc640 1 -- 172.21.15.6:0/381990989 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5401ce00 con 0x55bff90754b0 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.082+0000 7f7b6d673740 1 -- 172.21.15.6:0/381990989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 msgr2=0x55bff9079f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.082+0000 7f7b6d673740 1 --2- 172.21.15.6:0/381990989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9079f70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b540103d0 tx=0x7f7b54010890 comp rx=0 tx=0).stop 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.082+0000 7f7b68d9e640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7b4c0a2b70 0x7f7b4c0a5030 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0098b0 tx=0x7f7b5c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.082+0000 7f7b6d673740 1 -- 172.21.15.6:0/381990989 shutdown_connections 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.082+0000 7f7b6d673740 1 --2- 172.21.15.6:0/381990989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff907a540 0x55bff907ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.082+0000 7f7b6d673740 1 --2- 172.21.15.6:0/381990989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9079f70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.082+0000 7f7b6d673740 1 --2- 172.21.15.6:0/381990989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff9074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.082+0000 7f7b6d673740 1 -- 172.21.15.6:0/381990989 >> 172.21.15.6:0/381990989 conn(0x55bff90701e0 msgr2=0x55bff90705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.082+0000 7f7b6d673740 1 -- 172.21.15.6:0/381990989 shutdown_connections 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.082+0000 7f7b6d673740 1 -- 172.21.15.6:0/381990989 wait complete. 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.083+0000 7f7b6d673740 1 -- start start 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.083+0000 7f7b6d673740 1 Processor -- start 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.083+0000 7f7b6d673740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff907ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.083+0000 7f7b6d673740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff90754b0 0x55bff907f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.083+0000 7f7b6d673740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff907a540 0x55bff9086290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.083+0000 7f7b6d673740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55bff907d510 con 0x55bff90754b0 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.083+0000 7f7b6d673740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bff8f61290 con 0x55bff907a540 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.083+0000 7f7b6d673740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bff907d690 con 0x55bff9074b70 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.083+0000 7f7b6d673740 10 client.0 _ll_register_callbacks cb 0x55bff8f92140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.083+0000 7f7b637fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff90754b0 0x55bff907f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b637fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff90754b0 0x55bff907f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39076/0 (socket says 172.21.15.6:39076) 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b68d9e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff907a540 0x55bff9086290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b637fe640 1 -- 172.21.15.6:0/1065313399 learned_addr learned my addr 172.21.15.6:0/1065313399 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b63fff640 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff907ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b637fe640 1 -- 172.21.15.6:0/1065313399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 msgr2=0x55bff907ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b637fe640 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff907ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b637fe640 1 -- 172.21.15.6:0/1065313399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff907a540 msgr2=0x55bff9086290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b637fe640 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff907a540 0x55bff9086290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b637fe640 1 -- 172.21.15.6:0/1065313399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bff8ceb210 con 0x55bff90754b0 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b68d9e640 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff907a540 0x55bff9086290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b637fe640 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff90754b0 0x55bff907f250 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7b58000c00 tx=0x7f7b58003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ea07f585ba36a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b437fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b437fe640 1 -- 172.21.15.6:0/1065313399 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b580efe60 con 0x55bff90754b0 2024-09-12T00:08:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b437fe640 1 -- 172.21.15.6:0/1065313399 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f7b580b8540 con 0x55bff90754b0 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b6d673740 1 -- 172.21.15.6:0/1065313399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b54011d50 con 0x55bff90754b0 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b437fe640 1 -- 172.21.15.6:0/1065313399 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7b58049030 con 0x55bff90754b0 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b6d673740 10 client.16080 fetch_fsmap learned FSMap version 33 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.084+0000 7f7b6d673740 1 -- 172.21.15.6:0/1065313399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55bff8db7620 con 0x55bff90754b0 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.085+0000 7f7b437fe640 1 -- 172.21.15.6:0/1065313399 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7b54011d50 con 0x55bff90754b0 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.085+0000 7f7b437fe640 1 -- 172.21.15.6:0/1065313399 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f7b5803bc90 con 0x55bff90754b0 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.085+0000 7f7b6d673740 10 client.16080 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.085+0000 7f7b6d673740 10 client.16080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.085+0000 7f7b6d673740 20 client.16080 populate_metadata read hostname 'smithi006' 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.085+0000 7f7b6d673740 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bff908a980 0x55bff908cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.085+0000 7f7b6d673740 4 client.16080 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.085+0000 7f7b6d673740 1 -- 172.21.15.6:0/1065313399 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bff8fe5a20 con 0x55bff908a980 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.085+0000 7f7b63fff640 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bff908a980 0x55bff908cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.086+0000 7f7b437fe640 10 client.16080 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.086+0000 7f7b63fff640 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bff908a980 0x55bff908cdc0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7a22aff10e3b443 server_cookie=f0664c1fd68a29fa in_seq=0 out_seq=0 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.086+0000 7f7b437fe640 1 -- 172.21.15.6:0/1065313399 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bff8fe5a20 con 0x55bff908a980 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.086+0000 7f7b437fe640 10 client.16080 handle_command_reply: tid=0 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.086+0000 7f7b6d673740 1 client.16080 shutdown 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.086+0000 7f7b6d673740 1 -- 172.21.15.6:0/1065313399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff90754b0 msgr2=0x55bff907f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.086+0000 7f7b6d673740 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff90754b0 0x55bff907f250 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7b58000c00 tx=0x7f7b58003e60 comp rx=0 tx=0).stop 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.087+0000 7f7b6d673740 1 -- 172.21.15.6:0/1065313399 shutdown_connections 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.087+0000 7f7b6d673740 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff907a540 0x55bff9086290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.087+0000 7f7b6d673740 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff90754b0 0x55bff907f250 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.087+0000 7f7b6d673740 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bff908a980 0x55bff908cdc0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.087+0000 7f7b6d673740 1 --2- 172.21.15.6:0/1065313399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff907ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.087+0000 7f7b437fe640 0 client.16080 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.087+0000 7f7b6d673740 1 -- 172.21.15.6:0/1065313399 >> 172.21.15.6:0/1065313399 conn(0x55bff90701e0 msgr2=0x55bff90719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.087+0000 7f7b6d673740 1 -- 172.21.15.6:0/1065313399 shutdown_connections 2024-09-12T00:08:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.087+0000 7f7b6d673740 1 -- 172.21.15.6:0/1065313399 wait complete. 2024-09-12T00:08:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.087+0000 7f7b6d673740 20 client.16080 trim_cache size 0 max 16384 2024-09-12T00:08:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.103+0000 7f7b6d673740 1 Processor -- start 2024-09-12T00:08:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.103+0000 7f7b6d673740 1 -- start start 2024-09-12T00:08:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b6d673740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff9079e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b6d673740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9086250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b6d673740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff907a540 0x55bff90717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b6d673740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641ac870 con 0x55bff907a540 2024-09-12T00:08:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b6d673740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641ae3b0 con 0x55bff90754b0 2024-09-12T00:08:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b6d673740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641acf40 con 0x55bff9074b70 2024-09-12T00:08:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b68d9e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff907a540 0x55bff90717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b68d9e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff907a540 0x55bff90717a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39086/0 (socket says 172.21.15.6:39086) 2024-09-12T00:08:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b637fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9086250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b68d9e640 1 -- 172.21.15.6:0/621982332 learned_addr learned my addr 172.21.15.6:0/621982332 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b63fff640 1 --2- 172.21.15.6:0/621982332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff9079e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b637fe640 1 -- 172.21.15.6:0/621982332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 msgr2=0x55bff9079e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b637fe640 1 --2- 172.21.15.6:0/621982332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff9079e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b637fe640 1 -- 172.21.15.6:0/621982332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff907a540 msgr2=0x55bff90717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b637fe640 1 --2- 172.21.15.6:0/621982332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff907a540 0x55bff90717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b637fe640 1 -- 172.21.15.6:0/621982332 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bff9070000 con 0x55bff90754b0 2024-09-12T00:08:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b63fff640 1 --2- 172.21.15.6:0/621982332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff9079e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b637fe640 1 --2- 172.21.15.6:0/621982332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9086250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b580b88a0 tx=0x7f7b580c01d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1a2a7ffd4fff786 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.104+0000 7f7b49ffb640 1 -- 172.21.15.6:0/621982332 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b580f51f0 con 0x55bff90754b0 2024-09-12T00:08:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.105+0000 7f7b49ffb640 1 -- 172.21.15.6:0/621982332 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7b580c4a90 con 0x55bff90754b0 2024-09-12T00:08:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.105+0000 7f7b49ffb640 1 -- 172.21.15.6:0/621982332 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b580c4600 con 0x55bff90754b0 2024-09-12T00:08:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.105+0000 7f7b6d673740 1 -- 172.21.15.6:0/621982332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 msgr2=0x55bff9086250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.105+0000 7f7b6d673740 1 --2- 172.21.15.6:0/621982332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9086250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b580b88a0 tx=0x7f7b580c01d0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.105+0000 7f7b6d673740 1 -- 172.21.15.6:0/621982332 shutdown_connections 2024-09-12T00:08:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.105+0000 7f7b6d673740 1 --2- 172.21.15.6:0/621982332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff907a540 0x55bff90717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.105+0000 7f7b6d673740 1 --2- 172.21.15.6:0/621982332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9086250 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.105+0000 7f7b6d673740 1 --2- 172.21.15.6:0/621982332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff9074b70 0x55bff9079e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.105+0000 7f7b6d673740 1 -- 172.21.15.6:0/621982332 >> 172.21.15.6:0/621982332 conn(0x55bff90701e0 msgr2=0x55bff9071090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.105+0000 7f7b6d673740 1 -- 172.21.15.6:0/621982332 shutdown_connections 2024-09-12T00:08:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.105+0000 7f7b6d673740 1 -- 172.21.15.6:0/621982332 wait complete. 2024-09-12T00:08:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b6d673740 1 -- start start 2024-09-12T00:08:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b6d673740 1 Processor -- start 2024-09-12T00:08:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b6d673740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff9074b70 0x55bff9083a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b6d673740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9083f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b6d673740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff907a540 0x55bff9084f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b6d673740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641adce0 con 0x55bff9074b70 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b6d673740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641ad610 con 0x55bff90754b0 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b6d673740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641aa850 con 0x55bff907a540 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b6d673740 10 client.0 _ll_register_callbacks cb 0x7f7b58005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b63fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff9074b70 0x55bff9083a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b63fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff9074b70 0x55bff9083a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39094/0 (socket says 172.21.15.6:39094) 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b63fff640 1 -- 172.21.15.6:0/126314095 learned_addr learned my addr 172.21.15.6:0/126314095 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.106+0000 7f7b637fe640 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9083f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b63fff640 1 -- 172.21.15.6:0/126314095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff907a540 msgr2=0x55bff9084f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b68d9e640 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff907a540 0x55bff9084f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b63fff640 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff907a540 0x55bff9084f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b63fff640 1 -- 172.21.15.6:0/126314095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 msgr2=0x55bff9083f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b63fff640 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9083f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b63fff640 1 -- 172.21.15.6:0/126314095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bff9085510 con 0x55bff9074b70 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b637fe640 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9083f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b63fff640 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff9074b70 0x55bff9083a00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7b540103d0 tx=0x7f7b54010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d997737765f32bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b437fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b437fe640 1 -- 172.21.15.6:0/126314095 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5402c070 con 0x55bff9074b70 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b437fe640 1 -- 172.21.15.6:0/126314095 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f7b54005450 con 0x55bff9074b70 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b6d673740 1 -- 172.21.15.6:0/126314095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b580c4a90 con 0x55bff9074b70 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b437fe640 1 -- 172.21.15.6:0/126314095 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7b54038050 con 0x55bff9074b70 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b6d673740 10 client.16086 fetch_fsmap learned FSMap version 33 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b6d673740 1 -- 172.21.15.6:0/126314095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55bff90f5790 con 0x55bff9074b70 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.107+0000 7f7b437fe640 1 -- 172.21.15.6:0/126314095 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7b580c4a90 con 0x55bff9074b70 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.108+0000 7f7b437fe640 1 -- 172.21.15.6:0/126314095 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f7b54003730 con 0x55bff9074b70 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.108+0000 7f7b6d673740 10 client.16086 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:08:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.108+0000 7f7b6d673740 10 client.16086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:08:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.108+0000 7f7b6d673740 20 client.16086 populate_metadata read hostname 'smithi006' 2024-09-12T00:08:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.108+0000 7f7b6d673740 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bff90f5e10 0x55bff90f8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.108+0000 7f7b6d673740 4 client.16086 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:08:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.108+0000 7f7b6d673740 1 -- 172.21.15.6:0/126314095 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bff8fdfd70 con 0x55bff90f5e10 2024-09-12T00:08:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.108+0000 7f7b637fe640 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bff90f5e10 0x55bff90f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.108+0000 7f7b437fe640 10 client.16086 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.108+0000 7f7b637fe640 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bff90f5e10 0x55bff90f8200 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f42c5492441b3672 server_cookie=b653edc326f08d3a in_seq=0 out_seq=0 2024-09-12T00:08:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b437fe640 1 -- 172.21.15.6:0/126314095 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bff8fdfd70 con 0x55bff90f5e10 2024-09-12T00:08:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b437fe640 10 client.16086 handle_command_reply: tid=0 2024-09-12T00:08:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b6d673740 1 client.16086 shutdown 2024-09-12T00:08:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b6d673740 1 -- 172.21.15.6:0/126314095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff9074b70 msgr2=0x55bff9083a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b6d673740 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff9074b70 0x55bff9083a00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7b540103d0 tx=0x7f7b54010e40 comp rx=0 tx=0).stop 2024-09-12T00:08:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b6d673740 1 -- 172.21.15.6:0/126314095 shutdown_connections 2024-09-12T00:08:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b6d673740 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bff90f5e10 0x55bff90f8200 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b6d673740 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bff907a540 0x55bff9084f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b6d673740 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bff90754b0 0x55bff9083f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b437fe640 0 client.16086 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b6d673740 1 --2- 172.21.15.6:0/126314095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bff9074b70 0x55bff9083a00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b6d673740 1 -- 172.21.15.6:0/126314095 >> 172.21.15.6:0/126314095 conn(0x55bff90701e0 msgr2=0x55bff90718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b6d673740 1 -- 172.21.15.6:0/126314095 shutdown_connections 2024-09-12T00:08:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b6d673740 1 -- 172.21.15.6:0/126314095 wait complete. 2024-09-12T00:08:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.125+0000 7f7b6d673740 20 client.16086 trim_cache size 0 max 16384 2024-09-12T00:08:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:08:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:08:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:08:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:08:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.126+0000 7f7b6959f640 1 -- 172.21.15.6:0/3673862462 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7b4c0a2b70 msgr2=0x7f7b4c0a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.126+0000 7f7b6959f640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7b4c0a2b70 0x7f7b4c0a5030 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0098b0 tx=0x7f7b5c004a40 comp rx=0 tx=0).stop 2024-09-12T00:08:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.126+0000 7f7b6959f640 1 -- 172.21.15.6:0/3673862462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b64104db0 msgr2=0x7f7b6419a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.126+0000 7f7b6959f640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b64104db0 0x7f7b6419a3c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7b580314e0 tx=0x7f7b580042e0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.126+0000 7f7b6959f640 1 -- 172.21.15.6:0/3673862462 shutdown_connections 2024-09-12T00:08:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.126+0000 7f7b6959f640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7b4c0a2b70 0x7f7b4c0a5030 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.126+0000 7f7b6959f640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641076e0 0x7f7b641a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.126+0000 7f7b6959f640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b64104db0 0x7f7b6419a3c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.126+0000 7f7b6959f640 1 --2- 172.21.15.6:0/3673862462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b64102480 0x7f7b64199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.126+0000 7f7b6959f640 1 -- 172.21.15.6:0/3673862462 >> 172.21.15.6:0/3673862462 conn(0x7f7b640fc040 msgr2=0x7f7b64101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.126+0000 7f7b6959f640 1 -- 172.21.15.6:0/3673862462 shutdown_connections 2024-09-12T00:08:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:26.126+0000 7f7b6959f640 1 -- 172.21.15.6:0/3673862462 wait complete. 2024-09-12T00:08:26.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:26 smithi134 ceph-mon[34893]: pgmap v632: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:08:26.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:26 smithi039 ceph-mon[34543]: pgmap v632: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:08:26.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:26 smithi006 ceph-mon[30947]: pgmap v632: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:08:28.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:28 smithi134 ceph-mon[34893]: pgmap v633: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:08:28.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:28 smithi039 ceph-mon[34543]: pgmap v633: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:08:28.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:28 smithi006 ceph-mon[30947]: pgmap v633: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-12T00:08:30.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:30 smithi134 ceph-mon[34893]: pgmap v634: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 22 op/s 2024-09-12T00:08:30.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:30 smithi039 ceph-mon[34543]: pgmap v634: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 22 op/s 2024-09-12T00:08:30.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:30 smithi006 ceph-mon[30947]: pgmap v634: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 22 op/s 2024-09-12T00:08:32.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:32 smithi134 ceph-mon[34893]: pgmap v635: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 26 op/s 2024-09-12T00:08:32.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:32 smithi039 ceph-mon[34543]: pgmap v635: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 26 op/s 2024-09-12T00:08:32.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:32 smithi006 ceph-mon[30947]: pgmap v635: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 26 op/s 2024-09-12T00:08:34.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:34 smithi134 ceph-mon[34893]: pgmap v636: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:08:34.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:34 smithi039 ceph-mon[34543]: pgmap v636: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:08:34.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:34 smithi006 ceph-mon[30947]: pgmap v636: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-09-12T00:08:36.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:36 smithi134 ceph-mon[34893]: pgmap v637: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:08:36.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:36 smithi039 ceph-mon[34543]: pgmap v637: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:08:36.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:36 smithi006 ceph-mon[30947]: pgmap v637: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 24 op/s 2024-09-12T00:08:38.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:38 smithi134 ceph-mon[34893]: pgmap v638: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:08:38.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:38 smithi039 ceph-mon[34543]: pgmap v638: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:08:38.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:38 smithi006 ceph-mon[30947]: pgmap v638: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 28 op/s 2024-09-12T00:08:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.234+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/421475935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3c40761b0 msgr2=0x7fc3c4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.234+0000 7fc3ca2f1640 1 --2- 172.21.15.6:0/421475935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3c40761b0 0x7fc3c4074600 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009900 tx=0x7fc3b402a480 comp rx=0 tx=0).stop 2024-09-12T00:08:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.234+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/421475935 shutdown_connections 2024-09-12T00:08:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.234+0000 7fc3ca2f1640 1 --2- 172.21.15.6:0/421475935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3c4109a10 0x7fc3c410bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.234+0000 7fc3ca2f1640 1 --2- 172.21.15.6:0/421475935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3c4074bd0 0x7fc3c4075030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.234+0000 7fc3ca2f1640 1 --2- 172.21.15.6:0/421475935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3c40761b0 0x7fc3c4074600 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.234+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/421475935 >> 172.21.15.6:0/421475935 conn(0x7fc3c40fd2e0 msgr2=0x7fc3c40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.234+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/421475935 shutdown_connections 2024-09-12T00:08:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.234+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/421475935 wait complete. 2024-09-12T00:08:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.234+0000 7fc3ca2f1640 1 Processor -- start 2024-09-12T00:08:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3ca2f1640 1 -- start start 2024-09-12T00:08:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3ca2f1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3c4074bd0 0x7fc3c4199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3ca2f1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3c40761b0 0x7fc3c419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3ca2f1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3c4109a10 0x7fc3c41a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3ca2f1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c410f870 con 0x7fc3c4074bd0 2024-09-12T00:08:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3ca2f1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c410f6f0 con 0x7fc3c40761b0 2024-09-12T00:08:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3ca2f1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c410f9f0 con 0x7fc3c4109a10 2024-09-12T00:08:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3c3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3c4074bd0 0x7fc3c4199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3c3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3c4074bd0 0x7fc3c4199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59056/0 (socket says 172.21.15.6:59056) 2024-09-12T00:08:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3c3fff640 1 -- 172.21.15.6:0/1900740511 learned_addr learned my addr 172.21.15.6:0/1900740511 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3c888e640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3c4109a10 0x7fc3c41a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3c37fe640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3c40761b0 0x7fc3c419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3c3fff640 1 -- 172.21.15.6:0/1900740511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3c4109a10 msgr2=0x7fc3c41a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3c3fff640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3c4109a10 0x7fc3c41a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3c3fff640 1 -- 172.21.15.6:0/1900740511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3c40761b0 msgr2=0x7fc3c419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3c3fff640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3c40761b0 0x7fc3c419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.235+0000 7fc3c3fff640 1 -- 172.21.15.6:0/1900740511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c41a1c10 con 0x7fc3c4074bd0 2024-09-12T00:08:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.236+0000 7fc3c37fe640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3c40761b0 0x7fc3c419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.236+0000 7fc3c3fff640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3c4074bd0 0x7fc3c4199ff0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4005940 tx=0x7fc3b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.236+0000 7fc3c17fa640 1 -- 172.21.15.6:0/1900740511 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b403f030 con 0x7fc3c4074bd0 2024-09-12T00:08:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.236+0000 7fc3c17fa640 1 -- 172.21.15.6:0/1900740511 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3b4003cb0 con 0x7fc3c4074bd0 2024-09-12T00:08:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.236+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/1900740511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c41a1ea0 con 0x7fc3c4074bd0 2024-09-12T00:08:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.236+0000 7fc3c17fa640 1 -- 172.21.15.6:0/1900740511 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4035070 con 0x7fc3c4074bd0 2024-09-12T00:08:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.236+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/1900740511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c41a2300 con 0x7fc3c4074bd0 2024-09-12T00:08:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3cd08f740 1 Processor -- start 2024-09-12T00:08:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3cd08f740 1 -- start start 2024-09-12T00:08:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3cd08f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af769a0 0x55813af76da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3cd08f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af772e0 0x55813af7bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3cd08f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af7c370 0x55813af7e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3cd08f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55813aeda2f0 con 0x55813af769a0 2024-09-12T00:08:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3cd08f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55813ae82270 con 0x55813af7c370 2024-09-12T00:08:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3cd08f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55813aed62b0 con 0x55813af772e0 2024-09-12T00:08:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3c888e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af769a0 0x55813af76da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3c888e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af769a0 0x55813af76da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59066/0 (socket says 172.21.15.6:59066) 2024-09-12T00:08:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3c888e640 1 -- 172.21.15.6:0/1362212515 learned_addr learned my addr 172.21.15.6:0/1362212515 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3c17fa640 1 -- 172.21.15.6:0/1900740511 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fc3b4042030 con 0x7fc3c4074bd0 2024-09-12T00:08:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3c37fe640 1 --2- 172.21.15.6:0/1362212515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af7c370 0x55813af7e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3c888e640 1 -- 172.21.15.6:0/1362212515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af772e0 msgr2=0x55813af7bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3c888e640 1 --2- 172.21.15.6:0/1362212515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af772e0 0x55813af7bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3c888e640 1 -- 172.21.15.6:0/1362212515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af7c370 msgr2=0x55813af7e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3c888e640 1 --2- 172.21.15.6:0/1362212515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af7c370 0x55813af7e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.239+0000 7fc3c888e640 1 -- 172.21.15.6:0/1362212515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55813ae81340 con 0x55813af769a0 2024-09-12T00:08:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.240+0000 7fc3c888e640 1 --2- 172.21.15.6:0/1362212515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af769a0 0x55813af76da0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009f50 tx=0x7fc3bc0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928b62a62fc7d7d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.240+0000 7fc3aa7fc640 1 -- 172.21.15.6:0/1362212515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc004d20 con 0x55813af769a0 2024-09-12T00:08:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.240+0000 7fc3aa7fc640 1 -- 172.21.15.6:0/1362212515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3bc004050 con 0x55813af769a0 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.240+0000 7fc3aa7fc640 1 -- 172.21.15.6:0/1362212515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc005280 con 0x55813af769a0 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.240+0000 7fc3c17fa640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3ac0a2c80 0x7fc3ac0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.240+0000 7fc3c17fa640 1 -- 172.21.15.6:0/1900740511 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fc3b40ef9d0 con 0x7fc3c4074bd0 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.240+0000 7fc3c3fff640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3ac0a2c80 0x7fc3ac0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.240+0000 7fc3cd08f740 1 -- 172.21.15.6:0/1362212515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af769a0 msgr2=0x55813af76da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.240+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/1362212515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af769a0 0x55813af76da0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009f50 tx=0x7fc3bc0118d0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.241+0000 7fc3cd08f740 1 -- 172.21.15.6:0/1362212515 shutdown_connections 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.241+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/1362212515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af7c370 0x55813af7e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.241+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/1362212515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af772e0 0x55813af7bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.241+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/1362212515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af769a0 0x55813af76da0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.241+0000 7fc3cd08f740 1 -- 172.21.15.6:0/1362212515 >> 172.21.15.6:0/1362212515 conn(0x55813af72010 msgr2=0x55813af72410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.241+0000 7fc3cd08f740 1 -- 172.21.15.6:0/1362212515 shutdown_connections 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.241+0000 7fc3cd08f740 1 -- 172.21.15.6:0/1362212515 wait complete. 2024-09-12T00:08:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.241+0000 7fc3c3fff640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3ac0a2c80 0x7fc3ac0a5140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4032ad0 tx=0x7fc3b402a480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.241+0000 7fc3cd08f740 1 -- start start 2024-09-12T00:08:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.241+0000 7fc3cd08f740 1 Processor -- start 2024-09-12T00:08:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3cd08f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af769a0 0x55813af80b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3cd08f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af772e0 0x55813af810a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3cd08f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 0x55813af880e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3cd08f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55813af7f340 con 0x55813af7c370 2024-09-12T00:08:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3cd08f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55813ae63290 con 0x55813af772e0 2024-09-12T00:08:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3cd08f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55813af7f4c0 con 0x55813af769a0 2024-09-12T00:08:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3cd08f740 10 client.0 _ll_register_callbacks cb 0x55813ae94140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3c888e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 0x55813af880e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3c888e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 0x55813af880e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59068/0 (socket says 172.21.15.6:59068) 2024-09-12T00:08:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3c888e640 1 -- 172.21.15.6:0/59840853 learned_addr learned my addr 172.21.15.6:0/59840853 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3c37fe640 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af772e0 0x55813af810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3c888e640 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af769a0 0x55813af80b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3c888e640 1 -- 172.21.15.6:0/59840853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af769a0 msgr2=0x55813af80b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3c888e640 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af769a0 0x55813af80b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3c888e640 1 -- 172.21.15.6:0/59840853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af772e0 msgr2=0x55813af810a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3c888e640 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af772e0 0x55813af810a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3c888e640 1 -- 172.21.15.6:0/59840853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55813abed210 con 0x55813af7c370 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3c888e640 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 0x55813af880e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x55813af80090 tx=0x7fc3bc004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f8c20323304b31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.242+0000 7fc3a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3a37fe640 1 -- 172.21.15.6:0/59840853 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc02d060 con 0x55813af7c370 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3a37fe640 1 -- 172.21.15.6:0/59840853 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fc3bc004c40 con 0x55813af7c370 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3cd08f740 1 -- 172.21.15.6:0/59840853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3bc004050 con 0x55813af7c370 2024-09-12T00:08:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3a37fe640 1 -- 172.21.15.6:0/59840853 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc3bc004510 con 0x55813af7c370 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3cd08f740 10 client.16098 fetch_fsmap learned FSMap version 33 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3cd08f740 1 -- 172.21.15.6:0/59840853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55813acb9620 con 0x55813af7c370 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3a37fe640 1 -- 172.21.15.6:0/59840853 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3bc004050 con 0x55813af7c370 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3a37fe640 1 -- 172.21.15.6:0/59840853 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fc3bc00f480 con 0x55813af7c370 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3cd08f740 10 client.16098 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3cd08f740 10 client.16098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3cd08f740 20 client.16098 populate_metadata read hostname 'smithi006' 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55813af8c640 0x55813af8ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3cd08f740 4 client.16098 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3cd08f740 1 -- 172.21.15.6:0/59840853 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55813aee7a20 con 0x55813af8c640 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.243+0000 7fc3c37fe640 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55813af8c640 0x55813af8ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.244+0000 7fc3c37fe640 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55813af8c640 0x55813af8ea50 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44ac0b1f636d60ff server_cookie=55d8261e6bfdfef8 in_seq=0 out_seq=0 2024-09-12T00:08:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.244+0000 7fc3a37fe640 10 client.16098 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3a37fe640 1 -- 172.21.15.6:0/59840853 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55813aee7a20 con 0x55813af8c640 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3a37fe640 10 client.16098 handle_command_reply: tid=0 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3cd08f740 1 client.16098 shutdown 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3cd08f740 1 -- 172.21.15.6:0/59840853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 msgr2=0x55813af880e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 0x55813af880e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x55813af80090 tx=0x7fc3bc004850 comp rx=0 tx=0).stop 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3cd08f740 1 -- 172.21.15.6:0/59840853 shutdown_connections 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 0x55813af880e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af772e0 0x55813af810a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55813af8c640 0x55813af8ea50 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/59840853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af769a0 0x55813af80b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3a37fe640 0 client.16098 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3cd08f740 1 -- 172.21.15.6:0/59840853 >> 172.21.15.6:0/59840853 conn(0x55813af72010 msgr2=0x55813af73820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3cd08f740 1 -- 172.21.15.6:0/59840853 shutdown_connections 2024-09-12T00:08:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3cd08f740 1 -- 172.21.15.6:0/59840853 wait complete. 2024-09-12T00:08:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.245+0000 7fc3cd08f740 20 client.16098 trim_cache size 0 max 16384 2024-09-12T00:08:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3cd08f740 1 Processor -- start 2024-09-12T00:08:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3cd08f740 1 -- start start 2024-09-12T00:08:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3cd08f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af769a0 0x55813af710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3cd08f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af772e0 0x55813af88000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3cd08f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 0x55813af93350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3cd08f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c41aca60 con 0x55813af7c370 2024-09-12T00:08:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3cd08f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c41ae5a0 con 0x55813af769a0 2024-09-12T00:08:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3cd08f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c41ad130 con 0x55813af772e0 2024-09-12T00:08:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3c888e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 0x55813af93350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3c888e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 0x55813af93350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59072/0 (socket says 172.21.15.6:59072) 2024-09-12T00:08:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3c888e640 1 -- 172.21.15.6:0/587039430 learned_addr learned my addr 172.21.15.6:0/587039430 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3c888e640 1 --2- 172.21.15.6:0/587039430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af769a0 0x55813af710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3c37fe640 1 --2- 172.21.15.6:0/587039430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af772e0 0x55813af88000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3c888e640 1 -- 172.21.15.6:0/587039430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af772e0 msgr2=0x55813af88000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3c888e640 1 --2- 172.21.15.6:0/587039430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af772e0 0x55813af88000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3c888e640 1 -- 172.21.15.6:0/587039430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af769a0 msgr2=0x55813af710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3c888e640 1 --2- 172.21.15.6:0/587039430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af769a0 0x55813af710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.261+0000 7fc3c888e640 1 -- 172.21.15.6:0/587039430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55813af8f0d0 con 0x55813af7c370 2024-09-12T00:08:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.262+0000 7fc3c888e640 1 --2- 172.21.15.6:0/587039430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 0x55813af93350 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc005d70 tx=0x7fc3bc009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25a7cc17c026c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.262+0000 7fc3a9ffb640 1 -- 172.21.15.6:0/587039430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc02d040 con 0x55813af7c370 2024-09-12T00:08:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.262+0000 7fc3a9ffb640 1 -- 172.21.15.6:0/587039430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3bc00fa90 con 0x55813af7c370 2024-09-12T00:08:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.262+0000 7fc3a9ffb640 1 -- 172.21.15.6:0/587039430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0288d0 con 0x55813af7c370 2024-09-12T00:08:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.263+0000 7fc3cd08f740 1 -- 172.21.15.6:0/587039430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 msgr2=0x55813af93350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.263+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/587039430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 0x55813af93350 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc005d70 tx=0x7fc3bc009230 comp rx=0 tx=0).stop 2024-09-12T00:08:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.263+0000 7fc3cd08f740 1 -- 172.21.15.6:0/587039430 shutdown_connections 2024-09-12T00:08:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.263+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/587039430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af7c370 0x55813af93350 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.263+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/587039430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af772e0 0x55813af88000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.263+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/587039430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af769a0 0x55813af710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.263+0000 7fc3cd08f740 1 -- 172.21.15.6:0/587039430 >> 172.21.15.6:0/587039430 conn(0x55813af72010 msgr2=0x55813af709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.263+0000 7fc3cd08f740 1 -- 172.21.15.6:0/587039430 shutdown_connections 2024-09-12T00:08:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.263+0000 7fc3cd08f740 1 -- 172.21.15.6:0/587039430 wait complete. 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.263+0000 7fc3cd08f740 1 -- start start 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.263+0000 7fc3cd08f740 1 Processor -- start 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3cd08f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af769a0 0x55813af857e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3cd08f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af772e0 0x55813af85d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3cd08f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af7c370 0x55813af86d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3cd08f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c41aded0 con 0x55813af772e0 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3cd08f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c41ad800 con 0x55813af7c370 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3cd08f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c41aaa40 con 0x55813af769a0 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3cd08f740 10 client.0 _ll_register_callbacks cb 0x7fc3bc009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af772e0 0x55813af85d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af772e0 0x55813af85d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59086/0 (socket says 172.21.15.6:59086) 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3c37fe640 1 -- 172.21.15.6:0/718720077 learned_addr learned my addr 172.21.15.6:0/718720077 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3c888e640 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af769a0 0x55813af857e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3c888e640 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af7c370 0x55813af86d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3c37fe640 1 -- 172.21.15.6:0/718720077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af769a0 msgr2=0x55813af857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3c37fe640 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af769a0 0x55813af857e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3c37fe640 1 -- 172.21.15.6:0/718720077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af7c370 msgr2=0x55813af86d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3c37fe640 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af7c370 0x55813af86d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3c37fe640 1 -- 172.21.15.6:0/718720077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55813af72ca0 con 0x55813af772e0 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3c888e640 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af7c370 0x55813af86d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3c37fe640 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af772e0 0x55813af85d20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80057c0 tx=0x7fc3b8013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b21ba369a30cdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3a37fe640 1 -- 172.21.15.6:0/718720077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8005460 con 0x55813af772e0 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3a37fe640 1 -- 172.21.15.6:0/718720077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fc3b8004020 con 0x55813af772e0 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.264+0000 7fc3cd08f740 1 -- 172.21.15.6:0/718720077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3bc00fa90 con 0x55813af772e0 2024-09-12T00:08:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.265+0000 7fc3a37fe640 1 -- 172.21.15.6:0/718720077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc3b802b050 con 0x55813af772e0 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.265+0000 7fc3cd08f740 10 client.16104 fetch_fsmap learned FSMap version 33 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.265+0000 7fc3cd08f740 1 -- 172.21.15.6:0/718720077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55813aff7330 con 0x55813af772e0 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.265+0000 7fc3a37fe640 1 -- 172.21.15.6:0/718720077 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3bc00fa90 con 0x55813af772e0 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.265+0000 7fc3a37fe640 1 -- 172.21.15.6:0/718720077 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fc3b800f040 con 0x55813af772e0 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.265+0000 7fc3cd08f740 10 client.16104 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.265+0000 7fc3cd08f740 10 client.16104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.265+0000 7fc3cd08f740 20 client.16104 populate_metadata read hostname 'smithi006' 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.265+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55813aff7c30 0x55813affa050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.265+0000 7fc3cd08f740 4 client.16104 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.265+0000 7fc3cd08f740 1 -- 172.21.15.6:0/718720077 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55813aee1d70 con 0x55813aff7c30 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.265+0000 7fc3c888e640 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55813aff7c30 0x55813affa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.266+0000 7fc3c888e640 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55813aff7c30 0x55813affa050 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b227b7c9d28a4253 server_cookie=f6f9440bf1e39ef0 in_seq=0 out_seq=0 2024-09-12T00:08:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.266+0000 7fc3a37fe640 10 client.16104 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3a37fe640 1 -- 172.21.15.6:0/718720077 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55813aee1d70 con 0x55813aff7c30 2024-09-12T00:08:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3a37fe640 10 client.16104 handle_command_reply: tid=0 2024-09-12T00:08:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3cd08f740 1 client.16104 shutdown 2024-09-12T00:08:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3cd08f740 1 -- 172.21.15.6:0/718720077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af772e0 msgr2=0x55813af85d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af772e0 0x55813af85d20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80057c0 tx=0x7fc3b8013830 comp rx=0 tx=0).stop 2024-09-12T00:08:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3cd08f740 1 -- 172.21.15.6:0/718720077 shutdown_connections 2024-09-12T00:08:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55813af7c370 0x55813af86d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55813af772e0 0x55813af85d20 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55813aff7c30 0x55813affa050 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3cd08f740 1 --2- 172.21.15.6:0/718720077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55813af769a0 0x55813af857e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3a37fe640 0 client.16104 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3cd08f740 1 -- 172.21.15.6:0/718720077 >> 172.21.15.6:0/718720077 conn(0x55813af72010 msgr2=0x55813af709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3cd08f740 1 -- 172.21.15.6:0/718720077 shutdown_connections 2024-09-12T00:08:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.283+0000 7fc3cd08f740 1 -- 172.21.15.6:0/718720077 wait complete. 2024-09-12T00:08:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3cd08f740 20 client.16104 trim_cache size 0 max 16384 2024-09-12T00:08:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:08:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:08:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:08:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:08:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/1900740511 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3ac0a2c80 msgr2=0x7fc3ac0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3ca2f1640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3ac0a2c80 0x7fc3ac0a5140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4032ad0 tx=0x7fc3b402a480 comp rx=0 tx=0).stop 2024-09-12T00:08:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/1900740511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3c4074bd0 msgr2=0x7fc3c4199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3ca2f1640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3c4074bd0 0x7fc3c4199ff0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4005940 tx=0x7fc3b40042f0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/1900740511 shutdown_connections 2024-09-12T00:08:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3ca2f1640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fc3ac0a2c80 0x7fc3ac0a5140 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3ca2f1640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3c4109a10 0x7fc3c41a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3ca2f1640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3c40761b0 0x7fc3c419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3ca2f1640 1 --2- 172.21.15.6:0/1900740511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3c4074bd0 0x7fc3c4199ff0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/1900740511 >> 172.21.15.6:0/1900740511 conn(0x7fc3c40fd2e0 msgr2=0x7fc3c41059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/1900740511 shutdown_connections 2024-09-12T00:08:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:39.284+0000 7fc3ca2f1640 1 -- 172.21.15.6:0/1900740511 wait complete. 2024-09-12T00:08:40.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:40 smithi134 ceph-mon[34893]: pgmap v639: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:08:40.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:40 smithi039 ceph-mon[34543]: pgmap v639: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:08:40.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:40 smithi006 ceph-mon[30947]: pgmap v639: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-09-12T00:08:42.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:42 smithi134 ceph-mon[34893]: pgmap v640: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-12T00:08:42.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:42 smithi039 ceph-mon[34543]: pgmap v640: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-12T00:08:42.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:42 smithi006 ceph-mon[30947]: pgmap v640: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-12T00:08:44.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:44 smithi134 ceph-mon[34893]: pgmap v641: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:08:44.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:44 smithi039 ceph-mon[34543]: pgmap v641: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:08:44.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:44 smithi006 ceph-mon[30947]: pgmap v641: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 23 op/s 2024-09-12T00:08:46.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:46 smithi134 ceph-mon[34893]: pgmap v642: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:08:46.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:46 smithi039 ceph-mon[34543]: pgmap v642: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:08:46.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:46 smithi006 ceph-mon[30947]: pgmap v642: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 25 op/s 2024-09-12T00:08:48.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:48 smithi134 ceph-mon[34893]: pgmap v643: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 MiB/s wr, 28 op/s 2024-09-12T00:08:48.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:48 smithi039 ceph-mon[34543]: pgmap v643: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 MiB/s wr, 28 op/s 2024-09-12T00:08:48.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:48 smithi006 ceph-mon[30947]: pgmap v643: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 MiB/s wr, 28 op/s 2024-09-12T00:08:48.719 INFO:tasks.workunit.client.0.smithi006.stdout:fs setup took 485 secs 2024-09-12T00:08:49.234 INFO:tasks.workunit.client.0.smithi006.stdout:Syncing()...0 sec 2024-09-12T00:08:49.235 INFO:tasks.workunit.client.0.smithi006.stdout:Starting Actual Benchmark At: Thu Sep 12 00:08:49 2024 2024-09-12T00:08:49.235 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:08:50.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:50 smithi039 ceph-mon[34543]: pgmap v644: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:08:50.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:50 smithi006 ceph-mon[30947]: pgmap v644: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:08:50.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:50 smithi134 ceph-mon[34893]: pgmap v644: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-09-12T00:08:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.469+0000 7f77b898d640 1 -- 172.21.15.6:0/2560084192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b4101c30 msgr2=0x7f77b41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.469+0000 7f77b898d640 1 --2- 172.21.15.6:0/2560084192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b4101c30 0x7f77b41020b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009900 tx=0x7f77a802a410 comp rx=0 tx=0).stop 2024-09-12T00:08:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.470+0000 7f77b898d640 1 -- 172.21.15.6:0/2560084192 shutdown_connections 2024-09-12T00:08:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.470+0000 7f77b898d640 1 --2- 172.21.15.6:0/2560084192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77b41025f0 0x7f77b4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.470+0000 7f77b898d640 1 --2- 172.21.15.6:0/2560084192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b4101c30 0x7f77b41020b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.470+0000 7f77b898d640 1 --2- 172.21.15.6:0/2560084192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77b4100a40 0x7f77b4100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.470+0000 7f77b898d640 1 -- 172.21.15.6:0/2560084192 >> 172.21.15.6:0/2560084192 conn(0x7f77b40fc1c0 msgr2=0x7f77b40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.470+0000 7f77b898d640 1 -- 172.21.15.6:0/2560084192 shutdown_connections 2024-09-12T00:08:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.470+0000 7f77b898d640 1 -- 172.21.15.6:0/2560084192 wait complete. 2024-09-12T00:08:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.471+0000 7f77b898d640 1 Processor -- start 2024-09-12T00:08:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.471+0000 7f77b898d640 1 -- start start 2024-09-12T00:08:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.471+0000 7f77b898d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77b4100a40 0x7f77b406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.471+0000 7f77b898d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77b4101c30 0x7f77b406f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.471+0000 7f77b898d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b41025f0 0x7f77b4072730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.471+0000 7f77b1d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77b4101c30 0x7f77b406f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.471+0000 7f77b1d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77b4101c30 0x7f77b406f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:56628/0 (socket says 172.21.15.6:56628) 2024-09-12T00:08:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.471+0000 7f77b1d9b640 1 -- 172.21.15.6:0/2548028196 learned_addr learned my addr 172.21.15.6:0/2548028196 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.471+0000 7f77b898d640 1 -- 172.21.15.6:0/2548028196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f77b410b530 con 0x7f77b41025f0 2024-09-12T00:08:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.471+0000 7f77b898d640 1 -- 172.21.15.6:0/2548028196 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f77b406a900 con 0x7f77b4101c30 2024-09-12T00:08:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.471+0000 7f77b898d640 1 -- 172.21.15.6:0/2548028196 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f77b410b6b0 con 0x7f77b4100a40 2024-09-12T00:08:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.471+0000 7f77b259c640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77b4100a40 0x7f77b406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.472+0000 7f77b2d9d640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b41025f0 0x7f77b4072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.473+0000 7f77b259c640 1 -- 172.21.15.6:0/2548028196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77b4101c30 msgr2=0x7f77b406f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.473+0000 7f77b259c640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77b4101c30 0x7f77b406f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.473+0000 7f77b259c640 1 -- 172.21.15.6:0/2548028196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b41025f0 msgr2=0x7f77b4072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.473+0000 7f77b259c640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b41025f0 0x7f77b4072730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.473+0000 7f77b259c640 1 -- 172.21.15.6:0/2548028196 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b4072da0 con 0x7f77b4100a40 2024-09-12T00:08:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.474+0000 7f77b259c640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77b4100a40 0x7f77b406f1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77a400d6a0 tx=0x7f77a400db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.474+0000 7f77a37fe640 1 -- 172.21.15.6:0/2548028196 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4017070 con 0x7f77b4100a40 2024-09-12T00:08:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.474+0000 7f77a37fe640 1 -- 172.21.15.6:0/2548028196 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77a4009cd0 con 0x7f77b4100a40 2024-09-12T00:08:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.474+0000 7f77a37fe640 1 -- 172.21.15.6:0/2548028196 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4003c50 con 0x7f77b4100a40 2024-09-12T00:08:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.475+0000 7f77b898d640 1 -- 172.21.15.6:0/2548028196 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b4073090 con 0x7f77b4100a40 2024-09-12T00:08:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.475+0000 7f77b898d640 1 -- 172.21.15.6:0/2548028196 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b40734d0 con 0x7f77b4100a40 2024-09-12T00:08:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.481+0000 7f77a37fe640 1 -- 172.21.15.6:0/2548028196 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f77a4010460 con 0x7f77b4100a40 2024-09-12T00:08:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.482+0000 7f77bb804740 1 Processor -- start 2024-09-12T00:08:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.482+0000 7f77bb804740 1 -- start start 2024-09-12T00:08:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77bb804740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c979a0 0x55e244c97da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77bb804740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c982e0 0x55e244c9cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77bb804740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c9d370 0x55e244c9f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77bb804740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e244bfb2f0 con 0x55e244c9d370 2024-09-12T00:08:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77bb804740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e244ba3270 con 0x55e244c979a0 2024-09-12T00:08:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77bb804740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e244bf72b0 con 0x55e244c982e0 2024-09-12T00:08:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77b1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c9d370 0x55e244c9f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77b2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c979a0 0x55e244c97da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77a37fe640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f779c0a2d50 0x7f779c0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77b1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c9d370 0x55e244c9f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52626/0 (socket says 172.21.15.6:52626) 2024-09-12T00:08:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77b1d9b640 1 -- 172.21.15.6:0/3666078311 learned_addr learned my addr 172.21.15.6:0/3666078311 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77b2d9d640 1 --2- 172.21.15.6:0/3666078311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c979a0 0x55e244c97da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:56640/0 (socket says 172.21.15.6:56640) 2024-09-12T00:08:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77a37fe640 1 -- 172.21.15.6:0/2548028196 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f77a40cf0a0 con 0x7f77b4100a40 2024-09-12T00:08:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.483+0000 7f77b259c640 1 --2- 172.21.15.6:0/3666078311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c982e0 0x55e244c9cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.484+0000 7f77b1d9b640 1 -- 172.21.15.6:0/3666078311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c982e0 msgr2=0x55e244c9cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.484+0000 7f77b1d9b640 1 --2- 172.21.15.6:0/3666078311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c982e0 0x55e244c9cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.484+0000 7f77b1d9b640 1 -- 172.21.15.6:0/3666078311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c979a0 msgr2=0x55e244c97da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.484+0000 7f77b1d9b640 1 --2- 172.21.15.6:0/3666078311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c979a0 0x55e244c97da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.484+0000 7f77b1d9b640 1 -- 172.21.15.6:0/3666078311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e244ba2340 con 0x55e244c9d370 2024-09-12T00:08:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.484+0000 7f77b2d9d640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f779c0a2d50 0x7f779c0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.484+0000 7f77b1d9b640 1 --2- 172.21.15.6:0/3666078311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c9d370 0x55e244c9f830 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f77a800b1f0 tx=0x7f77a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aedf6d14e185366 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.485+0000 7f77b2d9d640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f779c0a2d50 0x7f779c0a5210 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f77ac016fd0 tx=0x7f77ac004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.485+0000 7f77a0ff9640 1 -- 172.21.15.6:0/3666078311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a8051070 con 0x55e244c9d370 2024-09-12T00:08:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.485+0000 7f77a0ff9640 1 -- 172.21.15.6:0/3666078311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77a80044c0 con 0x55e244c9d370 2024-09-12T00:08:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.485+0000 7f77a0ff9640 1 -- 172.21.15.6:0/3666078311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a8035040 con 0x55e244c9d370 2024-09-12T00:08:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.486+0000 7f77bb804740 1 -- 172.21.15.6:0/3666078311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c9d370 msgr2=0x55e244c9f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.486+0000 7f77bb804740 1 --2- 172.21.15.6:0/3666078311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c9d370 0x55e244c9f830 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f77a800b1f0 tx=0x7f77a8000bc0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.486+0000 7f77bb804740 1 -- 172.21.15.6:0/3666078311 shutdown_connections 2024-09-12T00:08:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.487+0000 7f77bb804740 1 --2- 172.21.15.6:0/3666078311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c9d370 0x55e244c9f830 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.487+0000 7f77bb804740 1 --2- 172.21.15.6:0/3666078311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c982e0 0x55e244c9cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.487+0000 7f77bb804740 1 --2- 172.21.15.6:0/3666078311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c979a0 0x55e244c97da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.487+0000 7f77bb804740 1 -- 172.21.15.6:0/3666078311 >> 172.21.15.6:0/3666078311 conn(0x55e244c93010 msgr2=0x55e244c93410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.487+0000 7f77bb804740 1 -- 172.21.15.6:0/3666078311 shutdown_connections 2024-09-12T00:08:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.487+0000 7f77bb804740 1 -- 172.21.15.6:0/3666078311 wait complete. 2024-09-12T00:08:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.488+0000 7f77bb804740 1 -- start start 2024-09-12T00:08:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.488+0000 7f77bb804740 1 Processor -- start 2024-09-12T00:08:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.489+0000 7f77bb804740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c979a0 0x55e244ca1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.489+0000 7f77bb804740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c982e0 0x55e244ca20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.489+0000 7f77bb804740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c9d370 0x55e244ca90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.489+0000 7f77b259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c979a0 0x55e244ca1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.489+0000 7f77b1d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c982e0 0x55e244ca20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.489+0000 7f77b1d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c982e0 0x55e244ca20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:56650/0 (socket says 172.21.15.6:56650) 2024-09-12T00:08:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.489+0000 7f77b1d9b640 1 -- 172.21.15.6:0/2857303562 learned_addr learned my addr 172.21.15.6:0/2857303562 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.490+0000 7f77bb804740 1 -- 172.21.15.6:0/2857303562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e244ca02e0 con 0x55e244c9d370 2024-09-12T00:08:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.490+0000 7f77bb804740 1 -- 172.21.15.6:0/2857303562 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e244b84290 con 0x55e244c982e0 2024-09-12T00:08:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.490+0000 7f77bb804740 1 -- 172.21.15.6:0/2857303562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e244ca0460 con 0x55e244c979a0 2024-09-12T00:08:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.490+0000 7f77b2d9d640 1 --2- 172.21.15.6:0/2857303562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c9d370 0x55e244ca90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.490+0000 7f77bb804740 10 client.0 _ll_register_callbacks cb 0x55e244bb5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.490+0000 7f77b1d9b640 1 -- 172.21.15.6:0/2857303562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c979a0 msgr2=0x55e244ca1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.490+0000 7f77b1d9b640 1 --2- 172.21.15.6:0/2857303562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c979a0 0x55e244ca1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.490+0000 7f77b1d9b640 1 -- 172.21.15.6:0/2857303562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c9d370 msgr2=0x55e244ca90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.490+0000 7f77b1d9b640 1 --2- 172.21.15.6:0/2857303562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c9d370 0x55e244ca90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.490+0000 7f77b1d9b640 1 -- 172.21.15.6:0/2857303562 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e24490e210 con 0x55e244c982e0 2024-09-12T00:08:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.491+0000 7f77b1d9b640 1 --2- 172.21.15.6:0/2857303562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c982e0 0x55e244ca20a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009850 tx=0x7f77a8004c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41fc00e1074cae52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.492+0000 7f7799ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:08:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.492+0000 7f7799ffb640 1 -- 172.21.15.6:0/2857303562 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a805e070 con 0x55e244c982e0 2024-09-12T00:08:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.492+0000 7f7799ffb640 1 -- 172.21.15.6:0/2857303562 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f77a8005460 con 0x55e244c982e0 2024-09-12T00:08:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.492+0000 7f77bb804740 1 -- 172.21.15.6:0/2857303562 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e244c08a20 con 0x55e244c982e0 2024-09-12T00:08:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.493+0000 7f7799ffb640 1 -- 172.21.15.6:0/2857303562 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f77a8068050 con 0x55e244c982e0 2024-09-12T00:08:52.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.493+0000 7f77bb804740 10 client.25694 fetch_fsmap learned FSMap version 33 2024-09-12T00:08:52.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.493+0000 7f77bb804740 1 -- 172.21.15.6:0/2857303562 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e2449da620 con 0x55e244c982e0 2024-09-12T00:08:52.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.494+0000 7f7799ffb640 1 -- 172.21.15.6:0/2857303562 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55e244c08a20 con 0x55e244c982e0 2024-09-12T00:08:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.494+0000 7f7799ffb640 1 -- 172.21.15.6:0/2857303562 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f77a80316d0 con 0x55e244c982e0 2024-09-12T00:08:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.495+0000 7f77bb804740 10 client.25694 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:08:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.495+0000 7f77bb804740 10 client.25694 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:08:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.495+0000 7f77bb804740 20 client.25694 populate_metadata read hostname 'smithi006' 2024-09-12T00:08:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.495+0000 7f77bb804740 1 --2- 172.21.15.6:0/2857303562 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e244cad3e0 0x55e244caf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.495+0000 7f77bb804740 4 client.25694 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.495+0000 7f77bb804740 1 -- 172.21.15.6:0/2857303562 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e244c02d70 con 0x55e244cad3e0 2024-09-12T00:08:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.496+0000 7f77b259c640 1 --2- 172.21.15.6:0/2857303562 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e244cad3e0 0x55e244caf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.497+0000 7f77b259c640 1 --2- 172.21.15.6:0/2857303562 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e244cad3e0 0x55e244caf7d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=538e97f71efcaeb4 server_cookie=46264dc2e0de5046 in_seq=0 out_seq=0 2024-09-12T00:08:52.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.497+0000 7f7799ffb640 10 client.25694 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.498+0000 7f7799ffb640 1 -- 172.21.15.6:0/2857303562 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e244c02d70 con 0x55e244cad3e0 2024-09-12T00:08:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.498+0000 7f7799ffb640 10 client.25694 handle_command_reply: tid=0 2024-09-12T00:08:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.498+0000 7f77bb804740 1 client.25694 shutdown 2024-09-12T00:08:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.498+0000 7f77bb804740 1 -- 172.21.15.6:0/2857303562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c982e0 msgr2=0x55e244ca20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.498+0000 7f77bb804740 1 --2- 172.21.15.6:0/2857303562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c982e0 0x55e244ca20a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009850 tx=0x7f77a8004c20 comp rx=0 tx=0).stop 2024-09-12T00:08:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.499+0000 7f77bb804740 1 -- 172.21.15.6:0/2857303562 shutdown_connections 2024-09-12T00:08:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.499+0000 7f77bb804740 1 --2- 172.21.15.6:0/2857303562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c9d370 0x55e244ca90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.499+0000 7f77bb804740 1 --2- 172.21.15.6:0/2857303562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c982e0 0x55e244ca20a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.499+0000 7f77bb804740 1 --2- 172.21.15.6:0/2857303562 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e244cad3e0 0x55e244caf7d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.499+0000 7f77bb804740 1 --2- 172.21.15.6:0/2857303562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c979a0 0x55e244ca1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.499+0000 7f77bb804740 1 -- 172.21.15.6:0/2857303562 >> 172.21.15.6:0/2857303562 conn(0x55e244c93010 msgr2=0x55e244c94820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:52.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.499+0000 7f7799ffb640 0 client.25694 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:52.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.500+0000 7f77bb804740 1 -- 172.21.15.6:0/2857303562 shutdown_connections 2024-09-12T00:08:52.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.500+0000 7f77bb804740 1 -- 172.21.15.6:0/2857303562 wait complete. 2024-09-12T00:08:52.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.501+0000 7f77bb804740 20 client.25694 trim_cache size 0 max 16384 2024-09-12T00:08:52.535 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.534+0000 7f77bb804740 1 Processor -- start 2024-09-12T00:08:52.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.535+0000 7f77bb804740 1 -- start start 2024-09-12T00:08:52.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.535+0000 7f77bb804740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c93010 0x55e244c920b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.535+0000 7f77bb804740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c979a0 0x55e244ca90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.535+0000 7f77bb804740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c982e0 0x55e244c94400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.535+0000 7f77bb804740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f77b41b0ef0 con 0x55e244c979a0 2024-09-12T00:08:52.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.535+0000 7f77bb804740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f77b41b2a30 con 0x55e244c93010 2024-09-12T00:08:52.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.535+0000 7f77bb804740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f77b41b15c0 con 0x55e244c982e0 2024-09-12T00:08:52.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.537+0000 7f77b2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c982e0 0x55e244c94400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.537+0000 7f77b2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c982e0 0x55e244c94400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:58866/0 (socket says 172.21.15.6:58866) 2024-09-12T00:08:52.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.537+0000 7f77b2d9d640 1 -- 172.21.15.6:0/515280685 learned_addr learned my addr 172.21.15.6:0/515280685 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.537+0000 7f77b259c640 1 --2- 172.21.15.6:0/515280685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c93010 0x55e244c920b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.537+0000 7f77b2d9d640 1 -- 172.21.15.6:0/515280685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c93010 msgr2=0x55e244c920b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.537+0000 7f77b2d9d640 1 --2- 172.21.15.6:0/515280685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c93010 0x55e244c920b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.537+0000 7f77b2d9d640 1 -- 172.21.15.6:0/515280685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c979a0 msgr2=0x55e244ca90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.537+0000 7f77b2d9d640 1 --2- 172.21.15.6:0/515280685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c979a0 0x55e244ca90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.537+0000 7f77b2d9d640 1 -- 172.21.15.6:0/515280685 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e244c8e2d0 con 0x55e244c982e0 2024-09-12T00:08:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.540+0000 7f77b2d9d640 1 --2- 172.21.15.6:0/515280685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c982e0 0x55e244c94400 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0048b0 tx=0x7f77ac009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d874be704f4eec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.540+0000 7f779bfff640 1 -- 172.21.15.6:0/515280685 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac01f040 con 0x55e244c982e0 2024-09-12T00:08:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.540+0000 7f779bfff640 1 -- 172.21.15.6:0/515280685 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77ac02a070 con 0x55e244c982e0 2024-09-12T00:08:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.540+0000 7f779bfff640 1 -- 172.21.15.6:0/515280685 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac0129a0 con 0x55e244c982e0 2024-09-12T00:08:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.541+0000 7f77bb804740 1 -- 172.21.15.6:0/515280685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c982e0 msgr2=0x55e244c94400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.541+0000 7f77bb804740 1 --2- 172.21.15.6:0/515280685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c982e0 0x55e244c94400 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0048b0 tx=0x7f77ac009920 comp rx=0 tx=0).stop 2024-09-12T00:08:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.541+0000 7f77bb804740 1 -- 172.21.15.6:0/515280685 shutdown_connections 2024-09-12T00:08:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.541+0000 7f77bb804740 1 --2- 172.21.15.6:0/515280685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c982e0 0x55e244c94400 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.541+0000 7f77bb804740 1 --2- 172.21.15.6:0/515280685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c979a0 0x55e244ca90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.541+0000 7f77bb804740 1 --2- 172.21.15.6:0/515280685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c93010 0x55e244c920b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.541+0000 7f77bb804740 1 -- 172.21.15.6:0/515280685 >> 172.21.15.6:0/515280685 conn(0x55e244c9ce90 msgr2=0x55e244c919a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:52.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.542+0000 7f77bb804740 1 -- 172.21.15.6:0/515280685 shutdown_connections 2024-09-12T00:08:52.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.542+0000 7f77bb804740 1 -- 172.21.15.6:0/515280685 wait complete. 2024-09-12T00:08:52.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.542+0000 7f77bb804740 1 -- start start 2024-09-12T00:08:52.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.543+0000 7f77bb804740 1 Processor -- start 2024-09-12T00:08:52.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.544+0000 7f77bb804740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c93010 0x55e244ca5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.544+0000 7f77bb804740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c979a0 0x55e244ca6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.544+0000 7f77b259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c93010 0x55e244ca5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.544+0000 7f77b259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c93010 0x55e244ca5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:58876/0 (socket says 172.21.15.6:58876) 2024-09-12T00:08:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.544+0000 7f77b259c640 1 -- 172.21.15.6:0/3744108674 learned_addr learned my addr 172.21.15.6:0/3744108674 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:08:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.544+0000 7f77bb804740 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c982e0 0x55e244d15eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.545+0000 7f77b1d9b640 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c979a0 0x55e244ca6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.545+0000 7f77bb804740 1 -- 172.21.15.6:0/3744108674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f77b41b2360 con 0x55e244c982e0 2024-09-12T00:08:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.545+0000 7f77bb804740 1 -- 172.21.15.6:0/3744108674 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f77b41b1c90 con 0x55e244c979a0 2024-09-12T00:08:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.545+0000 7f77bb804740 1 -- 172.21.15.6:0/3744108674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f77b41aeed0 con 0x55e244c93010 2024-09-12T00:08:52.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:52 smithi039 ceph-mon[34543]: pgmap v645: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 149 op/s 2024-09-12T00:08:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.545+0000 7f77bb804740 10 client.0 _ll_register_callbacks cb 0x7f77ac016b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.546+0000 7f77b259c640 1 -- 172.21.15.6:0/3744108674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c979a0 msgr2=0x55e244ca6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.546+0000 7f77b259c640 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c979a0 0x55e244ca6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.546+0000 7f77b259c640 1 -- 172.21.15.6:0/3744108674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c982e0 msgr2=0x55e244d15eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.546+0000 7f77b259c640 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c982e0 0x55e244d15eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.546+0000 7f77b259c640 1 -- 172.21.15.6:0/3744108674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e244ca6890 con 0x55e244c93010 2024-09-12T00:08:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.546+0000 7f77b259c640 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c93010 0x55e244ca5d40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77a4003740 tx=0x7f77a40035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12f26f46890592f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.546+0000 7f7799ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:08:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.546+0000 7f7799ffb640 1 -- 172.21.15.6:0/3744108674 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a40b9060 con 0x55e244c93010 2024-09-12T00:08:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.546+0000 7f77bb804740 1 -- 172.21.15.6:0/3744108674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77ac02a070 con 0x55e244c93010 2024-09-12T00:08:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.546+0000 7f7799ffb640 1 -- 172.21.15.6:0/3744108674 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f77a4099860 con 0x55e244c93010 2024-09-12T00:08:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.547+0000 7f7799ffb640 1 -- 172.21.15.6:0/3744108674 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f77a4020040 con 0x55e244c93010 2024-09-12T00:08:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.547+0000 7f77bb804740 10 client.25711 fetch_fsmap learned FSMap version 33 2024-09-12T00:08:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.547+0000 7f77bb804740 1 -- 172.21.15.6:0/3744108674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e244d17540 con 0x55e244c93010 2024-09-12T00:08:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.548+0000 7f7799ffb640 1 -- 172.21.15.6:0/3744108674 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77ac02a070 con 0x55e244c93010 2024-09-12T00:08:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.548+0000 7f7799ffb640 1 -- 172.21.15.6:0/3744108674 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f77a40a3c90 con 0x55e244c93010 2024-09-12T00:08:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.548+0000 7f77bb804740 10 client.25711 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:08:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.548+0000 7f77bb804740 10 client.25711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:08:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.548+0000 7f77bb804740 20 client.25711 populate_metadata read hostname 'smithi006' 2024-09-12T00:08:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.548+0000 7f77bb804740 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e244c9d370 0x55e244d19f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.548+0000 7f77bb804740 4 client.25711 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:08:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.548+0000 7f77bb804740 1 -- 172.21.15.6:0/3744108674 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e244b7f900 con 0x55e244c9d370 2024-09-12T00:08:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.548+0000 7f77b1d9b640 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e244c9d370 0x55e244d19f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.549+0000 7f7799ffb640 10 client.25711 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.549+0000 7f77b1d9b640 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e244c9d370 0x55e244d19f80 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d66a82167b60d95 server_cookie=2f30d560a14ec319 in_seq=0 out_seq=0 2024-09-12T00:08:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.599+0000 7f7799ffb640 1 -- 172.21.15.6:0/3744108674 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e244b7f900 con 0x55e244c9d370 2024-09-12T00:08:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.599+0000 7f7799ffb640 10 client.25711 handle_command_reply: tid=0 2024-09-12T00:08:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.600+0000 7f77bb804740 1 client.25711 shutdown 2024-09-12T00:08:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.602+0000 7f77bb804740 1 -- 172.21.15.6:0/3744108674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c93010 msgr2=0x55e244ca5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.602+0000 7f77bb804740 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c93010 0x55e244ca5d40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77a4003740 tx=0x7f77a40035f0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.603+0000 7f77bb804740 1 -- 172.21.15.6:0/3744108674 shutdown_connections 2024-09-12T00:08:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.603+0000 7f77bb804740 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e244c982e0 0x55e244d15eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.603+0000 7f77bb804740 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e244c979a0 0x55e244ca6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.603+0000 7f77bb804740 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55e244c9d370 0x55e244d19f80 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.603+0000 7f77bb804740 1 --2- 172.21.15.6:0/3744108674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e244c93010 0x55e244ca5d40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.603+0000 7f77bb804740 1 -- 172.21.15.6:0/3744108674 >> 172.21.15.6:0/3744108674 conn(0x55e244c9ce90 msgr2=0x55e244c921c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.606+0000 7f7799ffb640 0 client.25711 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:08:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.606+0000 7f77bb804740 1 -- 172.21.15.6:0/3744108674 shutdown_connections 2024-09-12T00:08:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.606+0000 7f77bb804740 1 -- 172.21.15.6:0/3744108674 wait complete. 2024-09-12T00:08:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.606+0000 7f77bb804740 20 client.25711 trim_cache size 0 max 16384 2024-09-12T00:08:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:08:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:08:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:08:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:08:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.608+0000 7f77b898d640 1 -- 172.21.15.6:0/2548028196 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f779c0a2d50 msgr2=0x7f779c0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.608+0000 7f77b898d640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f779c0a2d50 0x7f779c0a5210 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f77ac016fd0 tx=0x7f77ac004ab0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.608+0000 7f77b898d640 1 -- 172.21.15.6:0/2548028196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77b4100a40 msgr2=0x7f77b406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.608+0000 7f77b898d640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77b4100a40 0x7f77b406f1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77a400d6a0 tx=0x7f77a400db60 comp rx=0 tx=0).stop 2024-09-12T00:08:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.608+0000 7f77b898d640 1 -- 172.21.15.6:0/2548028196 shutdown_connections 2024-09-12T00:08:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.608+0000 7f77b898d640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f779c0a2d50 0x7f779c0a5210 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.608+0000 7f77b898d640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b41025f0 0x7f77b4072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.609+0000 7f77b898d640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77b4101c30 0x7f77b406f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.609+0000 7f77b898d640 1 --2- 172.21.15.6:0/2548028196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77b4100a40 0x7f77b406f1a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.609+0000 7f77b898d640 1 -- 172.21.15.6:0/2548028196 >> 172.21.15.6:0/2548028196 conn(0x7f77b40fc1c0 msgr2=0x7f77b40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.611+0000 7f77b898d640 1 -- 172.21.15.6:0/2548028196 shutdown_connections 2024-09-12T00:08:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:08:52.611+0000 7f77b898d640 1 -- 172.21.15.6:0/2548028196 wait complete. 2024-09-12T00:08:52.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:52 smithi006 ceph-mon[30947]: pgmap v645: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 149 op/s 2024-09-12T00:08:52.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:52 smithi134 ceph-mon[34893]: pgmap v645: 129 pgs: 129 active+clean; 12 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 149 op/s 2024-09-12T00:08:54.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:54 smithi039 ceph-mon[34543]: pgmap v646: 129 pgs: 129 active+clean; 13 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 510 op/s 2024-09-12T00:08:54.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:54 smithi006 ceph-mon[30947]: pgmap v646: 129 pgs: 129 active+clean; 13 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 510 op/s 2024-09-12T00:08:54.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:54 smithi134 ceph-mon[34893]: pgmap v646: 129 pgs: 129 active+clean; 13 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 510 op/s 2024-09-12T00:08:56.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:56 smithi039 ceph-mon[34543]: pgmap v647: 129 pgs: 129 active+clean; 13 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 1.16k op/s 2024-09-12T00:08:56.621 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:56 smithi006 ceph-mon[30947]: pgmap v647: 129 pgs: 129 active+clean; 13 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 1.16k op/s 2024-09-12T00:08:56.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:56 smithi134 ceph-mon[34893]: pgmap v647: 129 pgs: 129 active+clean; 13 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 1.16k op/s 2024-09-12T00:08:58.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:08:58 smithi039 ceph-mon[34543]: pgmap v648: 129 pgs: 129 active+clean; 13 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 MiB/s wr, 2.11k op/s 2024-09-12T00:08:58.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:08:58 smithi006 ceph-mon[30947]: pgmap v648: 129 pgs: 129 active+clean; 13 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 MiB/s wr, 2.11k op/s 2024-09-12T00:08:58.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:08:58 smithi134 ceph-mon[34893]: pgmap v648: 129 pgs: 129 active+clean; 13 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 MiB/s wr, 2.11k op/s 2024-09-12T00:09:00.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:00 smithi039 ceph-mon[34543]: pgmap v649: 129 pgs: 129 active+clean; 13 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 3.03k op/s 2024-09-12T00:09:00.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:00 smithi006 ceph-mon[30947]: pgmap v649: 129 pgs: 129 active+clean; 13 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 3.03k op/s 2024-09-12T00:09:00.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:00 smithi134 ceph-mon[34893]: pgmap v649: 129 pgs: 129 active+clean; 13 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 3.03k op/s 2024-09-12T00:09:02.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:02 smithi039 ceph-mon[34543]: pgmap v650: 129 pgs: 129 active+clean; 13 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 3.63k op/s 2024-09-12T00:09:02.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:02 smithi006 ceph-mon[30947]: pgmap v650: 129 pgs: 129 active+clean; 13 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 3.63k op/s 2024-09-12T00:09:02.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:02 smithi134 ceph-mon[34893]: pgmap v650: 129 pgs: 129 active+clean; 13 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 3.63k op/s 2024-09-12T00:09:04.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:04 smithi039 ceph-mon[34543]: pgmap v651: 129 pgs: 129 active+clean; 13 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 4.30k op/s 2024-09-12T00:09:04.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:04 smithi006 ceph-mon[30947]: pgmap v651: 129 pgs: 129 active+clean; 13 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 4.30k op/s 2024-09-12T00:09:04.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:04 smithi134 ceph-mon[34893]: pgmap v651: 129 pgs: 129 active+clean; 13 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 4.30k op/s 2024-09-12T00:09:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.839+0000 7f2c509c6640 1 -- 172.21.15.6:0/3800651846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4c076230 msgr2=0x7f2c4c074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.839+0000 7f2c509c6640 1 --2- 172.21.15.6:0/3800651846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4c076230 0x7f2c4c074680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009860 tx=0x7f2c3402a340 comp rx=0 tx=0).stop 2024-09-12T00:09:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.840+0000 7f2c509c6640 1 -- 172.21.15.6:0/3800651846 shutdown_connections 2024-09-12T00:09:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.840+0000 7f2c509c6640 1 --2- 172.21.15.6:0/3800651846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c4c10df90 0x7f2c4c110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.840+0000 7f2c509c6640 1 --2- 172.21.15.6:0/3800651846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c4c074c50 0x7f2c4c0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.840+0000 7f2c509c6640 1 --2- 172.21.15.6:0/3800651846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4c076230 0x7f2c4c074680 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009860 tx=0x7f2c3402a340 comp rx=0 tx=0).stop 2024-09-12T00:09:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.840+0000 7f2c509c6640 1 -- 172.21.15.6:0/3800651846 >> 172.21.15.6:0/3800651846 conn(0x7f2c4c0fd160 msgr2=0x7f2c4c0ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.847+0000 7f2c509c6640 1 -- 172.21.15.6:0/3800651846 shutdown_connections 2024-09-12T00:09:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.850+0000 7f2c509c6640 1 -- 172.21.15.6:0/3800651846 wait complete. 2024-09-12T00:09:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.851+0000 7f2c509c6640 1 Processor -- start 2024-09-12T00:09:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.851+0000 7f2c509c6640 1 -- start start 2024-09-12T00:09:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.851+0000 7f2c509c6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c4c074c50 0x7f2c4c10d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.851+0000 7f2c509c6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c4c10df90 0x7f2c4c10d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.851+0000 7f2c509c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4c10ba70 0x7f2c4c10bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.851+0000 7f2c509c6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c106080 con 0x7f2c4c074c50 2024-09-12T00:09:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.851+0000 7f2c509c6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c105f00 con 0x7f2c4c10df90 2024-09-12T00:09:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.851+0000 7f2c509c6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c106200 con 0x7f2c4c10ba70 2024-09-12T00:09:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.852+0000 7f2c4ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4c10ba70 0x7f2c4c10bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.852+0000 7f2c4ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4c10ba70 0x7f2c4c10bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:39756/0 (socket says 172.21.15.6:39756) 2024-09-12T00:09:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.852+0000 7f2c4ad9d640 1 -- 172.21.15.6:0/3346407997 learned_addr learned my addr 172.21.15.6:0/3346407997 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.852+0000 7f2c49d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c4c10df90 0x7f2c4c10d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.853+0000 7f2c4a59c640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c4c074c50 0x7f2c4c10d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.853+0000 7f2c4ad9d640 1 -- 172.21.15.6:0/3346407997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c4c10df90 msgr2=0x7f2c4c10d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.853+0000 7f2c4ad9d640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c4c10df90 0x7f2c4c10d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.853+0000 7f2c4ad9d640 1 -- 172.21.15.6:0/3346407997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c4c074c50 msgr2=0x7f2c4c10d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.853+0000 7f2c4ad9d640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c4c074c50 0x7f2c4c10d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.853+0000 7f2c4ad9d640 1 -- 172.21.15.6:0/3346407997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4c10c750 con 0x7f2c4c10ba70 2024-09-12T00:09:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.854+0000 7f2c4ad9d640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4c10ba70 0x7f2c4c10bf20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400e970 tx=0x7f2c4400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.854+0000 7f2c437fe640 1 -- 172.21.15.6:0/3346407997 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4400ccc0 con 0x7f2c4c10ba70 2024-09-12T00:09:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.855+0000 7f2c509c6640 1 -- 172.21.15.6:0/3346407997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4c06bc10 con 0x7f2c4c10ba70 2024-09-12T00:09:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.855+0000 7f2c509c6640 1 -- 172.21.15.6:0/3346407997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4c06c160 con 0x7f2c4c10ba70 2024-09-12T00:09:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.855+0000 7f2c437fe640 1 -- 172.21.15.6:0/3346407997 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c440054d0 con 0x7f2c4c10ba70 2024-09-12T00:09:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.855+0000 7f2c437fe640 1 -- 172.21.15.6:0/3346407997 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c44010430 con 0x7f2c4c10ba70 2024-09-12T00:09:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.860+0000 7f2c53837740 1 Processor -- start 2024-09-12T00:09:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.862+0000 7f2c53837740 1 -- start start 2024-09-12T00:09:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.862+0000 7f2c53837740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 0x560db2b4af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.862+0000 7f2c53837740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4b4b0 0x560db2b4ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.862+0000 7f2c53837740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b50540 0x560db2b52a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.862+0000 7f2c53837740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560db2aae2f0 con 0x560db2b50540 2024-09-12T00:09:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.862+0000 7f2c53837740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560db2a56270 con 0x560db2b4ab70 2024-09-12T00:09:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.862+0000 7f2c53837740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560db2aaa2b0 con 0x560db2b4b4b0 2024-09-12T00:09:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.862+0000 7f2c49d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 0x560db2b4af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.862+0000 7f2c49d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 0x560db2b4af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:49922/0 (socket says 172.21.15.6:49922) 2024-09-12T00:09:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.862+0000 7f2c49d9b640 1 -- 172.21.15.6:0/2574954059 learned_addr learned my addr 172.21.15.6:0/2574954059 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.863+0000 7f2c437fe640 1 -- 172.21.15.6:0/3346407997 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f2c440105d0 con 0x7f2c4c10ba70 2024-09-12T00:09:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.863+0000 7f2c49d9b640 1 -- 172.21.15.6:0/2574954059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4b4b0 msgr2=0x560db2b4ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.863+0000 7f2c49d9b640 1 --2- 172.21.15.6:0/2574954059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4b4b0 0x560db2b4ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.863+0000 7f2c49d9b640 1 -- 172.21.15.6:0/2574954059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b50540 msgr2=0x560db2b52a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.863+0000 7f2c49d9b640 1 --2- 172.21.15.6:0/2574954059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b50540 0x560db2b52a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.863+0000 7f2c49d9b640 1 -- 172.21.15.6:0/2574954059 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db2a55340 con 0x560db2b4ab70 2024-09-12T00:09:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.863+0000 7f2c49d9b640 1 --2- 172.21.15.6:0/2574954059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 0x560db2b4af70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00b4f0 tx=0x7f2c3c00b9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=549a4fa2eb5ccb7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.865+0000 7f2c437fe640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2c380a2d40 0x7f2c380a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.865+0000 7f2c4a59c640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2c380a2d40 0x7f2c380a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.865+0000 7f2c40ff9640 1 -- 172.21.15.6:0/2574954059 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c01b070 con 0x560db2b4ab70 2024-09-12T00:09:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.866+0000 7f2c40ff9640 1 -- 172.21.15.6:0/2574954059 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c3c008d80 con 0x560db2b4ab70 2024-09-12T00:09:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.866+0000 7f2c40ff9640 1 -- 172.21.15.6:0/2574954059 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0153a0 con 0x560db2b4ab70 2024-09-12T00:09:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.867+0000 7f2c53837740 1 -- 172.21.15.6:0/2574954059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 msgr2=0x560db2b4af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.867+0000 7f2c53837740 1 --2- 172.21.15.6:0/2574954059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 0x560db2b4af70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00b4f0 tx=0x7f2c3c00b9b0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.869+0000 7f2c437fe640 1 -- 172.21.15.6:0/3346407997 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f2c440cf7c0 con 0x7f2c4c10ba70 2024-09-12T00:09:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.870+0000 7f2c4a59c640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2c380a2d40 0x7f2c380a5200 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2c34035040 tx=0x7f2c34030450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.871+0000 7f2c53837740 1 -- 172.21.15.6:0/2574954059 shutdown_connections 2024-09-12T00:09:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.871+0000 7f2c53837740 1 --2- 172.21.15.6:0/2574954059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b50540 0x560db2b52a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.871+0000 7f2c53837740 1 --2- 172.21.15.6:0/2574954059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4b4b0 0x560db2b4ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.871+0000 7f2c53837740 1 --2- 172.21.15.6:0/2574954059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 0x560db2b4af70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.871+0000 7f2c53837740 1 -- 172.21.15.6:0/2574954059 >> 172.21.15.6:0/2574954059 conn(0x560db2b461e0 msgr2=0x560db2b465e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.871+0000 7f2c53837740 1 -- 172.21.15.6:0/2574954059 shutdown_connections 2024-09-12T00:09:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.871+0000 7f2c53837740 1 -- 172.21.15.6:0/2574954059 wait complete. 2024-09-12T00:09:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.871+0000 7f2c53837740 1 -- start start 2024-09-12T00:09:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.872+0000 7f2c53837740 1 Processor -- start 2024-09-12T00:09:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.872+0000 7f2c53837740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4ab70 0x560db2b54e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.872+0000 7f2c53837740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 0x560db2b55390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.872+0000 7f2c53837740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b50540 0x560db2b5c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.872+0000 7f2c53837740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560db2b53510 con 0x560db2b50540 2024-09-12T00:09:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.872+0000 7f2c53837740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560db2a37290 con 0x560db2b4b4b0 2024-09-12T00:09:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.872+0000 7f2c53837740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560db2b53690 con 0x560db2b4ab70 2024-09-12T00:09:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.872+0000 7f2c53837740 10 client.0 _ll_register_callbacks cb 0x560db2a68140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.873+0000 7f2c49d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 0x560db2b55390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.873+0000 7f2c49d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 0x560db2b55390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:49934/0 (socket says 172.21.15.6:49934) 2024-09-12T00:09:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.873+0000 7f2c49d9b640 1 -- 172.21.15.6:0/3752322077 learned_addr learned my addr 172.21.15.6:0/3752322077 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.873+0000 7f2c49d9b640 1 -- 172.21.15.6:0/3752322077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4ab70 msgr2=0x560db2b54e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.873+0000 7f2c49d9b640 1 --2- 172.21.15.6:0/3752322077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4ab70 0x560db2b54e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.873+0000 7f2c49d9b640 1 -- 172.21.15.6:0/3752322077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b50540 msgr2=0x560db2b5c3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:09:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.873+0000 7f2c4ad9d640 1 --2- 172.21.15.6:0/3752322077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b50540 0x560db2b5c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.873+0000 7f2c49d9b640 1 --2- 172.21.15.6:0/3752322077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b50540 0x560db2b5c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.873+0000 7f2c49d9b640 1 -- 172.21.15.6:0/3752322077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560db27c1210 con 0x560db2b4b4b0 2024-09-12T00:09:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.874+0000 7f2c49d9b640 1 --2- 172.21.15.6:0/3752322077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 0x560db2b55390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009a10 tx=0x7f2c3c016630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cc5042962153221 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.874+0000 7f2c31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:09:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.875+0000 7f2c31ffb640 1 -- 172.21.15.6:0/3752322077 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c025020 con 0x560db2b4b4b0 2024-09-12T00:09:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.875+0000 7f2c31ffb640 1 -- 172.21.15.6:0/3752322077 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f2c3c0088d0 con 0x560db2b4b4b0 2024-09-12T00:09:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.877+0000 7f2c53837740 1 -- 172.21.15.6:0/3752322077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c3c008d80 con 0x560db2b4b4b0 2024-09-12T00:09:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.878+0000 7f2c31ffb640 1 -- 172.21.15.6:0/3752322077 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2c3c01b040 con 0x560db2b4b4b0 2024-09-12T00:09:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.878+0000 7f2c53837740 10 client.25712 fetch_fsmap learned FSMap version 33 2024-09-12T00:09:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.878+0000 7f2c53837740 1 -- 172.21.15.6:0/3752322077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560db288d620 con 0x560db2b4b4b0 2024-09-12T00:09:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.881+0000 7f2c31ffb640 1 -- 172.21.15.6:0/3752322077 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c3c008d80 con 0x560db2b4b4b0 2024-09-12T00:09:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.881+0000 7f2c31ffb640 1 -- 172.21.15.6:0/3752322077 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f2c3c01e030 con 0x560db2b4b4b0 2024-09-12T00:09:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.881+0000 7f2c53837740 10 client.25712 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:09:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.881+0000 7f2c53837740 10 client.25712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:09:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.881+0000 7f2c53837740 20 client.25712 populate_metadata read hostname 'smithi006' 2024-09-12T00:09:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.881+0000 7f2c53837740 1 --2- 172.21.15.6:0/3752322077 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560db2b60dc0 0x560db2b63240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.881+0000 7f2c53837740 4 client.25712 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.881+0000 7f2c53837740 1 -- 172.21.15.6:0/3752322077 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560db2abba20 con 0x560db2b60dc0 2024-09-12T00:09:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.882+0000 7f2c4a59c640 1 --2- 172.21.15.6:0/3752322077 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560db2b60dc0 0x560db2b63240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.883+0000 7f2c4a59c640 1 --2- 172.21.15.6:0/3752322077 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560db2b60dc0 0x560db2b63240 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ea73501ac761c25 server_cookie=7622d3b4f86892be in_seq=0 out_seq=0 2024-09-12T00:09:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.883+0000 7f2c31ffb640 10 client.25712 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:05.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.884+0000 7f2c31ffb640 1 -- 172.21.15.6:0/3752322077 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560db2abba20 con 0x560db2b60dc0 2024-09-12T00:09:05.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.886+0000 7f2c31ffb640 10 client.25712 handle_command_reply: tid=0 2024-09-12T00:09:05.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.886+0000 7f2c53837740 1 client.25712 shutdown 2024-09-12T00:09:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.891+0000 7f2c53837740 1 -- 172.21.15.6:0/3752322077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 msgr2=0x560db2b55390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.891+0000 7f2c53837740 1 --2- 172.21.15.6:0/3752322077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 0x560db2b55390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009a10 tx=0x7f2c3c016630 comp rx=0 tx=0).stop 2024-09-12T00:09:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.891+0000 7f2c53837740 1 -- 172.21.15.6:0/3752322077 shutdown_connections 2024-09-12T00:09:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.891+0000 7f2c53837740 1 --2- 172.21.15.6:0/3752322077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b50540 0x560db2b5c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.891+0000 7f2c53837740 1 --2- 172.21.15.6:0/3752322077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 0x560db2b55390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.891+0000 7f2c53837740 1 --2- 172.21.15.6:0/3752322077 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560db2b60dc0 0x560db2b63240 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.891+0000 7f2c53837740 1 --2- 172.21.15.6:0/3752322077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4ab70 0x560db2b54e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.891+0000 7f2c53837740 1 -- 172.21.15.6:0/3752322077 >> 172.21.15.6:0/3752322077 conn(0x560db2b461e0 msgr2=0x560db2b479f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.892+0000 7f2c31ffb640 0 client.25712 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.892+0000 7f2c53837740 1 -- 172.21.15.6:0/3752322077 shutdown_connections 2024-09-12T00:09:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.892+0000 7f2c53837740 1 -- 172.21.15.6:0/3752322077 wait complete. 2024-09-12T00:09:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.892+0000 7f2c53837740 20 client.25712 trim_cache size 0 max 16384 2024-09-12T00:09:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.931+0000 7f2c53837740 1 Processor -- start 2024-09-12T00:09:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.932+0000 7f2c53837740 1 -- start start 2024-09-12T00:09:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.933+0000 7f2c53837740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b461e0 0x560db2b4af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.933+0000 7f2c53837740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 0x560db2b5c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.933+0000 7f2c53837740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4b4b0 0x560db2b465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.933+0000 7f2c53837740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c00fe70 con 0x560db2b461e0 2024-09-12T00:09:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.933+0000 7f2c53837740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c0119b0 con 0x560db2b4ab70 2024-09-12T00:09:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.933+0000 7f2c53837740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c010540 con 0x560db2b4b4b0 2024-09-12T00:09:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.934+0000 7f2c49d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 0x560db2b5c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.934+0000 7f2c49d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 0x560db2b5c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:49950/0 (socket says 172.21.15.6:49950) 2024-09-12T00:09:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.934+0000 7f2c49d9b640 1 -- 172.21.15.6:0/987650579 learned_addr learned my addr 172.21.15.6:0/987650579 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.935+0000 7f2c4ad9d640 1 --2- 172.21.15.6:0/987650579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4b4b0 0x560db2b465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.935+0000 7f2c4a59c640 1 --2- 172.21.15.6:0/987650579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b461e0 0x560db2b4af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.935+0000 7f2c4ad9d640 1 -- 172.21.15.6:0/987650579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 msgr2=0x560db2b5c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.935+0000 7f2c4ad9d640 1 --2- 172.21.15.6:0/987650579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 0x560db2b5c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.935+0000 7f2c4ad9d640 1 -- 172.21.15.6:0/987650579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b461e0 msgr2=0x560db2b4af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.935+0000 7f2c4ad9d640 1 --2- 172.21.15.6:0/987650579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b461e0 0x560db2b4af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.935+0000 7f2c4ad9d640 1 -- 172.21.15.6:0/987650579 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db2b46000 con 0x560db2b4b4b0 2024-09-12T00:09:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.936+0000 7f2c4ad9d640 1 --2- 172.21.15.6:0/987650579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4b4b0 0x560db2b465c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c440cce70 tx=0x7f2c4400ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=776873e37780acfd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.936+0000 7f2c33fff640 1 -- 172.21.15.6:0/987650579 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4409bbd0 con 0x560db2b4b4b0 2024-09-12T00:09:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.937+0000 7f2c33fff640 1 -- 172.21.15.6:0/987650579 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c4409ff80 con 0x560db2b4b4b0 2024-09-12T00:09:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.937+0000 7f2c33fff640 1 -- 172.21.15.6:0/987650579 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c440046c0 con 0x560db2b4b4b0 2024-09-12T00:09:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.939+0000 7f2c53837740 1 -- 172.21.15.6:0/987650579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4b4b0 msgr2=0x560db2b465c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.939+0000 7f2c53837740 1 --2- 172.21.15.6:0/987650579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4b4b0 0x560db2b465c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c440cce70 tx=0x7f2c4400ce60 comp rx=0 tx=0).stop 2024-09-12T00:09:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.939+0000 7f2c53837740 1 -- 172.21.15.6:0/987650579 shutdown_connections 2024-09-12T00:09:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.939+0000 7f2c53837740 1 --2- 172.21.15.6:0/987650579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b4b4b0 0x560db2b465c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.939+0000 7f2c53837740 1 --2- 172.21.15.6:0/987650579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4ab70 0x560db2b5c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.941+0000 7f2c53837740 1 --2- 172.21.15.6:0/987650579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b461e0 0x560db2b4af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.942+0000 7f2c53837740 1 -- 172.21.15.6:0/987650579 >> 172.21.15.6:0/987650579 conn(0x560db2b500d0 msgr2=0x560db2b54c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.944+0000 7f2c53837740 1 -- 172.21.15.6:0/987650579 shutdown_connections 2024-09-12T00:09:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.945+0000 7f2c53837740 1 -- 172.21.15.6:0/987650579 wait complete. 2024-09-12T00:09:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.945+0000 7f2c53837740 1 -- start start 2024-09-12T00:09:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.945+0000 7f2c53837740 1 Processor -- start 2024-09-12T00:09:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c53837740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b461e0 0x560db2b5bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c53837740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b4ab70 0x560db2b589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c53837740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 0x560db2b58f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c53837740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c0112e0 con 0x560db2b4ab70 2024-09-12T00:09:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c53837740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c010c10 con 0x560db2b4b4b0 2024-09-12T00:09:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c53837740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c00de50 con 0x560db2b461e0 2024-09-12T00:09:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c53837740 10 client.0 _ll_register_callbacks cb 0x7f2c3c019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c4ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 0x560db2b58f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c4ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 0x560db2b58f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:49958/0 (socket says 172.21.15.6:49958) 2024-09-12T00:09:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c4ad9d640 1 -- 172.21.15.6:0/2969823013 learned_addr learned my addr 172.21.15.6:0/2969823013 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c49d9b640 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b4ab70 0x560db2b589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c4a59c640 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b461e0 0x560db2b5bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c4ad9d640 1 -- 172.21.15.6:0/2969823013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b461e0 msgr2=0x560db2b5bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c4ad9d640 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b461e0 0x560db2b5bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c4ad9d640 1 -- 172.21.15.6:0/2969823013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b4ab70 msgr2=0x560db2b589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c4ad9d640 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b4ab70 0x560db2b589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.946+0000 7f2c4ad9d640 1 -- 172.21.15.6:0/2969823013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560db2b5c590 con 0x560db2b4b4b0 2024-09-12T00:09:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.947+0000 7f2c4ad9d640 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 0x560db2b58f10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2c44098030 tx=0x7f2c440cd190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75d5a604e3b84d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.947+0000 7f2c31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:09:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.947+0000 7f2c31ffb640 1 -- 172.21.15.6:0/2969823013 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c440a8070 con 0x560db2b4b4b0 2024-09-12T00:09:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.947+0000 7f2c31ffb640 1 -- 172.21.15.6:0/2969823013 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f2c440ba4c0 con 0x560db2b4b4b0 2024-09-12T00:09:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.947+0000 7f2c53837740 1 -- 172.21.15.6:0/2969823013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c4409ff80 con 0x560db2b4b4b0 2024-09-12T00:09:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.948+0000 7f2c31ffb640 1 -- 172.21.15.6:0/2969823013 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2c4407f050 con 0x560db2b4b4b0 2024-09-12T00:09:05.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.949+0000 7f2c53837740 10 client.25718 fetch_fsmap learned FSMap version 33 2024-09-12T00:09:05.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.949+0000 7f2c53837740 1 -- 172.21.15.6:0/2969823013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560db2bcaa20 con 0x560db2b4b4b0 2024-09-12T00:09:05.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.949+0000 7f2c31ffb640 1 -- 172.21.15.6:0/2969823013 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c4409bbd0 con 0x560db2b4b4b0 2024-09-12T00:09:05.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.950+0000 7f2c31ffb640 1 -- 172.21.15.6:0/2969823013 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f2c44005020 con 0x560db2b4b4b0 2024-09-12T00:09:05.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.950+0000 7f2c53837740 10 client.25718 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:09:05.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.950+0000 7f2c53837740 10 client.25718 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:09:05.948 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.950+0000 7f2c53837740 20 client.25718 populate_metadata read hostname 'smithi006' 2024-09-12T00:09:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.950+0000 7f2c53837740 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560db2b50540 0x560db2bcd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.950+0000 7f2c53837740 4 client.25718 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:09:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.950+0000 7f2c53837740 1 -- 172.21.15.6:0/2969823013 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f2c4409ff80 con 0x560db2b50540 2024-09-12T00:09:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.950+0000 7f2c4a59c640 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560db2b50540 0x560db2bcd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.950+0000 7f2c4a59c640 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560db2b50540 0x560db2bcd340 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7d642f128336603 server_cookie=8b34e4a34e4bda73 in_seq=0 out_seq=0 2024-09-12T00:09:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:05.951+0000 7f2c31ffb640 10 client.25718 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.085+0000 7f2c31ffb640 1 -- 172.21.15.6:0/2969823013 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f2c4409ff80 con 0x560db2b50540 2024-09-12T00:09:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.085+0000 7f2c31ffb640 10 client.25718 handle_command_reply: tid=0 2024-09-12T00:09:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.085+0000 7f2c53837740 1 client.25718 shutdown 2024-09-12T00:09:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.086+0000 7f2c53837740 1 -- 172.21.15.6:0/2969823013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 msgr2=0x560db2b58f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.086+0000 7f2c53837740 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 0x560db2b58f10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2c44098030 tx=0x7f2c440cd190 comp rx=0 tx=0).stop 2024-09-12T00:09:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.086+0000 7f2c53837740 1 -- 172.21.15.6:0/2969823013 shutdown_connections 2024-09-12T00:09:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.086+0000 7f2c53837740 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2b4b4b0 0x560db2b58f10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.086+0000 7f2c53837740 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db2b4ab70 0x560db2b589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.086+0000 7f2c53837740 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x560db2b50540 0x560db2bcd340 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.086+0000 7f2c53837740 1 --2- 172.21.15.6:0/2969823013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560db2b461e0 0x560db2b5bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.086+0000 7f2c53837740 1 -- 172.21.15.6:0/2969823013 >> 172.21.15.6:0/2969823013 conn(0x560db2b500d0 msgr2=0x560db2b54c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.086+0000 7f2c31ffb640 0 client.25718 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.086+0000 7f2c53837740 1 -- 172.21.15.6:0/2969823013 shutdown_connections 2024-09-12T00:09:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.086+0000 7f2c53837740 1 -- 172.21.15.6:0/2969823013 wait complete. 2024-09-12T00:09:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.090+0000 7f2c53837740 20 client.25718 trim_cache size 0 max 16384 2024-09-12T00:09:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:09:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:09:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:09:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:09:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.092+0000 7f2c509c6640 1 -- 172.21.15.6:0/3346407997 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2c380a2d40 msgr2=0x7f2c380a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.092+0000 7f2c509c6640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2c380a2d40 0x7f2c380a5200 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2c34035040 tx=0x7f2c34030450 comp rx=0 tx=0).stop 2024-09-12T00:09:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.092+0000 7f2c509c6640 1 -- 172.21.15.6:0/3346407997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4c10ba70 msgr2=0x7f2c4c10bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.092+0000 7f2c509c6640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4c10ba70 0x7f2c4c10bf20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400e970 tx=0x7f2c4400ee30 comp rx=0 tx=0).stop 2024-09-12T00:09:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.093+0000 7f2c509c6640 1 -- 172.21.15.6:0/3346407997 shutdown_connections 2024-09-12T00:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.094+0000 7f2c509c6640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f2c380a2d40 0x7f2c380a5200 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.094+0000 7f2c509c6640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4c10ba70 0x7f2c4c10bf20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.094+0000 7f2c509c6640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c4c10df90 0x7f2c4c10d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.094+0000 7f2c509c6640 1 --2- 172.21.15.6:0/3346407997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c4c074c50 0x7f2c4c10d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.094+0000 7f2c509c6640 1 -- 172.21.15.6:0/3346407997 >> 172.21.15.6:0/3346407997 conn(0x7f2c4c0fd160 msgr2=0x7f2c4c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.098+0000 7f2c509c6640 1 -- 172.21.15.6:0/3346407997 shutdown_connections 2024-09-12T00:09:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:06.098+0000 7f2c509c6640 1 -- 172.21.15.6:0/3346407997 wait complete. 2024-09-12T00:09:06.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:06 smithi039 ceph-mon[34543]: pgmap v652: 129 pgs: 129 active+clean; 13 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 4.73k op/s 2024-09-12T00:09:06.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:06 smithi006 ceph-mon[30947]: pgmap v652: 129 pgs: 129 active+clean; 13 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 4.73k op/s 2024-09-12T00:09:06.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:06 smithi134 ceph-mon[34893]: pgmap v652: 129 pgs: 129 active+clean; 13 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 4.73k op/s 2024-09-12T00:09:07.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:07 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:09:07.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:07 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:09:07.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:07 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:09:08.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:08 smithi039 ceph-mon[34543]: pgmap v653: 129 pgs: 129 active+clean; 13 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 4.96k op/s 2024-09-12T00:09:08.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:08 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:08.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:08 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:08.604 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:08 smithi134 ceph-mon[34893]: pgmap v653: 129 pgs: 129 active+clean; 13 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 4.96k op/s 2024-09-12T00:09:08.604 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:08 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:08.604 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:08 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:08.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:08 smithi006 ceph-mon[30947]: pgmap v653: 129 pgs: 129 active+clean; 13 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 4.96k op/s 2024-09-12T00:09:08.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:08 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:08.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:08 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:10.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:10 smithi039 ceph-mon[34543]: pgmap v654: 129 pgs: 129 active+clean; 13 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2024-09-12T00:09:10.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:10 smithi006 ceph-mon[30947]: pgmap v654: 129 pgs: 129 active+clean; 13 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2024-09-12T00:09:10.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:10 smithi134 ceph-mon[34893]: pgmap v654: 129 pgs: 129 active+clean; 13 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2024-09-12T00:09:12.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:12 smithi039 ceph-mon[34543]: pgmap v655: 129 pgs: 129 active+clean; 13 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.45k op/s 2024-09-12T00:09:12.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:12 smithi006 ceph-mon[30947]: pgmap v655: 129 pgs: 129 active+clean; 13 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.45k op/s 2024-09-12T00:09:12.650 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:12 smithi134 ceph-mon[34893]: pgmap v655: 129 pgs: 129 active+clean; 13 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.45k op/s 2024-09-12T00:09:14.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:14 smithi039 ceph-mon[34543]: pgmap v656: 129 pgs: 129 active+clean; 13 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.41k op/s 2024-09-12T00:09:14.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:14 smithi006 ceph-mon[30947]: pgmap v656: 129 pgs: 129 active+clean; 13 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.41k op/s 2024-09-12T00:09:14.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:14 smithi134 ceph-mon[34893]: pgmap v656: 129 pgs: 129 active+clean; 13 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.41k op/s 2024-09-12T00:09:16.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:16 smithi006 ceph-mon[30947]: pgmap v657: 129 pgs: 129 active+clean; 13 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 MiB/s wr, 4.17k op/s 2024-09-12T00:09:16.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:16.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:16 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:16.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:16 smithi134 ceph-mon[34893]: pgmap v657: 129 pgs: 129 active+clean; 13 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 MiB/s wr, 4.17k op/s 2024-09-12T00:09:16.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:16.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:16 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:16.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:16 smithi039 ceph-mon[34543]: pgmap v657: 129 pgs: 129 active+clean; 13 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 MiB/s wr, 4.17k op/s 2024-09-12T00:09:16.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:16.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:16 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:18.595 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:18 smithi039 ceph-mon[34543]: pgmap v658: 129 pgs: 129 active+clean; 13 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2024-09-12T00:09:18.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:18 smithi006 ceph-mon[30947]: pgmap v658: 129 pgs: 129 active+clean; 13 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2024-09-12T00:09:18.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:18 smithi134 ceph-mon[34893]: pgmap v658: 129 pgs: 129 active+clean; 13 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2024-09-12T00:09:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.293+0000 7fcdda504640 1 -- 172.21.15.6:0/778644877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdd41008c0 msgr2=0x7fcdd4100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.293+0000 7fcdda504640 1 --2- 172.21.15.6:0/778644877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdd41008c0 0x7fcdd4100cc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009900 tx=0x7fcdd002a410 comp rx=0 tx=0).stop 2024-09-12T00:09:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.293+0000 7fcdda504640 1 -- 172.21.15.6:0/778644877 shutdown_connections 2024-09-12T00:09:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.293+0000 7fcdda504640 1 --2- 172.21.15.6:0/778644877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcdd4102470 0x7fcdd4108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.294+0000 7fcdda504640 1 --2- 172.21.15.6:0/778644877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdd4101ab0 0x7fcdd4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.294+0000 7fcdda504640 1 --2- 172.21.15.6:0/778644877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdd41008c0 0x7fcdd4100cc0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.294+0000 7fcdda504640 1 -- 172.21.15.6:0/778644877 >> 172.21.15.6:0/778644877 conn(0x7fcdd40fc020 msgr2=0x7fcdd40fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.294+0000 7fcdda504640 1 -- 172.21.15.6:0/778644877 shutdown_connections 2024-09-12T00:09:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.294+0000 7fcdda504640 1 -- 172.21.15.6:0/778644877 wait complete. 2024-09-12T00:09:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.294+0000 7fcdda504640 1 Processor -- start 2024-09-12T00:09:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.294+0000 7fcdda504640 1 -- start start 2024-09-12T00:09:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdda504640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcdd41008c0 0x7fcdd4196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdda504640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdd4101ab0 0x7fcdd4197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdda504640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdd4102470 0x7fcdd419e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdd9502640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcdd41008c0 0x7fcdd4196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdd9502640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcdd41008c0 0x7fcdd4196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:50894/0 (socket says 172.21.15.6:50894) 2024-09-12T00:09:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdda504640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd410c3f0 con 0x7fcdd4102470 2024-09-12T00:09:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdda504640 1 -- 172.21.15.6:0/817315348 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd410c270 con 0x7fcdd41008c0 2024-09-12T00:09:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdd9502640 1 -- 172.21.15.6:0/817315348 learned_addr learned my addr 172.21.15.6:0/817315348 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdd4101ab0 0x7fcdd4197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdd9d03640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdd4102470 0x7fcdd419e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdda504640 1 -- 172.21.15.6:0/817315348 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd410c570 con 0x7fcdd4101ab0 2024-09-12T00:09:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdd9d03640 1 -- 172.21.15.6:0/817315348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdd4101ab0 msgr2=0x7fcdd4197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdd9d03640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdd4101ab0 0x7fcdd4197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdd9d03640 1 -- 172.21.15.6:0/817315348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcdd41008c0 msgr2=0x7fcdd4196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdd9d03640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcdd41008c0 0x7fcdd4196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdd9d03640 1 -- 172.21.15.6:0/817315348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd406a2b0 con 0x7fcdd4102470 2024-09-12T00:09:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.295+0000 7fcdd9502640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcdd41008c0 0x7fcdd4196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.296+0000 7fcdd9d03640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdd4102470 0x7fcdd419e0e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00e940 tx=0x7fcdcc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.296+0000 7fcdca7fc640 1 -- 172.21.15.6:0/817315348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc004d20 con 0x7fcdd4102470 2024-09-12T00:09:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.296+0000 7fcdca7fc640 1 -- 172.21.15.6:0/817315348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcdcc005020 con 0x7fcdd4102470 2024-09-12T00:09:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.296+0000 7fcdca7fc640 1 -- 172.21.15.6:0/817315348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc0116d0 con 0x7fcdd4102470 2024-09-12T00:09:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.296+0000 7fcdda504640 1 -- 172.21.15.6:0/817315348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd406a5a0 con 0x7fcdd4102470 2024-09-12T00:09:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.296+0000 7fcdda504640 1 -- 172.21.15.6:0/817315348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd406aaa0 con 0x7fcdd4102470 2024-09-12T00:09:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.298+0000 7fcdca7fc640 1 -- 172.21.15.6:0/817315348 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fcdcc00cb20 con 0x7fcdd4102470 2024-09-12T00:09:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.298+0000 7fcdde5db740 1 Processor -- start 2024-09-12T00:09:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.298+0000 7fcdde5db740 1 -- start start 2024-09-12T00:09:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdde5db740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c48f80 0x556f67c49380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdde5db740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c498c0 0x556f67c4e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdde5db740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c4e950 0x556f67c50e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdde5db740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x556f67ba82f0 con 0x556f67c4e950 2024-09-12T00:09:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdde5db740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556f67b50270 con 0x556f67c48f80 2024-09-12T00:09:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdde5db740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556f67ba42b0 con 0x556f67c498c0 2024-09-12T00:09:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdd8d01640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c48f80 0x556f67c49380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdd8d01640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c48f80 0x556f67c49380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:50906/0 (socket says 172.21.15.6:50906) 2024-09-12T00:09:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdd8d01640 1 -- 172.21.15.6:0/2505314746 learned_addr learned my addr 172.21.15.6:0/2505314746 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdca7fc640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcdc00a2bf0 0x7fcdc00a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/2505314746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c4e950 0x556f67c50e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdd9502640 1 --2- 172.21.15.6:0/2505314746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c498c0 0x556f67c4e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdd9d03640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcdc00a2bf0 0x7fcdc00a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdd8d01640 1 -- 172.21.15.6:0/2505314746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c498c0 msgr2=0x556f67c4e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/2505314746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c498c0 0x556f67c4e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdd8d01640 1 -- 172.21.15.6:0/2505314746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c4e950 msgr2=0x556f67c50e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/2505314746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c4e950 0x556f67c50e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdd8d01640 1 -- 172.21.15.6:0/2505314746 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67b4f340 con 0x556f67c48f80 2024-09-12T00:09:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdca7fc640 1 -- 172.21.15.6:0/817315348 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fcdcc0cf3a0 con 0x7fcdd4102470 2024-09-12T00:09:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.299+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/2505314746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c48f80 0x556f67c49380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4011810 tx=0x7fcdc40097d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c4519cdc82ea0ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.300+0000 7fcdbf7fe640 1 -- 172.21.15.6:0/2505314746 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4004030 con 0x556f67c48f80 2024-09-12T00:09:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.300+0000 7fcdd9d03640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcdc00a2bf0 0x7fcdc00a50b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0a3ff0 tx=0x7fcdcc0142d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.300+0000 7fcdbf7fe640 1 -- 172.21.15.6:0/2505314746 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcdc4011e50 con 0x556f67c48f80 2024-09-12T00:09:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.300+0000 7fcdbf7fe640 1 -- 172.21.15.6:0/2505314746 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4003850 con 0x556f67c48f80 2024-09-12T00:09:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.300+0000 7fcdde5db740 1 -- 172.21.15.6:0/2505314746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c48f80 msgr2=0x556f67c49380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.300+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2505314746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c48f80 0x556f67c49380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4011810 tx=0x7fcdc40097d0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.300+0000 7fcdde5db740 1 -- 172.21.15.6:0/2505314746 shutdown_connections 2024-09-12T00:09:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.300+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2505314746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c4e950 0x556f67c50e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.300+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2505314746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c498c0 0x556f67c4e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.300+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2505314746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c48f80 0x556f67c49380 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.300+0000 7fcdde5db740 1 -- 172.21.15.6:0/2505314746 >> 172.21.15.6:0/2505314746 conn(0x556f67c401e0 msgr2=0x556f67c405e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.301+0000 7fcdde5db740 1 -- 172.21.15.6:0/2505314746 shutdown_connections 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.301+0000 7fcdde5db740 1 -- 172.21.15.6:0/2505314746 wait complete. 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.301+0000 7fcdde5db740 1 -- start start 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.301+0000 7fcdde5db740 1 Processor -- start 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdde5db740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c4bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdde5db740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c498c0 0x556f67c4c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdde5db740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c4e950 0x556f67c4d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdde5db740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x556f67c44a90 con 0x556f67c48f80 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdde5db740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556f67b31290 con 0x556f67c4e950 2024-09-12T00:09:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdde5db740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556f67c44c10 con 0x556f67c498c0 2024-09-12T00:09:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdd8d01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c4bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdd9502640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c498c0 0x556f67c4c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdd8d01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c4bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52668/0 (socket says 172.21.15.6:52668) 2024-09-12T00:09:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdd8d01640 1 -- 172.21.15.6:0/2325471104 learned_addr learned my addr 172.21.15.6:0/2325471104 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c4e950 0x556f67c4d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdde5db740 10 client.0 _ll_register_callbacks cb 0x556f67b62140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdd9502640 1 -- 172.21.15.6:0/2325471104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c4e950 msgr2=0x556f67c4d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdd9502640 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c4e950 0x556f67c4d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdd9502640 1 -- 172.21.15.6:0/2325471104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 msgr2=0x556f67c4bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdd9502640 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c4bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdd9502640 1 -- 172.21.15.6:0/2325471104 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f678bb210 con 0x556f67c498c0 2024-09-12T00:09:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdde5db740 1 -- 172.21.15.6:0/2325471104 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdc4011e50 con 0x556f67c498c0 2024-09-12T00:09:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c4bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdd9502640 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c498c0 0x556f67c4c4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0000c00 tx=0x7fcdd00318f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3916c3e3270bf7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.302+0000 7fcdbcff9640 10 client.25732 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:09:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.303+0000 7fcdbcff9640 1 -- 172.21.15.6:0/2325471104 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0035040 con 0x556f67c498c0 2024-09-12T00:09:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.303+0000 7fcdbcff9640 1 -- 172.21.15.6:0/2325471104 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fcdd00438d0 con 0x556f67c498c0 2024-09-12T00:09:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.303+0000 7fcdbcff9640 1 -- 172.21.15.6:0/2325471104 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcdd0043af0 con 0x556f67c498c0 2024-09-12T00:09:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.303+0000 7fcdde5db740 10 client.25732 fetch_fsmap learned FSMap version 33 2024-09-12T00:09:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.303+0000 7fcdde5db740 1 -- 172.21.15.6:0/2325471104 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=33}) -- 0x556f67987620 con 0x556f67c498c0 2024-09-12T00:09:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.304+0000 7fcdbcff9640 1 -- 172.21.15.6:0/2325471104 <== mon.1 v2:172.21.15.134:3300/0 4 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fcdd004a070 con 0x556f67c498c0 2024-09-12T00:09:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.304+0000 7fcdde5db740 10 client.25732 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.304+0000 7fcdde5db740 10 client.25732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.304+0000 7fcdde5db740 20 client.25732 populate_metadata read hostname 'smithi006' 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.304+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556f67c5a8c0 0x556f67c5ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.304+0000 7fcdde5db740 4 client.25732 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.304+0000 7fcdde5db740 1 -- 172.21.15.6:0/2325471104 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f67bb5a20 con 0x556f67c5a8c0 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.304+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556f67c5a8c0 0x556f67c5ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.304+0000 7fcdbcff9640 10 client.25732 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.304+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556f67c5a8c0 0x556f67c5ccb0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c46d43fa3161ee3d server_cookie=95aa9c359142ed07 in_seq=0 out_seq=0 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdbcff9640 1 -- 172.21.15.6:0/2325471104 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f67bb5a20 con 0x556f67c5a8c0 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdbcff9640 10 client.25732 handle_command_reply: tid=0 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdde5db740 1 client.25732 shutdown 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdde5db740 1 -- 172.21.15.6:0/2325471104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c498c0 msgr2=0x556f67c4c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c498c0 0x556f67c4c4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0000c00 tx=0x7fcdd00318f0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdde5db740 1 -- 172.21.15.6:0/2325471104 shutdown_connections 2024-09-12T00:09:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c4e950 0x556f67c4d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556f67c5a8c0 0x556f67c5ccb0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdbcff9640 0 client.25732 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c498c0 0x556f67c4c4c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2325471104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c4bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdde5db740 1 -- 172.21.15.6:0/2325471104 >> 172.21.15.6:0/2325471104 conn(0x556f67c401e0 msgr2=0x556f67c419f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdde5db740 1 -- 172.21.15.6:0/2325471104 shutdown_connections 2024-09-12T00:09:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdde5db740 1 -- 172.21.15.6:0/2325471104 wait complete. 2024-09-12T00:09:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.305+0000 7fcdde5db740 20 client.25732 trim_cache size 0 max 16384 2024-09-12T00:09:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdde5db740 1 Processor -- start 2024-09-12T00:09:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdde5db740 1 -- start start 2024-09-12T00:09:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdde5db740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c3ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdde5db740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c498c0 0x556f67c3efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdde5db740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c4e950 0x556f67c3f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdde5db740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd41a8390 con 0x556f67c48f80 2024-09-12T00:09:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdde5db740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd41a9ed0 con 0x556f67c498c0 2024-09-12T00:09:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdde5db740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd41a8a60 con 0x556f67c4e950 2024-09-12T00:09:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdd8d01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c3ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdd8d01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c3ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52670/0 (socket says 172.21.15.6:52670) 2024-09-12T00:09:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdd8d01640 1 -- 172.21.15.6:0/2494528922 learned_addr learned my addr 172.21.15.6:0/2494528922 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdd9502640 1 --2- 172.21.15.6:0/2494528922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c498c0 0x556f67c3efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdd8d01640 1 -- 172.21.15.6:0/2494528922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c4e950 msgr2=0x556f67c3f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/2494528922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c4e950 0x556f67c3f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdd8d01640 1 -- 172.21.15.6:0/2494528922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c498c0 msgr2=0x556f67c3efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/2494528922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c498c0 0x556f67c3efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.320+0000 7fcdd8d01640 1 -- 172.21.15.6:0/2494528922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67c5d300 con 0x556f67c48f80 2024-09-12T00:09:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.321+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/2494528922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c3ea90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40097a0 tx=0x7fcdc4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2840b0f33d402bd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.321+0000 7fcdbeffd640 1 -- 172.21.15.6:0/2494528922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc402f070 con 0x556f67c48f80 2024-09-12T00:09:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.321+0000 7fcdbeffd640 1 -- 172.21.15.6:0/2494528922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcdc400fd30 con 0x556f67c48f80 2024-09-12T00:09:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.321+0000 7fcdbeffd640 1 -- 172.21.15.6:0/2494528922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4026030 con 0x556f67c48f80 2024-09-12T00:09:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.321+0000 7fcdde5db740 1 -- 172.21.15.6:0/2494528922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 msgr2=0x556f67c3ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.321+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2494528922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c3ea90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40097a0 tx=0x7fcdc4005850 comp rx=0 tx=0).stop 2024-09-12T00:09:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.322+0000 7fcdde5db740 1 -- 172.21.15.6:0/2494528922 shutdown_connections 2024-09-12T00:09:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.322+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2494528922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c4e950 0x556f67c3f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.322+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2494528922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c498c0 0x556f67c3efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.322+0000 7fcdde5db740 1 --2- 172.21.15.6:0/2494528922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c3ea90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.322+0000 7fcdde5db740 1 -- 172.21.15.6:0/2494528922 >> 172.21.15.6:0/2494528922 conn(0x556f67c401e0 msgr2=0x556f67c405c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.322+0000 7fcdde5db740 1 -- 172.21.15.6:0/2494528922 shutdown_connections 2024-09-12T00:09:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.322+0000 7fcdde5db740 1 -- 172.21.15.6:0/2494528922 wait complete. 2024-09-12T00:09:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.322+0000 7fcdde5db740 1 -- start start 2024-09-12T00:09:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.322+0000 7fcdde5db740 1 Processor -- start 2024-09-12T00:09:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdde5db740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c54db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdde5db740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c498c0 0x556f67c552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdde5db740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c4e950 0x556f67c56300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdde5db740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd41a9800 con 0x556f67c48f80 2024-09-12T00:09:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdde5db740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd41a9130 con 0x556f67c498c0 2024-09-12T00:09:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdde5db740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd41a6370 con 0x556f67c4e950 2024-09-12T00:09:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdd8d01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c54db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdd9502640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c498c0 0x556f67c552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdde5db740 10 client.0 _ll_register_callbacks cb 0x7fcdd0032eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdd8d01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c54db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52674/0 (socket says 172.21.15.6:52674) 2024-09-12T00:09:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdd8d01640 1 -- 172.21.15.6:0/1215095532 learned_addr learned my addr 172.21.15.6:0/1215095532 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/1215095532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c4e950 0x556f67c56300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdd9502640 1 -- 172.21.15.6:0/1215095532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c4e950 msgr2=0x556f67c56300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdd9502640 1 --2- 172.21.15.6:0/1215095532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c4e950 0x556f67c56300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdd9502640 1 -- 172.21.15.6:0/1215095532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 msgr2=0x556f67c54db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdd9502640 1 --2- 172.21.15.6:0/1215095532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c54db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdd9502640 1 -- 172.21.15.6:0/1215095532 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f67c56910 con 0x556f67c498c0 2024-09-12T00:09:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdd9502640 1 --2- 172.21.15.6:0/1215095532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c498c0 0x556f67c552f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00314e0 tx=0x7fcdd0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9849025b61b1d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:09:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdbcff9640 1 -- 172.21.15.6:0/1215095532 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0035040 con 0x556f67c498c0 2024-09-12T00:09:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdbcff9640 1 -- 172.21.15.6:0/1215095532 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fcdd0003dd0 con 0x556f67c498c0 2024-09-12T00:09:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.323+0000 7fcdde5db740 1 -- 172.21.15.6:0/1215095532 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdc400fd30 con 0x556f67c498c0 2024-09-12T00:09:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdbcff9640 1 -- 172.21.15.6:0/1215095532 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcdd0068050 con 0x556f67c498c0 2024-09-12T00:09:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdde5db740 10 client.25736 fetch_fsmap learned FSMap version 33 2024-09-12T00:09:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdde5db740 1 -- 172.21.15.6:0/1215095532 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556f67cc5870 con 0x556f67c498c0 2024-09-12T00:09:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdbcff9640 1 -- 172.21.15.6:0/1215095532 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcdc400fd30 con 0x556f67c498c0 2024-09-12T00:09:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdbcff9640 1 -- 172.21.15.6:0/1215095532 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fcdd004a040 con 0x556f67c498c0 2024-09-12T00:09:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdde5db740 10 client.25736 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:09:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdde5db740 10 client.25736 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:09:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdde5db740 20 client.25736 populate_metadata read hostname 'smithi006' 2024-09-12T00:09:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdde5db740 1 --2- 172.21.15.6:0/1215095532 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556f67cc6210 0x556f67cc8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdde5db740 4 client.25736 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:09:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdde5db740 1 -- 172.21.15.6:0/1215095532 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556f67c45320 con 0x556f67cc6210 2024-09-12T00:09:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/1215095532 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556f67cc6210 0x556f67cc8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdd8d01640 1 --2- 172.21.15.6:0/1215095532 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556f67cc6210 0x556f67cc8630 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13ffa3dc98bf8967 server_cookie=3c6a71816edad534 in_seq=0 out_seq=0 2024-09-12T00:09:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:19.324+0000 7fcdbcff9640 10 client.25736 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:20.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:20 smithi039 ceph-mon[34543]: pgmap v659: 129 pgs: 129 active+clean; 13 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-09-12T00:09:20.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:20 smithi006 ceph-mon[30947]: pgmap v659: 129 pgs: 129 active+clean; 13 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-09-12T00:09:20.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:20 smithi134 ceph-mon[34893]: pgmap v659: 129 pgs: 129 active+clean; 13 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-09-12T00:09:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.722+0000 7fcdbcff9640 1 -- 172.21.15.6:0/1215095532 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556f67c45320 con 0x556f67cc6210 2024-09-12T00:09:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.722+0000 7fcdbcff9640 10 client.25736 handle_command_reply: tid=0 2024-09-12T00:09:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.722+0000 7fcdde5db740 1 client.25736 shutdown 2024-09-12T00:09:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.723+0000 7fcdde5db740 1 -- 172.21.15.6:0/1215095532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c498c0 msgr2=0x556f67c552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.723+0000 7fcdde5db740 1 --2- 172.21.15.6:0/1215095532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c498c0 0x556f67c552f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00314e0 tx=0x7fcdd0009260 comp rx=0 tx=0).stop 2024-09-12T00:09:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.723+0000 7fcdde5db740 1 -- 172.21.15.6:0/1215095532 shutdown_connections 2024-09-12T00:09:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.723+0000 7fcdde5db740 1 --2- 172.21.15.6:0/1215095532 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x556f67cc6210 0x556f67cc8630 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.723+0000 7fcdde5db740 1 --2- 172.21.15.6:0/1215095532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f67c4e950 0x556f67c56300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.723+0000 7fcdde5db740 1 --2- 172.21.15.6:0/1215095532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f67c498c0 0x556f67c552f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.723+0000 7fcdde5db740 1 --2- 172.21.15.6:0/1215095532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556f67c48f80 0x556f67c54db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.723+0000 7fcdde5db740 1 -- 172.21.15.6:0/1215095532 >> 172.21.15.6:0/1215095532 conn(0x556f67c401e0 msgr2=0x556f67c3f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.723+0000 7fcdbcff9640 0 client.25736 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.723+0000 7fcdde5db740 1 -- 172.21.15.6:0/1215095532 shutdown_connections 2024-09-12T00:09:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.723+0000 7fcdde5db740 1 -- 172.21.15.6:0/1215095532 wait complete. 2024-09-12T00:09:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.724+0000 7fcdde5db740 20 client.25736 trim_cache size 0 max 16384 2024-09-12T00:09:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:09:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:09:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:09:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:09:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.726+0000 7fcdda504640 1 -- 172.21.15.6:0/817315348 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcdc00a2bf0 msgr2=0x7fcdc00a50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.726+0000 7fcdda504640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcdc00a2bf0 0x7fcdc00a50b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0a3ff0 tx=0x7fcdcc0142d0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.726+0000 7fcdda504640 1 -- 172.21.15.6:0/817315348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdd4102470 msgr2=0x7fcdd419e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.726+0000 7fcdda504640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdd4102470 0x7fcdd419e0e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00e940 tx=0x7fcdcc00ee00 comp rx=0 tx=0).stop 2024-09-12T00:09:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.727+0000 7fcdda504640 1 -- 172.21.15.6:0/817315348 shutdown_connections 2024-09-12T00:09:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.727+0000 7fcdda504640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcdc00a2bf0 0x7fcdc00a50b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.727+0000 7fcdda504640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdd4102470 0x7fcdd419e0e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.727+0000 7fcdda504640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdd4101ab0 0x7fcdd4197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.727+0000 7fcdda504640 1 --2- 172.21.15.6:0/817315348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcdd41008c0 0x7fcdd4196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.727+0000 7fcdda504640 1 -- 172.21.15.6:0/817315348 >> 172.21.15.6:0/817315348 conn(0x7fcdd40fc020 msgr2=0x7fcdd4104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.734+0000 7fcdda504640 1 -- 172.21.15.6:0/817315348 shutdown_connections 2024-09-12T00:09:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:20.734+0000 7fcdda504640 1 -- 172.21.15.6:0/817315348 wait complete. 2024-09-12T00:09:22.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:22 smithi006 ceph-mon[30947]: pgmap v660: 129 pgs: 129 active+clean; 13 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 3.64k op/s 2024-09-12T00:09:22.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:22 smithi134 ceph-mon[34893]: pgmap v660: 129 pgs: 129 active+clean; 13 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 3.64k op/s 2024-09-12T00:09:22.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:22 smithi039 ceph-mon[34543]: pgmap v660: 129 pgs: 129 active+clean; 13 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 3.64k op/s 2024-09-12T00:09:23.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:23.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:23.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:09:23.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:09:23.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:23.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:23.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:23.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:09:23.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:09:23.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:23.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:23.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:23.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:09:23.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:09:23.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:09:24.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:24 smithi006 ceph-mon[30947]: pgmap v661: 129 pgs: 129 active+clean; 13 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 3.61k op/s 2024-09-12T00:09:24.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:24 smithi134 ceph-mon[34893]: pgmap v661: 129 pgs: 129 active+clean; 13 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 3.61k op/s 2024-09-12T00:09:25.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:24 smithi039 ceph-mon[34543]: pgmap v661: 129 pgs: 129 active+clean; 13 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 3.61k op/s 2024-09-12T00:09:26.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:26 smithi006 ceph-mon[30947]: pgmap v662: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 3.60k op/s 2024-09-12T00:09:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:26 smithi134 ceph-mon[34893]: pgmap v662: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 3.60k op/s 2024-09-12T00:09:27.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:26 smithi039 ceph-mon[34543]: pgmap v662: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 3.60k op/s 2024-09-12T00:09:28.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:28 smithi006 ceph-mon[30947]: pgmap v663: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 3.93k op/s 2024-09-12T00:09:28.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:28 smithi134 ceph-mon[34893]: pgmap v663: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 3.93k op/s 2024-09-12T00:09:29.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:28 smithi039 ceph-mon[34543]: pgmap v663: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 3.93k op/s 2024-09-12T00:09:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:30 smithi006 ceph-mon[30947]: pgmap v664: 129 pgs: 129 active+clean; 13 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 3.91k op/s 2024-09-12T00:09:30.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:30 smithi134 ceph-mon[34893]: pgmap v664: 129 pgs: 129 active+clean; 13 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 3.91k op/s 2024-09-12T00:09:31.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:30 smithi039 ceph-mon[34543]: pgmap v664: 129 pgs: 129 active+clean; 13 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 3.91k op/s 2024-09-12T00:09:32.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:32 smithi006 ceph-mon[30947]: pgmap v665: 129 pgs: 129 active+clean; 13 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2024-09-12T00:09:32.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:32 smithi134 ceph-mon[34893]: pgmap v665: 129 pgs: 129 active+clean; 13 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2024-09-12T00:09:33.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:32 smithi039 ceph-mon[34543]: pgmap v665: 129 pgs: 129 active+clean; 13 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2024-09-12T00:09:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.940+0000 7f1367fff640 1 -- 172.21.15.6:0/3292064288 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368030d10 con 0x7f137010de90 2024-09-12T00:09:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.941+0000 7f13763cc640 1 -- 172.21.15.6:0/3292064288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f137010de90 msgr2=0x7f1370110350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.941+0000 7f13763cc640 1 --2- 172.21.15.6:0/3292064288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f137010de90 0x7f1370110350 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1368009be0 tx=0x7f136802a6f0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.943+0000 7f13763cc640 1 -- 172.21.15.6:0/3292064288 shutdown_connections 2024-09-12T00:09:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.943+0000 7f13763cc640 1 --2- 172.21.15.6:0/3292064288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f137010de90 0x7f1370110350 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.943+0000 7f13763cc640 1 --2- 172.21.15.6:0/3292064288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137010b4e0 0x7f137010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.943+0000 7f13763cc640 1 --2- 172.21.15.6:0/3292064288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1370072d80 0x7f1370073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.943+0000 7f13763cc640 1 -- 172.21.15.6:0/3292064288 >> 172.21.15.6:0/3292064288 conn(0x7f137006eb10 msgr2=0x7f1370070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.947+0000 7f13763cc640 1 -- 172.21.15.6:0/3292064288 shutdown_connections 2024-09-12T00:09:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.947+0000 7f13763cc640 1 -- 172.21.15.6:0/3292064288 wait complete. 2024-09-12T00:09:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.948+0000 7f13763cc640 1 Processor -- start 2024-09-12T00:09:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.948+0000 7f13763cc640 1 -- start start 2024-09-12T00:09:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.948+0000 7f13763cc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1370072d80 0x7f137019e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.948+0000 7f13763cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f137010b4e0 0x7f137019ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.948+0000 7f13763cc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f137010de90 0x7f13701a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.948+0000 7f13763cc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1370113490 con 0x7f137010b4e0 2024-09-12T00:09:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.948+0000 7f13763cc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1370113310 con 0x7f1370072d80 2024-09-12T00:09:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.948+0000 7f13763cc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1370113610 con 0x7f137010de90 2024-09-12T00:09:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.949+0000 7f1375bcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f137010de90 0x7f13701a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.949+0000 7f13753ca640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1370072d80 0x7f137019e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.949+0000 7f1375bcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f137010de90 0x7f13701a57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:54524/0 (socket says 172.21.15.6:54524) 2024-09-12T00:09:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.949+0000 7f1375bcb640 1 -- 172.21.15.6:0/1571454250 learned_addr learned my addr 172.21.15.6:0/1571454250 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.949+0000 7f1374bc9640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f137010b4e0 0x7f137019ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.949+0000 7f1375bcb640 1 -- 172.21.15.6:0/1571454250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1370072d80 msgr2=0x7f137019e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.949+0000 7f1375bcb640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1370072d80 0x7f137019e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.949+0000 7f1375bcb640 1 -- 172.21.15.6:0/1571454250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f137010b4e0 msgr2=0x7f137019ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.949+0000 7f1375bcb640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f137010b4e0 0x7f137019ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.949+0000 7f1375bcb640 1 -- 172.21.15.6:0/1571454250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13701a5e20 con 0x7f137010de90 2024-09-12T00:09:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.949+0000 7f1374bc9640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f137010b4e0 0x7f137019ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.950+0000 7f1375bcb640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f137010de90 0x7f13701a57b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1368034040 tx=0x7f1368030fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.950+0000 7f13667fc640 1 -- 172.21.15.6:0/1571454250 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368041020 con 0x7f137010de90 2024-09-12T00:09:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.951+0000 7f13667fc640 1 -- 172.21.15.6:0/1571454250 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1368037040 con 0x7f137010de90 2024-09-12T00:09:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.951+0000 7f13667fc640 1 -- 172.21.15.6:0/1571454250 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368036070 con 0x7f137010de90 2024-09-12T00:09:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.952+0000 7f13763cc640 1 -- 172.21.15.6:0/1571454250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13701a60b0 con 0x7f137010de90 2024-09-12T00:09:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.952+0000 7f13763cc640 1 -- 172.21.15.6:0/1571454250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13701a6550 con 0x7f137010de90 2024-09-12T00:09:33.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.956+0000 7f137a3cd740 1 Processor -- start 2024-09-12T00:09:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.958+0000 7f137a3cd740 1 -- start start 2024-09-12T00:09:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.958+0000 7f137a3cd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 0x55ec0b01cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.958+0000 7f137a3cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01d4b0 0x55ec0b021f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.958+0000 7f137a3cd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b022540 0x55ec0b024a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.958+0000 7f137a3cd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ec0af802f0 con 0x55ec0b01cb70 2024-09-12T00:09:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.958+0000 7f137a3cd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ec0af28270 con 0x55ec0b022540 2024-09-12T00:09:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.958+0000 7f137a3cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ec0af7c2b0 con 0x55ec0b01d4b0 2024-09-12T00:09:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.959+0000 7f13667fc640 1 -- 172.21.15.6:0/1571454250 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f1368044020 con 0x7f137010de90 2024-09-12T00:09:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.959+0000 7f1374bc9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b022540 0x55ec0b024a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.960+0000 7f1374bc9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b022540 0x55ec0b024a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:36110/0 (socket says 172.21.15.6:36110) 2024-09-12T00:09:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.960+0000 7f1374bc9640 1 -- 172.21.15.6:0/2471833330 learned_addr learned my addr 172.21.15.6:0/2471833330 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.960+0000 7f1374bc9640 1 -- 172.21.15.6:0/2471833330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01d4b0 msgr2=0x55ec0b021f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:09:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.960+0000 7f1374bc9640 1 --2- 172.21.15.6:0/2471833330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01d4b0 0x55ec0b021f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.960+0000 7f1374bc9640 1 -- 172.21.15.6:0/2471833330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 msgr2=0x55ec0b01cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.960+0000 7f1374bc9640 1 --2- 172.21.15.6:0/2471833330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 0x55ec0b01cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.960+0000 7f1374bc9640 1 -- 172.21.15.6:0/2471833330 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec0af27340 con 0x55ec0b022540 2024-09-12T00:09:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.961+0000 7f1374bc9640 1 --2- 172.21.15.6:0/2471833330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b022540 0x55ec0b024a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f136001ddf0 tx=0x7f13600227c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97d72a847ef67f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.961+0000 7f13667fc640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f135c0a2da0 0x7f135c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.962+0000 7f135b7fe640 1 -- 172.21.15.6:0/2471833330 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136001a4f0 con 0x55ec0b022540 2024-09-12T00:09:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.962+0000 7f135b7fe640 1 -- 172.21.15.6:0/2471833330 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f136001ab40 con 0x55ec0b022540 2024-09-12T00:09:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.962+0000 7f135b7fe640 1 -- 172.21.15.6:0/2471833330 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360020c30 con 0x55ec0b022540 2024-09-12T00:09:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.962+0000 7f13667fc640 1 -- 172.21.15.6:0/1571454250 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f13680f0130 con 0x7f137010de90 2024-09-12T00:09:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.963+0000 7f137a3cd740 1 -- 172.21.15.6:0/2471833330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b022540 msgr2=0x55ec0b024a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.963+0000 7f137a3cd740 1 --2- 172.21.15.6:0/2471833330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b022540 0x55ec0b024a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f136001ddf0 tx=0x7f13600227c0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.964+0000 7f13753ca640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f135c0a2da0 0x7f135c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.965+0000 7f13753ca640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f135c0a2da0 0x7f135c0a5260 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f136c006fd0 tx=0x7f136c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.965+0000 7f137a3cd740 1 -- 172.21.15.6:0/2471833330 shutdown_connections 2024-09-12T00:09:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.965+0000 7f137a3cd740 1 --2- 172.21.15.6:0/2471833330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b022540 0x55ec0b024a00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.965+0000 7f137a3cd740 1 --2- 172.21.15.6:0/2471833330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01d4b0 0x55ec0b021f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.965+0000 7f137a3cd740 1 --2- 172.21.15.6:0/2471833330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 0x55ec0b01cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.965+0000 7f137a3cd740 1 -- 172.21.15.6:0/2471833330 >> 172.21.15.6:0/2471833330 conn(0x55ec0b0181e0 msgr2=0x55ec0b0185e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.965+0000 7f137a3cd740 1 -- 172.21.15.6:0/2471833330 shutdown_connections 2024-09-12T00:09:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.966+0000 7f137a3cd740 1 -- 172.21.15.6:0/2471833330 wait complete. 2024-09-12T00:09:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.966+0000 7f137a3cd740 1 -- start start 2024-09-12T00:09:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.966+0000 7f137a3cd740 1 Processor -- start 2024-09-12T00:09:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.967+0000 7f137a3cd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 0x55ec0b026eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.967+0000 7f137a3cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01d4b0 0x55ec0b0273f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.967+0000 7f137a3cd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b022540 0x55ec0b02e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.967+0000 7f137a3cd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ec0b025510 con 0x55ec0b01cb70 2024-09-12T00:09:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.967+0000 7f137a3cd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ec0af09290 con 0x55ec0b022540 2024-09-12T00:09:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.967+0000 7f137a3cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ec0b025690 con 0x55ec0b01d4b0 2024-09-12T00:09:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.967+0000 7f137a3cd740 10 client.0 _ll_register_callbacks cb 0x55ec0af3a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.968+0000 7f1374bc9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01d4b0 0x55ec0b0273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.968+0000 7f13753ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 0x55ec0b026eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.968+0000 7f1374bc9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01d4b0 0x55ec0b0273f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:54546/0 (socket says 172.21.15.6:54546) 2024-09-12T00:09:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.968+0000 7f1374bc9640 1 -- 172.21.15.6:0/463558500 learned_addr learned my addr 172.21.15.6:0/463558500 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.968+0000 7f1375bcb640 1 --2- 172.21.15.6:0/463558500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b022540 0x55ec0b02e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.969+0000 7f13753ca640 1 -- 172.21.15.6:0/463558500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01d4b0 msgr2=0x55ec0b0273f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.969+0000 7f13753ca640 1 --2- 172.21.15.6:0/463558500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01d4b0 0x55ec0b0273f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.970+0000 7f13753ca640 1 -- 172.21.15.6:0/463558500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b022540 msgr2=0x55ec0b02e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.970+0000 7f13753ca640 1 --2- 172.21.15.6:0/463558500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b022540 0x55ec0b02e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.970+0000 7f13753ca640 1 -- 172.21.15.6:0/463558500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec0ac93210 con 0x55ec0b01cb70 2024-09-12T00:09:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.970+0000 7f13753ca640 1 --2- 172.21.15.6:0/463558500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 0x55ec0b026eb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x55ec0b01dee0 tx=0x7f136c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44383f3c009f47eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.970+0000 7f1358ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:09:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.970+0000 7f1358ff9640 1 -- 172.21.15.6:0/463558500 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c022020 con 0x55ec0b01cb70 2024-09-12T00:09:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.971+0000 7f137a3cd740 1 -- 172.21.15.6:0/463558500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f136001ab40 con 0x55ec0b01cb70 2024-09-12T00:09:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.971+0000 7f1358ff9640 1 -- 172.21.15.6:0/463558500 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f136c00dd10 con 0x55ec0b01cb70 2024-09-12T00:09:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.971+0000 7f1358ff9640 1 -- 172.21.15.6:0/463558500 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f136c02d050 con 0x55ec0b01cb70 2024-09-12T00:09:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.971+0000 7f137a3cd740 10 client.16152 fetch_fsmap learned FSMap version 33 2024-09-12T00:09:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.971+0000 7f137a3cd740 1 -- 172.21.15.6:0/463558500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ec0ad5f620 con 0x55ec0b01cb70 2024-09-12T00:09:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.972+0000 7f1358ff9640 1 -- 172.21.15.6:0/463558500 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f136001ab40 con 0x55ec0b01cb70 2024-09-12T00:09:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.972+0000 7f1358ff9640 1 -- 172.21.15.6:0/463558500 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f136c01d030 con 0x55ec0b01cb70 2024-09-12T00:09:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.972+0000 7f137a3cd740 10 client.16152 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:09:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.972+0000 7f137a3cd740 10 client.16152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:09:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.972+0000 7f137a3cd740 20 client.16152 populate_metadata read hostname 'smithi006' 2024-09-12T00:09:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.972+0000 7f137a3cd740 1 --2- 172.21.15.6:0/463558500 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ec0b0550d0 0x55ec0b057510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.972+0000 7f137a3cd740 4 client.16152 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.972+0000 7f137a3cd740 1 -- 172.21.15.6:0/463558500 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec0af8da20 con 0x55ec0b0550d0 2024-09-12T00:09:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.975+0000 7f1374bc9640 1 --2- 172.21.15.6:0/463558500 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ec0b0550d0 0x55ec0b057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.976+0000 7f1358ff9640 10 client.16152 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.976+0000 7f1374bc9640 1 --2- 172.21.15.6:0/463558500 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ec0b0550d0 0x55ec0b057510 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fe9afd54e887d32 server_cookie=7c6dec80b7ce282b in_seq=0 out_seq=0 2024-09-12T00:09:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.978+0000 7f1358ff9640 1 -- 172.21.15.6:0/463558500 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec0af8da20 con 0x55ec0b0550d0 2024-09-12T00:09:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.978+0000 7f1358ff9640 10 client.16152 handle_command_reply: tid=0 2024-09-12T00:09:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.978+0000 7f137a3cd740 1 client.16152 shutdown 2024-09-12T00:09:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.982+0000 7f137a3cd740 1 -- 172.21.15.6:0/463558500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 msgr2=0x55ec0b026eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.982+0000 7f137a3cd740 1 --2- 172.21.15.6:0/463558500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 0x55ec0b026eb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x55ec0b01dee0 tx=0x7f136c004770 comp rx=0 tx=0).stop 2024-09-12T00:09:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.982+0000 7f137a3cd740 1 -- 172.21.15.6:0/463558500 shutdown_connections 2024-09-12T00:09:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.982+0000 7f137a3cd740 1 --2- 172.21.15.6:0/463558500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b022540 0x55ec0b02e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.982+0000 7f137a3cd740 1 --2- 172.21.15.6:0/463558500 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ec0b0550d0 0x55ec0b057510 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.982+0000 7f137a3cd740 1 --2- 172.21.15.6:0/463558500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01d4b0 0x55ec0b0273f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.982+0000 7f137a3cd740 1 --2- 172.21.15.6:0/463558500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 0x55ec0b026eb0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.982+0000 7f137a3cd740 1 -- 172.21.15.6:0/463558500 >> 172.21.15.6:0/463558500 conn(0x55ec0b0181e0 msgr2=0x55ec0b0199f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.982+0000 7f1358ff9640 0 client.16152 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.982+0000 7f137a3cd740 1 -- 172.21.15.6:0/463558500 shutdown_connections 2024-09-12T00:09:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.985+0000 7f137a3cd740 1 -- 172.21.15.6:0/463558500 wait complete. 2024-09-12T00:09:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:33.989+0000 7f137a3cd740 20 client.16152 trim_cache size 0 max 16384 2024-09-12T00:09:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.019+0000 7f137a3cd740 1 Processor -- start 2024-09-12T00:09:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.023+0000 7f137a3cd740 1 -- start start 2024-09-12T00:09:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.023+0000 7f137a3cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01cb70 0x55ec0b0185c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.023+0000 7f137a3cd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b01d4b0 0x55ec0b02e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.024+0000 7f137a3cd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b022540 0x55ec0b018b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.024+0000 7f13753ca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01cb70 0x55ec0b0185c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.024+0000 7f13753ca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01cb70 0x55ec0b0185c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:54558/0 (socket says 172.21.15.6:54558) 2024-09-12T00:09:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.024+0000 7f13753ca640 1 -- 172.21.15.6:0/2657587611 learned_addr learned my addr 172.21.15.6:0/2657587611 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.024+0000 7f137a3cd740 1 -- 172.21.15.6:0/2657587611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f135400fe70 con 0x55ec0b022540 2024-09-12T00:09:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.024+0000 7f137a3cd740 1 -- 172.21.15.6:0/2657587611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f13540119b0 con 0x55ec0b01d4b0 2024-09-12T00:09:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.024+0000 7f137a3cd740 1 -- 172.21.15.6:0/2657587611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1354010540 con 0x55ec0b01cb70 2024-09-12T00:09:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.024+0000 7f1374bc9640 1 --2- 172.21.15.6:0/2657587611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b01d4b0 0x55ec0b02e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.025+0000 7f1374bc9640 1 -- 172.21.15.6:0/2657587611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01cb70 msgr2=0x55ec0b0185c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.025+0000 7f1374bc9640 1 --2- 172.21.15.6:0/2657587611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01cb70 0x55ec0b0185c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.025+0000 7f1374bc9640 1 -- 172.21.15.6:0/2657587611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b022540 msgr2=0x55ec0b018b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.025+0000 7f1374bc9640 1 --2- 172.21.15.6:0/2657587611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b022540 0x55ec0b018b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.025+0000 7f1374bc9640 1 -- 172.21.15.6:0/2657587611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec0b018000 con 0x55ec0b01d4b0 2024-09-12T00:09:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.029+0000 7f1374bc9640 1 --2- 172.21.15.6:0/2657587611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b01d4b0 0x55ec0b02e3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1360001eb0 tx=0x7f1360005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52ed2d04d699ee1b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.032+0000 7f135affd640 1 -- 172.21.15.6:0/2657587611 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360005240 con 0x55ec0b01d4b0 2024-09-12T00:09:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.032+0000 7f135affd640 1 -- 172.21.15.6:0/2657587611 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f136001a9a0 con 0x55ec0b01d4b0 2024-09-12T00:09:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.032+0000 7f135affd640 1 -- 172.21.15.6:0/2657587611 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360020930 con 0x55ec0b01d4b0 2024-09-12T00:09:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.033+0000 7f137a3cd740 1 -- 172.21.15.6:0/2657587611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b01d4b0 msgr2=0x55ec0b02e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.033+0000 7f137a3cd740 1 --2- 172.21.15.6:0/2657587611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b01d4b0 0x55ec0b02e3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1360001eb0 tx=0x7f1360005850 comp rx=0 tx=0).stop 2024-09-12T00:09:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.038+0000 7f137a3cd740 1 -- 172.21.15.6:0/2657587611 shutdown_connections 2024-09-12T00:09:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.038+0000 7f137a3cd740 1 --2- 172.21.15.6:0/2657587611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b022540 0x55ec0b018b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.038+0000 7f137a3cd740 1 --2- 172.21.15.6:0/2657587611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b01d4b0 0x55ec0b02e3f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.038+0000 7f137a3cd740 1 --2- 172.21.15.6:0/2657587611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b01cb70 0x55ec0b0185c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.038+0000 7f137a3cd740 1 -- 172.21.15.6:0/2657587611 >> 172.21.15.6:0/2657587611 conn(0x55ec0b0181e0 msgr2=0x55ec0b026c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:34.041 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.042+0000 7f137a3cd740 1 -- 172.21.15.6:0/2657587611 shutdown_connections 2024-09-12T00:09:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.046+0000 7f137a3cd740 1 -- 172.21.15.6:0/2657587611 wait complete. 2024-09-12T00:09:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.046+0000 7f137a3cd740 1 -- start start 2024-09-12T00:09:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.046+0000 7f137a3cd740 1 Processor -- start 2024-09-12T00:09:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f137a3cd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 0x55ec0b02b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f137a3cd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b01d4b0 0x55ec0b02b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f137a3cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b022540 0x55ec0b0bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f137a3cd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f13540112e0 con 0x55ec0b01cb70 2024-09-12T00:09:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f137a3cd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1354010c10 con 0x55ec0b01d4b0 2024-09-12T00:09:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f137a3cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f135400de50 con 0x55ec0b022540 2024-09-12T00:09:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f137a3cd740 10 client.0 _ll_register_callbacks cb 0x7f136c00b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f1374bc9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b01d4b0 0x55ec0b02b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f1375bcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b022540 0x55ec0b0bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f1375bcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b022540 0x55ec0b0bdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:54568/0 (socket says 172.21.15.6:54568) 2024-09-12T00:09:34.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f1375bcb640 1 -- 172.21.15.6:0/1154383481 learned_addr learned my addr 172.21.15.6:0/1154383481 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:34.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f1375bcb640 1 -- 172.21.15.6:0/1154383481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b01d4b0 msgr2=0x55ec0b02b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:34.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f1375bcb640 1 --2- 172.21.15.6:0/1154383481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b01d4b0 0x55ec0b02b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f1375bcb640 1 -- 172.21.15.6:0/1154383481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 msgr2=0x55ec0b02b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:34.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f1375bcb640 1 --2- 172.21.15.6:0/1154383481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 0x55ec0b02b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.047+0000 7f1375bcb640 1 -- 172.21.15.6:0/1154383481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec0b0be2e0 con 0x55ec0b022540 2024-09-12T00:09:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.053+0000 7f1375bcb640 1 --2- 172.21.15.6:0/1154383481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b022540 0x55ec0b0bdda0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f13680ed7e0 tx=0x7f13680bc3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=508160bd79e84874 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.053+0000 7f1358ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:09:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.054+0000 7f1358ff9640 1 -- 172.21.15.6:0/1154383481 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13680d4070 con 0x55ec0b022540 2024-09-12T00:09:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.054+0000 7f137a3cd740 1 -- 172.21.15.6:0/1154383481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f136001a9a0 con 0x55ec0b022540 2024-09-12T00:09:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.054+0000 7f1358ff9640 1 -- 172.21.15.6:0/1154383481 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f1368004710 con 0x55ec0b022540 2024-09-12T00:09:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.054+0000 7f1358ff9640 1 -- 172.21.15.6:0/1154383481 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f13680bcc40 con 0x55ec0b022540 2024-09-12T00:09:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.063+0000 7f137a3cd740 10 client.25747 fetch_fsmap learned FSMap version 33 2024-09-12T00:09:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.063+0000 7f137a3cd740 1 -- 172.21.15.6:0/1154383481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ec0b0bf4e0 con 0x55ec0b022540 2024-09-12T00:09:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.067+0000 7f1358ff9640 1 -- 172.21.15.6:0/1154383481 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f136001a9a0 con 0x55ec0b022540 2024-09-12T00:09:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.067+0000 7f1358ff9640 1 -- 172.21.15.6:0/1154383481 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f13680b8bd0 con 0x55ec0b022540 2024-09-12T00:09:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.067+0000 7f137a3cd740 10 client.25747 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:09:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.067+0000 7f137a3cd740 10 client.25747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:09:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.067+0000 7f137a3cd740 20 client.25747 populate_metadata read hostname 'smithi006' 2024-09-12T00:09:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.067+0000 7f137a3cd740 1 --2- 172.21.15.6:0/1154383481 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ec0b0bfe40 0x55ec0b0c2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.067+0000 7f137a3cd740 4 client.25747 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:09:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.067+0000 7f137a3cd740 1 -- 172.21.15.6:0/1154383481 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ec0af87d70 con 0x55ec0b0bfe40 2024-09-12T00:09:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.070+0000 7f13753ca640 1 --2- 172.21.15.6:0/1154383481 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ec0b0bfe40 0x55ec0b0c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.078+0000 7f13753ca640 1 --2- 172.21.15.6:0/1154383481 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ec0b0bfe40 0x55ec0b0c2260 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56f6bed466fb46ba server_cookie=141b5408cbe73be1 in_seq=0 out_seq=0 2024-09-12T00:09:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.078+0000 7f1358ff9640 10 client.25747 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.167+0000 7f1358ff9640 1 -- 172.21.15.6:0/1154383481 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ec0af87d70 con 0x55ec0b0bfe40 2024-09-12T00:09:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.167+0000 7f1358ff9640 10 client.25747 handle_command_reply: tid=0 2024-09-12T00:09:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.167+0000 7f137a3cd740 1 client.25747 shutdown 2024-09-12T00:09:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.169+0000 7f137a3cd740 1 -- 172.21.15.6:0/1154383481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b022540 msgr2=0x55ec0b0bdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.169+0000 7f137a3cd740 1 --2- 172.21.15.6:0/1154383481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b022540 0x55ec0b0bdda0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f13680ed7e0 tx=0x7f13680bc3d0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.170+0000 7f137a3cd740 1 -- 172.21.15.6:0/1154383481 shutdown_connections 2024-09-12T00:09:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.170+0000 7f137a3cd740 1 --2- 172.21.15.6:0/1154383481 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55ec0b0bfe40 0x55ec0b0c2260 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.170+0000 7f137a3cd740 1 --2- 172.21.15.6:0/1154383481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0b022540 0x55ec0b0bdda0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.170+0000 7f137a3cd740 1 --2- 172.21.15.6:0/1154383481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec0b01d4b0 0x55ec0b02b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.170+0000 7f137a3cd740 1 --2- 172.21.15.6:0/1154383481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec0b01cb70 0x55ec0b02b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.170+0000 7f137a3cd740 1 -- 172.21.15.6:0/1154383481 >> 172.21.15.6:0/1154383481 conn(0x55ec0b0181e0 msgr2=0x55ec0b016a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.170+0000 7f1358ff9640 0 client.25747 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.170+0000 7f137a3cd740 1 -- 172.21.15.6:0/1154383481 shutdown_connections 2024-09-12T00:09:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.170+0000 7f137a3cd740 1 -- 172.21.15.6:0/1154383481 wait complete. 2024-09-12T00:09:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.171+0000 7f137a3cd740 20 client.25747 trim_cache size 0 max 16384 2024-09-12T00:09:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:09:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:09:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:09:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:09:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.174+0000 7f13763cc640 1 -- 172.21.15.6:0/1571454250 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f135c0a2da0 msgr2=0x7f135c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.174+0000 7f13763cc640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f135c0a2da0 0x7f135c0a5260 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f136c006fd0 tx=0x7f136c008040 comp rx=0 tx=0).stop 2024-09-12T00:09:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.174+0000 7f13763cc640 1 -- 172.21.15.6:0/1571454250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f137010de90 msgr2=0x7f13701a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.174+0000 7f13763cc640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f137010de90 0x7f13701a57b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1368034040 tx=0x7f1368030fb0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.175+0000 7f13763cc640 1 -- 172.21.15.6:0/1571454250 shutdown_connections 2024-09-12T00:09:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.175+0000 7f13763cc640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f135c0a2da0 0x7f135c0a5260 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.175+0000 7f13763cc640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f137010de90 0x7f13701a57b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.175+0000 7f13763cc640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f137010b4e0 0x7f137019ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.175+0000 7f13763cc640 1 --2- 172.21.15.6:0/1571454250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1370072d80 0x7f137019e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.175+0000 7f13763cc640 1 -- 172.21.15.6:0/1571454250 >> 172.21.15.6:0/1571454250 conn(0x7f137006eb10 msgr2=0x7f137010c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.176+0000 7f13763cc640 1 -- 172.21.15.6:0/1571454250 shutdown_connections 2024-09-12T00:09:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:34.176+0000 7f13763cc640 1 -- 172.21.15.6:0/1571454250 wait complete. 2024-09-12T00:09:34.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:34 smithi006 ceph-mon[30947]: pgmap v666: 129 pgs: 129 active+clean; 13 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2024-09-12T00:09:34.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:34 smithi134 ceph-mon[34893]: pgmap v666: 129 pgs: 129 active+clean; 13 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2024-09-12T00:09:35.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:34 smithi039 ceph-mon[34543]: pgmap v666: 129 pgs: 129 active+clean; 13 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2024-09-12T00:09:36.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:36 smithi006 ceph-mon[30947]: pgmap v667: 129 pgs: 129 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.43k op/s 2024-09-12T00:09:36.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:36 smithi134 ceph-mon[34893]: pgmap v667: 129 pgs: 129 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.43k op/s 2024-09-12T00:09:37.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:36 smithi039 ceph-mon[34543]: pgmap v667: 129 pgs: 129 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.43k op/s 2024-09-12T00:09:38.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:38 smithi134 ceph-mon[34893]: pgmap v668: 129 pgs: 129 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 19 MiB/s wr, 4.76k op/s 2024-09-12T00:09:39.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:38 smithi039 ceph-mon[34543]: pgmap v668: 129 pgs: 129 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 19 MiB/s wr, 4.76k op/s 2024-09-12T00:09:39.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:38 smithi006 ceph-mon[30947]: pgmap v668: 129 pgs: 129 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 19 MiB/s wr, 4.76k op/s 2024-09-12T00:09:40.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:40 smithi134 ceph-mon[34893]: pgmap v669: 129 pgs: 129 active+clean; 13 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 MiB/s wr, 4.62k op/s 2024-09-12T00:09:41.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:40 smithi039 ceph-mon[34543]: pgmap v669: 129 pgs: 129 active+clean; 13 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 MiB/s wr, 4.62k op/s 2024-09-12T00:09:41.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:40 smithi006 ceph-mon[30947]: pgmap v669: 129 pgs: 129 active+clean; 13 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 MiB/s wr, 4.62k op/s 2024-09-12T00:09:42.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:42 smithi134 ceph-mon[34893]: pgmap v670: 129 pgs: 129 active+clean; 13 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 4.64k op/s 2024-09-12T00:09:43.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:42 smithi039 ceph-mon[34543]: pgmap v670: 129 pgs: 129 active+clean; 13 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 4.64k op/s 2024-09-12T00:09:43.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:42 smithi006 ceph-mon[30947]: pgmap v670: 129 pgs: 129 active+clean; 13 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 4.64k op/s 2024-09-12T00:09:44.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:44 smithi134 ceph-mon[34893]: pgmap v671: 129 pgs: 129 active+clean; 13 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 4.62k op/s 2024-09-12T00:09:45.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:44 smithi039 ceph-mon[34543]: pgmap v671: 129 pgs: 129 active+clean; 13 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 4.62k op/s 2024-09-12T00:09:45.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:44 smithi006 ceph-mon[30947]: pgmap v671: 129 pgs: 129 active+clean; 13 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 4.62k op/s 2024-09-12T00:09:46.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:46 smithi134 ceph-mon[34893]: pgmap v672: 129 pgs: 129 active+clean; 13 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.46k op/s 2024-09-12T00:09:47.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:46 smithi039 ceph-mon[34543]: pgmap v672: 129 pgs: 129 active+clean; 13 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.46k op/s 2024-09-12T00:09:47.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:46 smithi006 ceph-mon[30947]: pgmap v672: 129 pgs: 129 active+clean; 13 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.46k op/s 2024-09-12T00:09:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.382+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2419809614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d9810b4e0 msgr2=0x7f8d9810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.382+0000 7f8d9ee6e640 1 --2- 172.21.15.6:0/2419809614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d9810b4e0 0x7f8d9810d950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009c10 tx=0x7f8d8c02a700 comp rx=0 tx=0).stop 2024-09-12T00:09:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.383+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2419809614 shutdown_connections 2024-09-12T00:09:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.383+0000 7f8d9ee6e640 1 --2- 172.21.15.6:0/2419809614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9810de90 0x7f8d98110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.383+0000 7f8d9ee6e640 1 --2- 172.21.15.6:0/2419809614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d9810b4e0 0x7f8d9810d950 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009c10 tx=0x7f8d8c02a700 comp rx=0 tx=0).stop 2024-09-12T00:09:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.383+0000 7f8d9ee6e640 1 --2- 172.21.15.6:0/2419809614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d98072d80 0x7f8d98073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.383+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2419809614 >> 172.21.15.6:0/2419809614 conn(0x7f8d9806eb10 msgr2=0x7f8d98070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.384+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2419809614 shutdown_connections 2024-09-12T00:09:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.388+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2419809614 wait complete. 2024-09-12T00:09:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.388+0000 7f8d9ee6e640 1 Processor -- start 2024-09-12T00:09:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.389+0000 7f8d9ee6e640 1 -- start start 2024-09-12T00:09:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.389+0000 7f8d9ee6e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d98072d80 0x7f8d981a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.389+0000 7f8d9ee6e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9810de90 0x7f8d981a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.389+0000 7f8d9ee6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d981ac270 0x7f8d981ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.389+0000 7f8d9ee6e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9811c360 con 0x7f8d981ac270 2024-09-12T00:09:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.389+0000 7f8d9ee6e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9811c1e0 con 0x7f8d98072d80 2024-09-12T00:09:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.389+0000 7f8d9ee6e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9811c4e0 con 0x7f8d9810de90 2024-09-12T00:09:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.390+0000 7f8d9de6c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d98072d80 0x7f8d981a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.390+0000 7f8d9de6c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d98072d80 0x7f8d981a6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:54244/0 (socket says 172.21.15.6:54244) 2024-09-12T00:09:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.390+0000 7f8d9de6c640 1 -- 172.21.15.6:0/2130875893 learned_addr learned my addr 172.21.15.6:0/2130875893 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.390+0000 7f8d9d66b640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9810de90 0x7f8d981a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.391+0000 7f8d9de6c640 1 -- 172.21.15.6:0/2130875893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9810de90 msgr2=0x7f8d981a7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.391+0000 7f8d9de6c640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9810de90 0x7f8d981a7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.391+0000 7f8d9de6c640 1 -- 172.21.15.6:0/2130875893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d981ac270 msgr2=0x7f8d981ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.391+0000 7f8d9de6c640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d981ac270 0x7f8d981ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.391+0000 7f8d9de6c640 1 -- 172.21.15.6:0/2130875893 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d98110a50 con 0x7f8d98072d80 2024-09-12T00:09:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.392+0000 7f8d9de6c640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d98072d80 0x7f8d981a6d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400b4a0 tx=0x7f8d8400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.393+0000 7f8d96ffd640 1 -- 172.21.15.6:0/2130875893 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d84014070 con 0x7f8d98072d80 2024-09-12T00:09:48.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.393+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2130875893 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d98110d40 con 0x7f8d98072d80 2024-09-12T00:09:48.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.394+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2130875893 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d98111290 con 0x7f8d98072d80 2024-09-12T00:09:48.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.397+0000 7f8da2e6c740 1 Processor -- start 2024-09-12T00:09:48.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.397+0000 7f8d96ffd640 1 -- 172.21.15.6:0/2130875893 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d84010ac0 con 0x7f8d98072d80 2024-09-12T00:09:48.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.397+0000 7f8d96ffd640 1 -- 172.21.15.6:0/2130875893 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d84017c30 con 0x7f8d98072d80 2024-09-12T00:09:48.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.398+0000 7f8da2e6c740 1 -- start start 2024-09-12T00:09:48.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.400+0000 7f8da2e6c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 0x558d12c43f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.400+0000 7f8da2e6c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 0x558d12c48f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.400+0000 7f8da2e6c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c49540 0x558d12c4ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.400+0000 7f8da2e6c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x558d12ba72f0 con 0x558d12c49540 2024-09-12T00:09:48.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.400+0000 7f8da2e6c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x558d12b4f270 con 0x558d12c444b0 2024-09-12T00:09:48.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.400+0000 7f8da2e6c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d12ba32b0 con 0x558d12c43b70 2024-09-12T00:09:48.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.400+0000 7f8d9e66d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 0x558d12c43f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:48.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.400+0000 7f8d9e66d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 0x558d12c43f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:56462/0 (socket says 172.21.15.6:56462) 2024-09-12T00:09:48.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.400+0000 7f8d9e66d640 1 -- 172.21.15.6:0/900591103 learned_addr learned my addr 172.21.15.6:0/900591103 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:48.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.401+0000 7f8d9e66d640 1 -- 172.21.15.6:0/900591103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 msgr2=0x558d12c48f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:09:48.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.401+0000 7f8d9e66d640 1 --2- 172.21.15.6:0/900591103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 0x558d12c48f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.401+0000 7f8d9e66d640 1 -- 172.21.15.6:0/900591103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c49540 msgr2=0x558d12c4ba00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:09:48.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.401+0000 7f8d9e66d640 1 --2- 172.21.15.6:0/900591103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c49540 0x558d12c4ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.401+0000 7f8d9e66d640 1 -- 172.21.15.6:0/900591103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d12b4e340 con 0x558d12c43b70 2024-09-12T00:09:48.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.401+0000 7f8d96ffd640 1 -- 172.21.15.6:0/2130875893 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f8d84017070 con 0x7f8d98072d80 2024-09-12T00:09:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.404+0000 7f8d9e66d640 1 --2- 172.21.15.6:0/900591103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 0x558d12c43f70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009b40 tx=0x7f8d9000e350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=845623d8d540795e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.404+0000 7f8d83fff640 1 -- 172.21.15.6:0/900591103 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000edc0 con 0x558d12c43b70 2024-09-12T00:09:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.405+0000 7f8d83fff640 1 -- 172.21.15.6:0/900591103 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d900108e0 con 0x558d12c43b70 2024-09-12T00:09:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.406+0000 7f8d96ffd640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8d880a2d20 0x7f8d880a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.406+0000 7f8da2e6c740 1 -- 172.21.15.6:0/900591103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 msgr2=0x558d12c43f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.406+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/900591103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 0x558d12c43f70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009b40 tx=0x7f8d9000e350 comp rx=0 tx=0).stop 2024-09-12T00:09:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.406+0000 7f8d96ffd640 1 -- 172.21.15.6:0/2130875893 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f8d840cbf70 con 0x7f8d98072d80 2024-09-12T00:09:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.408+0000 7f8d9de6c640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8d880a2d20 0x7f8d880a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.408+0000 7f8da2e6c740 1 -- 172.21.15.6:0/900591103 shutdown_connections 2024-09-12T00:09:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.408+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/900591103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c49540 0x558d12c4ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.408+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/900591103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 0x558d12c48f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.408+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/900591103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 0x558d12c43f70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.408+0000 7f8da2e6c740 1 -- 172.21.15.6:0/900591103 >> 172.21.15.6:0/900591103 conn(0x558d12c3f1e0 msgr2=0x558d12c3f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.410+0000 7f8da2e6c740 1 -- 172.21.15.6:0/900591103 shutdown_connections 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.410+0000 7f8d9de6c640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8d880a2d20 0x7f8d880a51e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8d840cc1d0 tx=0x7f8d840047d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.410+0000 7f8da2e6c740 1 -- 172.21.15.6:0/900591103 wait complete. 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.410+0000 7f8da2e6c740 1 -- start start 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.410+0000 7f8da2e6c740 1 Processor -- start 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.411+0000 7f8da2e6c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c43b70 0x558d12c4dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.411+0000 7f8da2e6c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 0x558d12c4e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.411+0000 7f8da2e6c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c49540 0x558d12c552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.411+0000 7f8da2e6c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x558d12c4c5b0 con 0x558d12c43b70 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.411+0000 7f8da2e6c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x558d12b30290 con 0x558d12c444b0 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.411+0000 7f8da2e6c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d12c4c730 con 0x558d12c49540 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.411+0000 7f8da2e6c740 10 client.0 _ll_register_callbacks cb 0x558d12b61140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.412+0000 7f8d9e66d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c43b70 0x558d12c4dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.412+0000 7f8d9e66d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c43b70 0x558d12c4dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40744/0 (socket says 172.21.15.6:40744) 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.412+0000 7f8d9e66d640 1 -- 172.21.15.6:0/2082674415 learned_addr learned my addr 172.21.15.6:0/2082674415 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.412+0000 7f8d9e66d640 1 --2- 172.21.15.6:0/2082674415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c49540 0x558d12c552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.412+0000 7f8d9e66d640 1 -- 172.21.15.6:0/2082674415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 msgr2=0x558d12c4e2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.412+0000 7f8d9e66d640 1 --2- 172.21.15.6:0/2082674415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 0x558d12c4e2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.412+0000 7f8d9e66d640 1 -- 172.21.15.6:0/2082674415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c43b70 msgr2=0x558d12c4dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.412+0000 7f8d9e66d640 1 --2- 172.21.15.6:0/2082674415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c43b70 0x558d12c4dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.412+0000 7f8d9e66d640 1 -- 172.21.15.6:0/2082674415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d128ba210 con 0x558d12c49540 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.413+0000 7f8d9e66d640 1 --2- 172.21.15.6:0/2082674415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c49540 0x558d12c552e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8d90004700 tx=0x7f8d90005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81f749ef1c52fcf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.414+0000 7f8d817fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.414+0000 7f8d817fa640 1 -- 172.21.15.6:0/2082674415 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9002c060 con 0x558d12c49540 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.414+0000 7f8da2e6c740 1 -- 172.21.15.6:0/2082674415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d900108e0 con 0x558d12c49540 2024-09-12T00:09:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.414+0000 7f8d817fa640 1 -- 172.21.15.6:0/2082674415 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f8d90010a90 con 0x558d12c49540 2024-09-12T00:09:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.415+0000 7f8d817fa640 1 -- 172.21.15.6:0/2082674415 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8d90033050 con 0x558d12c49540 2024-09-12T00:09:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.420+0000 7f8da2e6c740 10 client.25759 fetch_fsmap learned FSMap version 33 2024-09-12T00:09:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.420+0000 7f8da2e6c740 1 -- 172.21.15.6:0/2082674415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558d12986620 con 0x558d12c49540 2024-09-12T00:09:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.421+0000 7f8d817fa640 1 -- 172.21.15.6:0/2082674415 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d900108e0 con 0x558d12c49540 2024-09-12T00:09:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.422+0000 7f8d817fa640 1 -- 172.21.15.6:0/2082674415 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f8d90024040 con 0x558d12c49540 2024-09-12T00:09:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.422+0000 7f8da2e6c740 10 client.25759 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:09:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.422+0000 7f8da2e6c740 10 client.25759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:09:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.422+0000 7f8da2e6c740 20 client.25759 populate_metadata read hostname 'smithi006' 2024-09-12T00:09:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.422+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/2082674415 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x558d12c59d90 0x558d12c5c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.422+0000 7f8da2e6c740 4 client.25759 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.422+0000 7f8da2e6c740 1 -- 172.21.15.6:0/2082674415 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d12bb4a20 con 0x558d12c59d90 2024-09-12T00:09:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.422+0000 7f8d9d66b640 1 --2- 172.21.15.6:0/2082674415 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x558d12c59d90 0x558d12c5c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.423+0000 7f8d9d66b640 1 --2- 172.21.15.6:0/2082674415 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x558d12c59d90 0x558d12c5c1b0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd638b3fcf0b63ab server_cookie=e57b4b3a6d266bf0 in_seq=0 out_seq=0 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.423+0000 7f8d817fa640 10 client.25759 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.425+0000 7f8d817fa640 1 -- 172.21.15.6:0/2082674415 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d12bb4a20 con 0x558d12c59d90 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.425+0000 7f8d817fa640 10 client.25759 handle_command_reply: tid=0 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.425+0000 7f8da2e6c740 1 client.25759 shutdown 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.437+0000 7f8da2e6c740 1 -- 172.21.15.6:0/2082674415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c49540 msgr2=0x558d12c552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.437+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/2082674415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c49540 0x558d12c552e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8d90004700 tx=0x7f8d90005fd0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.439+0000 7f8da2e6c740 1 -- 172.21.15.6:0/2082674415 shutdown_connections 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.439+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/2082674415 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x558d12c59d90 0x558d12c5c1b0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.439+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/2082674415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c49540 0x558d12c552e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.439+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/2082674415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 0x558d12c4e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.439+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/2082674415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c43b70 0x558d12c4dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.439+0000 7f8da2e6c740 1 -- 172.21.15.6:0/2082674415 >> 172.21.15.6:0/2082674415 conn(0x558d12c3f1e0 msgr2=0x558d12c409f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.439+0000 7f8d817fa640 0 client.25759 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:48.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.439+0000 7f8da2e6c740 1 -- 172.21.15.6:0/2082674415 shutdown_connections 2024-09-12T00:09:48.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.440+0000 7f8da2e6c740 1 -- 172.21.15.6:0/2082674415 wait complete. 2024-09-12T00:09:48.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.440+0000 7f8da2e6c740 20 client.25759 trim_cache size 0 max 16384 2024-09-12T00:09:48.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.480+0000 7f8da2e6c740 1 Processor -- start 2024-09-12T00:09:48.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.486+0000 7f8da2e6c740 1 -- start start 2024-09-12T00:09:48.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.486+0000 7f8da2e6c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 0x558d12c4cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.486+0000 7f8da2e6c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 0x558d12c552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.487+0000 7f8da2e6c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c49540 0x558d12c3f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.487+0000 7f8d9e66d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 0x558d12c4cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:48.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.487+0000 7f8d9e66d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 0x558d12c4cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:56484/0 (socket says 172.21.15.6:56484) 2024-09-12T00:09:48.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.487+0000 7f8d9d66b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 0x558d12c552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:48.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.487+0000 7f8d9e66d640 1 -- 172.21.15.6:0/132647489 learned_addr learned my addr 172.21.15.6:0/132647489 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.487+0000 7f8da2e6c740 1 -- 172.21.15.6:0/132647489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c00fd20 con 0x558d12c49540 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.487+0000 7f8da2e6c740 1 -- 172.21.15.6:0/132647489 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c011860 con 0x558d12c444b0 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.487+0000 7f8da2e6c740 1 -- 172.21.15.6:0/132647489 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c0103f0 con 0x558d12c43b70 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.488+0000 7f8d9d66b640 1 -- 172.21.15.6:0/132647489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 msgr2=0x558d12c4cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.488+0000 7f8d9d66b640 1 --2- 172.21.15.6:0/132647489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 0x558d12c4cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.488+0000 7f8d9d66b640 1 -- 172.21.15.6:0/132647489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c49540 msgr2=0x558d12c3f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.488+0000 7f8d9d66b640 1 --2- 172.21.15.6:0/132647489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c49540 0x558d12c3f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.488+0000 7f8d9d66b640 1 -- 172.21.15.6:0/132647489 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d12c3f000 con 0x558d12c444b0 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.488+0000 7f8d9d66b640 1 --2- 172.21.15.6:0/132647489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 0x558d12c552a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c008000 tx=0x7f8d8c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96d101248c02684b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.488+0000 7f8d837fe640 1 -- 172.21.15.6:0/132647489 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c04d070 con 0x558d12c444b0 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.489+0000 7f8d837fe640 1 -- 172.21.15.6:0/132647489 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d8c037040 con 0x558d12c444b0 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.489+0000 7f8d837fe640 1 -- 172.21.15.6:0/132647489 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c036040 con 0x558d12c444b0 2024-09-12T00:09:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.491+0000 7f8da2e6c740 1 -- 172.21.15.6:0/132647489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 msgr2=0x558d12c552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.491+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/132647489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 0x558d12c552a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c008000 tx=0x7f8d8c005fd0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.491+0000 7f8da2e6c740 1 -- 172.21.15.6:0/132647489 shutdown_connections 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.491+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/132647489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c49540 0x558d12c3f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.491+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/132647489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c444b0 0x558d12c552a0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c008000 tx=0x7f8d8c005fd0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.491+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/132647489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c43b70 0x558d12c4cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.491+0000 7f8da2e6c740 1 -- 172.21.15.6:0/132647489 >> 172.21.15.6:0/132647489 conn(0x558d12c3f1e0 msgr2=0x558d12c4dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.503+0000 7f8da2e6c740 1 -- 172.21.15.6:0/132647489 shutdown_connections 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.503+0000 7f8da2e6c740 1 -- 172.21.15.6:0/132647489 wait complete. 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.504+0000 7f8da2e6c740 1 -- start start 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.505+0000 7f8da2e6c740 1 Processor -- start 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.510+0000 7f8da2e6c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c43b70 0x558d12c550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.513+0000 7f8d9e66d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c43b70 0x558d12c550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.513+0000 7f8d9e66d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c43b70 0x558d12c550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:54258/0 (socket says 172.21.15.6:54258) 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.514+0000 7f8d9e66d640 1 -- 172.21.15.6:0/1903058175 learned_addr learned my addr 172.21.15.6:0/1903058175 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.514+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c49540 0x558d12c51b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.514+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c520b0 0x558d12cc2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.515+0000 7f8da2e6c740 1 -- 172.21.15.6:0/1903058175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c011190 con 0x558d12c520b0 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.515+0000 7f8da2e6c740 1 -- 172.21.15.6:0/1903058175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c010ac0 con 0x558d12c43b70 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.515+0000 7f8da2e6c740 1 -- 172.21.15.6:0/1903058175 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c00ddb0 con 0x558d12c49540 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.515+0000 7f8d9d66b640 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c49540 0x558d12c51b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.515+0000 7f8da2e6c740 10 client.0 _ll_register_callbacks cb 0x7f8d90009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.515+0000 7f8d9d66b640 1 -- 172.21.15.6:0/1903058175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c43b70 msgr2=0x558d12c550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.515+0000 7f8d9d66b640 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c43b70 0x558d12c550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.515+0000 7f8d9d66b640 1 -- 172.21.15.6:0/1903058175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c520b0 msgr2=0x558d12cc2a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.515+0000 7f8d9d66b640 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c520b0 0x558d12cc2a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.515+0000 7f8d9d66b640 1 -- 172.21.15.6:0/1903058175 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d12c52710 con 0x558d12c49540 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.516+0000 7f8d9d66b640 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c49540 0x558d12c51b70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c005cc0 tx=0x7f8d8c009930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d63ac30dfecff848 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.517+0000 7f8d817fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.517+0000 7f8d817fa640 1 -- 172.21.15.6:0/1903058175 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c055060 con 0x558d12c49540 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.517+0000 7f8da2e6c740 1 -- 172.21.15.6:0/1903058175 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d8c037040 con 0x558d12c49540 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.517+0000 7f8d817fa640 1 -- 172.21.15.6:0/1903058175 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f8d8c003970 con 0x558d12c49540 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.517+0000 7f8d817fa640 1 -- 172.21.15.6:0/1903058175 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8d8c05c050 con 0x558d12c49540 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.519+0000 7f8d9e66d640 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c43b70 0x558d12c550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.522+0000 7f8da2e6c740 10 client.25765 fetch_fsmap learned FSMap version 33 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.522+0000 7f8da2e6c740 1 -- 172.21.15.6:0/1903058175 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558d12cc4080 con 0x558d12c49540 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.524+0000 7f8d817fa640 1 -- 172.21.15.6:0/1903058175 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d8c0303a0 con 0x558d12c49540 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.524+0000 7f8d817fa640 1 -- 172.21.15.6:0/1903058175 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f8d8c03c040 con 0x558d12c49540 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.524+0000 7f8da2e6c740 10 client.25765 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:09:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.524+0000 7f8da2e6c740 10 client.25765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.524+0000 7f8da2e6c740 20 client.25765 populate_metadata read hostname 'smithi006' 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.524+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x558d12cc48a0 0x558d12cc6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.524+0000 7f8da2e6c740 4 client.25765 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.524+0000 7f8da2e6c740 1 -- 172.21.15.6:0/1903058175 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8d8c037040 con 0x558d12cc48a0 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.525+0000 7f8d9e66d640 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x558d12cc48a0 0x558d12cc6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.530+0000 7f8d9e66d640 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x558d12cc48a0 0x558d12cc6cc0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc4e545783cff623 server_cookie=ce998acc4a6b642 in_seq=0 out_seq=0 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.530+0000 7f8d817fa640 10 client.25765 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.582+0000 7f8d817fa640 1 -- 172.21.15.6:0/1903058175 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8d8c037040 con 0x558d12cc48a0 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.583+0000 7f8d817fa640 10 client.25765 handle_command_reply: tid=0 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.587+0000 7f8da2e6c740 1 client.25765 shutdown 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.588+0000 7f8da2e6c740 1 -- 172.21.15.6:0/1903058175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c49540 msgr2=0x558d12c51b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.588+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c49540 0x558d12c51b70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c005cc0 tx=0x7f8d8c009930 comp rx=0 tx=0).stop 2024-09-12T00:09:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.589+0000 7f8da2e6c740 1 -- 172.21.15.6:0/1903058175 shutdown_connections 2024-09-12T00:09:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.589+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d12c520b0 0x558d12cc2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.589+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x558d12cc48a0 0x558d12cc6cc0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.589+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d12c49540 0x558d12c51b70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.589+0000 7f8da2e6c740 1 --2- 172.21.15.6:0/1903058175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558d12c43b70 0x558d12c550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.589+0000 7f8da2e6c740 1 -- 172.21.15.6:0/1903058175 >> 172.21.15.6:0/1903058175 conn(0x558d12c3f1e0 msgr2=0x558d12c3da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.590+0000 7f8d817fa640 0 client.25765 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:09:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.591+0000 7f8da2e6c740 1 -- 172.21.15.6:0/1903058175 shutdown_connections 2024-09-12T00:09:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.592+0000 7f8da2e6c740 1 -- 172.21.15.6:0/1903058175 wait complete. 2024-09-12T00:09:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.593+0000 7f8da2e6c740 20 client.25765 trim_cache size 0 max 16384 2024-09-12T00:09:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:09:48.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:09:48.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:09:48.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:09:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.598+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2130875893 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8d880a2d20 msgr2=0x7f8d880a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.598+0000 7f8d9ee6e640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8d880a2d20 0x7f8d880a51e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8d840cc1d0 tx=0x7f8d840047d0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.598+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2130875893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d98072d80 msgr2=0x7f8d981a6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.598+0000 7f8d9ee6e640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d98072d80 0x7f8d981a6d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400b4a0 tx=0x7f8d8400b960 comp rx=0 tx=0).stop 2024-09-12T00:09:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.602+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2130875893 shutdown_connections 2024-09-12T00:09:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.603+0000 7f8d9ee6e640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8d880a2d20 0x7f8d880a51e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.603+0000 7f8d9ee6e640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d981ac270 0x7f8d981ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.603+0000 7f8d9ee6e640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9810de90 0x7f8d981a7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.519 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.603+0000 7f8d9ee6e640 1 --2- 172.21.15.6:0/2130875893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d98072d80 0x7f8d981a6d10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:48.519 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.603+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2130875893 >> 172.21.15.6:0/2130875893 conn(0x7f8d9806eb10 msgr2=0x7f8d9810f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:48.519 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.606+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2130875893 shutdown_connections 2024-09-12T00:09:48.519 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:09:47.606+0000 7f8d9ee6e640 1 -- 172.21.15.6:0/2130875893 wait complete. 2024-09-12T00:09:48.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:48 smithi134 ceph-mon[34893]: pgmap v673: 129 pgs: 129 active+clean; 13 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 4.52k op/s 2024-09-12T00:09:49.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:48 smithi039 ceph-mon[34543]: pgmap v673: 129 pgs: 129 active+clean; 13 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 4.52k op/s 2024-09-12T00:09:49.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:48 smithi006 ceph-mon[30947]: pgmap v673: 129 pgs: 129 active+clean; 13 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 4.52k op/s 2024-09-12T00:09:50.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:50 smithi134 ceph-mon[34893]: pgmap v674: 129 pgs: 129 active+clean; 13 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.43k op/s 2024-09-12T00:09:51.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:50 smithi039 ceph-mon[34543]: pgmap v674: 129 pgs: 129 active+clean; 13 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.43k op/s 2024-09-12T00:09:51.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:50 smithi006 ceph-mon[30947]: pgmap v674: 129 pgs: 129 active+clean; 13 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.43k op/s 2024-09-12T00:09:52.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:52 smithi134 ceph-mon[34893]: pgmap v675: 129 pgs: 129 active+clean; 13 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-12T00:09:53.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:52 smithi039 ceph-mon[34543]: pgmap v675: 129 pgs: 129 active+clean; 13 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-12T00:09:53.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:52 smithi006 ceph-mon[30947]: pgmap v675: 129 pgs: 129 active+clean; 13 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-12T00:09:54.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:54 smithi134 ceph-mon[34893]: pgmap v676: 129 pgs: 129 active+clean; 13 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 4.20k op/s 2024-09-12T00:09:55.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:54 smithi039 ceph-mon[34543]: pgmap v676: 129 pgs: 129 active+clean; 13 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 4.20k op/s 2024-09-12T00:09:55.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:54 smithi006 ceph-mon[30947]: pgmap v676: 129 pgs: 129 active+clean; 13 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 4.20k op/s 2024-09-12T00:09:56.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:56 smithi134 ceph-mon[34893]: pgmap v677: 129 pgs: 129 active+clean; 13 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 4.21k op/s 2024-09-12T00:09:57.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:56 smithi039 ceph-mon[34543]: pgmap v677: 129 pgs: 129 active+clean; 13 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 4.21k op/s 2024-09-12T00:09:57.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:56 smithi006 ceph-mon[30947]: pgmap v677: 129 pgs: 129 active+clean; 13 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 4.21k op/s 2024-09-12T00:09:58.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:09:58 smithi134 ceph-mon[34893]: pgmap v678: 129 pgs: 129 active+clean; 13 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-09-12T00:09:59.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:09:58 smithi039 ceph-mon[34543]: pgmap v678: 129 pgs: 129 active+clean; 13 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-09-12T00:09:59.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:09:58 smithi006 ceph-mon[30947]: pgmap v678: 129 pgs: 129 active+clean; 13 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-09-12T00:10:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.860+0000 7f8b82e8f640 1 -- 172.21.15.6:0/107488221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b7c109f70 msgr2=0x7f8b7c110890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.860+0000 7f8b82e8f640 1 --2- 172.21.15.6:0/107488221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b7c109f70 0x7f8b7c110890 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009ca0 tx=0x7f8b7402a8b0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.860+0000 7f8b82e8f640 1 -- 172.21.15.6:0/107488221 shutdown_connections 2024-09-12T00:10:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.860+0000 7f8b82e8f640 1 --2- 172.21.15.6:0/107488221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b7c109f70 0x7f8b7c110890 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.860+0000 7f8b82e8f640 1 --2- 172.21.15.6:0/107488221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c1095b0 0x7f8b7c109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.860+0000 7f8b82e8f640 1 --2- 172.21.15.6:0/107488221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b7c073550 0x7f8b7c073950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.860+0000 7f8b82e8f640 1 -- 172.21.15.6:0/107488221 >> 172.21.15.6:0/107488221 conn(0x7f8b7c06eb10 msgr2=0x7f8b7c070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.867+0000 7f8b82e8f640 1 -- 172.21.15.6:0/107488221 shutdown_connections 2024-09-12T00:10:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.869+0000 7f8b82e8f640 1 -- 172.21.15.6:0/107488221 wait complete. 2024-09-12T00:10:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.871+0000 7f8b82e8f640 1 Processor -- start 2024-09-12T00:10:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.871+0000 7f8b82e8f640 1 -- start start 2024-09-12T00:10:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.872+0000 7f8b82e8f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c073550 0x7f8b7c19e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.872+0000 7f8b82e8f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b7c1095b0 0x7f8b7c19e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.872+0000 7f8b81e8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c073550 0x7f8b7c19e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.872+0000 7f8b81e8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c073550 0x7f8b7c19e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:39166/0 (socket says 172.21.15.6:39166) 2024-09-12T00:10:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.872+0000 7f8b81e8d640 1 -- 172.21.15.6:0/772912203 learned_addr learned my addr 172.21.15.6:0/772912203 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.872+0000 7f8b82e8f640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b7c109f70 0x7f8b7c1a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.872+0000 7f8b82e8f640 1 -- 172.21.15.6:0/772912203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c113ac0 con 0x7f8b7c1095b0 2024-09-12T00:10:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.872+0000 7f8b82e8f640 1 -- 172.21.15.6:0/772912203 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c113940 con 0x7f8b7c109f70 2024-09-12T00:10:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.873+0000 7f8b82e8f640 1 -- 172.21.15.6:0/772912203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c113c40 con 0x7f8b7c073550 2024-09-12T00:10:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.873+0000 7f8b8268e640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b7c109f70 0x7f8b7c1a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:00.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.874+0000 7f8b8168c640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b7c1095b0 0x7f8b7c19e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.875+0000 7f8b81e8d640 1 -- 172.21.15.6:0/772912203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b7c109f70 msgr2=0x7f8b7c1a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.875+0000 7f8b81e8d640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b7c109f70 0x7f8b7c1a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.875+0000 7f8b81e8d640 1 -- 172.21.15.6:0/772912203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b7c1095b0 msgr2=0x7f8b7c19e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.875+0000 7f8b81e8d640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b7c1095b0 0x7f8b7c19e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.875+0000 7f8b81e8d640 1 -- 172.21.15.6:0/772912203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c1a5da0 con 0x7f8b7c073550 2024-09-12T00:10:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.877+0000 7f8b81e8d640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c073550 0x7f8b7c19e180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00fac0 tx=0x7f8b6c00ff80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.878+0000 7f8b72ffd640 1 -- 172.21.15.6:0/772912203 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c018030 con 0x7f8b7c073550 2024-09-12T00:10:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.878+0000 7f8b72ffd640 1 -- 172.21.15.6:0/772912203 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8b6c00e970 con 0x7f8b7c073550 2024-09-12T00:10:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.878+0000 7f8b72ffd640 1 -- 172.21.15.6:0/772912203 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c003b40 con 0x7f8b7c073550 2024-09-12T00:10:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.878+0000 7f8b82e8f640 1 -- 172.21.15.6:0/772912203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7c1a6090 con 0x7f8b7c073550 2024-09-12T00:10:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.878+0000 7f8b82e8f640 1 -- 172.21.15.6:0/772912203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b7c1a6590 con 0x7f8b7c073550 2024-09-12T00:10:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.884+0000 7f8b72ffd640 1 -- 172.21.15.6:0/772912203 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f8b6c01b070 con 0x7f8b7c073550 2024-09-12T00:10:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.884+0000 7f8b86e8d740 1 Processor -- start 2024-09-12T00:10:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.884+0000 7f8b86e8d740 1 -- start start 2024-09-12T00:10:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.885+0000 7f8b86e8d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.885+0000 7f8b86e8d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d2cc0 0x561f122d7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.885+0000 7f8b86e8d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122d7d50 0x561f122da210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.885+0000 7f8b86e8d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561f1222d2f0 con 0x561f122d2380 2024-09-12T00:10:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.885+0000 7f8b86e8d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561f121d5270 con 0x561f122d7d50 2024-09-12T00:10:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.885+0000 7f8b86e8d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561f122292b0 con 0x561f122d2cc0 2024-09-12T00:10:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.886+0000 7f8b8268e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.886+0000 7f8b8268e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40444/0 (socket says 172.21.15.6:40444) 2024-09-12T00:10:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.886+0000 7f8b8268e640 1 -- 172.21.15.6:0/4209707315 learned_addr learned my addr 172.21.15.6:0/4209707315 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.886+0000 7f8b72ffd640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8b680a2da0 0x7f8b680a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.887+0000 7f8b81e8d640 1 --2- 172.21.15.6:0/4209707315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d2cc0 0x561f122d7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.887+0000 7f8b72ffd640 1 -- 172.21.15.6:0/772912203 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f8b6c0cf1c0 con 0x7f8b7c073550 2024-09-12T00:10:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.888+0000 7f8b81e8d640 1 -- 172.21.15.6:0/4209707315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122d7d50 msgr2=0x561f122da210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:10:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.888+0000 7f8b81e8d640 1 --2- 172.21.15.6:0/4209707315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122d7d50 0x561f122da210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.888+0000 7f8b81e8d640 1 -- 172.21.15.6:0/4209707315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 msgr2=0x561f122d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.888+0000 7f8b81e8d640 1 --2- 172.21.15.6:0/4209707315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.888+0000 7f8b81e8d640 1 -- 172.21.15.6:0/4209707315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f121d4340 con 0x561f122d2cc0 2024-09-12T00:10:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.889+0000 7f8b8268e640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8b680a2da0 0x7f8b680a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.894+0000 7f8b81e8d640 1 --2- 172.21.15.6:0/4209707315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d2cc0 0x561f122d7780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c000c00 tx=0x7f8b6c09b110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5403de90c403e5b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.894+0000 7f8b67fff640 1 -- 172.21.15.6:0/4209707315 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c09b5d0 con 0x561f122d2cc0 2024-09-12T00:10:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.894+0000 7f8b67fff640 1 -- 172.21.15.6:0/4209707315 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8b6c09f980 con 0x561f122d2cc0 2024-09-12T00:10:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.894+0000 7f8b67fff640 1 -- 172.21.15.6:0/4209707315 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0b4270 con 0x561f122d2cc0 2024-09-12T00:10:00.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.896+0000 7f8b86e8d740 1 -- 172.21.15.6:0/4209707315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d2cc0 msgr2=0x561f122d7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:00.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.896+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/4209707315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d2cc0 0x561f122d7780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c000c00 tx=0x7f8b6c09b110 comp rx=0 tx=0).stop 2024-09-12T00:10:00.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.898+0000 7f8b86e8d740 1 -- 172.21.15.6:0/4209707315 shutdown_connections 2024-09-12T00:10:00.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.898+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/4209707315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122d7d50 0x561f122da210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.898+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/4209707315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d2cc0 0x561f122d7780 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.898+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/4209707315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.898+0000 7f8b86e8d740 1 -- 172.21.15.6:0/4209707315 >> 172.21.15.6:0/4209707315 conn(0x561f122c51e0 msgr2=0x561f122c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.900+0000 7f8b86e8d740 1 -- 172.21.15.6:0/4209707315 shutdown_connections 2024-09-12T00:10:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.903+0000 7f8b86e8d740 1 -- 172.21.15.6:0/4209707315 wait complete. 2024-09-12T00:10:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.903+0000 7f8b86e8d740 1 -- start start 2024-09-12T00:10:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.903+0000 7f8b86e8d740 1 Processor -- start 2024-09-12T00:10:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.903+0000 7f8b8268e640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8b680a2da0 0x7f8b680a5260 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009a60 tx=0x7f8b7402a8b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.906+0000 7f8b86e8d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122dc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.906+0000 7f8b86e8d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d2cc0 0x561f122dca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.906+0000 7f8b86e8d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122d7d50 0x561f122e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.906+0000 7f8b86e8d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561f122dacc0 con 0x561f122d2380 2024-09-12T00:10:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.906+0000 7f8b86e8d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561f121b6290 con 0x561f122d7d50 2024-09-12T00:10:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.907+0000 7f8b86e8d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561f122dae40 con 0x561f122d2cc0 2024-09-12T00:10:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.907+0000 7f8b86e8d740 10 client.0 _ll_register_callbacks cb 0x561f121e7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:10:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.908+0000 7f8b81e8d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122dc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.908+0000 7f8b81e8d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122dc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40446/0 (socket says 172.21.15.6:40446) 2024-09-12T00:10:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.908+0000 7f8b81e8d640 1 -- 172.21.15.6:0/3577516268 learned_addr learned my addr 172.21.15.6:0/3577516268 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.908+0000 7f8b81e8d640 1 -- 172.21.15.6:0/3577516268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d2cc0 msgr2=0x561f122dca60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:10:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.908+0000 7f8b81e8d640 1 --2- 172.21.15.6:0/3577516268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d2cc0 0x561f122dca60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.908+0000 7f8b81e8d640 1 -- 172.21.15.6:0/3577516268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122d7d50 msgr2=0x561f122e3aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:10:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.908+0000 7f8b81e8d640 1 --2- 172.21.15.6:0/3577516268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122d7d50 0x561f122e3aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.908+0000 7f8b81e8d640 1 -- 172.21.15.6:0/3577516268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f11f40210 con 0x561f122d2380 2024-09-12T00:10:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.910+0000 7f8b81e8d640 1 --2- 172.21.15.6:0/3577516268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122dc520 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0a3d10 tx=0x7f8b6c0971b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66694ffd7eaf7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.910+0000 7f8b657fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:10:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.913+0000 7f8b657fa640 1 -- 172.21.15.6:0/3577516268 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c09aa20 con 0x561f122d2380 2024-09-12T00:10:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.914+0000 7f8b86e8d740 1 -- 172.21.15.6:0/3577516268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b6c09f980 con 0x561f122d2380 2024-09-12T00:10:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.914+0000 7f8b657fa640 1 -- 172.21.15.6:0/3577516268 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f8b6c0b4070 con 0x561f122d2380 2024-09-12T00:10:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.914+0000 7f8b657fa640 1 -- 172.21.15.6:0/3577516268 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8b6c0ac050 con 0x561f122d2380 2024-09-12T00:10:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.914+0000 7f8b86e8d740 10 client.16167 fetch_fsmap learned FSMap version 33 2024-09-12T00:10:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.914+0000 7f8b86e8d740 1 -- 172.21.15.6:0/3577516268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561f1200c620 con 0x561f122d2380 2024-09-12T00:10:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.916+0000 7f8b657fa640 1 -- 172.21.15.6:0/3577516268 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8b6c09f980 con 0x561f122d2380 2024-09-12T00:10:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.917+0000 7f8b657fa640 1 -- 172.21.15.6:0/3577516268 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f8b6c025060 con 0x561f122d2380 2024-09-12T00:10:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.917+0000 7f8b86e8d740 10 client.16167 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:10:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.917+0000 7f8b86e8d740 10 client.16167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:10:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.917+0000 7f8b86e8d740 20 client.16167 populate_metadata read hostname 'smithi006' 2024-09-12T00:10:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.917+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/3577516268 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561f122cd7d0 0x561f122cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.917+0000 7f8b86e8d740 4 client.16167 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:10:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.917+0000 7f8b86e8d740 1 -- 172.21.15.6:0/3577516268 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f1223aa20 con 0x561f122cd7d0 2024-09-12T00:10:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.917+0000 7f8b8168c640 1 --2- 172.21.15.6:0/3577516268 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561f122cd7d0 0x561f122cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.919+0000 7f8b8168c640 1 --2- 172.21.15.6:0/3577516268 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561f122cd7d0 0x561f122cfc30 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fd0a00d74369548 server_cookie=3203608daf630800 in_seq=0 out_seq=0 2024-09-12T00:10:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.919+0000 7f8b657fa640 10 client.16167 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.920+0000 7f8b657fa640 1 -- 172.21.15.6:0/3577516268 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f1223aa20 con 0x561f122cd7d0 2024-09-12T00:10:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.920+0000 7f8b657fa640 10 client.16167 handle_command_reply: tid=0 2024-09-12T00:10:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.922+0000 7f8b86e8d740 1 client.16167 shutdown 2024-09-12T00:10:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.924+0000 7f8b86e8d740 1 -- 172.21.15.6:0/3577516268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 msgr2=0x561f122dc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.924+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/3577516268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122dc520 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0a3d10 tx=0x7f8b6c0971b0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.929+0000 7f8b86e8d740 1 -- 172.21.15.6:0/3577516268 shutdown_connections 2024-09-12T00:10:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.929+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/3577516268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122d7d50 0x561f122e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.929+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/3577516268 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561f122cd7d0 0x561f122cfc30 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.929+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/3577516268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d2cc0 0x561f122dca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.929+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/3577516268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122dc520 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.929+0000 7f8b86e8d740 1 -- 172.21.15.6:0/3577516268 >> 172.21.15.6:0/3577516268 conn(0x561f122c51e0 msgr2=0x561f122c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.935+0000 7f8b657fa640 0 client.16167 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.937+0000 7f8b86e8d740 1 -- 172.21.15.6:0/3577516268 shutdown_connections 2024-09-12T00:10:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.937+0000 7f8b86e8d740 1 -- 172.21.15.6:0/3577516268 wait complete. 2024-09-12T00:10:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.938+0000 7f8b86e8d740 20 client.16167 trim_cache size 0 max 16384 2024-09-12T00:10:00.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:00 smithi134 ceph-mon[34893]: pgmap v679: 129 pgs: 129 active+clean; 13 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.45k op/s 2024-09-12T00:10:00.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:00 smithi134 ceph-mon[34893]: overall HEALTH_OK 2024-09-12T00:10:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.990+0000 7f8b86e8d740 1 Processor -- start 2024-09-12T00:10:00.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.992+0000 7f8b86e8d740 1 -- start start 2024-09-12T00:10:00.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.993+0000 7f8b86e8d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122d2380 0x561f122dc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.993+0000 7f8b86e8d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2cc0 0x561f122e3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.993+0000 7f8b86e8d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d7d50 0x561f122dca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.993+0000 7f8b86e8d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c1b0c70 con 0x561f122d2cc0 2024-09-12T00:10:00.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.993+0000 7f8b86e8d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c1b27b0 con 0x561f122d2380 2024-09-12T00:10:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.993+0000 7f8b86e8d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c1b1340 con 0x561f122d7d50 2024-09-12T00:10:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.993+0000 7f8b8168c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2cc0 0x561f122e3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.993+0000 7f8b8168c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2cc0 0x561f122e3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40450/0 (socket says 172.21.15.6:40450) 2024-09-12T00:10:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.993+0000 7f8b8168c640 1 -- 172.21.15.6:0/2208588795 learned_addr learned my addr 172.21.15.6:0/2208588795 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.994+0000 7f8b8168c640 1 -- 172.21.15.6:0/2208588795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d7d50 msgr2=0x561f122dca20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:10:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.994+0000 7f8b8168c640 1 --2- 172.21.15.6:0/2208588795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d7d50 0x561f122dca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.994+0000 7f8b8168c640 1 -- 172.21.15.6:0/2208588795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122d2380 msgr2=0x561f122dc4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:10:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.994+0000 7f8b8168c640 1 --2- 172.21.15.6:0/2208588795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122d2380 0x561f122dc4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.994+0000 7f8b8168c640 1 -- 172.21.15.6:0/2208588795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f122c5000 con 0x561f122d2cc0 2024-09-12T00:10:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.994+0000 7f8b8168c640 1 --2- 172.21.15.6:0/2208588795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2cc0 0x561f122e3a60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x561f122c6060 tx=0x7f8b78005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8879226170fe86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.994+0000 7f8b677fe640 1 -- 172.21.15.6:0/2208588795 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78024070 con 0x561f122d2cc0 2024-09-12T00:10:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.995+0000 7f8b677fe640 1 -- 172.21.15.6:0/2208588795 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8b7801f460 con 0x561f122d2cc0 2024-09-12T00:10:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.996+0000 7f8b86e8d740 1 -- 172.21.15.6:0/2208588795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2cc0 msgr2=0x561f122e3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.996+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/2208588795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2cc0 0x561f122e3a60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x561f122c6060 tx=0x7f8b78005f90 comp rx=0 tx=0).stop 2024-09-12T00:10:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.996+0000 7f8b86e8d740 1 -- 172.21.15.6:0/2208588795 shutdown_connections 2024-09-12T00:10:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.996+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/2208588795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d7d50 0x561f122dca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.996+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/2208588795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2cc0 0x561f122e3a60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.996+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/2208588795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122d2380 0x561f122dc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.996+0000 7f8b86e8d740 1 -- 172.21.15.6:0/2208588795 >> 172.21.15.6:0/2208588795 conn(0x561f122c51e0 msgr2=0x561f122d3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.996+0000 7f8b86e8d740 1 -- 172.21.15.6:0/2208588795 shutdown_connections 2024-09-12T00:10:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.996+0000 7f8b86e8d740 1 -- 172.21.15.6:0/2208588795 wait complete. 2024-09-12T00:10:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.997+0000 7f8b86e8d740 1 -- start start 2024-09-12T00:10:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.997+0000 7f8b86e8d740 1 Processor -- start 2024-09-12T00:10:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.997+0000 7f8b86e8d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122de430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.997+0000 7f8b86e8d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d7d50 0x561f122e3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.997+0000 7f8b86e8d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122de970 0x561f12358fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.997+0000 7f8b86e8d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c1b20e0 con 0x561f122d2380 2024-09-12T00:10:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.997+0000 7f8b86e8d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c1b1a10 con 0x561f122de970 2024-09-12T00:10:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.997+0000 7f8b86e8d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c1aed00 con 0x561f122d7d50 2024-09-12T00:10:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.997+0000 7f8b86e8d740 10 client.0 _ll_register_callbacks cb 0x7f8b6c0cc810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:10:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.998+0000 7f8b8268e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122de970 0x561f12358fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.998+0000 7f8b8268e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122de970 0x561f12358fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:45756/0 (socket says 172.21.15.6:45756) 2024-09-12T00:10:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.998+0000 7f8b8268e640 1 -- 172.21.15.6:0/1520923855 learned_addr learned my addr 172.21.15.6:0/1520923855 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.998+0000 7f8b8168c640 1 --2- 172.21.15.6:0/1520923855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d7d50 0x561f122e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:00.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.998+0000 7f8b8268e640 1 -- 172.21.15.6:0/1520923855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d7d50 msgr2=0x561f122e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:00.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.998+0000 7f8b8268e640 1 --2- 172.21.15.6:0/1520923855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d7d50 0x561f122e3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.998+0000 7f8b8268e640 1 -- 172.21.15.6:0/1520923855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 msgr2=0x561f122de430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.998+0000 7f8b8268e640 1 --2- 172.21.15.6:0/1520923855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122de430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.999+0000 7f8b8268e640 1 -- 172.21.15.6:0/1520923855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f12359510 con 0x561f122de970 2024-09-12T00:10:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:00.999+0000 7f8b8268e640 1 --2- 172.21.15.6:0/1520923855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122de970 0x561f12358fd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8b74030d50 tx=0x7f8b740095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2994ce692acf284 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.000+0000 7f8b657fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:10:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.000+0000 7f8b657fa640 1 -- 172.21.15.6:0/1520923855 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74004240 con 0x561f122de970 2024-09-12T00:10:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.000+0000 7f8b86e8d740 1 -- 172.21.15.6:0/1520923855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561f12234d70 con 0x561f122de970 2024-09-12T00:10:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.000+0000 7f8b657fa640 1 -- 172.21.15.6:0/1520923855 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f8b740043e0 con 0x561f122de970 2024-09-12T00:10:01.001 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.000+0000 7f8b657fa640 1 -- 172.21.15.6:0/1520923855 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8b740045e0 con 0x561f122de970 2024-09-12T00:10:01.001 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.000+0000 7f8b86e8d740 10 client.25772 fetch_fsmap learned FSMap version 33 2024-09-12T00:10:01.001 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.001+0000 7f8b86e8d740 1 -- 172.21.15.6:0/1520923855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561f1235a790 con 0x561f122de970 2024-09-12T00:10:01.001 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.001+0000 7f8b657fa640 1 -- 172.21.15.6:0/1520923855 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x561f12234d70 con 0x561f122de970 2024-09-12T00:10:01.001 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.001+0000 7f8b657fa640 1 -- 172.21.15.6:0/1520923855 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f8b74031440 con 0x561f122de970 2024-09-12T00:10:01.001 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.001+0000 7f8b86e8d740 10 client.25772 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:10:01.001 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.001+0000 7f8b86e8d740 10 client.25772 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:10:01.001 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.001+0000 7f8b86e8d740 20 client.25772 populate_metadata read hostname 'smithi006' 2024-09-12T00:10:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.001+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/1520923855 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561f1235b120 0x561f1235d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.001+0000 7f8b86e8d740 4 client.25772 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:10:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.001+0000 7f8b86e8d740 1 -- 172.21.15.6:0/1520923855 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561f121b1900 con 0x561f1235b120 2024-09-12T00:10:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.002+0000 7f8b81e8d640 1 --2- 172.21.15.6:0/1520923855 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561f1235b120 0x561f1235d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.003+0000 7f8b81e8d640 1 --2- 172.21.15.6:0/1520923855 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561f1235b120 0x561f1235d540 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d37b755b4ec1285e server_cookie=3fa89e25afabed95 in_seq=0 out_seq=0 2024-09-12T00:10:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.003+0000 7f8b657fa640 10 client.25772 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:01.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:00 smithi039 ceph-mon[34543]: pgmap v679: 129 pgs: 129 active+clean; 13 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.45k op/s 2024-09-12T00:10:01.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:00 smithi039 ceph-mon[34543]: overall HEALTH_OK 2024-09-12T00:10:01.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:00 smithi006 ceph-mon[30947]: pgmap v679: 129 pgs: 129 active+clean; 13 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.45k op/s 2024-09-12T00:10:01.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:00 smithi006 ceph-mon[30947]: overall HEALTH_OK 2024-09-12T00:10:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.273+0000 7f8b657fa640 1 -- 172.21.15.6:0/1520923855 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561f121b1900 con 0x561f1235b120 2024-09-12T00:10:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.273+0000 7f8b657fa640 10 client.25772 handle_command_reply: tid=0 2024-09-12T00:10:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.273+0000 7f8b86e8d740 1 client.25772 shutdown 2024-09-12T00:10:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.273+0000 7f8b86e8d740 1 -- 172.21.15.6:0/1520923855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122de970 msgr2=0x561f12358fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.273+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/1520923855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122de970 0x561f12358fd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8b74030d50 tx=0x7f8b740095c0 comp rx=0 tx=0).stop 2024-09-12T00:10:01.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.273+0000 7f8b86e8d740 1 -- 172.21.15.6:0/1520923855 shutdown_connections 2024-09-12T00:10:01.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.273+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/1520923855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561f122de970 0x561f12358fd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:01.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.273+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/1520923855 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x561f1235b120 0x561f1235d540 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:01.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.273+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/1520923855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561f122d7d50 0x561f122e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:01.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.273+0000 7f8b86e8d740 1 --2- 172.21.15.6:0/1520923855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f122d2380 0x561f122de430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:01.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.273+0000 7f8b86e8d740 1 -- 172.21.15.6:0/1520923855 >> 172.21.15.6:0/1520923855 conn(0x561f122c51e0 msgr2=0x561f122d3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:01.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.273+0000 7f8b657fa640 0 client.25772 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:01.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.274+0000 7f8b86e8d740 1 -- 172.21.15.6:0/1520923855 shutdown_connections 2024-09-12T00:10:01.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.274+0000 7f8b86e8d740 1 -- 172.21.15.6:0/1520923855 wait complete. 2024-09-12T00:10:01.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.274+0000 7f8b86e8d740 20 client.25772 trim_cache size 0 max 16384 2024-09-12T00:10:01.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:10:01.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:10:01.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:10:01.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:10:01.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.279+0000 7f8b82e8f640 1 -- 172.21.15.6:0/772912203 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8b680a2da0 msgr2=0x7f8b680a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:01.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.279+0000 7f8b82e8f640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8b680a2da0 0x7f8b680a5260 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009a60 tx=0x7f8b7402a8b0 comp rx=0 tx=0).stop 2024-09-12T00:10:01.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.279+0000 7f8b82e8f640 1 -- 172.21.15.6:0/772912203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c073550 msgr2=0x7f8b7c19e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:01.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.279+0000 7f8b82e8f640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c073550 0x7f8b7c19e180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00fac0 tx=0x7f8b6c00ff80 comp rx=0 tx=0).stop 2024-09-12T00:10:01.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.279+0000 7f8b82e8f640 1 -- 172.21.15.6:0/772912203 shutdown_connections 2024-09-12T00:10:01.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.280+0000 7f8b82e8f640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f8b680a2da0 0x7f8b680a5260 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:01.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.280+0000 7f8b82e8f640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b7c109f70 0x7f8b7c1a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:01.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.280+0000 7f8b82e8f640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b7c1095b0 0x7f8b7c19e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:01.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.280+0000 7f8b82e8f640 1 --2- 172.21.15.6:0/772912203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c073550 0x7f8b7c19e180 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:01.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.280+0000 7f8b82e8f640 1 -- 172.21.15.6:0/772912203 >> 172.21.15.6:0/772912203 conn(0x7f8b7c06eb10 msgr2=0x7f8b7c10c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:01.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.281+0000 7f8b82e8f640 1 -- 172.21.15.6:0/772912203 shutdown_connections 2024-09-12T00:10:01.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:01.281+0000 7f8b82e8f640 1 -- 172.21.15.6:0/772912203 wait complete. 2024-09-12T00:10:02.782 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:02 smithi006 ceph-mon[30947]: pgmap v680: 129 pgs: 129 active+clean; 13 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 4.25k op/s 2024-09-12T00:10:03.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:02 smithi039 ceph-mon[34543]: pgmap v680: 129 pgs: 129 active+clean; 13 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 4.25k op/s 2024-09-12T00:10:03.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:02 smithi134 ceph-mon[34893]: pgmap v680: 129 pgs: 129 active+clean; 13 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 4.25k op/s 2024-09-12T00:10:05.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:04 smithi039 ceph-mon[34543]: pgmap v681: 129 pgs: 129 active+clean; 13 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-09-12T00:10:05.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:04 smithi006 ceph-mon[30947]: pgmap v681: 129 pgs: 129 active+clean; 13 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-09-12T00:10:05.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:04 smithi134 ceph-mon[34893]: pgmap v681: 129 pgs: 129 active+clean; 13 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-09-12T00:10:07.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:06 smithi039 ceph-mon[34543]: pgmap v682: 129 pgs: 129 active+clean; 13 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.44k op/s 2024-09-12T00:10:07.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:06 smithi006 ceph-mon[30947]: pgmap v682: 129 pgs: 129 active+clean; 13 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.44k op/s 2024-09-12T00:10:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:06 smithi134 ceph-mon[34893]: pgmap v682: 129 pgs: 129 active+clean; 13 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.44k op/s 2024-09-12T00:10:09.005 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:08 smithi134 ceph-mon[34893]: pgmap v683: 129 pgs: 129 active+clean; 13 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 4.51k op/s 2024-09-12T00:10:09.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:08 smithi039 ceph-mon[34543]: pgmap v683: 129 pgs: 129 active+clean; 13 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 4.51k op/s 2024-09-12T00:10:09.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:08 smithi006 ceph-mon[30947]: pgmap v683: 129 pgs: 129 active+clean; 13 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 4.51k op/s 2024-09-12T00:10:11.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:10 smithi039 ceph-mon[34543]: pgmap v684: 129 pgs: 129 active+clean; 13 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-09-12T00:10:11.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:10 smithi006 ceph-mon[30947]: pgmap v684: 129 pgs: 129 active+clean; 13 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-09-12T00:10:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:10 smithi134 ceph-mon[34893]: pgmap v684: 129 pgs: 129 active+clean; 13 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-09-12T00:10:13.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:12 smithi039 ceph-mon[34543]: pgmap v685: 129 pgs: 129 active+clean; 13 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 4.08k op/s 2024-09-12T00:10:13.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:12 smithi006 ceph-mon[30947]: pgmap v685: 129 pgs: 129 active+clean; 13 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 4.08k op/s 2024-09-12T00:10:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:12 smithi134 ceph-mon[34893]: pgmap v685: 129 pgs: 129 active+clean; 13 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 4.08k op/s 2024-09-12T00:10:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.485+0000 7faff8d6f640 1 -- 172.21.15.6:0/1127719546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faff41091f0 msgr2=0x7faff4109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.485+0000 7faff8d6f640 1 --2- 172.21.15.6:0/1127719546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faff41091f0 0x7faff4109670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009930 tx=0x7fafe402a480 comp rx=0 tx=0).stop 2024-09-12T00:10:14.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.495+0000 7faff8d6f640 1 -- 172.21.15.6:0/1127719546 shutdown_connections 2024-09-12T00:10:14.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.495+0000 7faff8d6f640 1 --2- 172.21.15.6:0/1127719546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faff4109bb0 0x7faff4119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.495+0000 7faff8d6f640 1 --2- 172.21.15.6:0/1127719546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faff41091f0 0x7faff4109670 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.495+0000 7faff8d6f640 1 --2- 172.21.15.6:0/1127719546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff40732d0 0x7faff40736d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.495+0000 7faff8d6f640 1 -- 172.21.15.6:0/1127719546 >> 172.21.15.6:0/1127719546 conn(0x7faff406eb10 msgr2=0x7faff4070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.505+0000 7faff8d6f640 1 -- 172.21.15.6:0/1127719546 shutdown_connections 2024-09-12T00:10:14.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.512+0000 7faff8d6f640 1 -- 172.21.15.6:0/1127719546 wait complete. 2024-09-12T00:10:14.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.513+0000 7faff8d6f640 1 Processor -- start 2024-09-12T00:10:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.515+0000 7faff8d6f640 1 -- start start 2024-09-12T00:10:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.515+0000 7faff8d6f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faff40732d0 0x7faff4115940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.515+0000 7faff8d6f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faff41091f0 0x7faff4115e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.515+0000 7faff8d6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff4109bb0 0x7faff41b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.515+0000 7faff8d6f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faff411c450 con 0x7faff4109bb0 2024-09-12T00:10:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.515+0000 7faff8d6f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7faff411c2d0 con 0x7faff41091f0 2024-09-12T00:10:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.515+0000 7faff8d6f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faff411c5d0 con 0x7faff40732d0 2024-09-12T00:10:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.516+0000 7faff259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faff40732d0 0x7faff4115940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.516+0000 7faff259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faff40732d0 0x7faff4115940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:53402/0 (socket says 172.21.15.6:53402) 2024-09-12T00:10:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.516+0000 7faff259c640 1 -- 172.21.15.6:0/2936328840 learned_addr learned my addr 172.21.15.6:0/2936328840 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.517+0000 7faff2d9d640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff4109bb0 0x7faff41b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.522 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.521+0000 7faff259c640 1 -- 172.21.15.6:0/2936328840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faff41091f0 msgr2=0x7faff4115e80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T00:10:14.522 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.521+0000 7faff259c640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faff41091f0 0x7faff4115e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.522 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.521+0000 7faff259c640 1 -- 172.21.15.6:0/2936328840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff4109bb0 msgr2=0x7faff41b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.522 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.521+0000 7faff259c640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff4109bb0 0x7faff41b6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.522 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.521+0000 7faff259c640 1 -- 172.21.15.6:0/2936328840 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff41b70a0 con 0x7faff40732d0 2024-09-12T00:10:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.524+0000 7faff259c640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faff40732d0 0x7faff4115940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fafec00b9c0 tx=0x7fafec00be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.524+0000 7fafe37fe640 1 -- 172.21.15.6:0/2936328840 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec019070 con 0x7faff40732d0 2024-09-12T00:10:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.524+0000 7fafe37fe640 1 -- 172.21.15.6:0/2936328840 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafec00cba0 con 0x7faff40732d0 2024-09-12T00:10:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.524+0000 7fafe37fe640 1 -- 172.21.15.6:0/2936328840 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec012580 con 0x7faff40732d0 2024-09-12T00:10:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.529+0000 7faff8d6f640 1 -- 172.21.15.6:0/2936328840 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff41b7270 con 0x7faff40732d0 2024-09-12T00:10:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.529+0000 7faff8d6f640 1 -- 172.21.15.6:0/2936328840 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff41b77f0 con 0x7faff40732d0 2024-09-12T00:10:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.532+0000 7faffbbe1740 1 Processor -- start 2024-09-12T00:10:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.532+0000 7faffbbe1740 1 -- start start 2024-09-12T00:10:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.533+0000 7faffbbe1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.533+0000 7faffbbe1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1a6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.533+0000 7faffbbe1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a7540 0x55bc1b1a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.533+0000 7faffbbe1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55bc1b1052f0 con 0x55bc1b1a1b70 2024-09-12T00:10:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.533+0000 7faffbbe1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bc1b0ad270 con 0x55bc1b1a7540 2024-09-12T00:10:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.533+0000 7faffbbe1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bc1b1012b0 con 0x55bc1b1a24b0 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.535+0000 7faff2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.535+0000 7faff2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1a1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47976/0 (socket says 172.21.15.6:47976) 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.535+0000 7faff2d9d640 1 -- 172.21.15.6:0/3663607843 learned_addr learned my addr 172.21.15.6:0/3663607843 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.536+0000 7faff1d9b640 1 --2- 172.21.15.6:0/3663607843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a7540 0x55bc1b1a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.536+0000 7faff2d9d640 1 -- 172.21.15.6:0/3663607843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 msgr2=0x55bc1b1a6f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.536+0000 7faff2d9d640 1 --2- 172.21.15.6:0/3663607843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1a6f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.536+0000 7faff2d9d640 1 -- 172.21.15.6:0/3663607843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a7540 msgr2=0x55bc1b1a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.536+0000 7faff2d9d640 1 --2- 172.21.15.6:0/3663607843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a7540 0x55bc1b1a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.536+0000 7faff2d9d640 1 -- 172.21.15.6:0/3663607843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc1b0ac340 con 0x55bc1b1a1b70 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.536+0000 7faff2d9d640 1 --2- 172.21.15.6:0/3663607843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1a1f70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009850 tx=0x7fafe8009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2868af014005166 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.537+0000 7fafe0ff9640 1 -- 172.21.15.6:0/3663607843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe8039070 con 0x55bc1b1a1b70 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.537+0000 7fafe0ff9640 1 -- 172.21.15.6:0/3663607843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafe8030e70 con 0x55bc1b1a1b70 2024-09-12T00:10:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.537+0000 7fafe0ff9640 1 -- 172.21.15.6:0/3663607843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe80343e0 con 0x55bc1b1a1b70 2024-09-12T00:10:14.538 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.538+0000 7fafe37fe640 1 -- 172.21.15.6:0/2936328840 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fafec01c070 con 0x7faff40732d0 2024-09-12T00:10:14.538 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.539+0000 7faffbbe1740 1 -- 172.21.15.6:0/3663607843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a1b70 msgr2=0x55bc1b1a1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.539+0000 7faffbbe1740 1 --2- 172.21.15.6:0/3663607843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1a1f70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009850 tx=0x7fafe8009d10 comp rx=0 tx=0).stop 2024-09-12T00:10:14.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.540+0000 7fafe37fe640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fafdc0a2da0 0x7fafdc0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.540+0000 7fafe37fe640 1 -- 172.21.15.6:0/2936328840 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fafec0ce8c0 con 0x7faff40732d0 2024-09-12T00:10:14.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.541+0000 7faffbbe1740 1 -- 172.21.15.6:0/3663607843 shutdown_connections 2024-09-12T00:10:14.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.541+0000 7faffbbe1740 1 --2- 172.21.15.6:0/3663607843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a7540 0x55bc1b1a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.541+0000 7faffbbe1740 1 --2- 172.21.15.6:0/3663607843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1a6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.541+0000 7faffbbe1740 1 --2- 172.21.15.6:0/3663607843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1a1f70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.541+0000 7faffbbe1740 1 -- 172.21.15.6:0/3663607843 >> 172.21.15.6:0/3663607843 conn(0x55bc1b19d1e0 msgr2=0x55bc1b19d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:14.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.544+0000 7faffbbe1740 1 -- 172.21.15.6:0/3663607843 shutdown_connections 2024-09-12T00:10:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.548+0000 7faff2d9d640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fafdc0a2da0 0x7fafdc0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.549+0000 7faffbbe1740 1 -- 172.21.15.6:0/3663607843 wait complete. 2024-09-12T00:10:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.549+0000 7faffbbe1740 1 -- start start 2024-09-12T00:10:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.549+0000 7faffbbe1740 1 Processor -- start 2024-09-12T00:10:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.550+0000 7faffbbe1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.550+0000 7faffbbe1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1ac340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.550+0000 7faffbbe1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a7540 0x55bc1b1b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.550+0000 7faffbbe1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55bc1b1aa510 con 0x55bc1b1a24b0 2024-09-12T00:10:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.550+0000 7faffbbe1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bc1b08e290 con 0x55bc1b1a1b70 2024-09-12T00:10:14.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.550+0000 7faffbbe1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bc1b1aa690 con 0x55bc1b1a7540 2024-09-12T00:10:14.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.551+0000 7faffbbe1740 10 client.0 _ll_register_callbacks cb 0x55bc1b0bf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:10:14.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.551+0000 7faff1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.551+0000 7faff1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1ac340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47988/0 (socket says 172.21.15.6:47988) 2024-09-12T00:10:14.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.551+0000 7faff1d9b640 1 -- 172.21.15.6:0/179227563 learned_addr learned my addr 172.21.15.6:0/179227563 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:14.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.552+0000 7faff259c640 1 --2- 172.21.15.6:0/179227563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.553+0000 7faff1d9b640 1 -- 172.21.15.6:0/179227563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a7540 msgr2=0x55bc1b1b3380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:10:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.553+0000 7faff1d9b640 1 --2- 172.21.15.6:0/179227563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a7540 0x55bc1b1b3380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.553+0000 7faff1d9b640 1 -- 172.21.15.6:0/179227563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a1b70 msgr2=0x55bc1b1abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.553+0000 7faff1d9b640 1 --2- 172.21.15.6:0/179227563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.553+0000 7faff1d9b640 1 -- 172.21.15.6:0/179227563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc1ae18210 con 0x55bc1b1a24b0 2024-09-12T00:10:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.555+0000 7faff1d9b640 1 --2- 172.21.15.6:0/179227563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1ac340 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009930 tx=0x7fafe4003800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1430a4d0ba66edc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.555+0000 7fafd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:10:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.555+0000 7fafd9ffb640 1 -- 172.21.15.6:0/179227563 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe403f070 con 0x55bc1b1a24b0 2024-09-12T00:10:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.555+0000 7faffbbe1740 1 -- 172.21.15.6:0/179227563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafe8030e70 con 0x55bc1b1a24b0 2024-09-12T00:10:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.556+0000 7fafd9ffb640 1 -- 172.21.15.6:0/179227563 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fafe4003d80 con 0x55bc1b1a24b0 2024-09-12T00:10:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.556+0000 7faff2d9d640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fafdc0a2da0 0x7fafdc0a5260 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fafe8006a30 tx=0x7fafe80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.556+0000 7fafd9ffb640 1 -- 172.21.15.6:0/179227563 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fafe404d050 con 0x55bc1b1a24b0 2024-09-12T00:10:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.556+0000 7faffbbe1740 10 client.16179 fetch_fsmap learned FSMap version 33 2024-09-12T00:10:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.556+0000 7faffbbe1740 1 -- 172.21.15.6:0/179227563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55bc1aee4620 con 0x55bc1b1a24b0 2024-09-12T00:10:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.556+0000 7fafd9ffb640 1 -- 172.21.15.6:0/179227563 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafe8030e70 con 0x55bc1b1a24b0 2024-09-12T00:10:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.557+0000 7fafd9ffb640 1 -- 172.21.15.6:0/179227563 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fafe40444f0 con 0x55bc1b1a24b0 2024-09-12T00:10:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.557+0000 7faffbbe1740 10 client.16179 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:10:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.557+0000 7faffbbe1740 10 client.16179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:10:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.557+0000 7faffbbe1740 20 client.16179 populate_metadata read hostname 'smithi006' 2024-09-12T00:10:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.557+0000 7faffbbe1740 1 --2- 172.21.15.6:0/179227563 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bc1b1b7a20 0x55bc1b1b9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.557+0000 7faffbbe1740 4 client.16179 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:10:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.557+0000 7faffbbe1740 1 -- 172.21.15.6:0/179227563 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc1b112a20 con 0x55bc1b1b7a20 2024-09-12T00:10:14.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.560+0000 7faff259c640 1 --2- 172.21.15.6:0/179227563 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bc1b1b7a20 0x55bc1b1b9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.570+0000 7faff259c640 1 --2- 172.21.15.6:0/179227563 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bc1b1b7a20 0x55bc1b1b9e70 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73c16f9ef20a5ff1 server_cookie=5e2b12b24306264a in_seq=0 out_seq=0 2024-09-12T00:10:14.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.570+0000 7fafd9ffb640 10 client.16179 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:14.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7fafd9ffb640 1 -- 172.21.15.6:0/179227563 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc1b112a20 con 0x55bc1b1b7a20 2024-09-12T00:10:14.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7fafd9ffb640 10 client.16179 handle_command_reply: tid=0 2024-09-12T00:10:14.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7faffbbe1740 1 client.16179 shutdown 2024-09-12T00:10:14.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7faffbbe1740 1 -- 172.21.15.6:0/179227563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a24b0 msgr2=0x55bc1b1ac340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7faffbbe1740 1 --2- 172.21.15.6:0/179227563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1ac340 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009930 tx=0x7fafe4003800 comp rx=0 tx=0).stop 2024-09-12T00:10:14.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7faffbbe1740 1 -- 172.21.15.6:0/179227563 shutdown_connections 2024-09-12T00:10:14.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7faffbbe1740 1 --2- 172.21.15.6:0/179227563 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bc1b1b7a20 0x55bc1b1b9e70 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7faffbbe1740 1 --2- 172.21.15.6:0/179227563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a7540 0x55bc1b1b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7faffbbe1740 1 --2- 172.21.15.6:0/179227563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1ac340 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7faffbbe1740 1 --2- 172.21.15.6:0/179227563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7fafd9ffb640 0 client.16179 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7faffbbe1740 1 -- 172.21.15.6:0/179227563 >> 172.21.15.6:0/179227563 conn(0x55bc1b19d1e0 msgr2=0x55bc1b19e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7faffbbe1740 1 -- 172.21.15.6:0/179227563 shutdown_connections 2024-09-12T00:10:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7faffbbe1740 1 -- 172.21.15.6:0/179227563 wait complete. 2024-09-12T00:10:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.571+0000 7faffbbe1740 20 client.16179 trim_cache size 0 max 16384 2024-09-12T00:10:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.596+0000 7faffbbe1740 1 Processor -- start 2024-09-12T00:10:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.596+0000 7faffbbe1740 1 -- start start 2024-09-12T00:10:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.597+0000 7faffbbe1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b19d1e0 0x55bc1b19d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.598+0000 7faff259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b19d1e0 0x55bc1b19d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.598+0000 7faff259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b19d1e0 0x55bc1b19d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:42642/0 (socket says 172.21.15.6:42642) 2024-09-12T00:10:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.598+0000 7faff259c640 1 -- 172.21.15.6:0/4098195749 learned_addr learned my addr 172.21.15.6:0/4098195749 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.598+0000 7faffbbe1740 1 --2- 172.21.15.6:0/4098195749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1b3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.598+0000 7faffbbe1740 1 --2- 172.21.15.6:0/4098195749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 0x55bc1b19db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.598+0000 7faffbbe1740 1 -- 172.21.15.6:0/4098195749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fafd400fe20 con 0x55bc1b1a1b70 2024-09-12T00:10:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.599+0000 7faff1d9b640 1 --2- 172.21.15.6:0/4098195749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.599+0000 7faff2d9d640 1 --2- 172.21.15.6:0/4098195749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 0x55bc1b19db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.599+0000 7faffbbe1740 1 -- 172.21.15.6:0/4098195749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fafd4011960 con 0x55bc1b19d1e0 2024-09-12T00:10:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.599+0000 7faffbbe1740 1 -- 172.21.15.6:0/4098195749 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40104f0 con 0x55bc1b1a24b0 2024-09-12T00:10:14.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.601+0000 7faff259c640 1 -- 172.21.15.6:0/4098195749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 msgr2=0x55bc1b19db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:14.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.601+0000 7faff259c640 1 --2- 172.21.15.6:0/4098195749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 0x55bc1b19db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.601+0000 7faff259c640 1 -- 172.21.15.6:0/4098195749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a1b70 msgr2=0x55bc1b1b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:14.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.601+0000 7faff259c640 1 --2- 172.21.15.6:0/4098195749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.602+0000 7faff259c640 1 -- 172.21.15.6:0/4098195749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc1b19d000 con 0x55bc1b19d1e0 2024-09-12T00:10:14.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.603+0000 7faff259c640 1 --2- 172.21.15.6:0/4098195749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b19d1e0 0x55bc1b19d5c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fafec014e60 tx=0x7fafec00e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49504080c235b871 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.604+0000 7fafdbfff640 1 -- 172.21.15.6:0/4098195749 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec099080 con 0x55bc1b19d1e0 2024-09-12T00:10:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.604+0000 7fafdbfff640 1 -- 172.21.15.6:0/4098195749 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafec0cc080 con 0x55bc1b19d1e0 2024-09-12T00:10:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.605+0000 7faffbbe1740 1 -- 172.21.15.6:0/4098195749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b19d1e0 msgr2=0x55bc1b19d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.605+0000 7faffbbe1740 1 --2- 172.21.15.6:0/4098195749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b19d1e0 0x55bc1b19d5c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fafec014e60 tx=0x7fafec00e040 comp rx=0 tx=0).stop 2024-09-12T00:10:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.608+0000 7faffbbe1740 1 -- 172.21.15.6:0/4098195749 shutdown_connections 2024-09-12T00:10:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.608+0000 7faffbbe1740 1 --2- 172.21.15.6:0/4098195749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 0x55bc1b19db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.608+0000 7faffbbe1740 1 --2- 172.21.15.6:0/4098195749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.608+0000 7faffbbe1740 1 --2- 172.21.15.6:0/4098195749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b19d1e0 0x55bc1b19d5c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.608+0000 7faffbbe1740 1 -- 172.21.15.6:0/4098195749 >> 172.21.15.6:0/4098195749 conn(0x55bc1b1a7060 msgr2=0x55bc1b1ab380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:14.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.611+0000 7faffbbe1740 1 -- 172.21.15.6:0/4098195749 shutdown_connections 2024-09-12T00:10:14.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.612+0000 7faffbbe1740 1 -- 172.21.15.6:0/4098195749 wait complete. 2024-09-12T00:10:14.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.613+0000 7faffbbe1740 1 -- start start 2024-09-12T00:10:14.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.613+0000 7faffbbe1740 1 Processor -- start 2024-09-12T00:10:14.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.614+0000 7faffbbe1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b19d1e0 0x55bc1b1b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.614+0000 7faffbbe1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.614+0000 7faffbbe1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.614+0000 7faffbbe1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fafd4011290 con 0x55bc1b19d1e0 2024-09-12T00:10:14.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.614+0000 7faffbbe1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fafd4010bc0 con 0x55bc1b1a1b70 2024-09-12T00:10:14.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.614+0000 7faffbbe1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fafd400de00 con 0x55bc1b1a24b0 2024-09-12T00:10:14.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.614+0000 7faffbbe1740 10 client.0 _ll_register_callbacks cb 0x7fafe4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:10:14.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.614+0000 7faff1d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.614+0000 7faff1d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:42652/0 (socket says 172.21.15.6:42652) 2024-09-12T00:10:14.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.614+0000 7faff1d9b640 1 -- 172.21.15.6:0/2806520103 learned_addr learned my addr 172.21.15.6:0/2806520103 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:14.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.614+0000 7faff2d9d640 1 --2- 172.21.15.6:0/2806520103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.615+0000 7faff1d9b640 1 -- 172.21.15.6:0/2806520103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 msgr2=0x55bc1b1b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:14.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.615+0000 7faff1d9b640 1 --2- 172.21.15.6:0/2806520103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.615+0000 7faff1d9b640 1 -- 172.21.15.6:0/2806520103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b19d1e0 msgr2=0x55bc1b1b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:14.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.615+0000 7faff1d9b640 1 --2- 172.21.15.6:0/2806520103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b19d1e0 0x55bc1b1b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.615+0000 7faff1d9b640 1 -- 172.21.15.6:0/2806520103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc1b1b2450 con 0x55bc1b1a1b70 2024-09-12T00:10:14.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.616+0000 7faff1d9b640 1 --2- 172.21.15.6:0/2806520103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1b0e30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fafe4005d90 tx=0x7fafe4004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dafe38256444dcc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:14.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.616+0000 7fafd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:10:14.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.617+0000 7fafd9ffb640 1 -- 172.21.15.6:0/2806520103 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe404a040 con 0x55bc1b1a1b70 2024-09-12T00:10:14.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.617+0000 7faffbbe1740 1 -- 172.21.15.6:0/2806520103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafec0cc080 con 0x55bc1b1a1b70 2024-09-12T00:10:14.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.617+0000 7fafd9ffb640 1 -- 172.21.15.6:0/2806520103 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fafe402ae40 con 0x55bc1b1a1b70 2024-09-12T00:10:14.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.618+0000 7fafd9ffb640 1 -- 172.21.15.6:0/2806520103 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fafe4062050 con 0x55bc1b1a1b70 2024-09-12T00:10:14.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.620+0000 7faffbbe1740 10 client.25787 fetch_fsmap learned FSMap version 33 2024-09-12T00:10:14.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.620+0000 7faffbbe1740 1 -- 172.21.15.6:0/2806520103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55bc1b222750 con 0x55bc1b1a1b70 2024-09-12T00:10:14.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.620+0000 7fafd9ffb640 1 -- 172.21.15.6:0/2806520103 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafec0cc080 con 0x55bc1b1a1b70 2024-09-12T00:10:14.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.621+0000 7fafd9ffb640 1 -- 172.21.15.6:0/2806520103 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fafe4031710 con 0x55bc1b1a1b70 2024-09-12T00:10:14.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.622+0000 7faffbbe1740 10 client.25787 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:10:14.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.622+0000 7faffbbe1740 10 client.25787 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:10:14.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.622+0000 7faffbbe1740 20 client.25787 populate_metadata read hostname 'smithi006' 2024-09-12T00:10:14.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.622+0000 7faffbbe1740 1 --2- 172.21.15.6:0/2806520103 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bc1b1a7540 0x55bc1b225080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.622+0000 7faffbbe1740 4 client.25787 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:10:14.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.622+0000 7faffbbe1740 1 -- 172.21.15.6:0/2806520103 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc1b10cd70 con 0x55bc1b1a7540 2024-09-12T00:10:14.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.624+0000 7faff259c640 1 --2- 172.21.15.6:0/2806520103 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bc1b1a7540 0x55bc1b225080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.626+0000 7faff259c640 1 --2- 172.21.15.6:0/2806520103 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bc1b1a7540 0x55bc1b225080 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=550d40ba5df58340 server_cookie=99430fc19e753cd5 in_seq=0 out_seq=0 2024-09-12T00:10:14.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.626+0000 7fafd9ffb640 10 client.25787 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.976+0000 7fafd9ffb640 1 -- 172.21.15.6:0/2806520103 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc1b10cd70 con 0x55bc1b1a7540 2024-09-12T00:10:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.976+0000 7fafd9ffb640 10 client.25787 handle_command_reply: tid=0 2024-09-12T00:10:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.976+0000 7faffbbe1740 1 client.25787 shutdown 2024-09-12T00:10:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.977+0000 7faffbbe1740 1 -- 172.21.15.6:0/2806520103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a1b70 msgr2=0x55bc1b1b0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.977+0000 7faffbbe1740 1 --2- 172.21.15.6:0/2806520103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1b0e30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fafe4005d90 tx=0x7fafe4004610 comp rx=0 tx=0).stop 2024-09-12T00:10:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.977+0000 7faffbbe1740 1 -- 172.21.15.6:0/2806520103 shutdown_connections 2024-09-12T00:10:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.977+0000 7faffbbe1740 1 --2- 172.21.15.6:0/2806520103 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55bc1b1a7540 0x55bc1b225080 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.977+0000 7faffbbe1740 1 --2- 172.21.15.6:0/2806520103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bc1b1a24b0 0x55bc1b1b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.977+0000 7faffbbe1740 1 --2- 172.21.15.6:0/2806520103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc1b1a1b70 0x55bc1b1b0e30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.977+0000 7faffbbe1740 1 --2- 172.21.15.6:0/2806520103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc1b19d1e0 0x55bc1b1b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.977+0000 7faffbbe1740 1 -- 172.21.15.6:0/2806520103 >> 172.21.15.6:0/2806520103 conn(0x55bc1b1a7060 msgr2=0x55bc1b1ab310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.977+0000 7fafd9ffb640 0 client.25787 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.978+0000 7faffbbe1740 1 -- 172.21.15.6:0/2806520103 shutdown_connections 2024-09-12T00:10:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.980+0000 7faffbbe1740 1 -- 172.21.15.6:0/2806520103 wait complete. 2024-09-12T00:10:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.981+0000 7faffbbe1740 20 client.25787 trim_cache size 0 max 16384 2024-09-12T00:10:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:10:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:10:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:10:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:10:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.986+0000 7faff8d6f640 1 -- 172.21.15.6:0/2936328840 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fafdc0a2da0 msgr2=0x7fafdc0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.986+0000 7faff8d6f640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fafdc0a2da0 0x7fafdc0a5260 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fafe8006a30 tx=0x7fafe80046c0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.986+0000 7faff8d6f640 1 -- 172.21.15.6:0/2936328840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faff40732d0 msgr2=0x7faff4115940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.986+0000 7faff8d6f640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faff40732d0 0x7faff4115940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fafec00b9c0 tx=0x7fafec00be80 comp rx=0 tx=0).stop 2024-09-12T00:10:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.990+0000 7faff8d6f640 1 -- 172.21.15.6:0/2936328840 shutdown_connections 2024-09-12T00:10:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.990+0000 7faff8d6f640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fafdc0a2da0 0x7fafdc0a5260 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.990+0000 7faff8d6f640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff4109bb0 0x7faff41b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.990+0000 7faff8d6f640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faff41091f0 0x7faff4115e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.990+0000 7faff8d6f640 1 --2- 172.21.15.6:0/2936328840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faff40732d0 0x7faff4115940 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.990+0000 7faff8d6f640 1 -- 172.21.15.6:0/2936328840 >> 172.21.15.6:0/2936328840 conn(0x7faff406eb10 msgr2=0x7faff40715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.991+0000 7faff8d6f640 1 -- 172.21.15.6:0/2936328840 shutdown_connections 2024-09-12T00:10:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:14.991+0000 7faff8d6f640 1 -- 172.21.15.6:0/2936328840 wait complete. 2024-09-12T00:10:15.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:14 smithi039 ceph-mon[34543]: pgmap v686: 129 pgs: 129 active+clean; 13 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.36k op/s 2024-09-12T00:10:15.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:14 smithi006 ceph-mon[30947]: pgmap v686: 129 pgs: 129 active+clean; 13 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.36k op/s 2024-09-12T00:10:15.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:14 smithi134 ceph-mon[34893]: pgmap v686: 129 pgs: 129 active+clean; 13 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.36k op/s 2024-09-12T00:10:17.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:16 smithi039 ceph-mon[34543]: pgmap v687: 129 pgs: 129 active+clean; 13 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-09-12T00:10:17.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:16 smithi006 ceph-mon[30947]: pgmap v687: 129 pgs: 129 active+clean; 13 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-09-12T00:10:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:16 smithi134 ceph-mon[34893]: pgmap v687: 129 pgs: 129 active+clean; 13 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-09-12T00:10:19.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:18 smithi039 ceph-mon[34543]: pgmap v688: 129 pgs: 129 active+clean; 13 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 4.39k op/s 2024-09-12T00:10:19.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:18 smithi006 ceph-mon[30947]: pgmap v688: 129 pgs: 129 active+clean; 13 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 4.39k op/s 2024-09-12T00:10:19.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:18 smithi134 ceph-mon[34893]: pgmap v688: 129 pgs: 129 active+clean; 13 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 4.39k op/s 2024-09-12T00:10:21.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:20 smithi039 ceph-mon[34543]: pgmap v689: 129 pgs: 129 active+clean; 13 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-09-12T00:10:21.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:20 smithi006 ceph-mon[30947]: pgmap v689: 129 pgs: 129 active+clean; 13 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-09-12T00:10:21.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:20 smithi134 ceph-mon[34893]: pgmap v689: 129 pgs: 129 active+clean; 13 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-09-12T00:10:23.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:22 smithi039 ceph-mon[34543]: pgmap v690: 129 pgs: 129 active+clean; 13 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 16 MiB/s wr, 4.13k op/s 2024-09-12T00:10:23.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:22 smithi006 ceph-mon[30947]: pgmap v690: 129 pgs: 129 active+clean; 13 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 16 MiB/s wr, 4.13k op/s 2024-09-12T00:10:23.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:22 smithi134 ceph-mon[34893]: pgmap v690: 129 pgs: 129 active+clean; 13 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 16 MiB/s wr, 4.13k op/s 2024-09-12T00:10:24.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:23 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:10:24.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:23 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:10:24.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:23 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:10:25.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:24 smithi006 ceph-mon[30947]: pgmap v691: 129 pgs: 129 active+clean; 13 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2024-09-12T00:10:25.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:10:25.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:24 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:10:25.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:24 smithi134 ceph-mon[34893]: pgmap v691: 129 pgs: 129 active+clean; 13 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2024-09-12T00:10:25.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:10:25.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:24 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:10:25.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:24 smithi039 ceph-mon[34543]: pgmap v691: 129 pgs: 129 active+clean; 13 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2024-09-12T00:10:25.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:10:25.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:24 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:10:26.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:10:26.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:10:26.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:25 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:10:26.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:10:26.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:10:26.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:25 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:10:26.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:10:26.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:10:26.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:25 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:10:27.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:26 smithi006 ceph-mon[30947]: pgmap v692: 129 pgs: 129 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-12T00:10:27.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:26 smithi134 ceph-mon[34893]: pgmap v692: 129 pgs: 129 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-12T00:10:27.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:26 smithi039 ceph-mon[34543]: pgmap v692: 129 pgs: 129 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-12T00:10:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.259+0000 7f716aa5c640 1 -- 172.21.15.6:0/4285338187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71640732d0 msgr2=0x7f71640736d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.259+0000 7f716aa5c640 1 --2- 172.21.15.6:0/4285338187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71640732d0 0x7f71640736d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f715801a910 tx=0x7f715803b470 comp rx=0 tx=0).stop 2024-09-12T00:10:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.259+0000 7f716aa5c640 1 -- 172.21.15.6:0/4285338187 shutdown_connections 2024-09-12T00:10:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.259+0000 7f716aa5c640 1 --2- 172.21.15.6:0/4285338187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7164109bb0 0x7f7164119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.259+0000 7f716aa5c640 1 --2- 172.21.15.6:0/4285338187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71641091f0 0x7f7164109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.259+0000 7f716aa5c640 1 --2- 172.21.15.6:0/4285338187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71640732d0 0x7f71640736d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.259+0000 7f716aa5c640 1 -- 172.21.15.6:0/4285338187 >> 172.21.15.6:0/4285338187 conn(0x7f716406eb10 msgr2=0x7f7164070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.260+0000 7f716aa5c640 1 -- 172.21.15.6:0/4285338187 shutdown_connections 2024-09-12T00:10:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.260+0000 7f716aa5c640 1 -- 172.21.15.6:0/4285338187 wait complete. 2024-09-12T00:10:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.260+0000 7f716aa5c640 1 Processor -- start 2024-09-12T00:10:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.261+0000 7f716aa5c640 1 -- start start 2024-09-12T00:10:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.261+0000 7f716aa5c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71640732d0 0x7f716419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.261+0000 7f716aa5c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71641091f0 0x7f716419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.261+0000 7f716aa5c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7164109bb0 0x7f716407a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.261+0000 7f716aa5c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7164113300 con 0x7f71640732d0 2024-09-12T00:10:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.261+0000 7f716aa5c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7164113180 con 0x7f7164109bb0 2024-09-12T00:10:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.261+0000 7f716aa5c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7164113480 con 0x7f71641091f0 2024-09-12T00:10:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.261+0000 7f7168ff9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7164109bb0 0x7f716407a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.261+0000 7f7168ff9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7164109bb0 0x7f716407a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:41600/0 (socket says 172.21.15.6:41600) 2024-09-12T00:10:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.261+0000 7f7168ff9640 1 -- 172.21.15.6:0/2509838704 learned_addr learned my addr 172.21.15.6:0/2509838704 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.262+0000 7f71637fe640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71641091f0 0x7f716419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.262+0000 7f7168ff9640 1 -- 172.21.15.6:0/2509838704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71641091f0 msgr2=0x7f716419ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.262+0000 7f7168ff9640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71641091f0 0x7f716419ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.262+0000 7f7168ff9640 1 -- 172.21.15.6:0/2509838704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71640732d0 msgr2=0x7f716419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.262+0000 7f7168ff9640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71640732d0 0x7f716419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.262+0000 7f7168ff9640 1 -- 172.21.15.6:0/2509838704 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716407aac0 con 0x7f7164109bb0 2024-09-12T00:10:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.262+0000 7f7168ff9640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7164109bb0 0x7f716407a450 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7154009fd0 tx=0x7f715400b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.263+0000 7f71617fa640 1 -- 172.21.15.6:0/2509838704 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154011830 con 0x7f7164109bb0 2024-09-12T00:10:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.263+0000 7f71617fa640 1 -- 172.21.15.6:0/2509838704 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7154016070 con 0x7f7164109bb0 2024-09-12T00:10:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.263+0000 7f71617fa640 1 -- 172.21.15.6:0/2509838704 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154010e20 con 0x7f7164109bb0 2024-09-12T00:10:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.263+0000 7f716aa5c640 1 -- 172.21.15.6:0/2509838704 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716407adb0 con 0x7f7164109bb0 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.263+0000 7f716aa5c640 1 -- 172.21.15.6:0/2509838704 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f716407b330 con 0x7f7164109bb0 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.267+0000 7f716d7ed740 1 Processor -- start 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.268+0000 7f71617fa640 1 -- 172.21.15.6:0/2509838704 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f715401b4a0 con 0x7f7164109bb0 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.269+0000 7f71617fa640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f714c0a2da0 0x7f714c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.270+0000 7f71617fa640 1 -- 172.21.15.6:0/2509838704 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f71540cf960 con 0x7f7164109bb0 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.270+0000 7f716d7ed740 1 -- start start 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.270+0000 7f716d7ed740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6db70 0x562d6df6df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.270+0000 7f716d7ed740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df6e4b0 0x562d6df72f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.270+0000 7f716d7ed740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df73540 0x562d6df75a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.270+0000 7f716d7ed740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562d6ded12f0 con 0x562d6df6e4b0 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.270+0000 7f716d7ed740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562d6de79270 con 0x562d6df6db70 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.270+0000 7f716d7ed740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562d6decd2b0 con 0x562d6df73540 2024-09-12T00:10:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.270+0000 7f71637fe640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f714c0a2da0 0x7f714c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.271+0000 7f7163fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6db70 0x562d6df6df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.271+0000 7f7163fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6db70 0x562d6df6df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:41614/0 (socket says 172.21.15.6:41614) 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.271+0000 7f7163fff640 1 -- 172.21.15.6:0/1368060762 learned_addr learned my addr 172.21.15.6:0/1368060762 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.271+0000 7f7163fff640 1 -- 172.21.15.6:0/1368060762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df73540 msgr2=0x562d6df75a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.271+0000 7f7163fff640 1 --2- 172.21.15.6:0/1368060762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df73540 0x562d6df75a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.271+0000 7f7163fff640 1 -- 172.21.15.6:0/1368060762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df6e4b0 msgr2=0x562d6df72f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.271+0000 7f7163fff640 1 --2- 172.21.15.6:0/1368060762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df6e4b0 0x562d6df72f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.271+0000 7f7163fff640 1 -- 172.21.15.6:0/1368060762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d6de78340 con 0x562d6df6db70 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.273+0000 7f7163fff640 1 --2- 172.21.15.6:0/1368060762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6db70 0x562d6df6df70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71580049d0 tx=0x7f715801a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4570a66a37b9a677 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.274+0000 7f71637fe640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f714c0a2da0 0x7f714c0a5260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x562d6df6eee0 tx=0x7f715c009c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.278+0000 7f714a7fc640 1 -- 172.21.15.6:0/1368060762 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158051070 con 0x562d6df6db70 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.278+0000 7f714a7fc640 1 -- 172.21.15.6:0/1368060762 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71580409c0 con 0x562d6df6db70 2024-09-12T00:10:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.278+0000 7f714a7fc640 1 -- 172.21.15.6:0/1368060762 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158042880 con 0x562d6df6db70 2024-09-12T00:10:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.279+0000 7f716d7ed740 1 -- 172.21.15.6:0/1368060762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6db70 msgr2=0x562d6df6df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.279+0000 7f716d7ed740 1 --2- 172.21.15.6:0/1368060762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6db70 0x562d6df6df70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71580049d0 tx=0x7f715801a630 comp rx=0 tx=0).stop 2024-09-12T00:10:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.281+0000 7f716d7ed740 1 -- 172.21.15.6:0/1368060762 shutdown_connections 2024-09-12T00:10:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.281+0000 7f716d7ed740 1 --2- 172.21.15.6:0/1368060762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df73540 0x562d6df75a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.281+0000 7f716d7ed740 1 --2- 172.21.15.6:0/1368060762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df6e4b0 0x562d6df72f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.281+0000 7f716d7ed740 1 --2- 172.21.15.6:0/1368060762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6db70 0x562d6df6df70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.282+0000 7f716d7ed740 1 -- 172.21.15.6:0/1368060762 >> 172.21.15.6:0/1368060762 conn(0x562d6df691e0 msgr2=0x562d6df695e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.282+0000 7f716d7ed740 1 -- 172.21.15.6:0/1368060762 shutdown_connections 2024-09-12T00:10:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.282+0000 7f716d7ed740 1 -- 172.21.15.6:0/1368060762 wait complete. 2024-09-12T00:10:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.283+0000 7f716d7ed740 1 -- start start 2024-09-12T00:10:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.283+0000 7f716d7ed740 1 Processor -- start 2024-09-12T00:10:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.284+0000 7f716d7ed740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 0x562d6df77dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.284+0000 7f716d7ed740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df6e4b0 0x562d6df78310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.284+0000 7f716d7ed740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df73540 0x562d6df7f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.284+0000 7f716d7ed740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562d6df76500 con 0x562d6df6e4b0 2024-09-12T00:10:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.284+0000 7f716d7ed740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562d6de5a290 con 0x562d6df73540 2024-09-12T00:10:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.284+0000 7f716d7ed740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562d6df76680 con 0x562d6df6db70 2024-09-12T00:10:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.284+0000 7f716d7ed740 10 client.0 _ll_register_callbacks cb 0x562d6de8b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:10:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.285+0000 7f7163fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 0x562d6df77dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.285+0000 7f7163fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 0x562d6df77dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:49226/0 (socket says 172.21.15.6:49226) 2024-09-12T00:10:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.285+0000 7f7163fff640 1 -- 172.21.15.6:0/209996743 learned_addr learned my addr 172.21.15.6:0/209996743 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.285+0000 7f7168ff9640 1 --2- 172.21.15.6:0/209996743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df73540 0x562d6df7f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.285+0000 7f7163fff640 1 -- 172.21.15.6:0/209996743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df73540 msgr2=0x562d6df7f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.285+0000 7f7163fff640 1 --2- 172.21.15.6:0/209996743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df73540 0x562d6df7f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.285+0000 7f7163fff640 1 -- 172.21.15.6:0/209996743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df6e4b0 msgr2=0x562d6df78310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.285+0000 7f7163fff640 1 --2- 172.21.15.6:0/209996743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df6e4b0 0x562d6df78310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.285+0000 7f7163fff640 1 -- 172.21.15.6:0/209996743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d6dbe4210 con 0x562d6df6db70 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.286+0000 7f7163fff640 1 --2- 172.21.15.6:0/209996743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 0x562d6df77dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f715803bc60 tx=0x7f7158040da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b15edbe8cff68f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.287+0000 7f71437fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.287+0000 7f71437fe640 1 -- 172.21.15.6:0/209996743 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715805d020 con 0x562d6df6db70 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.287+0000 7f716d7ed740 1 -- 172.21.15.6:0/209996743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71580409c0 con 0x562d6df6db70 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.287+0000 7f71437fe640 1 -- 172.21.15.6:0/209996743 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f7158042990 con 0x562d6df6db70 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.287+0000 7f71437fe640 1 -- 172.21.15.6:0/209996743 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7158068050 con 0x562d6df6db70 2024-09-12T00:10:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.289+0000 7f716d7ed740 10 client.25795 fetch_fsmap learned FSMap version 33 2024-09-12T00:10:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.289+0000 7f716d7ed740 1 -- 172.21.15.6:0/209996743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562d6dcb0620 con 0x562d6df6db70 2024-09-12T00:10:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.291+0000 7f71437fe640 1 -- 172.21.15.6:0/209996743 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71580409c0 con 0x562d6df6db70 2024-09-12T00:10:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.293+0000 7f71437fe640 1 -- 172.21.15.6:0/209996743 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f715804d430 con 0x562d6df6db70 2024-09-12T00:10:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.293+0000 7f716d7ed740 10 client.25795 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:10:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.293+0000 7f716d7ed740 10 client.25795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:10:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.293+0000 7f716d7ed740 20 client.25795 populate_metadata read hostname 'smithi006' 2024-09-12T00:10:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.293+0000 7f716d7ed740 1 --2- 172.21.15.6:0/209996743 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562d6df83c10 0x562d6df86050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.293+0000 7f716d7ed740 4 client.25795 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:10:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.293+0000 7f716d7ed740 1 -- 172.21.15.6:0/209996743 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d6dedea20 con 0x562d6df83c10 2024-09-12T00:10:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.299+0000 7f71637fe640 1 --2- 172.21.15.6:0/209996743 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562d6df83c10 0x562d6df86050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.301+0000 7f71637fe640 1 --2- 172.21.15.6:0/209996743 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562d6df83c10 0x562d6df86050 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2339d0c2c48a8727 server_cookie=426dc912e1a1e195 in_seq=0 out_seq=0 2024-09-12T00:10:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.301+0000 7f71437fe640 10 client.25795 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.302+0000 7f71437fe640 1 -- 172.21.15.6:0/209996743 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d6dedea20 con 0x562d6df83c10 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.302+0000 7f71437fe640 10 client.25795 handle_command_reply: tid=0 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.303+0000 7f716d7ed740 1 client.25795 shutdown 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.312+0000 7f716d7ed740 1 -- 172.21.15.6:0/209996743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 msgr2=0x562d6df77dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.312+0000 7f716d7ed740 1 --2- 172.21.15.6:0/209996743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 0x562d6df77dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f715803bc60 tx=0x7f7158040da0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.312+0000 7f716d7ed740 1 -- 172.21.15.6:0/209996743 shutdown_connections 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.312+0000 7f716d7ed740 1 --2- 172.21.15.6:0/209996743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df73540 0x562d6df7f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.312+0000 7f716d7ed740 1 --2- 172.21.15.6:0/209996743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df6e4b0 0x562d6df78310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.312+0000 7f716d7ed740 1 --2- 172.21.15.6:0/209996743 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562d6df83c10 0x562d6df86050 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.312+0000 7f716d7ed740 1 --2- 172.21.15.6:0/209996743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 0x562d6df77dd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.312+0000 7f716d7ed740 1 -- 172.21.15.6:0/209996743 >> 172.21.15.6:0/209996743 conn(0x562d6df691e0 msgr2=0x562d6df6a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.312+0000 7f71437fe640 0 client.25795 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.312+0000 7f716d7ed740 1 -- 172.21.15.6:0/209996743 shutdown_connections 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.312+0000 7f716d7ed740 1 -- 172.21.15.6:0/209996743 wait complete. 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.313+0000 7f716d7ed740 20 client.25795 trim_cache size 0 max 16384 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.365+0000 7f716d7ed740 1 Processor -- start 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.366+0000 7f716d7ed740 1 -- start start 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.366+0000 7f716d7ed740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 0x562d6df78290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.366+0000 7f716d7ed740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6e4b0 0x562d6df7f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.366+0000 7f716d7ed740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df73540 0x562d6df695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.366+0000 7f7163fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 0x562d6df78290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.366+0000 7f7163fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 0x562d6df78290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:49232/0 (socket says 172.21.15.6:49232) 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.366+0000 7f71637fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6e4b0 0x562d6df7f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.366+0000 7f71637fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6e4b0 0x562d6df7f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:41632/0 (socket says 172.21.15.6:41632) 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.366+0000 7f7163fff640 1 -- 172.21.15.6:0/2310580904 learned_addr learned my addr 172.21.15.6:0/2310580904 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.367+0000 7f7168ff9640 1 --2- 172.21.15.6:0/2310580904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df73540 0x562d6df695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.367+0000 7f716d7ed740 1 -- 172.21.15.6:0/2310580904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f715000fce0 con 0x562d6df73540 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.367+0000 7f716d7ed740 1 -- 172.21.15.6:0/2310580904 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7150011820 con 0x562d6df6e4b0 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.367+0000 7f716d7ed740 1 -- 172.21.15.6:0/2310580904 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f71500103b0 con 0x562d6df6db70 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.367+0000 7f71637fe640 1 -- 172.21.15.6:0/2310580904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 msgr2=0x562d6df78290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.367+0000 7f71637fe640 1 --2- 172.21.15.6:0/2310580904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 0x562d6df78290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.368+0000 7f71637fe640 1 -- 172.21.15.6:0/2310580904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df73540 msgr2=0x562d6df695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.368+0000 7f71637fe640 1 --2- 172.21.15.6:0/2310580904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df73540 0x562d6df695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.368+0000 7f71637fe640 1 -- 172.21.15.6:0/2310580904 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d6df77910 con 0x562d6df6e4b0 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.368+0000 7f71637fe640 1 --2- 172.21.15.6:0/2310580904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6e4b0 0x562d6df7f270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x562d6df86860 tx=0x7f715c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf3d1c4bad283563 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.369+0000 7f7149ffb640 1 -- 172.21.15.6:0/2310580904 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c00fbd0 con 0x562d6df6e4b0 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.369+0000 7f7149ffb640 1 -- 172.21.15.6:0/2310580904 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f715c00fd70 con 0x562d6df6e4b0 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.369+0000 7f7149ffb640 1 -- 172.21.15.6:0/2310580904 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c01d660 con 0x562d6df6e4b0 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.372+0000 7f716d7ed740 1 -- 172.21.15.6:0/2310580904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6e4b0 msgr2=0x562d6df7f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.372+0000 7f716d7ed740 1 --2- 172.21.15.6:0/2310580904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6e4b0 0x562d6df7f270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x562d6df86860 tx=0x7f715c014000 comp rx=0 tx=0).stop 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.372+0000 7f716d7ed740 1 -- 172.21.15.6:0/2310580904 shutdown_connections 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.372+0000 7f716d7ed740 1 --2- 172.21.15.6:0/2310580904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df73540 0x562d6df695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.372+0000 7f716d7ed740 1 --2- 172.21.15.6:0/2310580904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df6e4b0 0x562d6df7f270 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.372+0000 7f716d7ed740 1 --2- 172.21.15.6:0/2310580904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6db70 0x562d6df78290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.372+0000 7f716d7ed740 1 -- 172.21.15.6:0/2310580904 >> 172.21.15.6:0/2310580904 conn(0x562d6df691e0 msgr2=0x562d6df77b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.372+0000 7f716d7ed740 1 -- 172.21.15.6:0/2310580904 shutdown_connections 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.372+0000 7f716d7ed740 1 -- 172.21.15.6:0/2310580904 wait complete. 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.377+0000 7f716d7ed740 1 -- start start 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.377+0000 7f716d7ed740 1 Processor -- start 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.378+0000 7f716d7ed740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df6db70 0x562d6df7efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.378+0000 7f716d7ed740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6e4b0 0x562d6df7ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.378+0000 7f716d7ed740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df73540 0x562d6df7bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.378+0000 7f716d7ed740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7150011150 con 0x562d6df6db70 2024-09-12T00:10:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.378+0000 7f716d7ed740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7150010a80 con 0x562d6df73540 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.378+0000 7f716d7ed740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f715000dd70 con 0x562d6df6e4b0 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.378+0000 7f716d7ed740 10 client.0 _ll_register_callbacks cb 0x7f715801a790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.379+0000 7f7168ff9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df73540 0x562d6df7bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.379+0000 7f7168ff9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df73540 0x562d6df7bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:41636/0 (socket says 172.21.15.6:41636) 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.379+0000 7f7168ff9640 1 -- 172.21.15.6:0/4108996274 learned_addr learned my addr 172.21.15.6:0/4108996274 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.379+0000 7f7168ff9640 1 -- 172.21.15.6:0/4108996274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6e4b0 msgr2=0x562d6df7ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.379+0000 7f7168ff9640 1 --2- 172.21.15.6:0/4108996274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6e4b0 0x562d6df7ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.379+0000 7f7168ff9640 1 -- 172.21.15.6:0/4108996274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df6db70 msgr2=0x562d6df7efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.379+0000 7f7168ff9640 1 --2- 172.21.15.6:0/4108996274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df6db70 0x562d6df7efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.379+0000 7f7168ff9640 1 -- 172.21.15.6:0/4108996274 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d6df7c4f0 con 0x562d6df73540 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.380+0000 7f7168ff9640 1 --2- 172.21.15.6:0/4108996274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df73540 0x562d6df7bfb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71540109f0 tx=0x7f715409c5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d60633db0a577a54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.381+0000 7f71437fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:10:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.381+0000 7f71437fe640 1 -- 172.21.15.6:0/4108996274 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715409b1c0 con 0x562d6df73540 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.381+0000 7f716d7ed740 1 -- 172.21.15.6:0/4108996274 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f715c00fd70 con 0x562d6df73540 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.381+0000 7f71437fe640 1 -- 172.21.15.6:0/4108996274 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f715409b360 con 0x562d6df73540 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.381+0000 7f71437fe640 1 -- 172.21.15.6:0/4108996274 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7154097ac0 con 0x562d6df73540 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.383+0000 7f716d7ed740 10 client.25805 fetch_fsmap learned FSMap version 33 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.383+0000 7f716d7ed740 1 -- 172.21.15.6:0/4108996274 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562d6dfed950 con 0x562d6df73540 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.386+0000 7f71437fe640 1 -- 172.21.15.6:0/4108996274 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f715c00fd70 con 0x562d6df73540 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.386+0000 7f71437fe640 1 -- 172.21.15.6:0/4108996274 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f71540103c0 con 0x562d6df73540 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.386+0000 7f716d7ed740 10 client.25805 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.386+0000 7f716d7ed740 10 client.25805 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.387+0000 7f716d7ed740 20 client.25805 populate_metadata read hostname 'smithi006' 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.387+0000 7f716d7ed740 1 --2- 172.21.15.6:0/4108996274 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562d6dfee2b0 0x562d6dff0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.387+0000 7f716d7ed740 4 client.25805 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:10:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.387+0000 7f716d7ed740 1 -- 172.21.15.6:0/4108996274 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562d6ded8d70 con 0x562d6dfee2b0 2024-09-12T00:10:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.387+0000 7f7163fff640 1 --2- 172.21.15.6:0/4108996274 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562d6dfee2b0 0x562d6dff0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.388+0000 7f7163fff640 1 --2- 172.21.15.6:0/4108996274 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562d6dfee2b0 0x562d6dff0710 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e343a7715040f4ea server_cookie=720261d6acc2c8b1 in_seq=0 out_seq=0 2024-09-12T00:10:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.388+0000 7f71437fe640 10 client.25805 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:28.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.828+0000 7f71437fe640 1 -- 172.21.15.6:0/4108996274 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562d6ded8d70 con 0x562d6dfee2b0 2024-09-12T00:10:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.828+0000 7f71437fe640 10 client.25805 handle_command_reply: tid=0 2024-09-12T00:10:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.828+0000 7f716d7ed740 1 client.25805 shutdown 2024-09-12T00:10:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.829+0000 7f716d7ed740 1 -- 172.21.15.6:0/4108996274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df73540 msgr2=0x562d6df7bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.829+0000 7f716d7ed740 1 --2- 172.21.15.6:0/4108996274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df73540 0x562d6df7bfb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71540109f0 tx=0x7f715409c5c0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.829+0000 7f716d7ed740 1 -- 172.21.15.6:0/4108996274 shutdown_connections 2024-09-12T00:10:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.829+0000 7f716d7ed740 1 --2- 172.21.15.6:0/4108996274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d6df73540 0x562d6df7bfb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.829+0000 7f716d7ed740 1 --2- 172.21.15.6:0/4108996274 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x562d6dfee2b0 0x562d6dff0710 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.829+0000 7f716d7ed740 1 --2- 172.21.15.6:0/4108996274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d6df6e4b0 0x562d6df7ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.829+0000 7f716d7ed740 1 --2- 172.21.15.6:0/4108996274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d6df6db70 0x562d6df7efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.829+0000 7f716d7ed740 1 -- 172.21.15.6:0/4108996274 >> 172.21.15.6:0/4108996274 conn(0x562d6df691e0 msgr2=0x562d6df67a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.830+0000 7f71437fe640 0 client.25805 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.830+0000 7f716d7ed740 1 -- 172.21.15.6:0/4108996274 shutdown_connections 2024-09-12T00:10:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.832+0000 7f716d7ed740 1 -- 172.21.15.6:0/4108996274 wait complete. 2024-09-12T00:10:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.832+0000 7f716d7ed740 20 client.25805 trim_cache size 0 max 16384 2024-09-12T00:10:28.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:10:28.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:10:28.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:10:28.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:10:28.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.851+0000 7f716aa5c640 1 -- 172.21.15.6:0/2509838704 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f714c0a2da0 msgr2=0x7f714c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:28.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.851+0000 7f716aa5c640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f714c0a2da0 0x7f714c0a5260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x562d6df6eee0 tx=0x7f715c009c90 comp rx=0 tx=0).stop 2024-09-12T00:10:28.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.851+0000 7f716aa5c640 1 -- 172.21.15.6:0/2509838704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7164109bb0 msgr2=0x7f716407a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:28.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.851+0000 7f716aa5c640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7164109bb0 0x7f716407a450 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7154009fd0 tx=0x7f715400b8e0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.855+0000 7f716aa5c640 1 -- 172.21.15.6:0/2509838704 shutdown_connections 2024-09-12T00:10:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.855+0000 7f716aa5c640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f714c0a2da0 0x7f714c0a5260 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.855+0000 7f716aa5c640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7164109bb0 0x7f716407a450 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.855+0000 7f716aa5c640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71641091f0 0x7f716419ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.855+0000 7f716aa5c640 1 --2- 172.21.15.6:0/2509838704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71640732d0 0x7f716419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.856+0000 7f716aa5c640 1 -- 172.21.15.6:0/2509838704 >> 172.21.15.6:0/2509838704 conn(0x7f716406eb10 msgr2=0x7f7164115e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:28.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.859+0000 7f716aa5c640 1 -- 172.21.15.6:0/2509838704 shutdown_connections 2024-09-12T00:10:28.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:28.859+0000 7f716aa5c640 1 -- 172.21.15.6:0/2509838704 wait complete. 2024-09-12T00:10:29.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:28 smithi006 ceph-mon[30947]: pgmap v693: 129 pgs: 129 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-09-12T00:10:29.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:28 smithi134 ceph-mon[34893]: pgmap v693: 129 pgs: 129 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-09-12T00:10:29.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:28 smithi039 ceph-mon[34543]: pgmap v693: 129 pgs: 129 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-09-12T00:10:31.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:30 smithi006 ceph-mon[30947]: pgmap v694: 129 pgs: 129 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2024-09-12T00:10:31.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:30 smithi134 ceph-mon[34893]: pgmap v694: 129 pgs: 129 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2024-09-12T00:10:31.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:30 smithi039 ceph-mon[34543]: pgmap v694: 129 pgs: 129 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2024-09-12T00:10:33.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:32 smithi006 ceph-mon[30947]: pgmap v695: 129 pgs: 129 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 4.00k op/s 2024-09-12T00:10:33.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:32 smithi134 ceph-mon[34893]: pgmap v695: 129 pgs: 129 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 4.00k op/s 2024-09-12T00:10:33.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:32 smithi039 ceph-mon[34543]: pgmap v695: 129 pgs: 129 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 4.00k op/s 2024-09-12T00:10:35.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:34 smithi006 ceph-mon[30947]: pgmap v696: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2024-09-12T00:10:35.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:34 smithi134 ceph-mon[34893]: pgmap v696: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2024-09-12T00:10:35.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:34 smithi039 ceph-mon[34543]: pgmap v696: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2024-09-12T00:10:37.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:36 smithi134 ceph-mon[34893]: pgmap v697: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2024-09-12T00:10:37.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:36 smithi039 ceph-mon[34543]: pgmap v697: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2024-09-12T00:10:37.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:36 smithi006 ceph-mon[30947]: pgmap v697: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2024-09-12T00:10:39.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:38 smithi134 ceph-mon[34893]: pgmap v698: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2024-09-12T00:10:39.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:38 smithi039 ceph-mon[34543]: pgmap v698: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2024-09-12T00:10:39.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:38 smithi006 ceph-mon[30947]: pgmap v698: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2024-09-12T00:10:41.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:40 smithi134 ceph-mon[34893]: pgmap v699: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.45k op/s 2024-09-12T00:10:41.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:40 smithi039 ceph-mon[34543]: pgmap v699: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.45k op/s 2024-09-12T00:10:41.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:40 smithi006 ceph-mon[30947]: pgmap v699: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.45k op/s 2024-09-12T00:10:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.141+0000 7fb47cc43640 1 -- 172.21.15.6:0/3290994819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb478072d80 msgr2=0x7fb478073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.141+0000 7fb47cc43640 1 --2- 172.21.15.6:0/3290994819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb478072d80 0x7fb478073180 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb46c009930 tx=0x7fb46c02a480 comp rx=0 tx=0).stop 2024-09-12T00:10:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.145+0000 7fb47cc43640 1 -- 172.21.15.6:0/3290994819 shutdown_connections 2024-09-12T00:10:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.145+0000 7fb47cc43640 1 --2- 172.21.15.6:0/3290994819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb47810de90 0x7fb478110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.145+0000 7fb47cc43640 1 --2- 172.21.15.6:0/3290994819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb47810b4e0 0x7fb47810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.145+0000 7fb47cc43640 1 --2- 172.21.15.6:0/3290994819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb478072d80 0x7fb478073180 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.145+0000 7fb47cc43640 1 -- 172.21.15.6:0/3290994819 >> 172.21.15.6:0/3290994819 conn(0x7fb47806eb10 msgr2=0x7fb478070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.153+0000 7fb47cc43640 1 -- 172.21.15.6:0/3290994819 shutdown_connections 2024-09-12T00:10:42.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.154+0000 7fb47cc43640 1 -- 172.21.15.6:0/3290994819 wait complete. 2024-09-12T00:10:42.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.154+0000 7fb47cc43640 1 Processor -- start 2024-09-12T00:10:42.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.155+0000 7fb47cc43640 1 -- start start 2024-09-12T00:10:42.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.155+0000 7fb47cc43640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb478072d80 0x7fb4781183c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.155+0000 7fb47cc43640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb47810b4e0 0x7fb478118900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.155+0000 7fb47cc43640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb47810de90 0x7fb478116a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.155+0000 7fb47cc43640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb478111220 con 0x7fb478072d80 2024-09-12T00:10:42.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.155+0000 7fb47cc43640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb4781110a0 con 0x7fb47810de90 2024-09-12T00:10:42.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.155+0000 7fb47cc43640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb4781113a0 con 0x7fb47810b4e0 2024-09-12T00:10:42.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.158+0000 7fb477fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb47810de90 0x7fb478116a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:42.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.158+0000 7fb477fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb47810de90 0x7fb478116a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:60518/0 (socket says 172.21.15.6:60518) 2024-09-12T00:10:42.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.158+0000 7fb477fff640 1 -- 172.21.15.6:0/4287723483 learned_addr learned my addr 172.21.15.6:0/4287723483 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:42.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.160+0000 7fb477fff640 1 -- 172.21.15.6:0/4287723483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb47810b4e0 msgr2=0x7fb478118900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T00:10:42.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.164+0000 7fb477fff640 1 --2- 172.21.15.6:0/4287723483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb47810b4e0 0x7fb478118900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.164+0000 7fb477fff640 1 -- 172.21.15.6:0/4287723483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb478072d80 msgr2=0x7fb4781183c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:42.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.164+0000 7fb477fff640 1 --2- 172.21.15.6:0/4287723483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb478072d80 0x7fb4781183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.169+0000 7fb477fff640 1 -- 172.21.15.6:0/4287723483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb478117130 con 0x7fb47810de90 2024-09-12T00:10:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.171+0000 7fb477fff640 1 --2- 172.21.15.6:0/4287723483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb47810de90 0x7fb478116a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb46800c970 tx=0x7fb46800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.171+0000 7fb474ff9640 1 -- 172.21.15.6:0/4287723483 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb468007bb0 con 0x7fb47810de90 2024-09-12T00:10:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.171+0000 7fb47cc43640 1 -- 172.21.15.6:0/4287723483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb478117420 con 0x7fb47810de90 2024-09-12T00:10:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.171+0000 7fb47cc43640 1 -- 172.21.15.6:0/4287723483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4781b7730 con 0x7fb47810de90 2024-09-12T00:10:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.172+0000 7fb474ff9640 1 -- 172.21.15.6:0/4287723483 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb468007d50 con 0x7fb47810de90 2024-09-12T00:10:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.172+0000 7fb474ff9640 1 -- 172.21.15.6:0/4287723483 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46800f450 con 0x7fb47810de90 2024-09-12T00:10:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.190+0000 7fb474ff9640 1 -- 172.21.15.6:0/4287723483 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fb468004e90 con 0x7fb47810de90 2024-09-12T00:10:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.193+0000 7fb480c45740 1 Processor -- start 2024-09-12T00:10:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.194+0000 7fb480c45740 1 -- start start 2024-09-12T00:10:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.194+0000 7fb480c45740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b002845b70 0x55b002845f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.194+0000 7fb480c45740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 0x55b00284af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.194+0000 7fb480c45740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 0x55b00284da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.194+0000 7fb480c45740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b0027a92f0 con 0x55b002845b70 2024-09-12T00:10:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.194+0000 7fb480c45740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b002751270 con 0x55b0028464b0 2024-09-12T00:10:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.194+0000 7fb480c45740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b0027a52b0 con 0x55b00284b540 2024-09-12T00:10:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.195+0000 7fb4777fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 0x55b00284af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.195+0000 7fb4777fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 0x55b00284af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:60520/0 (socket says 172.21.15.6:60520) 2024-09-12T00:10:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.195+0000 7fb4777fe640 1 -- 172.21.15.6:0/320959952 learned_addr learned my addr 172.21.15.6:0/320959952 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.195+0000 7fb474ff9640 1 --2- 172.21.15.6:0/4287723483 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb4600a2da0 0x7fb4600a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.196+0000 7fb4777fe640 1 -- 172.21.15.6:0/320959952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 msgr2=0x55b00284da00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:10:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.196+0000 7fb4777fe640 1 --2- 172.21.15.6:0/320959952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 0x55b00284da00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.196+0000 7fb4777fe640 1 -- 172.21.15.6:0/320959952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b002845b70 msgr2=0x55b002845f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.196+0000 7fb4777fe640 1 --2- 172.21.15.6:0/320959952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b002845b70 0x55b002845f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.196+0000 7fb4777fe640 1 -- 172.21.15.6:0/320959952 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b002750340 con 0x55b0028464b0 2024-09-12T00:10:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.196+0000 7fb4777fe640 1 --2- 172.21.15.6:0/320959952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 0x55b00284af70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb46c004ba0 tx=0x7fb46c0094b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71340535d7b5dff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.196+0000 7fb474ff9640 1 -- 172.21.15.6:0/4287723483 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fb4680cf170 con 0x7fb47810de90 2024-09-12T00:10:42.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.199+0000 7fb45dffb640 1 -- 172.21.15.6:0/320959952 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c040030 con 0x55b0028464b0 2024-09-12T00:10:42.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.199+0000 7fb45dffb640 1 -- 172.21.15.6:0/320959952 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb46c0046c0 con 0x55b0028464b0 2024-09-12T00:10:42.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.200+0000 7fb480c45740 1 -- 172.21.15.6:0/320959952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 msgr2=0x55b00284af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:42.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.200+0000 7fb480c45740 1 --2- 172.21.15.6:0/320959952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 0x55b00284af70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb46c004ba0 tx=0x7fb46c0094b0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.202+0000 7fb477fff640 1 --2- 172.21.15.6:0/4287723483 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb4600a2da0 0x7fb4600a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:42.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.206+0000 7fb480c45740 1 -- 172.21.15.6:0/320959952 shutdown_connections 2024-09-12T00:10:42.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.206+0000 7fb480c45740 1 --2- 172.21.15.6:0/320959952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 0x55b00284da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.206+0000 7fb480c45740 1 --2- 172.21.15.6:0/320959952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 0x55b00284af70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.206+0000 7fb480c45740 1 --2- 172.21.15.6:0/320959952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b002845b70 0x55b002845f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.206+0000 7fb480c45740 1 -- 172.21.15.6:0/320959952 >> 172.21.15.6:0/320959952 conn(0x55b0028411e0 msgr2=0x55b0028415e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.211+0000 7fb480c45740 1 -- 172.21.15.6:0/320959952 shutdown_connections 2024-09-12T00:10:42.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.211+0000 7fb477fff640 1 --2- 172.21.15.6:0/4287723483 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb4600a2da0 0x7fb4600a5260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb46809b510 tx=0x7fb46800a470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:42.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.211+0000 7fb480c45740 1 -- 172.21.15.6:0/320959952 wait complete. 2024-09-12T00:10:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.212+0000 7fb480c45740 1 -- start start 2024-09-12T00:10:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.212+0000 7fb480c45740 1 Processor -- start 2024-09-12T00:10:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.212+0000 7fb480c45740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b002845b70 0x55b00284ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.212+0000 7fb480c45740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0028464b0 0x55b0028504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.213+0000 7fb480c45740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b00284b540 0x55b002857530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.213+0000 7fb480c45740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b00284e500 con 0x55b0028464b0 2024-09-12T00:10:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.213+0000 7fb480c45740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b002732290 con 0x55b00284b540 2024-09-12T00:10:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.213+0000 7fb480c45740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b00284e680 con 0x55b002845b70 2024-09-12T00:10:42.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.213+0000 7fb480c45740 10 client.0 _ll_register_callbacks cb 0x55b002763140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:10:42.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.216+0000 7fb476ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b002845b70 0x55b00284ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:42.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.216+0000 7fb476ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b00284b540 0x55b002857530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.220+0000 7fb4777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0028464b0 0x55b0028504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.220+0000 7fb4777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0028464b0 0x55b0028504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44638/0 (socket says 172.21.15.6:44638) 2024-09-12T00:10:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.220+0000 7fb4777fe640 1 -- 172.21.15.6:0/3025869890 learned_addr learned my addr 172.21.15.6:0/3025869890 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.221+0000 7fb476ffd640 1 -- 172.21.15.6:0/3025869890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b002845b70 msgr2=0x55b00284ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.222+0000 7fb476ffd640 1 --2- 172.21.15.6:0/3025869890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b002845b70 0x55b00284ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.222+0000 7fb476ffd640 1 -- 172.21.15.6:0/3025869890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0028464b0 msgr2=0x55b0028504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.222+0000 7fb476ffd640 1 --2- 172.21.15.6:0/3025869890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0028464b0 0x55b0028504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.222+0000 7fb476ffd640 1 -- 172.21.15.6:0/3025869890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0024bc210 con 0x55b00284b540 2024-09-12T00:10:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.222+0000 7fb476ffd640 1 --2- 172.21.15.6:0/3025869890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b00284b540 0x55b002857530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55b00284f4e0 tx=0x7fb470005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84f728b0e9466873 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:42.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.225+0000 7fb456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:10:42.226 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.225+0000 7fb456ffd640 1 -- 172.21.15.6:0/3025869890 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb470004d20 con 0x55b00284b540 2024-09-12T00:10:42.226 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.225+0000 7fb480c45740 1 -- 172.21.15.6:0/3025869890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b0027b6a20 con 0x55b00284b540 2024-09-12T00:10:42.226 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.225+0000 7fb456ffd640 1 -- 172.21.15.6:0/3025869890 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fb470010a70 con 0x55b00284b540 2024-09-12T00:10:42.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.231+0000 7fb456ffd640 1 -- 172.21.15.6:0/3025869890 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb470010c70 con 0x55b00284b540 2024-09-12T00:10:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.235+0000 7fb480c45740 10 client.25814 fetch_fsmap learned FSMap version 33 2024-09-12T00:10:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.235+0000 7fb480c45740 1 -- 172.21.15.6:0/3025869890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b002588620 con 0x55b00284b540 2024-09-12T00:10:42.235 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.237+0000 7fb456ffd640 1 -- 172.21.15.6:0/3025869890 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55b0027b6a20 con 0x55b00284b540 2024-09-12T00:10:42.235 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.237+0000 7fb456ffd640 1 -- 172.21.15.6:0/3025869890 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb47000c070 con 0x55b00284b540 2024-09-12T00:10:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.238+0000 7fb480c45740 10 client.25814 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:10:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.238+0000 7fb480c45740 10 client.25814 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:10:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.238+0000 7fb480c45740 20 client.25814 populate_metadata read hostname 'smithi006' 2024-09-12T00:10:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.238+0000 7fb480c45740 1 --2- 172.21.15.6:0/3025869890 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b00285c220 0x55b00285e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.238+0000 7fb480c45740 4 client.25814 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:10:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.238+0000 7fb480c45740 1 -- 172.21.15.6:0/3025869890 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0027b0d70 con 0x55b00285c220 2024-09-12T00:10:42.239 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.240+0000 7fb4777fe640 1 --2- 172.21.15.6:0/3025869890 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b00285c220 0x55b00285e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:42.240 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.242+0000 7fb4777fe640 1 --2- 172.21.15.6:0/3025869890 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b00285c220 0x55b00285e660 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e332a22f15a4a9c5 server_cookie=26071fafa346a189 in_seq=0 out_seq=0 2024-09-12T00:10:42.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.243+0000 7fb456ffd640 10 client.25814 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.248+0000 7fb456ffd640 1 -- 172.21.15.6:0/3025869890 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0027b0d70 con 0x55b00285c220 2024-09-12T00:10:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.248+0000 7fb456ffd640 10 client.25814 handle_command_reply: tid=0 2024-09-12T00:10:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.248+0000 7fb480c45740 1 client.25814 shutdown 2024-09-12T00:10:42.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.259+0000 7fb480c45740 1 -- 172.21.15.6:0/3025869890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b00284b540 msgr2=0x55b002857530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:42.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.259+0000 7fb480c45740 1 --2- 172.21.15.6:0/3025869890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b00284b540 0x55b002857530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55b00284f4e0 tx=0x7fb470005bd0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.265+0000 7fb480c45740 1 -- 172.21.15.6:0/3025869890 shutdown_connections 2024-09-12T00:10:42.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.265+0000 7fb480c45740 1 --2- 172.21.15.6:0/3025869890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b00284b540 0x55b002857530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.265+0000 7fb480c45740 1 --2- 172.21.15.6:0/3025869890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0028464b0 0x55b0028504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.265+0000 7fb480c45740 1 --2- 172.21.15.6:0/3025869890 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b00285c220 0x55b00285e660 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.265+0000 7fb480c45740 1 --2- 172.21.15.6:0/3025869890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b002845b70 0x55b00284ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.265+0000 7fb480c45740 1 -- 172.21.15.6:0/3025869890 >> 172.21.15.6:0/3025869890 conn(0x55b0028411e0 msgr2=0x55b002842a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:42.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.266+0000 7fb456ffd640 0 client.25814 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.267+0000 7fb480c45740 1 -- 172.21.15.6:0/3025869890 shutdown_connections 2024-09-12T00:10:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.270+0000 7fb480c45740 1 -- 172.21.15.6:0/3025869890 wait complete. 2024-09-12T00:10:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.270+0000 7fb480c45740 20 client.25814 trim_cache size 0 max 16384 2024-09-12T00:10:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.300+0000 7fb480c45740 1 Processor -- start 2024-09-12T00:10:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.301+0000 7fb480c45740 1 -- start start 2024-09-12T00:10:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.301+0000 7fb480c45740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b002845b70 0x55b00283bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.301+0000 7fb480c45740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 0x55b0028574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.301+0000 7fb480c45740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 0x55b00284ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.301+0000 7fb480c45740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb46400feb0 con 0x55b002845b70 2024-09-12T00:10:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.301+0000 7fb480c45740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb4640119f0 con 0x55b0028464b0 2024-09-12T00:10:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.301+0000 7fb480c45740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb464010580 con 0x55b00284b540 2024-09-12T00:10:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.301+0000 7fb4777fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 0x55b0028574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.302+0000 7fb4777fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 0x55b0028574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:60542/0 (socket says 172.21.15.6:60542) 2024-09-12T00:10:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.302+0000 7fb4777fe640 1 -- 172.21.15.6:0/1331585506 learned_addr learned my addr 172.21.15.6:0/1331585506 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.302+0000 7fb4777fe640 1 -- 172.21.15.6:0/1331585506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 msgr2=0x55b00284ffb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:10:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.302+0000 7fb4777fe640 1 --2- 172.21.15.6:0/1331585506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 0x55b00284ffb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.302+0000 7fb4777fe640 1 -- 172.21.15.6:0/1331585506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b002845b70 msgr2=0x55b00283bfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:10:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.302+0000 7fb4777fe640 1 --2- 172.21.15.6:0/1331585506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b002845b70 0x55b00283bfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.302+0000 7fb4777fe640 1 -- 172.21.15.6:0/1331585506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b00284faf0 con 0x55b0028464b0 2024-09-12T00:10:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.303+0000 7fb4777fe640 1 --2- 172.21.15.6:0/1331585506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 0x55b0028574f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb46c004a00 tx=0x7fb46c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aa9ac34082ac008 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.306+0000 7fb45d7fa640 1 -- 172.21.15.6:0/1331585506 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c052020 con 0x55b0028464b0 2024-09-12T00:10:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.306+0000 7fb45d7fa640 1 -- 172.21.15.6:0/1331585506 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb46c04e330 con 0x55b0028464b0 2024-09-12T00:10:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.307+0000 7fb480c45740 1 -- 172.21.15.6:0/1331585506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 msgr2=0x55b0028574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.307+0000 7fb480c45740 1 --2- 172.21.15.6:0/1331585506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 0x55b0028574f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb46c004a00 tx=0x7fb46c005fd0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.309+0000 7fb480c45740 1 -- 172.21.15.6:0/1331585506 shutdown_connections 2024-09-12T00:10:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.309+0000 7fb480c45740 1 --2- 172.21.15.6:0/1331585506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 0x55b00284ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.309+0000 7fb480c45740 1 --2- 172.21.15.6:0/1331585506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0028464b0 0x55b0028574f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.309+0000 7fb480c45740 1 --2- 172.21.15.6:0/1331585506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b002845b70 0x55b00283bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.309+0000 7fb480c45740 1 -- 172.21.15.6:0/1331585506 >> 172.21.15.6:0/1331585506 conn(0x55b0028411e0 msgr2=0x55b002847830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.309+0000 7fb480c45740 1 -- 172.21.15.6:0/1331585506 shutdown_connections 2024-09-12T00:10:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.311+0000 7fb480c45740 1 -- 172.21.15.6:0/1331585506 wait complete. 2024-09-12T00:10:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.311+0000 7fb480c45740 1 -- start start 2024-09-12T00:10:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.312+0000 7fb480c45740 1 Processor -- start 2024-09-12T00:10:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.312+0000 7fb480c45740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b002845b70 0x55b002856d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.312+0000 7fb480c45740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0028464b0 0x55b0028572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.312+0000 7fb480c45740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 0x55b002853890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.312+0000 7fb480c45740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb464011320 con 0x55b0028464b0 2024-09-12T00:10:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.312+0000 7fb480c45740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb464010c50 con 0x55b002845b70 2024-09-12T00:10:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.312+0000 7fb480c45740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb46400de90 con 0x55b00284b540 2024-09-12T00:10:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.312+0000 7fb480c45740 10 client.0 _ll_register_callbacks cb 0x7fb470009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:10:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.312+0000 7fb476ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b002845b70 0x55b002856d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.312+0000 7fb476ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b002845b70 0x55b002856d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:60556/0 (socket says 172.21.15.6:60556) 2024-09-12T00:10:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.312+0000 7fb476ffd640 1 -- 172.21.15.6:0/1579072920 learned_addr learned my addr 172.21.15.6:0/1579072920 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.312+0000 7fb476ffd640 1 --2- 172.21.15.6:0/1579072920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 0x55b002853890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.313+0000 7fb476ffd640 1 -- 172.21.15.6:0/1579072920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 msgr2=0x55b002853890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.313+0000 7fb476ffd640 1 --2- 172.21.15.6:0/1579072920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 0x55b002853890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.313+0000 7fb476ffd640 1 -- 172.21.15.6:0/1579072920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0028464b0 msgr2=0x55b0028572c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:10:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.313+0000 7fb476ffd640 1 --2- 172.21.15.6:0/1579072920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0028464b0 0x55b0028572c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.313+0000 7fb476ffd640 1 -- 172.21.15.6:0/1579072920 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b002853fd0 con 0x55b002845b70 2024-09-12T00:10:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.314+0000 7fb476ffd640 1 --2- 172.21.15.6:0/1579072920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b002845b70 0x55b002856d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb470015fd0 tx=0x7fb4700021f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=625760c223c6eb32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.314+0000 7fb456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T00:10:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.315+0000 7fb456ffd640 1 -- 172.21.15.6:0/1579072920 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb470009bf0 con 0x55b002845b70 2024-09-12T00:10:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.315+0000 7fb456ffd640 1 -- 172.21.15.6:0/1579072920 <== mon.2 v2:172.21.15.39:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fb470015070 con 0x55b002845b70 2024-09-12T00:10:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.315+0000 7fb480c45740 1 -- 172.21.15.6:0/1579072920 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb46c04e330 con 0x55b002845b70 2024-09-12T00:10:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.315+0000 7fb456ffd640 1 -- 172.21.15.6:0/1579072920 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb470015270 con 0x55b002845b70 2024-09-12T00:10:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.316+0000 7fb480c45740 10 client.25820 fetch_fsmap learned FSMap version 33 2024-09-12T00:10:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.316+0000 7fb480c45740 1 -- 172.21.15.6:0/1579072920 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b0028c5ba0 con 0x55b002845b70 2024-09-12T00:10:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.319+0000 7fb456ffd640 1 -- 172.21.15.6:0/1579072920 <== mon.2 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb46c04e330 con 0x55b002845b70 2024-09-12T00:10:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.319+0000 7fb456ffd640 1 -- 172.21.15.6:0/1579072920 <== mon.2 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb47000c030 con 0x55b002845b70 2024-09-12T00:10:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.319+0000 7fb480c45740 10 client.25820 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:10:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.320+0000 7fb480c45740 10 client.25820 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:10:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.320+0000 7fb480c45740 20 client.25820 populate_metadata read hostname 'smithi006' 2024-09-12T00:10:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.320+0000 7fb480c45740 1 --2- 172.21.15.6:0/1579072920 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b0028c64d0 0x55b0028c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.320+0000 7fb480c45740 4 client.25820 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:10:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.320+0000 7fb480c45740 1 -- 172.21.15.6:0/1579072920 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b00272d900 con 0x55b0028c64d0 2024-09-12T00:10:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.322+0000 7fb4777fe640 1 --2- 172.21.15.6:0/1579072920 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b0028c64d0 0x55b0028c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.323+0000 7fb4777fe640 1 --2- 172.21.15.6:0/1579072920 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b0028c64d0 0x55b0028c88f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3733423bafb69544 server_cookie=2e5051347cc6097b in_seq=0 out_seq=0 2024-09-12T00:10:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.324+0000 7fb456ffd640 10 client.25820 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:42.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.411+0000 7fb456ffd640 1 -- 172.21.15.6:0/1579072920 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b00272d900 con 0x55b0028c64d0 2024-09-12T00:10:42.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.411+0000 7fb456ffd640 10 client.25820 handle_command_reply: tid=0 2024-09-12T00:10:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.414+0000 7fb480c45740 1 client.25820 shutdown 2024-09-12T00:10:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.418+0000 7fb480c45740 1 -- 172.21.15.6:0/1579072920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b002845b70 msgr2=0x55b002856d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.418+0000 7fb480c45740 1 --2- 172.21.15.6:0/1579072920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b002845b70 0x55b002856d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb470015fd0 tx=0x7fb4700021f0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.420+0000 7fb480c45740 1 -- 172.21.15.6:0/1579072920 shutdown_connections 2024-09-12T00:10:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.420+0000 7fb480c45740 1 --2- 172.21.15.6:0/1579072920 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55b0028c64d0 0x55b0028c88f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.420+0000 7fb480c45740 1 --2- 172.21.15.6:0/1579072920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b00284b540 0x55b002853890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.420+0000 7fb480c45740 1 --2- 172.21.15.6:0/1579072920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0028464b0 0x55b0028572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.420+0000 7fb480c45740 1 --2- 172.21.15.6:0/1579072920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b002845b70 0x55b002856d80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.420+0000 7fb480c45740 1 -- 172.21.15.6:0/1579072920 >> 172.21.15.6:0/1579072920 conn(0x55b0028411e0 msgr2=0x55b00284ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.420+0000 7fb456ffd640 0 client.25820 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.425+0000 7fb480c45740 1 -- 172.21.15.6:0/1579072920 shutdown_connections 2024-09-12T00:10:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.425+0000 7fb480c45740 1 -- 172.21.15.6:0/1579072920 wait complete. 2024-09-12T00:10:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.425+0000 7fb480c45740 20 client.25820 trim_cache size 0 max 16384 2024-09-12T00:10:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:10:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:10:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:10:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:10:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.430+0000 7fb47cc43640 1 -- 172.21.15.6:0/4287723483 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb4600a2da0 msgr2=0x7fb4600a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.430+0000 7fb47cc43640 1 --2- 172.21.15.6:0/4287723483 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb4600a2da0 0x7fb4600a5260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb46809b510 tx=0x7fb46800a470 comp rx=0 tx=0).stop 2024-09-12T00:10:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.431+0000 7fb47cc43640 1 -- 172.21.15.6:0/4287723483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb47810de90 msgr2=0x7fb478116a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.431+0000 7fb47cc43640 1 --2- 172.21.15.6:0/4287723483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb47810de90 0x7fb478116a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb46800c970 tx=0x7fb46800ce30 comp rx=0 tx=0).stop 2024-09-12T00:10:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.431+0000 7fb47cc43640 1 -- 172.21.15.6:0/4287723483 shutdown_connections 2024-09-12T00:10:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.431+0000 7fb47cc43640 1 --2- 172.21.15.6:0/4287723483 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb4600a2da0 0x7fb4600a5260 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.431+0000 7fb47cc43640 1 --2- 172.21.15.6:0/4287723483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb47810de90 0x7fb478116a00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.431+0000 7fb47cc43640 1 --2- 172.21.15.6:0/4287723483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb47810b4e0 0x7fb478118900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.431+0000 7fb47cc43640 1 --2- 172.21.15.6:0/4287723483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb478072d80 0x7fb4781183c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.431+0000 7fb47cc43640 1 -- 172.21.15.6:0/4287723483 >> 172.21.15.6:0/4287723483 conn(0x7fb47806eb10 msgr2=0x7fb47810f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.431+0000 7fb47cc43640 1 -- 172.21.15.6:0/4287723483 shutdown_connections 2024-09-12T00:10:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:42.431+0000 7fb47cc43640 1 -- 172.21.15.6:0/4287723483 wait complete. 2024-09-12T00:10:43.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:42 smithi134 ceph-mon[34893]: pgmap v700: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 3.94k op/s 2024-09-12T00:10:43.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:42 smithi039 ceph-mon[34543]: pgmap v700: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 3.94k op/s 2024-09-12T00:10:43.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:42 smithi006 ceph-mon[30947]: pgmap v700: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 3.94k op/s 2024-09-12T00:10:45.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:44 smithi134 ceph-mon[34893]: pgmap v701: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.51k op/s 2024-09-12T00:10:45.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:44 smithi039 ceph-mon[34543]: pgmap v701: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.51k op/s 2024-09-12T00:10:45.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:44 smithi006 ceph-mon[30947]: pgmap v701: 129 pgs: 129 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.51k op/s 2024-09-12T00:10:47.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:46 smithi134 ceph-mon[34893]: pgmap v702: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.27k op/s 2024-09-12T00:10:47.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:46 smithi039 ceph-mon[34543]: pgmap v702: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.27k op/s 2024-09-12T00:10:47.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:46 smithi006 ceph-mon[30947]: pgmap v702: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 4.27k op/s 2024-09-12T00:10:49.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:48 smithi134 ceph-mon[34893]: pgmap v703: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-09-12T00:10:49.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:48 smithi039 ceph-mon[34543]: pgmap v703: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-09-12T00:10:49.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:48 smithi006 ceph-mon[30947]: pgmap v703: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-09-12T00:10:51.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:50 smithi134 ceph-mon[34893]: pgmap v704: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 4.36k op/s 2024-09-12T00:10:51.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:50 smithi039 ceph-mon[34543]: pgmap v704: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 4.36k op/s 2024-09-12T00:10:51.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:50 smithi006 ceph-mon[30947]: pgmap v704: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 4.36k op/s 2024-09-12T00:10:53.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:52 smithi134 ceph-mon[34893]: pgmap v705: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 3.83k op/s 2024-09-12T00:10:53.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:52 smithi039 ceph-mon[34543]: pgmap v705: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 3.83k op/s 2024-09-12T00:10:53.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:52 smithi006 ceph-mon[30947]: pgmap v705: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 3.83k op/s 2024-09-12T00:10:55.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:54 smithi134 ceph-mon[34893]: pgmap v706: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 4.53k op/s 2024-09-12T00:10:55.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:54 smithi039 ceph-mon[34543]: pgmap v706: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 4.53k op/s 2024-09-12T00:10:55.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:54 smithi006 ceph-mon[30947]: pgmap v706: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 4.53k op/s 2024-09-12T00:10:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.610+0000 7f441372c640 1 -- 172.21.15.6:0/2032671306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c109700 msgr2=0x7f440c109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.610+0000 7f441372c640 1 --2- 172.21.15.6:0/2032671306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c109700 0x7f440c109b00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4404009ca0 tx=0x7f440402a8f0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.622+0000 7f441372c640 1 -- 172.21.15.6:0/2032671306 shutdown_connections 2024-09-12T00:10:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.622+0000 7f441372c640 1 --2- 172.21.15.6:0/2032671306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c0736b0 0x7f440c119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.622+0000 7f441372c640 1 --2- 172.21.15.6:0/2032671306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f440c072d10 0x7f440c073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.622+0000 7f441372c640 1 --2- 172.21.15.6:0/2032671306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c109700 0x7f440c109b00 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.622+0000 7f441372c640 1 -- 172.21.15.6:0/2032671306 >> 172.21.15.6:0/2032671306 conn(0x7f440c06ecd0 msgr2=0x7f440c071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.622+0000 7f441372c640 1 -- 172.21.15.6:0/2032671306 shutdown_connections 2024-09-12T00:10:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.622+0000 7f441372c640 1 -- 172.21.15.6:0/2032671306 wait complete. 2024-09-12T00:10:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.623+0000 7f441372c640 1 Processor -- start 2024-09-12T00:10:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.624+0000 7f441372c640 1 -- start start 2024-09-12T00:10:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.624+0000 7f441372c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c072d10 0x7f440c115eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.624+0000 7f441372c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c0736b0 0x7f440c1163f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.624+0000 7f441372c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f440c109700 0x7f440c1b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.624+0000 7f441372c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f440c11c5b0 con 0x7f440c072d10 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.624+0000 7f441372c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f440c11c430 con 0x7f440c109700 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.624+0000 7f441372c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f440c11c730 con 0x7f440c0736b0 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.624+0000 7f4410cc7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c0736b0 0x7f440c1163f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.624+0000 7f4410cc7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c0736b0 0x7f440c1163f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:59262/0 (socket says 172.21.15.6:59262) 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.624+0000 7f4410cc7640 1 -- 172.21.15.6:0/2045466740 learned_addr learned my addr 172.21.15.6:0/2045466740 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.624+0000 7f44114c8640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c072d10 0x7f440c115eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.625+0000 7f4410cc7640 1 -- 172.21.15.6:0/2045466740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f440c109700 msgr2=0x7f440c1b6cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.625+0000 7f4410cc7640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f440c109700 0x7f440c1b6cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.625+0000 7f4410cc7640 1 -- 172.21.15.6:0/2045466740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c072d10 msgr2=0x7f440c115eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.625+0000 7f4410cc7640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c072d10 0x7f440c115eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.625+0000 7f4410cc7640 1 -- 172.21.15.6:0/2045466740 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c1b7200 con 0x7f440c0736b0 2024-09-12T00:10:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.625+0000 7f4410cc7640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c0736b0 0x7f440c1163f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f440800b450 tx=0x7f440800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.641+0000 7f44027fc640 1 -- 172.21.15.6:0/2045466740 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408015020 con 0x7f440c0736b0 2024-09-12T00:10:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.641+0000 7f44027fc640 1 -- 172.21.15.6:0/2045466740 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4408011d40 con 0x7f440c0736b0 2024-09-12T00:10:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.641+0000 7f44027fc640 1 -- 172.21.15.6:0/2045466740 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440800f340 con 0x7f440c0736b0 2024-09-12T00:10:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.645+0000 7f441372c640 1 -- 172.21.15.6:0/2045466740 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440c1b7430 con 0x7f440c0736b0 2024-09-12T00:10:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.645+0000 7f441372c640 1 -- 172.21.15.6:0/2045466740 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440c1b79b0 con 0x7f440c0736b0 2024-09-12T00:10:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.649+0000 7f44164c1740 1 Processor -- start 2024-09-12T00:10:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.650+0000 7f44164c1740 1 -- start start 2024-09-12T00:10:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.650+0000 7f44164c1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d45868f9a0 0x55d45868fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.650+0000 7f44164c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4586902e0 0x55d458694da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.650+0000 7f44164c1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d458695370 0x55d458697830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.650+0000 7f44164c1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d4585f32f0 con 0x55d45868f9a0 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.650+0000 7f44164c1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d45859b270 con 0x55d458695370 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.650+0000 7f44164c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d4585ef2b0 con 0x55d4586902e0 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.650+0000 7f4410cc7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d458695370 0x55d458697830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.651+0000 7f4410cc7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d458695370 0x55d458697830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:44390/0 (socket says 172.21.15.6:44390) 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.651+0000 7f4410cc7640 1 -- 172.21.15.6:0/1893461963 learned_addr learned my addr 172.21.15.6:0/1893461963 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.653+0000 7f4410cc7640 1 -- 172.21.15.6:0/1893461963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4586902e0 msgr2=0x55d458694da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.653+0000 7f4410cc7640 1 --2- 172.21.15.6:0/1893461963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4586902e0 0x55d458694da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.653+0000 7f4410cc7640 1 -- 172.21.15.6:0/1893461963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d45868f9a0 msgr2=0x55d45868fda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.653+0000 7f4410cc7640 1 --2- 172.21.15.6:0/1893461963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d45868f9a0 0x55d45868fda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.653+0000 7f4410cc7640 1 -- 172.21.15.6:0/1893461963 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d45859a340 con 0x55d458695370 2024-09-12T00:10:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.653+0000 7f44027fc640 1 -- 172.21.15.6:0/2045466740 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f4408018020 con 0x7f440c0736b0 2024-09-12T00:10:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.656+0000 7f44027fc640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f43f80a2d90 0x7f43f80a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.656+0000 7f44027fc640 1 -- 172.21.15.6:0/2045466740 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f44080f7ec0 con 0x7f440c0736b0 2024-09-12T00:10:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.657+0000 7f4410cc7640 1 --2- 172.21.15.6:0/1893461963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d458695370 0x55d458697830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f440800be10 tx=0x7f44080f89c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbb72281799c1244 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.658+0000 7f4411cc9640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f43f80a2d90 0x7f43f80a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.664+0000 7f43f77fe640 1 -- 172.21.15.6:0/1893461963 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44080c1370 con 0x55d458695370 2024-09-12T00:10:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.664+0000 7f43f77fe640 1 -- 172.21.15.6:0/1893461963 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f44080c5860 con 0x55d458695370 2024-09-12T00:10:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.664+0000 7f43f77fe640 1 -- 172.21.15.6:0/1893461963 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44080c32a0 con 0x55d458695370 2024-09-12T00:10:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.666+0000 7f44164c1740 1 -- 172.21.15.6:0/1893461963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d458695370 msgr2=0x55d458697830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.666+0000 7f44164c1740 1 --2- 172.21.15.6:0/1893461963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d458695370 0x55d458697830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f440800be10 tx=0x7f44080f89c0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.667+0000 7f4411cc9640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f43f80a2d90 0x7f43f80a5250 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0095b0 tx=0x7f43fc006c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.667+0000 7f44164c1740 1 -- 172.21.15.6:0/1893461963 shutdown_connections 2024-09-12T00:10:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.667+0000 7f44164c1740 1 --2- 172.21.15.6:0/1893461963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d458695370 0x55d458697830 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f440800be10 tx=0x7f44080f89c0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.667+0000 7f44164c1740 1 --2- 172.21.15.6:0/1893461963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4586902e0 0x55d458694da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.667+0000 7f44164c1740 1 --2- 172.21.15.6:0/1893461963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d45868f9a0 0x55d45868fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.667+0000 7f44164c1740 1 -- 172.21.15.6:0/1893461963 >> 172.21.15.6:0/1893461963 conn(0x55d45868b010 msgr2=0x55d45868b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.669+0000 7f44164c1740 1 -- 172.21.15.6:0/1893461963 shutdown_connections 2024-09-12T00:10:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.671+0000 7f44164c1740 1 -- 172.21.15.6:0/1893461963 wait complete. 2024-09-12T00:10:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.671+0000 7f44164c1740 1 -- start start 2024-09-12T00:10:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.671+0000 7f44164c1740 1 Processor -- start 2024-09-12T00:10:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.673+0000 7f44164c1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d45868f9a0 0x55d458699ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.673+0000 7f44164c1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4586902e0 0x55d45869a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.673+0000 7f44164c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45869f3f0 0x55d4586a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.673+0000 7f44164c1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d458698340 con 0x55d45868f9a0 2024-09-12T00:10:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.673+0000 7f44164c1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d45857c290 con 0x55d4586902e0 2024-09-12T00:10:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.673+0000 7f44164c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d4586984c0 con 0x55d45869f3f0 2024-09-12T00:10:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.674+0000 7f44164c1740 10 client.0 _ll_register_callbacks cb 0x55d4585ad140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:10:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.678+0000 7f4411cc9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45869f3f0 0x55d4586a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.678+0000 7f4411cc9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45869f3f0 0x55d4586a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:59272/0 (socket says 172.21.15.6:59272) 2024-09-12T00:10:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.678+0000 7f4411cc9640 1 -- 172.21.15.6:0/81992168 learned_addr learned my addr 172.21.15.6:0/81992168 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.679+0000 7f44114c8640 1 --2- 172.21.15.6:0/81992168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d45868f9a0 0x55d458699ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.680+0000 7f44114c8640 1 -- 172.21.15.6:0/81992168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45869f3f0 msgr2=0x55d4586a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.680+0000 7f44114c8640 1 --2- 172.21.15.6:0/81992168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45869f3f0 0x55d4586a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.680+0000 7f44114c8640 1 -- 172.21.15.6:0/81992168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4586902e0 msgr2=0x55d45869a430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:10:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.682+0000 7f44114c8640 1 --2- 172.21.15.6:0/81992168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4586902e0 0x55d45869a430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.682+0000 7f44114c8640 1 -- 172.21.15.6:0/81992168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d458306210 con 0x55d45868f9a0 2024-09-12T00:10:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.683+0000 7f44114c8640 1 --2- 172.21.15.6:0/81992168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d45868f9a0 0x55d458699ef0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4404006010 tx=0x7f44040316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985570ad415dc274 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.684+0000 7f43f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:10:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.684+0000 7f43f4ff9640 1 -- 172.21.15.6:0/81992168 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404003d80 con 0x55d45868f9a0 2024-09-12T00:10:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.684+0000 7f43f4ff9640 1 -- 172.21.15.6:0/81992168 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f4404004040 con 0x55d45868f9a0 2024-09-12T00:10:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.684+0000 7f44164c1740 1 -- 172.21.15.6:0/81992168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44080c5860 con 0x55d45868f9a0 2024-09-12T00:10:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.686+0000 7f43f4ff9640 1 -- 172.21.15.6:0/81992168 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f44040317a0 con 0x55d45868f9a0 2024-09-12T00:10:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.687+0000 7f44164c1740 10 client.16200 fetch_fsmap learned FSMap version 33 2024-09-12T00:10:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.687+0000 7f44164c1740 1 -- 172.21.15.6:0/81992168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d4583d2620 con 0x55d45868f9a0 2024-09-12T00:10:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.689+0000 7f43f4ff9640 1 -- 172.21.15.6:0/81992168 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f44080c5860 con 0x55d45868f9a0 2024-09-12T00:10:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.689+0000 7f43f4ff9640 1 -- 172.21.15.6:0/81992168 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f4404043070 con 0x55d45868f9a0 2024-09-12T00:10:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.691+0000 7f44164c1740 10 client.16200 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:10:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.691+0000 7f44164c1740 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:10:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.691+0000 7f44164c1740 20 client.16200 populate_metadata read hostname 'smithi006' 2024-09-12T00:10:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.691+0000 7f44164c1740 1 --2- 172.21.15.6:0/81992168 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d4586a5ed0 0x55d4586a8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.691+0000 7f44164c1740 4 client.16200 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:10:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.691+0000 7f44164c1740 1 -- 172.21.15.6:0/81992168 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d458600a20 con 0x55d4586a5ed0 2024-09-12T00:10:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.699+0000 7f4410cc7640 1 --2- 172.21.15.6:0/81992168 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d4586a5ed0 0x55d4586a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.710+0000 7f4410cc7640 1 --2- 172.21.15.6:0/81992168 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d4586a5ed0 0x55d4586a8300 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b622860c5095ed21 server_cookie=78e1fa9d14928c9f in_seq=0 out_seq=0 2024-09-12T00:10:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.710+0000 7f43f4ff9640 10 client.16200 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.712+0000 7f43f4ff9640 1 -- 172.21.15.6:0/81992168 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d458600a20 con 0x55d4586a5ed0 2024-09-12T00:10:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.712+0000 7f43f4ff9640 10 client.16200 handle_command_reply: tid=0 2024-09-12T00:10:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.712+0000 7f44164c1740 1 client.16200 shutdown 2024-09-12T00:10:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.718+0000 7f44164c1740 1 -- 172.21.15.6:0/81992168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d45868f9a0 msgr2=0x55d458699ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.718+0000 7f44164c1740 1 --2- 172.21.15.6:0/81992168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d45868f9a0 0x55d458699ef0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4404006010 tx=0x7f44040316b0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.718+0000 7f44164c1740 1 -- 172.21.15.6:0/81992168 shutdown_connections 2024-09-12T00:10:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.718+0000 7f44164c1740 1 --2- 172.21.15.6:0/81992168 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d4586a5ed0 0x55d4586a8300 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.718+0000 7f44164c1740 1 --2- 172.21.15.6:0/81992168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45869f3f0 0x55d4586a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.718+0000 7f44164c1740 1 --2- 172.21.15.6:0/81992168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4586902e0 0x55d45869a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.718+0000 7f44164c1740 1 --2- 172.21.15.6:0/81992168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d45868f9a0 0x55d458699ef0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.718+0000 7f44164c1740 1 -- 172.21.15.6:0/81992168 >> 172.21.15.6:0/81992168 conn(0x55d45868b010 msgr2=0x55d45868c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.718+0000 7f43f4ff9640 0 client.16200 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.719+0000 7f44164c1740 1 -- 172.21.15.6:0/81992168 shutdown_connections 2024-09-12T00:10:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.719+0000 7f44164c1740 1 -- 172.21.15.6:0/81992168 wait complete. 2024-09-12T00:10:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.719+0000 7f44164c1740 20 client.16200 trim_cache size 0 max 16384 2024-09-12T00:10:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.752+0000 7f44164c1740 1 Processor -- start 2024-09-12T00:10:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.752+0000 7f44164c1740 1 -- start start 2024-09-12T00:10:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.752+0000 7f44164c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45868f9a0 0x55d4586988c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.752+0000 7f44164c1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4586902e0 0x55d45868b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.752+0000 7f44164c1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d45869f3f0 0x55d45868b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.752+0000 7f44164c1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f43f000fe70 con 0x55d4586902e0 2024-09-12T00:10:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.752+0000 7f44164c1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f43f00119b0 con 0x55d45869f3f0 2024-09-12T00:10:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.752+0000 7f44164c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43f0010540 con 0x55d45868f9a0 2024-09-12T00:10:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.755+0000 7f4411cc9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d45869f3f0 0x55d45868b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.755+0000 7f4410cc7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4586902e0 0x55d45868b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.755+0000 7f4410cc7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4586902e0 0x55d45868b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35956/0 (socket says 172.21.15.6:35956) 2024-09-12T00:10:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.755+0000 7f4410cc7640 1 -- 172.21.15.6:0/1495164245 learned_addr learned my addr 172.21.15.6:0/1495164245 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.760+0000 7f4410cc7640 1 -- 172.21.15.6:0/1495164245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45868f9a0 msgr2=0x55d4586988c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:10:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.760+0000 7f4410cc7640 1 --2- 172.21.15.6:0/1495164245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45868f9a0 0x55d4586988c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.760+0000 7f4410cc7640 1 -- 172.21.15.6:0/1495164245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d45869f3f0 msgr2=0x55d45868b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.760+0000 7f4410cc7640 1 --2- 172.21.15.6:0/1495164245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d45869f3f0 0x55d45868b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.760+0000 7f4410cc7640 1 -- 172.21.15.6:0/1495164245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d45868ae30 con 0x55d4586902e0 2024-09-12T00:10:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.768+0000 7f4410cc7640 1 --2- 172.21.15.6:0/1495164245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4586902e0 0x55d45868b3f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f44080108e0 tx=0x7f4408010870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05f32e99294e5b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.768+0000 7f43f6ffd640 1 -- 172.21.15.6:0/1495164245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44080c4ac0 con 0x55d4586902e0 2024-09-12T00:10:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.768+0000 7f43f6ffd640 1 -- 172.21.15.6:0/1495164245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f44080c5860 con 0x55d4586902e0 2024-09-12T00:10:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.768+0000 7f43f6ffd640 1 -- 172.21.15.6:0/1495164245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44080c4ca0 con 0x55d4586902e0 2024-09-12T00:10:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.769+0000 7f44164c1740 1 -- 172.21.15.6:0/1495164245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4586902e0 msgr2=0x55d45868b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.769+0000 7f44164c1740 1 --2- 172.21.15.6:0/1495164245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4586902e0 0x55d45868b3f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f44080108e0 tx=0x7f4408010870 comp rx=0 tx=0).stop 2024-09-12T00:10:55.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.775+0000 7f44164c1740 1 -- 172.21.15.6:0/1495164245 shutdown_connections 2024-09-12T00:10:55.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.775+0000 7f44164c1740 1 --2- 172.21.15.6:0/1495164245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d45869f3f0 0x55d45868b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.775+0000 7f44164c1740 1 --2- 172.21.15.6:0/1495164245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4586902e0 0x55d45868b3f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.775+0000 7f44164c1740 1 --2- 172.21.15.6:0/1495164245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45868f9a0 0x55d4586988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.775+0000 7f44164c1740 1 -- 172.21.15.6:0/1495164245 >> 172.21.15.6:0/1495164245 conn(0x55d45868b010 msgr2=0x55d458699ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:55.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.780+0000 7f44164c1740 1 -- 172.21.15.6:0/1495164245 shutdown_connections 2024-09-12T00:10:55.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.781+0000 7f44164c1740 1 -- 172.21.15.6:0/1495164245 wait complete. 2024-09-12T00:10:55.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.782+0000 7f44164c1740 1 -- start start 2024-09-12T00:10:55.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.782+0000 7f44164c1740 1 Processor -- start 2024-09-12T00:10:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.782+0000 7f44164c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45868f9a0 0x55d4586b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.783+0000 7f44164c1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4586902e0 0x55d4586b7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.783+0000 7f44164c1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d45869f3f0 0x55d4586b8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.783+0000 7f44164c1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f43f00112e0 con 0x55d4586902e0 2024-09-12T00:10:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f44114c8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45868f9a0 0x55d4586b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f44114c8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45868f9a0 0x55d4586b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:59290/0 (socket says 172.21.15.6:59290) 2024-09-12T00:10:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f44114c8640 1 -- 172.21.15.6:0/1168417228 learned_addr learned my addr 172.21.15.6:0/1168417228 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:10:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f4411cc9640 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d45869f3f0 0x55d4586b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f4410cc7640 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4586902e0 0x55d4586b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f44164c1740 1 -- 172.21.15.6:0/1168417228 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f43f0010c10 con 0x55d45869f3f0 2024-09-12T00:10:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f44164c1740 1 -- 172.21.15.6:0/1168417228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43f000de50 con 0x55d45868f9a0 2024-09-12T00:10:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f44164c1740 10 client.0 _ll_register_callbacks cb 0x7f4404005eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:10:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f44114c8640 1 -- 172.21.15.6:0/1168417228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d45869f3f0 msgr2=0x55d4586b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f44114c8640 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d45869f3f0 0x55d4586b8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f44114c8640 1 -- 172.21.15.6:0/1168417228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4586902e0 msgr2=0x55d4586b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:10:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f44114c8640 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4586902e0 0x55d4586b7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f44114c8640 1 -- 172.21.15.6:0/1168417228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4586b8e80 con 0x55d45868f9a0 2024-09-12T00:10:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.784+0000 7f44164c1740 1 -- 172.21.15.6:0/1168417228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44080c5860 con 0x55d45868f9a0 2024-09-12T00:10:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.785+0000 7f44114c8640 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45868f9a0 0x55d4586b7320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f440404a040 tx=0x7f440402f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66379d4c81934eb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.785+0000 7f43f4ff9640 10 client.25816 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:10:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.785+0000 7f43f4ff9640 1 -- 172.21.15.6:0/1168417228 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404030b50 con 0x55d45868f9a0 2024-09-12T00:10:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.785+0000 7f43f4ff9640 1 -- 172.21.15.6:0/1168417228 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f4404030cf0 con 0x55d45868f9a0 2024-09-12T00:10:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.785+0000 7f43f4ff9640 1 -- 172.21.15.6:0/1168417228 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4404009b20 con 0x55d45868f9a0 2024-09-12T00:10:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.789+0000 7f44164c1740 10 client.25816 fetch_fsmap learned FSMap version 33 2024-09-12T00:10:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.789+0000 7f44164c1740 1 -- 172.21.15.6:0/1168417228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=33}) -- 0x55d4586ba130 con 0x55d45868f9a0 2024-09-12T00:10:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.797+0000 7f43f4ff9640 1 -- 172.21.15.6:0/1168417228 <== mon.1 v2:172.21.15.134:3300/0 4 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f4404043040 con 0x55d45868f9a0 2024-09-12T00:10:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.797+0000 7f44164c1740 10 client.25816 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:10:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.797+0000 7f44164c1740 10 client.25816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:10:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.797+0000 7f44164c1740 20 client.25816 populate_metadata read hostname 'smithi006' 2024-09-12T00:10:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.797+0000 7f44164c1740 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d458710c70 0x55d458713090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.798+0000 7f44164c1740 4 client.25816 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:10:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.798+0000 7f44164c1740 1 -- 172.21.15.6:0/1168417228 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d4585fad70 con 0x55d458710c70 2024-09-12T00:10:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.799+0000 7f4410cc7640 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d458710c70 0x55d458713090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:55.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.801+0000 7f4410cc7640 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d458710c70 0x55d458713090 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17ddc42e617edb13 server_cookie=1f4c0d7bf6e2bb99 in_seq=0 out_seq=0 2024-09-12T00:10:55.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:55.801+0000 7f43f4ff9640 10 client.25816 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.080+0000 7f43f4ff9640 1 -- 172.21.15.6:0/1168417228 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d4585fad70 con 0x55d458710c70 2024-09-12T00:10:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.080+0000 7f43f4ff9640 10 client.25816 handle_command_reply: tid=0 2024-09-12T00:10:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.080+0000 7f44164c1740 1 client.25816 shutdown 2024-09-12T00:10:56.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.084+0000 7f44164c1740 1 -- 172.21.15.6:0/1168417228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45868f9a0 msgr2=0x55d4586b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:56.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.084+0000 7f44164c1740 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45868f9a0 0x55d4586b7320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f440404a040 tx=0x7f440402f850 comp rx=0 tx=0).stop 2024-09-12T00:10:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.084+0000 7f44164c1740 1 -- 172.21.15.6:0/1168417228 shutdown_connections 2024-09-12T00:10:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.084+0000 7f44164c1740 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d45869f3f0 0x55d4586b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.085+0000 7f44164c1740 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4586902e0 0x55d4586b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.085+0000 7f44164c1740 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55d458710c70 0x55d458713090 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.085+0000 7f44164c1740 1 --2- 172.21.15.6:0/1168417228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d45868f9a0 0x55d4586b7320 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.085+0000 7f43f4ff9640 0 client.25816 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:10:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.085+0000 7f44164c1740 1 -- 172.21.15.6:0/1168417228 >> 172.21.15.6:0/1168417228 conn(0x55d45868b010 msgr2=0x55d4586899a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:56.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.087+0000 7f44164c1740 1 -- 172.21.15.6:0/1168417228 shutdown_connections 2024-09-12T00:10:56.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.087+0000 7f44164c1740 1 -- 172.21.15.6:0/1168417228 wait complete. 2024-09-12T00:10:56.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.088+0000 7f44164c1740 20 client.25816 trim_cache size 0 max 16384 2024-09-12T00:10:56.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:10:56.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:10:56.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:10:56.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:10:56.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.092+0000 7f441372c640 1 -- 172.21.15.6:0/2045466740 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f43f80a2d90 msgr2=0x7f43f80a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:56.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.092+0000 7f441372c640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f43f80a2d90 0x7f43f80a5250 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0095b0 tx=0x7f43fc006c20 comp rx=0 tx=0).stop 2024-09-12T00:10:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.092+0000 7f441372c640 1 -- 172.21.15.6:0/2045466740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c0736b0 msgr2=0x7f440c1163f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.092+0000 7f441372c640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c0736b0 0x7f440c1163f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f440800b450 tx=0x7f440800b910 comp rx=0 tx=0).stop 2024-09-12T00:10:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.093+0000 7f441372c640 1 -- 172.21.15.6:0/2045466740 shutdown_connections 2024-09-12T00:10:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.093+0000 7f441372c640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f43f80a2d90 0x7f43f80a5250 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.093+0000 7f441372c640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f440c109700 0x7f440c1b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.093+0000 7f441372c640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c0736b0 0x7f440c1163f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.093+0000 7f441372c640 1 --2- 172.21.15.6:0/2045466740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c072d10 0x7f440c115eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.093+0000 7f441372c640 1 -- 172.21.15.6:0/2045466740 >> 172.21.15.6:0/2045466740 conn(0x7f440c06ecd0 msgr2=0x7f440c10c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.094+0000 7f441372c640 1 -- 172.21.15.6:0/2045466740 shutdown_connections 2024-09-12T00:10:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:10:56.094+0000 7f441372c640 1 -- 172.21.15.6:0/2045466740 wait complete. 2024-09-12T00:10:57.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:56 smithi134 ceph-mon[34893]: pgmap v707: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 3.95k op/s 2024-09-12T00:10:57.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:56 smithi039 ceph-mon[34543]: pgmap v707: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 3.95k op/s 2024-09-12T00:10:57.374 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:56 smithi006 ceph-mon[30947]: pgmap v707: 129 pgs: 129 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 3.95k op/s 2024-09-12T00:10:59.202 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:10:58 smithi134 ceph-mon[34893]: pgmap v708: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.38k op/s 2024-09-12T00:10:59.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:10:58 smithi039 ceph-mon[34543]: pgmap v708: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.38k op/s 2024-09-12T00:10:59.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:10:58 smithi006 ceph-mon[30947]: pgmap v708: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.38k op/s 2024-09-12T00:11:01.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:00 smithi039 ceph-mon[34543]: pgmap v709: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.36k op/s 2024-09-12T00:11:01.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:00 smithi006 ceph-mon[30947]: pgmap v709: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.36k op/s 2024-09-12T00:11:01.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:00 smithi134 ceph-mon[34893]: pgmap v709: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.36k op/s 2024-09-12T00:11:03.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:02 smithi039 ceph-mon[34543]: pgmap v710: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.77k op/s 2024-09-12T00:11:03.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:02 smithi006 ceph-mon[30947]: pgmap v710: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.77k op/s 2024-09-12T00:11:03.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:02 smithi134 ceph-mon[34893]: pgmap v710: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.77k op/s 2024-09-12T00:11:05.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:04 smithi039 ceph-mon[34543]: pgmap v711: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2024-09-12T00:11:05.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:04 smithi006 ceph-mon[30947]: pgmap v711: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2024-09-12T00:11:05.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:04 smithi134 ceph-mon[34893]: pgmap v711: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2024-09-12T00:11:07.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:06 smithi039 ceph-mon[34543]: pgmap v712: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 4.00k op/s 2024-09-12T00:11:07.372 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:06 smithi006 ceph-mon[30947]: pgmap v712: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 4.00k op/s 2024-09-12T00:11:07.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:06 smithi134 ceph-mon[34893]: pgmap v712: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 4.00k op/s 2024-09-12T00:11:09.257 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:08 smithi134 ceph-mon[34893]: pgmap v713: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2024-09-12T00:11:09.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:08 smithi039 ceph-mon[34543]: pgmap v713: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2024-09-12T00:11:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.299+0000 7f9ae1342640 1 -- 172.21.15.6:0/3523924162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9adc1095e0 msgr2=0x7f9adc1099e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.299+0000 7f9ae1342640 1 --2- 172.21.15.6:0/3523924162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9adc1095e0 0x7f9adc1099e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00b880 tx=0x7f9acc005f90 comp rx=0 tx=0).stop 2024-09-12T00:11:09.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.300+0000 7f9ae1342640 1 -- 172.21.15.6:0/3523924162 shutdown_connections 2024-09-12T00:11:09.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.300+0000 7f9ae1342640 1 --2- 172.21.15.6:0/3523924162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9adc0737a0 0x7f9adc07a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.300+0000 7f9ae1342640 1 --2- 172.21.15.6:0/3523924162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc072de0 0x7f9adc073260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.300+0000 7f9ae1342640 1 --2- 172.21.15.6:0/3523924162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9adc1095e0 0x7f9adc1099e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.300+0000 7f9ae1342640 1 -- 172.21.15.6:0/3523924162 >> 172.21.15.6:0/3523924162 conn(0x7f9adc06eb10 msgr2=0x7f9adc070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.304+0000 7f9ae1342640 1 -- 172.21.15.6:0/3523924162 shutdown_connections 2024-09-12T00:11:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.304+0000 7f9ae1342640 1 -- 172.21.15.6:0/3523924162 wait complete. 2024-09-12T00:11:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.305+0000 7f9ae1342640 1 Processor -- start 2024-09-12T00:11:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.305+0000 7f9ae1342640 1 -- start start 2024-09-12T00:11:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.306+0000 7f9ae1342640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9adc072de0 0x7f9adc1b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.306+0000 7f9ae1342640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0737a0 0x7f9adc1b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.306+0000 7f9ae1342640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9adc1095e0 0x7f9adc1bef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.306+0000 7f9ae1342640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9adc12d330 con 0x7f9adc0737a0 2024-09-12T00:11:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.306+0000 7f9ae1342640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9adc12d1b0 con 0x7f9adc1095e0 2024-09-12T00:11:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.306+0000 7f9ae1342640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9adc12d4b0 con 0x7f9adc072de0 2024-09-12T00:11:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.309+0000 7f9ada7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0737a0 0x7f9adc1b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.309+0000 7f9ada7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0737a0 0x7f9adc1b7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37280/0 (socket says 172.21.15.6:37280) 2024-09-12T00:11:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.309+0000 7f9ada7fc640 1 -- 172.21.15.6:0/3761550834 learned_addr learned my addr 172.21.15.6:0/3761550834 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.309+0000 7f9adb7fe640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9adc1095e0 0x7f9adc1bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.309+0000 7f9adaffd640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9adc072de0 0x7f9adc1b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.319+0000 7f9adb7fe640 1 -- 172.21.15.6:0/3761550834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9adc072de0 msgr2=0x7f9adc1b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.319+0000 7f9adb7fe640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9adc072de0 0x7f9adc1b79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.319+0000 7f9adb7fe640 1 -- 172.21.15.6:0/3761550834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0737a0 msgr2=0x7f9adc1b7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.319+0000 7f9adb7fe640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0737a0 0x7f9adc1b7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.319+0000 7f9adb7fe640 1 -- 172.21.15.6:0/3761550834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9adc1bf5c0 con 0x7f9adc1095e0 2024-09-12T00:11:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.330+0000 7f9adb7fe640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9adc1095e0 0x7f9adc1bef50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000ba60 tx=0x7f9ad000bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.336+0000 7f9ac3fff640 1 -- 172.21.15.6:0/3761550834 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0004220 con 0x7f9adc1095e0 2024-09-12T00:11:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.339+0000 7f9ac3fff640 1 -- 172.21.15.6:0/3761550834 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ad000d400 con 0x7f9adc1095e0 2024-09-12T00:11:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.339+0000 7f9ac3fff640 1 -- 172.21.15.6:0/3761550834 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0009e60 con 0x7f9adc1095e0 2024-09-12T00:11:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.339+0000 7f9ae1342640 1 -- 172.21.15.6:0/3761550834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9adc1bf8b0 con 0x7f9adc1095e0 2024-09-12T00:11:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.339+0000 7f9ae1342640 1 -- 172.21.15.6:0/3761550834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9adc1bfdb0 con 0x7f9adc1095e0 2024-09-12T00:11:09.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.345+0000 7f9ac3fff640 1 -- 172.21.15.6:0/3761550834 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f9ad001d020 con 0x7f9adc1095e0 2024-09-12T00:11:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.346+0000 7f9ae40db740 1 Processor -- start 2024-09-12T00:11:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.346+0000 7f9ae40db740 1 -- start start 2024-09-12T00:11:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.346+0000 7f9ae40db740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 0x557e6addcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.346+0000 7f9ae40db740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6ade1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.346+0000 7f9ae40db740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6ade2540 0x557e6ade4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.346+0000 7f9ae40db740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557e6ad402f0 con 0x557e6addd4b0 2024-09-12T00:11:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.346+0000 7f9ae40db740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557e6ace8270 con 0x557e6ade2540 2024-09-12T00:11:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.346+0000 7f9ae40db740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557e6ad3c2b0 con 0x557e6addcb70 2024-09-12T00:11:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.347+0000 7f9ac3fff640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9ac40a2da0 0x7f9ac40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.347+0000 7f9ac3fff640 1 -- 172.21.15.6:0/3761550834 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f9ad00ce690 con 0x7f9adc1095e0 2024-09-12T00:11:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.348+0000 7f9ada7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6ade2540 0x557e6ade4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.348+0000 7f9ada7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 0x557e6addcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.348+0000 7f9ada7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 0x557e6addcf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:60128/0 (socket says 172.21.15.6:60128) 2024-09-12T00:11:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.348+0000 7f9ada7fc640 1 -- 172.21.15.6:0/48534872 learned_addr learned my addr 172.21.15.6:0/48534872 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.348+0000 7f9adaffd640 1 --2- 172.21.15.6:0/48534872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6ade1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.348+0000 7f9adaffd640 1 -- 172.21.15.6:0/48534872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 msgr2=0x557e6addcf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:09.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.348+0000 7f9adaffd640 1 --2- 172.21.15.6:0/48534872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 0x557e6addcf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.348+0000 7f9adaffd640 1 -- 172.21.15.6:0/48534872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6ade2540 msgr2=0x557e6ade4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:09.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.348+0000 7f9adaffd640 1 --2- 172.21.15.6:0/48534872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6ade2540 0x557e6ade4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.348+0000 7f9adaffd640 1 -- 172.21.15.6:0/48534872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e6ace7340 con 0x557e6addd4b0 2024-09-12T00:11:09.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.349+0000 7f9adaffd640 1 --2- 172.21.15.6:0/48534872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6ade1f70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00b7a0 tx=0x7f9acc00b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02721ffb1b8f85b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.351+0000 7f9adb7fe640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9ac40a2da0 0x7f9ac40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.352+0000 7f9adb7fe640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9ac40a2da0 0x7f9ac40a5260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000dfd0 tx=0x7f9ad000daf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.352+0000 7f9ac17fa640 1 -- 172.21.15.6:0/48534872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc040020 con 0x557e6addd4b0 2024-09-12T00:11:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.352+0000 7f9ac17fa640 1 -- 172.21.15.6:0/48534872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9acc02aa30 con 0x557e6addd4b0 2024-09-12T00:11:09.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.353+0000 7f9ae40db740 1 -- 172.21.15.6:0/48534872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 msgr2=0x557e6ade1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:09.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.353+0000 7f9ae40db740 1 --2- 172.21.15.6:0/48534872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6ade1f70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00b7a0 tx=0x7f9acc00b520 comp rx=0 tx=0).stop 2024-09-12T00:11:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.358+0000 7f9ae40db740 1 -- 172.21.15.6:0/48534872 shutdown_connections 2024-09-12T00:11:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.359+0000 7f9ae40db740 1 --2- 172.21.15.6:0/48534872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6ade2540 0x557e6ade4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.359+0000 7f9ae40db740 1 --2- 172.21.15.6:0/48534872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6ade1f70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.359+0000 7f9ae40db740 1 --2- 172.21.15.6:0/48534872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 0x557e6addcf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.359+0000 7f9ae40db740 1 -- 172.21.15.6:0/48534872 >> 172.21.15.6:0/48534872 conn(0x557e6add81e0 msgr2=0x557e6add85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:09.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.364+0000 7f9ae40db740 1 -- 172.21.15.6:0/48534872 shutdown_connections 2024-09-12T00:11:09.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:08 smithi006 ceph-mon[30947]: pgmap v713: 129 pgs: 129 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2024-09-12T00:11:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.369+0000 7f9ae40db740 1 -- 172.21.15.6:0/48534872 wait complete. 2024-09-12T00:11:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.375+0000 7f9ae40db740 1 -- start start 2024-09-12T00:11:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.375+0000 7f9ae40db740 1 Processor -- start 2024-09-12T00:11:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.375+0000 7f9ae40db740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6addcb70 0x557e6ade6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.375+0000 7f9ae40db740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6ade7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.375+0000 7f9ae40db740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6ade2540 0x557e6adee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.375+0000 7f9ae40db740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557e6ade5500 con 0x557e6addd4b0 2024-09-12T00:11:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.375+0000 7f9ae40db740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557e6acc9290 con 0x557e6addcb70 2024-09-12T00:11:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.375+0000 7f9ae40db740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557e6ade5680 con 0x557e6ade2540 2024-09-12T00:11:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.375+0000 7f9ae40db740 10 client.0 _ll_register_callbacks cb 0x557e6acfa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:11:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.376+0000 7f9adaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6ade7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.376+0000 7f9adaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6ade7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37306/0 (socket says 172.21.15.6:37306) 2024-09-12T00:11:09.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.376+0000 7f9adaffd640 1 -- 172.21.15.6:0/1305796279 learned_addr learned my addr 172.21.15.6:0/1305796279 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.379+0000 7f9adaffd640 1 -- 172.21.15.6:0/1305796279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6ade2540 msgr2=0x557e6adee2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:11:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.379+0000 7f9adaffd640 1 --2- 172.21.15.6:0/1305796279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6ade2540 0x557e6adee2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.379+0000 7f9adaffd640 1 -- 172.21.15.6:0/1305796279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6addcb70 msgr2=0x557e6ade6d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:11:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.379+0000 7f9adaffd640 1 --2- 172.21.15.6:0/1305796279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6addcb70 0x557e6ade6d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.379+0000 7f9adaffd640 1 -- 172.21.15.6:0/1305796279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e6aa53210 con 0x557e6addd4b0 2024-09-12T00:11:09.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.380+0000 7f9adaffd640 1 --2- 172.21.15.6:0/1305796279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6ade7290 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00a4d0 tx=0x7f9acc00a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69391d8fa4a4ae28 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:09.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.380+0000 7f9abeff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:11:09.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.381+0000 7f9abeff5640 1 -- 172.21.15.6:0/1305796279 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc049070 con 0x557e6addd4b0 2024-09-12T00:11:09.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.381+0000 7f9ae40db740 1 -- 172.21.15.6:0/1305796279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9acc02aa30 con 0x557e6addd4b0 2024-09-12T00:11:09.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.381+0000 7f9abeff5640 1 -- 172.21.15.6:0/1305796279 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f9acc00ab70 con 0x557e6addd4b0 2024-09-12T00:11:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.385+0000 7f9abeff5640 1 -- 172.21.15.6:0/1305796279 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9acc055050 con 0x557e6addd4b0 2024-09-12T00:11:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.385+0000 7f9ae40db740 10 client.16218 fetch_fsmap learned FSMap version 33 2024-09-12T00:11:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.385+0000 7f9ae40db740 1 -- 172.21.15.6:0/1305796279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557e6ab1f620 con 0x557e6addd4b0 2024-09-12T00:11:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.389+0000 7f9abeff5640 1 -- 172.21.15.6:0/1305796279 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9acc02aa30 con 0x557e6addd4b0 2024-09-12T00:11:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.389+0000 7f9abeff5640 1 -- 172.21.15.6:0/1305796279 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9acc032500 con 0x557e6addd4b0 2024-09-12T00:11:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.389+0000 7f9ae40db740 10 client.16218 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:11:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.389+0000 7f9ae40db740 10 client.16218 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:11:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.389+0000 7f9ae40db740 20 client.16218 populate_metadata read hostname 'smithi006' 2024-09-12T00:11:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.389+0000 7f9ae40db740 1 --2- 172.21.15.6:0/1305796279 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557e6ae03b60 0x557e6ae05fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.389+0000 7f9ae40db740 4 client.16218 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:11:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.389+0000 7f9ae40db740 1 -- 172.21.15.6:0/1305796279 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e6ad4da20 con 0x557e6ae03b60 2024-09-12T00:11:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.395+0000 7f9ada7fc640 1 --2- 172.21.15.6:0/1305796279 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557e6ae03b60 0x557e6ae05fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.402+0000 7f9ada7fc640 1 --2- 172.21.15.6:0/1305796279 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557e6ae03b60 0x557e6ae05fe0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=839aae4eb1eae0ba server_cookie=c2c87a44e486f8b in_seq=0 out_seq=0 2024-09-12T00:11:09.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.405+0000 7f9abeff5640 10 client.16218 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:11:09.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.406+0000 7f9abeff5640 1 -- 172.21.15.6:0/1305796279 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e6ad4da20 con 0x557e6ae03b60 2024-09-12T00:11:09.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.406+0000 7f9abeff5640 10 client.16218 handle_command_reply: tid=0 2024-09-12T00:11:09.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.406+0000 7f9ae40db740 1 client.16218 shutdown 2024-09-12T00:11:09.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.406+0000 7f9ae40db740 1 -- 172.21.15.6:0/1305796279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 msgr2=0x557e6ade7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:09.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.406+0000 7f9ae40db740 1 --2- 172.21.15.6:0/1305796279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6ade7290 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00a4d0 tx=0x7f9acc00a7a0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.406+0000 7f9ae40db740 1 -- 172.21.15.6:0/1305796279 shutdown_connections 2024-09-12T00:11:09.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.406+0000 7f9ae40db740 1 --2- 172.21.15.6:0/1305796279 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557e6ae03b60 0x557e6ae05fe0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.406+0000 7f9ae40db740 1 --2- 172.21.15.6:0/1305796279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6ade2540 0x557e6adee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.406+0000 7f9ae40db740 1 --2- 172.21.15.6:0/1305796279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6ade7290 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.406+0000 7f9ae40db740 1 --2- 172.21.15.6:0/1305796279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6addcb70 0x557e6ade6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.406+0000 7f9ae40db740 1 -- 172.21.15.6:0/1305796279 >> 172.21.15.6:0/1305796279 conn(0x557e6add81e0 msgr2=0x557e6add99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:09.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.407+0000 7f9abeff5640 0 client.16218 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:11:09.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.407+0000 7f9ae40db740 1 -- 172.21.15.6:0/1305796279 shutdown_connections 2024-09-12T00:11:09.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.407+0000 7f9ae40db740 1 -- 172.21.15.6:0/1305796279 wait complete. 2024-09-12T00:11:09.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.407+0000 7f9ae40db740 20 client.16218 trim_cache size 0 max 16384 2024-09-12T00:11:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.451+0000 7f9ae40db740 1 Processor -- start 2024-09-12T00:11:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.452+0000 7f9ae40db740 1 -- start start 2024-09-12T00:11:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.452+0000 7f9ae40db740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addcb70 0x557e6add2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.452+0000 7f9ae40db740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6addd4b0 0x557e6adee290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.453+0000 7f9ae40db740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6ade2540 0x557e6adde590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.453+0000 7f9ae40db740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac800feb0 con 0x557e6addcb70 2024-09-12T00:11:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.453+0000 7f9ae40db740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac80119f0 con 0x557e6addd4b0 2024-09-12T00:11:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.453+0000 7f9ada7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6ade2540 0x557e6adde590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.453+0000 7f9ada7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6ade2540 0x557e6adde590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:60140/0 (socket says 172.21.15.6:60140) 2024-09-12T00:11:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.453+0000 7f9ada7fc640 1 -- 172.21.15.6:0/3824218844 learned_addr learned my addr 172.21.15.6:0/3824218844 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.453+0000 7f9ae40db740 1 -- 172.21.15.6:0/3824218844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac8010580 con 0x557e6ade2540 2024-09-12T00:11:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.454+0000 7f9ada7fc640 1 --2- 172.21.15.6:0/3824218844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addcb70 0x557e6add2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.454+0000 7f9ada7fc640 1 -- 172.21.15.6:0/3824218844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6addd4b0 msgr2=0x557e6adee290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:11:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.454+0000 7f9ada7fc640 1 --2- 172.21.15.6:0/3824218844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6addd4b0 0x557e6adee290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.454+0000 7f9ada7fc640 1 -- 172.21.15.6:0/3824218844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addcb70 msgr2=0x557e6add2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.454+0000 7f9ada7fc640 1 --2- 172.21.15.6:0/3824218844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addcb70 0x557e6add2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.454+0000 7f9ada7fc640 1 -- 172.21.15.6:0/3824218844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e6add8de0 con 0x557e6ade2540 2024-09-12T00:11:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.454+0000 7f9ada7fc640 1 --2- 172.21.15.6:0/3824218844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6ade2540 0x557e6adde590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x557e6ade6280 tx=0x7f9ad400c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7406e66011e37702 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.455+0000 7f9ac0ff9640 1 -- 172.21.15.6:0/3824218844 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4004b20 con 0x557e6ade2540 2024-09-12T00:11:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.455+0000 7f9ac0ff9640 1 -- 172.21.15.6:0/3824218844 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ad401dde0 con 0x557e6ade2540 2024-09-12T00:11:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.455+0000 7f9ac0ff9640 1 -- 172.21.15.6:0/3824218844 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4005470 con 0x557e6ade2540 2024-09-12T00:11:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.456+0000 7f9ae40db740 1 -- 172.21.15.6:0/3824218844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6ade2540 msgr2=0x557e6adde590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.456+0000 7f9ae40db740 1 --2- 172.21.15.6:0/3824218844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6ade2540 0x557e6adde590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x557e6ade6280 tx=0x7f9ad400c040 comp rx=0 tx=0).stop 2024-09-12T00:11:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.456+0000 7f9ae40db740 1 -- 172.21.15.6:0/3824218844 shutdown_connections 2024-09-12T00:11:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.456+0000 7f9ae40db740 1 --2- 172.21.15.6:0/3824218844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6ade2540 0x557e6adde590 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.456+0000 7f9ae40db740 1 --2- 172.21.15.6:0/3824218844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6addd4b0 0x557e6adee290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.456+0000 7f9ae40db740 1 --2- 172.21.15.6:0/3824218844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addcb70 0x557e6add2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.456+0000 7f9ae40db740 1 -- 172.21.15.6:0/3824218844 >> 172.21.15.6:0/3824218844 conn(0x557e6add81e0 msgr2=0x557e6ade6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.456+0000 7f9ae40db740 1 -- 172.21.15.6:0/3824218844 shutdown_connections 2024-09-12T00:11:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.456+0000 7f9ae40db740 1 -- 172.21.15.6:0/3824218844 wait complete. 2024-09-12T00:11:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.457+0000 7f9ae40db740 1 -- start start 2024-09-12T00:11:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.457+0000 7f9ae40db740 1 Processor -- start 2024-09-12T00:11:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.457+0000 7f9ae40db740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 0x557e6adeb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.457+0000 7f9ae40db740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6adeb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.457+0000 7f9ae40db740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6ade2540 0x557e6ae6c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.457+0000 7f9ae40db740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac8011320 con 0x557e6addd4b0 2024-09-12T00:11:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.457+0000 7f9ae40db740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac8010c50 con 0x557e6ade2540 2024-09-12T00:11:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.457+0000 7f9ae40db740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac800de90 con 0x557e6addcb70 2024-09-12T00:11:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.457+0000 7f9ae40db740 10 client.0 _ll_register_callbacks cb 0x7f9ad4016500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:11:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.458+0000 7f9ada7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 0x557e6adeb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.458+0000 7f9ada7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 0x557e6adeb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:60142/0 (socket says 172.21.15.6:60142) 2024-09-12T00:11:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.458+0000 7f9ada7fc640 1 -- 172.21.15.6:0/2250710324 learned_addr learned my addr 172.21.15.6:0/2250710324 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.458+0000 7f9ada7fc640 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6ade2540 0x557e6ae6c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.458+0000 7f9adaffd640 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6adeb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.458+0000 7f9ada7fc640 1 -- 172.21.15.6:0/2250710324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6ade2540 msgr2=0x557e6ae6c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.458+0000 7f9ada7fc640 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6ade2540 0x557e6ae6c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.458+0000 7f9ada7fc640 1 -- 172.21.15.6:0/2250710324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 msgr2=0x557e6adeb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.458+0000 7f9ada7fc640 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6adeb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.458+0000 7f9ada7fc640 1 -- 172.21.15.6:0/2250710324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e6ae6cdf0 con 0x557e6addcb70 2024-09-12T00:11:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.458+0000 7f9adaffd640 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6adeb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:11:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.459+0000 7f9ada7fc640 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 0x557e6adeb140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4008ce0 tx=0x7f9ad401df90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=776af3ff3fc80918 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.459+0000 7f9abeff5640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:11:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.459+0000 7f9abeff5640 1 -- 172.21.15.6:0/2250710324 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4004c70 con 0x557e6addcb70 2024-09-12T00:11:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.460+0000 7f9ae40db740 1 -- 172.21.15.6:0/2250710324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ad401dde0 con 0x557e6addcb70 2024-09-12T00:11:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.460+0000 7f9abeff5640 1 -- 172.21.15.6:0/2250710324 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f9ad401db30 con 0x557e6addcb70 2024-09-12T00:11:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.460+0000 7f9abeff5640 1 -- 172.21.15.6:0/2250710324 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9ad40051f0 con 0x557e6addcb70 2024-09-12T00:11:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.460+0000 7f9ae40db740 10 client.25831 fetch_fsmap learned FSMap version 33 2024-09-12T00:11:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.460+0000 7f9ae40db740 1 -- 172.21.15.6:0/2250710324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557e6ae6e0c0 con 0x557e6addcb70 2024-09-12T00:11:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.462+0000 7f9abeff5640 1 -- 172.21.15.6:0/2250710324 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ad401dde0 con 0x557e6addcb70 2024-09-12T00:11:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.462+0000 7f9abeff5640 1 -- 172.21.15.6:0/2250710324 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9ad402d040 con 0x557e6addcb70 2024-09-12T00:11:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.462+0000 7f9ae40db740 10 client.25831 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:11:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.462+0000 7f9ae40db740 10 client.25831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:11:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.462+0000 7f9ae40db740 20 client.25831 populate_metadata read hostname 'smithi006' 2024-09-12T00:11:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.462+0000 7f9ae40db740 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557e6ae6ea30 0x557e6ae70e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.462+0000 7f9ae40db740 4 client.25831 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:11:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.462+0000 7f9ae40db740 1 -- 172.21.15.6:0/2250710324 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e6ad47d70 con 0x557e6ae6ea30 2024-09-12T00:11:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.463+0000 7f9adaffd640 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557e6ae6ea30 0x557e6ae70e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.464+0000 7f9adaffd640 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557e6ae6ea30 0x557e6ae70e50 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8427fcab29dcdd88 server_cookie=328c5b96ef7175cc in_seq=0 out_seq=0 2024-09-12T00:11:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:09.464+0000 7f9abeff5640 10 client.25831 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:11:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.754+0000 7f9abeff5640 1 -- 172.21.15.6:0/2250710324 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557e6ad47d70 con 0x557e6ae6ea30 2024-09-12T00:11:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.754+0000 7f9abeff5640 10 client.25831 handle_command_reply: tid=0 2024-09-12T00:11:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.754+0000 7f9ae40db740 1 client.25831 shutdown 2024-09-12T00:11:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.762+0000 7f9ae40db740 1 -- 172.21.15.6:0/2250710324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 msgr2=0x557e6adeb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.762+0000 7f9ae40db740 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 0x557e6adeb140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4008ce0 tx=0x7f9ad401df90 comp rx=0 tx=0).stop 2024-09-12T00:11:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.763+0000 7f9ae40db740 1 -- 172.21.15.6:0/2250710324 shutdown_connections 2024-09-12T00:11:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.763+0000 7f9ae40db740 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557e6ade2540 0x557e6ae6c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.763+0000 7f9ae40db740 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e6addd4b0 0x557e6adeb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.763+0000 7f9ae40db740 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557e6ae6ea30 0x557e6ae70e50 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.763+0000 7f9ae40db740 1 --2- 172.21.15.6:0/2250710324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e6addcb70 0x557e6adeb140 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4008ce0 tx=0x7f9ad401df90 comp rx=0 tx=0).stop 2024-09-12T00:11:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.763+0000 7f9ae40db740 1 -- 172.21.15.6:0/2250710324 >> 172.21.15.6:0/2250710324 conn(0x557e6add81e0 msgr2=0x557e6ade6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.763+0000 7f9abeff5640 0 client.25831 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:11:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.773+0000 7f9ae40db740 1 -- 172.21.15.6:0/2250710324 shutdown_connections 2024-09-12T00:11:10.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.775+0000 7f9ae40db740 1 -- 172.21.15.6:0/2250710324 wait complete. 2024-09-12T00:11:10.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.775+0000 7f9ae40db740 20 client.25831 trim_cache size 0 max 16384 2024-09-12T00:11:10.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:11:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:11:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:11:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:11:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.776+0000 7f9ae1342640 1 -- 172.21.15.6:0/3761550834 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9ac40a2da0 msgr2=0x7f9ac40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.776+0000 7f9ae1342640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9ac40a2da0 0x7f9ac40a5260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000dfd0 tx=0x7f9ad000daf0 comp rx=0 tx=0).stop 2024-09-12T00:11:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.776+0000 7f9ae1342640 1 -- 172.21.15.6:0/3761550834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9adc1095e0 msgr2=0x7f9adc1bef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.776+0000 7f9ae1342640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9adc1095e0 0x7f9adc1bef50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000ba60 tx=0x7f9ad000bf20 comp rx=0 tx=0).stop 2024-09-12T00:11:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.776+0000 7f9ae1342640 1 -- 172.21.15.6:0/3761550834 shutdown_connections 2024-09-12T00:11:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.776+0000 7f9ae1342640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9ac40a2da0 0x7f9ac40a5260 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.776+0000 7f9ae1342640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9adc1095e0 0x7f9adc1bef50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.776+0000 7f9ae1342640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0737a0 0x7f9adc1b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.776+0000 7f9ae1342640 1 --2- 172.21.15.6:0/3761550834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9adc072de0 0x7f9adc1b79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.776+0000 7f9ae1342640 1 -- 172.21.15.6:0/3761550834 >> 172.21.15.6:0/3761550834 conn(0x7f9adc06eb10 msgr2=0x7f9adc0765c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.777+0000 7f9ae1342640 1 -- 172.21.15.6:0/3761550834 shutdown_connections 2024-09-12T00:11:10.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:10.777+0000 7f9ae1342640 1 -- 172.21.15.6:0/3761550834 wait complete. 2024-09-12T00:11:11.299 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:10 smithi039 ceph-mon[34543]: pgmap v714: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2024-09-12T00:11:11.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:10 smithi006 ceph-mon[30947]: pgmap v714: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2024-09-12T00:11:11.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:10 smithi134 ceph-mon[34893]: pgmap v714: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2024-09-12T00:11:13.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:12 smithi039 ceph-mon[34543]: pgmap v715: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 3.61k op/s 2024-09-12T00:11:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:12 smithi006 ceph-mon[30947]: pgmap v715: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 3.61k op/s 2024-09-12T00:11:13.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:12 smithi134 ceph-mon[34893]: pgmap v715: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 3.61k op/s 2024-09-12T00:11:15.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:15 smithi039 ceph-mon[34543]: pgmap v716: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 4.52k op/s 2024-09-12T00:11:15.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:15 smithi006 ceph-mon[30947]: pgmap v716: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 4.52k op/s 2024-09-12T00:11:15.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:15 smithi134 ceph-mon[34893]: pgmap v716: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 4.52k op/s 2024-09-12T00:11:17.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:17 smithi039 ceph-mon[34543]: pgmap v717: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2024-09-12T00:11:17.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:17 smithi006 ceph-mon[30947]: pgmap v717: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2024-09-12T00:11:17.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:17 smithi134 ceph-mon[34893]: pgmap v717: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2024-09-12T00:11:19.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:19 smithi039 ceph-mon[34543]: pgmap v718: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2024-09-12T00:11:19.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:19 smithi006 ceph-mon[30947]: pgmap v718: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2024-09-12T00:11:19.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:19 smithi134 ceph-mon[34893]: pgmap v718: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2024-09-12T00:11:21.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:21 smithi039 ceph-mon[34543]: pgmap v719: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-12T00:11:21.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:21 smithi006 ceph-mon[30947]: pgmap v719: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-12T00:11:21.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:21 smithi134 ceph-mon[34893]: pgmap v719: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-12T00:11:23.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:23 smithi006 ceph-mon[30947]: pgmap v720: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 3.57k op/s 2024-09-12T00:11:23.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:23 smithi134 ceph-mon[34893]: pgmap v720: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 3.57k op/s 2024-09-12T00:11:23.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:23 smithi039 ceph-mon[34543]: pgmap v720: 129 pgs: 129 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 3.57k op/s 2024-09-12T00:11:23.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:23.990+0000 7fae5f59e640 1 -- 172.21.15.6:0/2723742691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6010b4e0 msgr2=0x7fae6010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:23.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:23.990+0000 7fae5f59e640 1 --2- 172.21.15.6:0/2723742691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6010b4e0 0x7fae6010d950 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fae58009ca0 tx=0x7fae5802a8d0 comp rx=0 tx=0).stop 2024-09-12T00:11:23.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:23.998+0000 7fae5f59e640 1 -- 172.21.15.6:0/2723742691 shutdown_connections 2024-09-12T00:11:23.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:23.998+0000 7fae5f59e640 1 --2- 172.21.15.6:0/2723742691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae6010de90 0x7fae60110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:23.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:23.998+0000 7fae5f59e640 1 --2- 172.21.15.6:0/2723742691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6010b4e0 0x7fae6010d950 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:23.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:23.998+0000 7fae5f59e640 1 --2- 172.21.15.6:0/2723742691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae60072d80 0x7fae60073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:23.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:23.998+0000 7fae5f59e640 1 -- 172.21.15.6:0/2723742691 >> 172.21.15.6:0/2723742691 conn(0x7fae6006eb10 msgr2=0x7fae60070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:23.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:23.999+0000 7fae5f59e640 1 -- 172.21.15.6:0/2723742691 shutdown_connections 2024-09-12T00:11:24.006 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.006+0000 7fae5f59e640 1 -- 172.21.15.6:0/2723742691 wait complete. 2024-09-12T00:11:24.006 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.007+0000 7fae5f59e640 1 Processor -- start 2024-09-12T00:11:24.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.014+0000 7fae5f59e640 1 -- start start 2024-09-12T00:11:24.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.014+0000 7fae5f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae60072d80 0x7fae601a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.014+0000 7fae5f59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae6010b4e0 0x7fae601a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.014+0000 7fae5f59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae6010de90 0x7fae601adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.014+0000 7fae5f59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fae6011c380 con 0x7fae60072d80 2024-09-12T00:11:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.014+0000 7fae5f59e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fae6011c200 con 0x7fae6010b4e0 2024-09-12T00:11:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.014+0000 7fae5f59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae6011c500 con 0x7fae6010de90 2024-09-12T00:11:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.016+0000 7fae5dd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae6010b4e0 0x7fae601a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.016+0000 7fae5dd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae6010b4e0 0x7fae601a6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:59416/0 (socket says 172.21.15.6:59416) 2024-09-12T00:11:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.016+0000 7fae5dd9b640 1 -- 172.21.15.6:0/1164275364 learned_addr learned my addr 172.21.15.6:0/1164275364 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.017+0000 7fae5dd9b640 1 -- 172.21.15.6:0/1164275364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae6010de90 msgr2=0x7fae601adf50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T00:11:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.017+0000 7fae5dd9b640 1 --2- 172.21.15.6:0/1164275364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae6010de90 0x7fae601adf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.017+0000 7fae5dd9b640 1 -- 172.21.15.6:0/1164275364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae60072d80 msgr2=0x7fae601a69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.017+0000 7fae5dd9b640 1 --2- 172.21.15.6:0/1164275364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae60072d80 0x7fae601a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.017+0000 7fae5dd9b640 1 -- 172.21.15.6:0/1164275364 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae60110a50 con 0x7fae6010b4e0 2024-09-12T00:11:24.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.020+0000 7fae5dd9b640 1 --2- 172.21.15.6:0/1164275364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae6010b4e0 0x7fae601a6ee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fae58009bf0 tx=0x7fae58030b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:24.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.024+0000 7fae4f7fe640 1 -- 172.21.15.6:0/1164275364 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae58003970 con 0x7fae6010b4e0 2024-09-12T00:11:24.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.024+0000 7fae5f59e640 1 -- 172.21.15.6:0/1164275364 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae60110ce0 con 0x7fae6010b4e0 2024-09-12T00:11:24.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.024+0000 7fae5f59e640 1 -- 172.21.15.6:0/1164275364 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae60111230 con 0x7fae6010b4e0 2024-09-12T00:11:24.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.024+0000 7fae4f7fe640 1 -- 172.21.15.6:0/1164275364 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae58004050 con 0x7fae6010b4e0 2024-09-12T00:11:24.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.024+0000 7fae4f7fe640 1 -- 172.21.15.6:0/1164275364 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5802f6e0 con 0x7fae6010b4e0 2024-09-12T00:11:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.032+0000 7fae67dba740 1 Processor -- start 2024-09-12T00:11:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.033+0000 7fae67dba740 1 -- start start 2024-09-12T00:11:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.033+0000 7fae67dba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009edb70 0x5575009edf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.033+0000 7fae67dba740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575009ee4b0 0x5575009f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.033+0000 7fae67dba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f3540 0x5575009f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.033+0000 7fae67dba740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5575009512f0 con 0x5575009ee4b0 2024-09-12T00:11:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.033+0000 7fae67dba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5575008f9270 con 0x5575009edb70 2024-09-12T00:11:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.033+0000 7fae67dba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55750094d2b0 con 0x5575009f3540 2024-09-12T00:11:24.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.034+0000 7fae5ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009edb70 0x5575009edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.034+0000 7fae5ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009edb70 0x5575009edf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:59426/0 (socket says 172.21.15.6:59426) 2024-09-12T00:11:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.034+0000 7fae5ed9d640 1 -- 172.21.15.6:0/1275898466 learned_addr learned my addr 172.21.15.6:0/1275898466 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.034+0000 7fae5ed9d640 1 -- 172.21.15.6:0/1275898466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f3540 msgr2=0x5575009f5a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:11:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.034+0000 7fae5ed9d640 1 --2- 172.21.15.6:0/1275898466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f3540 0x5575009f5a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.035+0000 7fae5ed9d640 1 -- 172.21.15.6:0/1275898466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575009ee4b0 msgr2=0x5575009f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.035+0000 7fae5ed9d640 1 --2- 172.21.15.6:0/1275898466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575009ee4b0 0x5575009f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.035+0000 7fae5ed9d640 1 -- 172.21.15.6:0/1275898466 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575008f8340 con 0x5575009edb70 2024-09-12T00:11:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.035+0000 7fae5ed9d640 1 --2- 172.21.15.6:0/1275898466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009edb70 0x5575009edf70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fae5000ba00 tx=0x7fae5000bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8236b1aa20bbaa40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.036+0000 7fae4cff9640 1 -- 172.21.15.6:0/1275898466 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50016070 con 0x5575009edb70 2024-09-12T00:11:24.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.036+0000 7fae4cff9640 1 -- 172.21.15.6:0/1275898466 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae500054d0 con 0x5575009edb70 2024-09-12T00:11:24.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.037+0000 7fae67dba740 1 -- 172.21.15.6:0/1275898466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009edb70 msgr2=0x5575009edf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:24.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.037+0000 7fae67dba740 1 --2- 172.21.15.6:0/1275898466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009edb70 0x5575009edf70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fae5000ba00 tx=0x7fae5000bec0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.037+0000 7fae67dba740 1 -- 172.21.15.6:0/1275898466 shutdown_connections 2024-09-12T00:11:24.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.037+0000 7fae67dba740 1 --2- 172.21.15.6:0/1275898466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f3540 0x5575009f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.037+0000 7fae67dba740 1 --2- 172.21.15.6:0/1275898466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575009ee4b0 0x5575009f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.037+0000 7fae67dba740 1 --2- 172.21.15.6:0/1275898466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009edb70 0x5575009edf70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.037+0000 7fae67dba740 1 -- 172.21.15.6:0/1275898466 >> 172.21.15.6:0/1275898466 conn(0x5575009e91e0 msgr2=0x5575009e95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:24.040 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.039+0000 7fae4f7fe640 1 -- 172.21.15.6:0/1164275364 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fae58003b10 con 0x7fae6010b4e0 2024-09-12T00:11:24.041 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.040+0000 7fae4f7fe640 1 --2- 172.21.15.6:0/1164275364 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fae480a2da0 0x7fae480a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.041 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.040+0000 7fae4f7fe640 1 -- 172.21.15.6:0/1164275364 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fae580f0930 con 0x7fae6010b4e0 2024-09-12T00:11:24.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.046+0000 7fae5e59c640 1 --2- 172.21.15.6:0/1164275364 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fae480a2da0 0x7fae480a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:24.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.051+0000 7fae67dba740 1 -- 172.21.15.6:0/1275898466 shutdown_connections 2024-09-12T00:11:24.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.053+0000 7fae67dba740 1 -- 172.21.15.6:0/1275898466 wait complete. 2024-09-12T00:11:24.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.053+0000 7fae67dba740 1 -- start start 2024-09-12T00:11:24.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.053+0000 7fae67dba740 1 Processor -- start 2024-09-12T00:11:24.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.054+0000 7fae67dba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009ee4b0 0x5575009f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.054+0000 7fae67dba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f8400 0x5575009fd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.054+0000 7fae67dba740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575009f8880 0x5575009ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.054+0000 7fae67dba740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5575009f65b0 con 0x5575009f8880 2024-09-12T00:11:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.054+0000 7fae67dba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5575008da290 con 0x5575009ee4b0 2024-09-12T00:11:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.054+0000 7fae67dba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5575009f6730 con 0x5575009f8400 2024-09-12T00:11:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.054+0000 7fae67dba740 10 client.0 _ll_register_callbacks cb 0x55750090b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:11:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.055+0000 7fae5dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f8400 0x5575009fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.055+0000 7fae5dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f8400 0x5575009fd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:53186/0 (socket says 172.21.15.6:53186) 2024-09-12T00:11:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.056+0000 7fae5dd9b640 1 -- 172.21.15.6:0/2626936610 learned_addr learned my addr 172.21.15.6:0/2626936610 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.056+0000 7fae5dd9b640 1 -- 172.21.15.6:0/2626936610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009ee4b0 msgr2=0x5575009f7ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:11:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.056+0000 7fae5dd9b640 1 --2- 172.21.15.6:0/2626936610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009ee4b0 0x5575009f7ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.056+0000 7fae5dd9b640 1 -- 172.21.15.6:0/2626936610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575009f8880 msgr2=0x5575009ff9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.056+0000 7fae5dd9b640 1 --2- 172.21.15.6:0/2626936610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575009f8880 0x5575009ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.056+0000 7fae5dd9b640 1 -- 172.21.15.6:0/2626936610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557500664210 con 0x5575009f8400 2024-09-12T00:11:24.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.062+0000 7fae5e59c640 1 --2- 172.21.15.6:0/1164275364 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fae480a2da0 0x7fae480a5260 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x5575009f73f0 tx=0x7fae54006cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.065+0000 7fae5dd9b640 1 --2- 172.21.15.6:0/2626936610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f8400 0x5575009fd430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fae58004af0 tx=0x7fae58031e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=279afc45c1e52883 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.067+0000 7fae45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:11:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.067+0000 7fae45ffb640 1 -- 172.21.15.6:0/2626936610 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae580098c0 con 0x5575009f8400 2024-09-12T00:11:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.067+0000 7fae67dba740 1 -- 172.21.15.6:0/2626936610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55750095ea20 con 0x5575009f8400 2024-09-12T00:11:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.067+0000 7fae45ffb640 1 -- 172.21.15.6:0/2626936610 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fae580ee0f0 con 0x5575009f8400 2024-09-12T00:11:24.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.082+0000 7fae45ffb640 1 -- 172.21.15.6:0/2626936610 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fae580bd440 con 0x5575009f8400 2024-09-12T00:11:24.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.088+0000 7fae67dba740 10 client.25834 fetch_fsmap learned FSMap version 33 2024-09-12T00:11:24.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.088+0000 7fae67dba740 1 -- 172.21.15.6:0/2626936610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557500730620 con 0x5575009f8400 2024-09-12T00:11:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.094+0000 7fae45ffb640 1 -- 172.21.15.6:0/2626936610 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55750095ea20 con 0x5575009f8400 2024-09-12T00:11:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.095+0000 7fae45ffb640 1 -- 172.21.15.6:0/2626936610 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fae580bc190 con 0x5575009f8400 2024-09-12T00:11:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.105+0000 7fae67dba740 10 client.25834 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:11:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.105+0000 7fae67dba740 10 client.25834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:11:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.105+0000 7fae67dba740 20 client.25834 populate_metadata read hostname 'smithi006' 2024-09-12T00:11:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.105+0000 7fae67dba740 1 --2- 172.21.15.6:0/2626936610 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557500a04450 0x557500a068b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.105+0000 7fae67dba740 4 client.25834 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:11:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.105+0000 7fae67dba740 1 -- 172.21.15.6:0/2626936610 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557500958d70 con 0x557500a04450 2024-09-12T00:11:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.106+0000 7fae5e59c640 1 --2- 172.21.15.6:0/2626936610 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557500a04450 0x557500a068b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.125+0000 7fae45ffb640 10 client.25834 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:11:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.125+0000 7fae5e59c640 1 --2- 172.21.15.6:0/2626936610 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557500a04450 0x557500a068b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fca6f3ca7706ed6 server_cookie=c3c65e0599775765 in_seq=0 out_seq=0 2024-09-12T00:11:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.126+0000 7fae45ffb640 1 -- 172.21.15.6:0/2626936610 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557500958d70 con 0x557500a04450 2024-09-12T00:11:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.126+0000 7fae45ffb640 10 client.25834 handle_command_reply: tid=0 2024-09-12T00:11:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.126+0000 7fae67dba740 1 client.25834 shutdown 2024-09-12T00:11:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.127+0000 7fae67dba740 1 -- 172.21.15.6:0/2626936610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f8400 msgr2=0x5575009fd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.127+0000 7fae67dba740 1 --2- 172.21.15.6:0/2626936610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f8400 0x5575009fd430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fae58004af0 tx=0x7fae58031e40 comp rx=0 tx=0).stop 2024-09-12T00:11:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.130+0000 7fae67dba740 1 -- 172.21.15.6:0/2626936610 shutdown_connections 2024-09-12T00:11:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.130+0000 7fae67dba740 1 --2- 172.21.15.6:0/2626936610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575009f8880 0x5575009ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.130+0000 7fae67dba740 1 --2- 172.21.15.6:0/2626936610 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557500a04450 0x557500a068b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.130+0000 7fae67dba740 1 --2- 172.21.15.6:0/2626936610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f8400 0x5575009fd430 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.130+0000 7fae67dba740 1 --2- 172.21.15.6:0/2626936610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009ee4b0 0x5575009f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.130+0000 7fae67dba740 1 -- 172.21.15.6:0/2626936610 >> 172.21.15.6:0/2626936610 conn(0x5575009e91e0 msgr2=0x5575009ea240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.130+0000 7fae45ffb640 0 client.25834 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:11:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.131+0000 7fae67dba740 1 -- 172.21.15.6:0/2626936610 shutdown_connections 2024-09-12T00:11:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.131+0000 7fae67dba740 1 -- 172.21.15.6:0/2626936610 wait complete. 2024-09-12T00:11:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.131+0000 7fae67dba740 20 client.25834 trim_cache size 0 max 16384 2024-09-12T00:11:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.207+0000 7fae67dba740 1 Processor -- start 2024-09-12T00:11:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.207+0000 7fae67dba740 1 -- start start 2024-09-12T00:11:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.208+0000 7fae67dba740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575009ee4b0 0x5575009f7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.208+0000 7fae67dba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f8400 0x557500a06460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.208+0000 7fae67dba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009f8880 0x5575009ef550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.208+0000 7fae67dba740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fae4000fd20 con 0x5575009ee4b0 2024-09-12T00:11:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.208+0000 7fae67dba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fae40011860 con 0x5575009f8880 2024-09-12T00:11:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.208+0000 7fae67dba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae400103f0 con 0x5575009f8400 2024-09-12T00:11:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.208+0000 7fae5ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009f8880 0x5575009ef550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.208+0000 7fae5ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009f8880 0x5575009ef550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:59450/0 (socket says 172.21.15.6:59450) 2024-09-12T00:11:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.208+0000 7fae5ed9d640 1 -- 172.21.15.6:0/635099163 learned_addr learned my addr 172.21.15.6:0/635099163 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.209+0000 7fae5ed9d640 1 -- 172.21.15.6:0/635099163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f8400 msgr2=0x557500a06460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:11:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.209+0000 7fae5ed9d640 1 --2- 172.21.15.6:0/635099163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f8400 0x557500a06460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.209+0000 7fae5ed9d640 1 -- 172.21.15.6:0/635099163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575009ee4b0 msgr2=0x5575009f7420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:11:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.209+0000 7fae5ed9d640 1 --2- 172.21.15.6:0/635099163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575009ee4b0 0x5575009f7420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.209+0000 7fae5ed9d640 1 -- 172.21.15.6:0/635099163 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575009f7a00 con 0x5575009f8880 2024-09-12T00:11:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.210+0000 7fae5ed9d640 1 --2- 172.21.15.6:0/635099163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009f8880 0x5575009ef550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fae5000d6b0 tx=0x7fae5000b600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e9c7e884dfdc431 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.210+0000 7fae47fff640 1 -- 172.21.15.6:0/635099163 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50016070 con 0x5575009f8880 2024-09-12T00:11:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.210+0000 7fae47fff640 1 -- 172.21.15.6:0/635099163 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae500054b0 con 0x5575009f8880 2024-09-12T00:11:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.211+0000 7fae67dba740 1 -- 172.21.15.6:0/635099163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009f8880 msgr2=0x5575009ef550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.211+0000 7fae67dba740 1 --2- 172.21.15.6:0/635099163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009f8880 0x5575009ef550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fae5000d6b0 tx=0x7fae5000b600 comp rx=0 tx=0).stop 2024-09-12T00:11:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.211+0000 7fae67dba740 1 -- 172.21.15.6:0/635099163 shutdown_connections 2024-09-12T00:11:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.212+0000 7fae67dba740 1 --2- 172.21.15.6:0/635099163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575009f8880 0x5575009ef550 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.212+0000 7fae67dba740 1 --2- 172.21.15.6:0/635099163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575009f8400 0x557500a06460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.212+0000 7fae67dba740 1 --2- 172.21.15.6:0/635099163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575009ee4b0 0x5575009f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.212+0000 7fae67dba740 1 -- 172.21.15.6:0/635099163 >> 172.21.15.6:0/635099163 conn(0x5575009e91e0 msgr2=0x5575009f2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.214+0000 7fae67dba740 1 -- 172.21.15.6:0/635099163 shutdown_connections 2024-09-12T00:11:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.214+0000 7fae67dba740 1 -- 172.21.15.6:0/635099163 wait complete. 2024-09-12T00:11:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.215+0000 7fae67dba740 1 -- start start 2024-09-12T00:11:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.215+0000 7fae67dba740 1 Processor -- start 2024-09-12T00:11:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.221+0000 7fae67dba740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557500a13520 0x557500a13960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.221+0000 7fae67dba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557500a13ea0 0x557500a6afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.221+0000 7fae67dba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557500a6b4f0 0x557500a6d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.221+0000 7fae67dba740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fae40011190 con 0x557500a13520 2024-09-12T00:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.221+0000 7fae67dba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fae40010ac0 con 0x557500a6b4f0 2024-09-12T00:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.221+0000 7fae67dba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae4000ddb0 con 0x557500a13ea0 2024-09-12T00:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.221+0000 7fae67dba740 10 client.0 _ll_register_callbacks cb 0x7fae580b88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:11:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.222+0000 7fae5e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557500a13520 0x557500a13960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.222+0000 7fae5e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557500a13520 0x557500a13960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55964/0 (socket says 172.21.15.6:55964) 2024-09-12T00:11:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.222+0000 7fae5e59c640 1 -- 172.21.15.6:0/275646070 learned_addr learned my addr 172.21.15.6:0/275646070 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.223+0000 7fae5dd9b640 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557500a13ea0 0x557500a6afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.223+0000 7fae5ed9d640 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557500a6b4f0 0x557500a6d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.223+0000 7fae5dd9b640 1 -- 172.21.15.6:0/275646070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557500a6b4f0 msgr2=0x557500a6d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.223+0000 7fae5dd9b640 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557500a6b4f0 0x557500a6d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.223+0000 7fae5dd9b640 1 -- 172.21.15.6:0/275646070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557500a13520 msgr2=0x557500a13960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.223+0000 7fae5dd9b640 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557500a13520 0x557500a13960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.223+0000 7fae5dd9b640 1 -- 172.21.15.6:0/275646070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557500a6de20 con 0x557500a13ea0 2024-09-12T00:11:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.224+0000 7fae5dd9b640 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557500a13ea0 0x557500a6afb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x5575009f3450 tx=0x7fae580b8fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d3dd1a31626aa01 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.224+0000 7fae45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T00:11:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.226+0000 7fae45ffb640 1 -- 172.21.15.6:0/275646070 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae580c59b0 con 0x557500a13ea0 2024-09-12T00:11:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.226+0000 7fae45ffb640 1 -- 172.21.15.6:0/275646070 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fae580ee060 con 0x557500a13ea0 2024-09-12T00:11:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.226+0000 7fae67dba740 1 -- 172.21.15.6:0/275646070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5575008d5900 con 0x557500a13ea0 2024-09-12T00:11:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.235+0000 7fae45ffb640 1 -- 172.21.15.6:0/275646070 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fae580c10f0 con 0x557500a13ea0 2024-09-12T00:11:24.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.236+0000 7fae67dba740 10 client.25837 fetch_fsmap learned FSMap version 33 2024-09-12T00:11:24.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.236+0000 7fae67dba740 1 -- 172.21.15.6:0/275646070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557500a6f190 con 0x557500a13ea0 2024-09-12T00:11:24.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.238+0000 7fae45ffb640 1 -- 172.21.15.6:0/275646070 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5575008d5900 con 0x557500a13ea0 2024-09-12T00:11:24.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.238+0000 7fae45ffb640 1 -- 172.21.15.6:0/275646070 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fae580bbd60 con 0x557500a13ea0 2024-09-12T00:11:24.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.240+0000 7fae67dba740 10 client.25837 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:11:24.242 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.240+0000 7fae67dba740 10 client.25837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:11:24.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.240+0000 7fae67dba740 20 client.25837 populate_metadata read hostname 'smithi006' 2024-09-12T00:11:24.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.240+0000 7fae67dba740 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557500a6f700 0x557500a71b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:24.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.240+0000 7fae67dba740 4 client.25837 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:11:24.243 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.240+0000 7fae67dba740 1 -- 172.21.15.6:0/275646070 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557500922820 con 0x557500a6f700 2024-09-12T00:11:24.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.245+0000 7fae5e59c640 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557500a6f700 0x557500a71b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.266+0000 7fae5e59c640 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557500a6f700 0x557500a71b20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c3fa77dfd1d28e server_cookie=b7c3f962e746894e in_seq=0 out_seq=0 2024-09-12T00:11:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:24.266+0000 7fae45ffb640 10 client.25837 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:11:25.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:25 smithi006 ceph-mon[30947]: pgmap v721: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.28k op/s 2024-09-12T00:11:25.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:25 smithi134 ceph-mon[34893]: pgmap v721: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.28k op/s 2024-09-12T00:11:25.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:25 smithi039 ceph-mon[34543]: pgmap v721: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.28k op/s 2024-09-12T00:11:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:11:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:26.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:26 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:26.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:11:26.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:26.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:26.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:26.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:26 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:26.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:11:26.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:26.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:26.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:26.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:26 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:27.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:27 smithi006 ceph-mon[30947]: pgmap v722: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-09-12T00:11:27.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:27 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:11:27.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:27 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:11:27.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:27 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:27.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:27 smithi134 ceph-mon[34893]: pgmap v722: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-09-12T00:11:27.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:27 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:11:27.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:27 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:11:27.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:27 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:27.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:27 smithi039 ceph-mon[34543]: pgmap v722: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-09-12T00:11:27.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:27 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:11:27.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:27 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:11:27.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:27 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:11:29.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:29 smithi006 ceph-mon[30947]: pgmap v723: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 4.14k op/s 2024-09-12T00:11:29.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:29 smithi134 ceph-mon[34893]: pgmap v723: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 4.14k op/s 2024-09-12T00:11:29.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:29 smithi039 ceph-mon[34543]: pgmap v723: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 4.14k op/s 2024-09-12T00:11:31.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:31 smithi006 ceph-mon[30947]: pgmap v724: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.20k op/s 2024-09-12T00:11:31.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:31 smithi134 ceph-mon[34893]: pgmap v724: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.20k op/s 2024-09-12T00:11:31.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:31 smithi039 ceph-mon[34543]: pgmap v724: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.20k op/s 2024-09-12T00:11:32.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:32 smithi134 ceph-mon[34893]: pgmap v725: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 3.53k op/s 2024-09-12T00:11:32.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:32 smithi039 ceph-mon[34543]: pgmap v725: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 3.53k op/s 2024-09-12T00:11:32.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:32 smithi006 ceph-mon[30947]: pgmap v725: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 3.53k op/s 2024-09-12T00:11:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.763+0000 7fae45ffb640 1 -- 172.21.15.6:0/275646070 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557500922820 con 0x557500a6f700 2024-09-12T00:11:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.763+0000 7fae45ffb640 10 client.25837 handle_command_reply: tid=0 2024-09-12T00:11:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.764+0000 7fae67dba740 1 client.25837 shutdown 2024-09-12T00:11:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.766+0000 7fae67dba740 1 -- 172.21.15.6:0/275646070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557500a13ea0 msgr2=0x557500a6afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.766+0000 7fae67dba740 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557500a13ea0 0x557500a6afb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x5575009f3450 tx=0x7fae580b8fe0 comp rx=0 tx=0).stop 2024-09-12T00:11:32.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.769+0000 7fae67dba740 1 -- 172.21.15.6:0/275646070 shutdown_connections 2024-09-12T00:11:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.769+0000 7fae67dba740 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557500a6b4f0 0x557500a6d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.769+0000 7fae67dba740 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x557500a6f700 0x557500a71b20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.769+0000 7fae67dba740 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557500a13ea0 0x557500a6afb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.769+0000 7fae67dba740 1 --2- 172.21.15.6:0/275646070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557500a13520 0x557500a13960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.769+0000 7fae67dba740 1 -- 172.21.15.6:0/275646070 >> 172.21.15.6:0/275646070 conn(0x5575009e91e0 msgr2=0x557500a06460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.769+0000 7fae45ffb640 0 client.25837 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:11:32.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.773+0000 7fae67dba740 1 -- 172.21.15.6:0/275646070 shutdown_connections 2024-09-12T00:11:32.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.773+0000 7fae67dba740 1 -- 172.21.15.6:0/275646070 wait complete. 2024-09-12T00:11:32.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.773+0000 7fae67dba740 20 client.25837 trim_cache size 0 max 16384 2024-09-12T00:11:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:11:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:11:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:11:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:11:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.777+0000 7fae5f59e640 1 -- 172.21.15.6:0/1164275364 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fae480a2da0 msgr2=0x7fae480a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.777+0000 7fae5f59e640 1 --2- 172.21.15.6:0/1164275364 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fae480a2da0 0x7fae480a5260 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x5575009f73f0 tx=0x7fae54006cb0 comp rx=0 tx=0).stop 2024-09-12T00:11:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.777+0000 7fae5f59e640 1 -- 172.21.15.6:0/1164275364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae6010b4e0 msgr2=0x7fae601a6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.777+0000 7fae5f59e640 1 --2- 172.21.15.6:0/1164275364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae6010b4e0 0x7fae601a6ee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fae58009bf0 tx=0x7fae58030b90 comp rx=0 tx=0).stop 2024-09-12T00:11:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.777+0000 7fae5f59e640 1 -- 172.21.15.6:0/1164275364 shutdown_connections 2024-09-12T00:11:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.777+0000 7fae5f59e640 1 --2- 172.21.15.6:0/1164275364 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fae480a2da0 0x7fae480a5260 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.777+0000 7fae5f59e640 1 --2- 172.21.15.6:0/1164275364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae6010de90 0x7fae601adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.777+0000 7fae5f59e640 1 --2- 172.21.15.6:0/1164275364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae6010b4e0 0x7fae601a6ee0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.778+0000 7fae5f59e640 1 --2- 172.21.15.6:0/1164275364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae60072d80 0x7fae601a69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.778+0000 7fae5f59e640 1 -- 172.21.15.6:0/1164275364 >> 172.21.15.6:0/1164275364 conn(0x7fae6006eb10 msgr2=0x7fae6010c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.780+0000 7fae5f59e640 1 -- 172.21.15.6:0/1164275364 shutdown_connections 2024-09-12T00:11:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:32.780+0000 7fae5f59e640 1 -- 172.21.15.6:0/1164275364 wait complete. 2024-09-12T00:11:34.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:34 smithi039 ceph-mon[34543]: pgmap v726: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.28k op/s 2024-09-12T00:11:34.629 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:34 smithi006 ceph-mon[30947]: pgmap v726: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.28k op/s 2024-09-12T00:11:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:34 smithi134 ceph-mon[34893]: pgmap v726: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.28k op/s 2024-09-12T00:11:36.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:36 smithi006 ceph-mon[30947]: pgmap v727: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 3.99k op/s 2024-09-12T00:11:36.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:36 smithi134 ceph-mon[34893]: pgmap v727: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 3.99k op/s 2024-09-12T00:11:36.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:36 smithi039 ceph-mon[34543]: pgmap v727: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 3.99k op/s 2024-09-12T00:11:38.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:38 smithi006 ceph-mon[30947]: pgmap v728: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 4.16k op/s 2024-09-12T00:11:38.704 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:38 smithi134 ceph-mon[34893]: pgmap v728: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 4.16k op/s 2024-09-12T00:11:38.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:38 smithi039 ceph-mon[34543]: pgmap v728: 129 pgs: 129 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 4.16k op/s 2024-09-12T00:11:40.622 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:40 smithi006 ceph-mon[30947]: pgmap v729: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 4.17k op/s 2024-09-12T00:11:40.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:40 smithi134 ceph-mon[34893]: pgmap v729: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 4.17k op/s 2024-09-12T00:11:40.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:40 smithi039 ceph-mon[34543]: pgmap v729: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 4.17k op/s 2024-09-12T00:11:42.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:42 smithi006 ceph-mon[30947]: pgmap v730: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 3.60k op/s 2024-09-12T00:11:42.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:42 smithi134 ceph-mon[34893]: pgmap v730: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 3.60k op/s 2024-09-12T00:11:42.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:42 smithi039 ceph-mon[34543]: pgmap v730: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 3.60k op/s 2024-09-12T00:11:44.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:44 smithi006 ceph-mon[30947]: pgmap v731: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-09-12T00:11:44.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:44 smithi134 ceph-mon[34893]: pgmap v731: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-09-12T00:11:44.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:44 smithi039 ceph-mon[34543]: pgmap v731: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-09-12T00:11:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.190+0000 7fde4a178640 1 -- 172.21.15.6:0/3203170944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde44109700 msgr2=0x7fde44109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.190+0000 7fde4a178640 1 --2- 172.21.15.6:0/3203170944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde44109700 0x7fde44109b00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fde3c01acb0 tx=0x7fde3c03b920 comp rx=0 tx=0).stop 2024-09-12T00:11:46.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.197+0000 7fde4a178640 1 -- 172.21.15.6:0/3203170944 shutdown_connections 2024-09-12T00:11:46.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.197+0000 7fde4a178640 1 --2- 172.21.15.6:0/3203170944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde440736b0 0x7fde44119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.197+0000 7fde4a178640 1 --2- 172.21.15.6:0/3203170944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde44072d10 0x7fde44073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.197+0000 7fde4a178640 1 --2- 172.21.15.6:0/3203170944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde44109700 0x7fde44109b00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.197+0000 7fde4a178640 1 -- 172.21.15.6:0/3203170944 >> 172.21.15.6:0/3203170944 conn(0x7fde4406ecd0 msgr2=0x7fde44071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.213+0000 7fde4a178640 1 -- 172.21.15.6:0/3203170944 shutdown_connections 2024-09-12T00:11:46.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.216+0000 7fde4a178640 1 -- 172.21.15.6:0/3203170944 wait complete. 2024-09-12T00:11:46.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.216+0000 7fde4a178640 1 Processor -- start 2024-09-12T00:11:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.217+0000 7fde4a178640 1 -- start start 2024-09-12T00:11:46.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.222+0000 7fde4a178640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde44072d10 0x7fde4419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.222+0000 7fde4a178640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde440736b0 0x7fde4419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.222+0000 7fde4a178640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde44109700 0x7fde441a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.222+0000 7fde4a178640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fde44113530 con 0x7fde44109700 2024-09-12T00:11:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.222+0000 7fde4a178640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fde441133b0 con 0x7fde440736b0 2024-09-12T00:11:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.222+0000 7fde4a178640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fde441136b0 con 0x7fde44072d10 2024-09-12T00:11:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.223+0000 7fde437fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde44072d10 0x7fde4419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.224+0000 7fde437fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde44072d10 0x7fde4419e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:34632/0 (socket says 172.21.15.6:34632) 2024-09-12T00:11:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.224+0000 7fde437fe640 1 -- 172.21.15.6:0/3502192600 learned_addr learned my addr 172.21.15.6:0/3502192600 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.227+0000 7fde437fe640 1 -- 172.21.15.6:0/3502192600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde440736b0 msgr2=0x7fde4419ee30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T00:11:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.227+0000 7fde437fe640 1 --2- 172.21.15.6:0/3502192600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde440736b0 0x7fde4419ee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.227+0000 7fde437fe640 1 -- 172.21.15.6:0/3502192600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde44109700 msgr2=0x7fde441a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.227+0000 7fde437fe640 1 --2- 172.21.15.6:0/3502192600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde44109700 0x7fde441a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.227+0000 7fde437fe640 1 -- 172.21.15.6:0/3502192600 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde441a60d0 con 0x7fde44072d10 2024-09-12T00:11:46.231 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.232+0000 7fde437fe640 1 --2- 172.21.15.6:0/3502192600 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde44072d10 0x7fde4419e8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fde3c03bf10 tx=0x7fde3c003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.236+0000 7fde40ff9640 1 -- 172.21.15.6:0/3502192600 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c045070 con 0x7fde44072d10 2024-09-12T00:11:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.236+0000 7fde4a178640 1 -- 172.21.15.6:0/3502192600 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde441a6360 con 0x7fde44072d10 2024-09-12T00:11:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.236+0000 7fde4a178640 1 -- 172.21.15.6:0/3502192600 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde441a68d0 con 0x7fde44072d10 2024-09-12T00:11:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.236+0000 7fde40ff9640 1 -- 172.21.15.6:0/3502192600 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fde3c003dd0 con 0x7fde44072d10 2024-09-12T00:11:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.236+0000 7fde40ff9640 1 -- 172.21.15.6:0/3502192600 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c004830 con 0x7fde44072d10 2024-09-12T00:11:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.239+0000 7fde4cfef740 1 Processor -- start 2024-09-12T00:11:46.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.247+0000 7fde40ff9640 1 -- 172.21.15.6:0/3502192600 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fde3c048020 con 0x7fde44072d10 2024-09-12T00:11:46.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.248+0000 7fde40ff9640 1 --2- 172.21.15.6:0/3502192600 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fde2c0a2d90 0x7fde2c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.248+0000 7fde40ff9640 1 -- 172.21.15.6:0/3502192600 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fde3c1023e0 con 0x7fde44072d10 2024-09-12T00:11:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.250+0000 7fde4cfef740 1 -- start start 2024-09-12T00:11:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.251+0000 7fde4cfef740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c3bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.251+0000 7fde4cfef740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c40da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.251+0000 7fde4cfef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c43830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.251+0000 7fde4cfef740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fdb6b9f2f0 con 0x55fdb6c3c2e0 2024-09-12T00:11:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.251+0000 7fde4cfef740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55fdb6b47270 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.251+0000 7fde4cfef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fdb6b9b2b0 con 0x55fdb6c41370 2024-09-12T00:11:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.252+0000 7fde437fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c3bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.252+0000 7fde437fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c3bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:51996/0 (socket says 172.21.15.6:51996) 2024-09-12T00:11:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.252+0000 7fde437fe640 1 -- 172.21.15.6:0/3048857540 learned_addr learned my addr 172.21.15.6:0/3048857540 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.254+0000 7fde43fff640 1 --2- 172.21.15.6:0/3502192600 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fde2c0a2d90 0x7fde2c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.256+0000 7fde43fff640 1 --2- 172.21.15.6:0/3048857540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c43830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.257+0000 7fde437fe640 1 -- 172.21.15.6:0/3048857540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 msgr2=0x55fdb6c43830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.257+0000 7fde437fe640 1 --2- 172.21.15.6:0/3048857540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c43830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.257+0000 7fde437fe640 1 -- 172.21.15.6:0/3048857540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3c2e0 msgr2=0x55fdb6c40da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.257+0000 7fde437fe640 1 --2- 172.21.15.6:0/3048857540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c40da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.257+0000 7fde437fe640 1 -- 172.21.15.6:0/3048857540 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb6b46340 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.257+0000 7fde43fff640 1 --2- 172.21.15.6:0/3502192600 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fde2c0a2d90 0x7fde2c0a5250 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fde380143a0 tx=0x7fde38009670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.258+0000 7fde437fe640 1 --2- 172.21.15.6:0/3048857540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c3bda0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde3c006010 tx=0x7fde3c0ce210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77639f63fd5e019d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.259+0000 7fde29ffb640 1 -- 172.21.15.6:0/3048857540 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0ce7f0 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.259+0000 7fde29ffb640 1 -- 172.21.15.6:0/3048857540 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fde3c0d2ba0 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.260+0000 7fde4cfef740 1 -- 172.21.15.6:0/3048857540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 msgr2=0x55fdb6c3bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.260+0000 7fde4cfef740 1 --2- 172.21.15.6:0/3048857540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c3bda0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde3c006010 tx=0x7fde3c0ce210 comp rx=0 tx=0).stop 2024-09-12T00:11:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.266+0000 7fde4cfef740 1 -- 172.21.15.6:0/3048857540 shutdown_connections 2024-09-12T00:11:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.266+0000 7fde4cfef740 1 --2- 172.21.15.6:0/3048857540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c43830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.266+0000 7fde4cfef740 1 --2- 172.21.15.6:0/3048857540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c40da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.266+0000 7fde4cfef740 1 --2- 172.21.15.6:0/3048857540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c3bda0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.266+0000 7fde4cfef740 1 -- 172.21.15.6:0/3048857540 >> 172.21.15.6:0/3048857540 conn(0x55fdb6c37010 msgr2=0x55fdb6c37410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.266+0000 7fde4cfef740 1 -- 172.21.15.6:0/3048857540 shutdown_connections 2024-09-12T00:11:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.267+0000 7fde4cfef740 1 -- 172.21.15.6:0/3048857540 wait complete. 2024-09-12T00:11:46.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.268+0000 7fde4cfef740 1 -- start start 2024-09-12T00:11:46.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.268+0000 7fde4cfef740 1 Processor -- start 2024-09-12T00:11:46.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.269+0000 7fde4cfef740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c45880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.269+0000 7fde4cfef740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c45dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.269+0000 7fde4cfef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c4ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.269+0000 7fde4cfef740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fdb6c44100 con 0x55fdb6c3c2e0 2024-09-12T00:11:46.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.269+0000 7fde4cfef740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55fdb6b28290 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.270+0000 7fde4cfef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fdb6c44280 con 0x55fdb6c41370 2024-09-12T00:11:46.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.270+0000 7fde4cfef740 10 client.0 _ll_register_callbacks cb 0x55fdb6b59140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:11:46.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.270+0000 7fde42ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c45dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.270+0000 7fde42ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c45dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43104/0 (socket says 172.21.15.6:43104) 2024-09-12T00:11:46.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.270+0000 7fde42ffd640 1 -- 172.21.15.6:0/1704272719 learned_addr learned my addr 172.21.15.6:0/1704272719 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:46.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.271+0000 7fde43fff640 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c4ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.271+0000 7fde437fe640 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c45880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.271+0000 7fde42ffd640 1 -- 172.21.15.6:0/1704272719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 msgr2=0x55fdb6c4ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:46.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.271+0000 7fde42ffd640 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c4ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.271+0000 7fde42ffd640 1 -- 172.21.15.6:0/1704272719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 msgr2=0x55fdb6c45880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:46.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.271+0000 7fde42ffd640 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c45880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.272 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.271+0000 7fde42ffd640 1 -- 172.21.15.6:0/1704272719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb68b2210 con 0x55fdb6c3c2e0 2024-09-12T00:11:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.274+0000 7fde42ffd640 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c45dc0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fde34009d80 tx=0x7fde3400b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237b1387bc92a35c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.274+0000 7fde22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:11:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.275+0000 7fde22ffd640 1 -- 172.21.15.6:0/1704272719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde34011420 con 0x55fdb6c3c2e0 2024-09-12T00:11:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.275+0000 7fde22ffd640 1 -- 172.21.15.6:0/1704272719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fde340115c0 con 0x55fdb6c3c2e0 2024-09-12T00:11:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.275+0000 7fde4cfef740 1 -- 172.21.15.6:0/1704272719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde3c0d2ba0 con 0x55fdb6c3c2e0 2024-09-12T00:11:46.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.282+0000 7fde22ffd640 1 -- 172.21.15.6:0/1704272719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fde340117c0 con 0x55fdb6c3c2e0 2024-09-12T00:11:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.283+0000 7fde4cfef740 10 client.16236 fetch_fsmap learned FSMap version 33 2024-09-12T00:11:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.283+0000 7fde4cfef740 1 -- 172.21.15.6:0/1704272719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fdb697e620 con 0x55fdb6c3c2e0 2024-09-12T00:11:46.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.284+0000 7fde22ffd640 1 -- 172.21.15.6:0/1704272719 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fde34016070 con 0x55fdb6c3c2e0 2024-09-12T00:11:46.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.284+0000 7fde22ffd640 1 -- 172.21.15.6:0/1704272719 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fde3401bcc0 con 0x55fdb6c3c2e0 2024-09-12T00:11:46.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.285+0000 7fde4cfef740 10 client.16236 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:11:46.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.285+0000 7fde4cfef740 10 client.16236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:11:46.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.285+0000 7fde4cfef740 20 client.16236 populate_metadata read hostname 'smithi006' 2024-09-12T00:11:46.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.285+0000 7fde4cfef740 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fdb6c515c0 0x55fdb6c539b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.285+0000 7fde4cfef740 4 client.16236 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:11:46.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.285+0000 7fde4cfef740 1 -- 172.21.15.6:0/1704272719 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fde3c0d2ba0 con 0x55fdb6c515c0 2024-09-12T00:11:46.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.285+0000 7fde437fe640 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fdb6c515c0 0x55fdb6c539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.292+0000 7fde437fe640 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fdb6c515c0 0x55fdb6c539b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df06850f4dfcda3d server_cookie=e42b49ab9b39ca41 in_seq=0 out_seq=0 2024-09-12T00:11:46.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.292+0000 7fde22ffd640 10 client.16236 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:11:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.296+0000 7fde22ffd640 1 -- 172.21.15.6:0/1704272719 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fde3c0d2ba0 con 0x55fdb6c515c0 2024-09-12T00:11:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.296+0000 7fde22ffd640 10 client.16236 handle_command_reply: tid=0 2024-09-12T00:11:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.296+0000 7fde4cfef740 1 client.16236 shutdown 2024-09-12T00:11:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.300+0000 7fde4cfef740 1 -- 172.21.15.6:0/1704272719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3c2e0 msgr2=0x55fdb6c45dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.300+0000 7fde4cfef740 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c45dc0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fde34009d80 tx=0x7fde3400b4b0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.301+0000 7fde4cfef740 1 -- 172.21.15.6:0/1704272719 shutdown_connections 2024-09-12T00:11:46.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.301+0000 7fde4cfef740 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fdb6c515c0 0x55fdb6c539b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.303+0000 7fde22ffd640 0 client.16236 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:11:46.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.303+0000 7fde4cfef740 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c4ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.303+0000 7fde4cfef740 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c45dc0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.303+0000 7fde4cfef740 1 --2- 172.21.15.6:0/1704272719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c45880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.303+0000 7fde4cfef740 1 -- 172.21.15.6:0/1704272719 >> 172.21.15.6:0/1704272719 conn(0x55fdb6c37010 msgr2=0x55fdb6c38820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.303+0000 7fde4cfef740 1 -- 172.21.15.6:0/1704272719 shutdown_connections 2024-09-12T00:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.303+0000 7fde4cfef740 1 -- 172.21.15.6:0/1704272719 wait complete. 2024-09-12T00:11:46.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.304+0000 7fde4cfef740 20 client.16236 trim_cache size 0 max 16384 2024-09-12T00:11:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.360+0000 7fde4cfef740 1 Processor -- start 2024-09-12T00:11:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.360+0000 7fde4cfef740 1 -- start start 2024-09-12T00:11:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.360+0000 7fde4cfef740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c3bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.360+0000 7fde4cfef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c4cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.360+0000 7fde4cfef740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c41370 0x55fdb6c360b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.360+0000 7fde4cfef740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fde3000feb0 con 0x55fdb6c41370 2024-09-12T00:11:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.360+0000 7fde437fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c3bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.360+0000 7fde437fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c3bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:52014/0 (socket says 172.21.15.6:52014) 2024-09-12T00:11:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.360+0000 7fde437fe640 1 -- 172.21.15.6:0/3085911854 learned_addr learned my addr 172.21.15.6:0/3085911854 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.360+0000 7fde42ffd640 1 --2- 172.21.15.6:0/3085911854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c4cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.360+0000 7fde43fff640 1 --2- 172.21.15.6:0/3085911854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c41370 0x55fdb6c360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.360+0000 7fde4cfef740 1 -- 172.21.15.6:0/3085911854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fde300119f0 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.361+0000 7fde4cfef740 1 -- 172.21.15.6:0/3085911854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fde30010580 con 0x55fdb6c3c2e0 2024-09-12T00:11:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.361+0000 7fde43fff640 1 -- 172.21.15.6:0/3085911854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c3c2e0 msgr2=0x55fdb6c4cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.361+0000 7fde43fff640 1 --2- 172.21.15.6:0/3085911854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c4cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.361+0000 7fde43fff640 1 -- 172.21.15.6:0/3085911854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 msgr2=0x55fdb6c3bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.361+0000 7fde43fff640 1 --2- 172.21.15.6:0/3085911854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c3bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.361+0000 7fde43fff640 1 -- 172.21.15.6:0/3085911854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb6c453c0 con 0x55fdb6c41370 2024-09-12T00:11:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.361+0000 7fde43fff640 1 --2- 172.21.15.6:0/3085911854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c41370 0x55fdb6c360b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fde38014c30 tx=0x7fde3801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6271f1bdc3a58680 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.361+0000 7fde297fa640 1 -- 172.21.15.6:0/3085911854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3802a070 con 0x55fdb6c41370 2024-09-12T00:11:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.361+0000 7fde297fa640 1 -- 172.21.15.6:0/3085911854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fde38017e20 con 0x55fdb6c41370 2024-09-12T00:11:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.361+0000 7fde297fa640 1 -- 172.21.15.6:0/3085911854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3800f070 con 0x55fdb6c41370 2024-09-12T00:11:46.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.362+0000 7fde4cfef740 1 -- 172.21.15.6:0/3085911854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c41370 msgr2=0x55fdb6c360b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:11:46.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.362+0000 7fde4cfef740 1 --2- 172.21.15.6:0/3085911854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c41370 0x55fdb6c360b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fde38014c30 tx=0x7fde3801b000 comp rx=0 tx=0).stop 2024-09-12T00:11:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.362+0000 7fde4cfef740 1 -- 172.21.15.6:0/3085911854 shutdown_connections 2024-09-12T00:11:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.362+0000 7fde4cfef740 1 --2- 172.21.15.6:0/3085911854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c41370 0x55fdb6c360b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.362+0000 7fde4cfef740 1 --2- 172.21.15.6:0/3085911854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c4cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.362+0000 7fde4cfef740 1 --2- 172.21.15.6:0/3085911854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c3bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.362+0000 7fde4cfef740 1 -- 172.21.15.6:0/3085911854 >> 172.21.15.6:0/3085911854 conn(0x55fdb6c37010 msgr2=0x55fdb6c359a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:11:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.362+0000 7fde4cfef740 1 -- 172.21.15.6:0/3085911854 shutdown_connections 2024-09-12T00:11:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.362+0000 7fde4cfef740 1 -- 172.21.15.6:0/3085911854 wait complete. 2024-09-12T00:11:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.362+0000 7fde4cfef740 1 -- start start 2024-09-12T00:11:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde4cfef740 1 Processor -- start 2024-09-12T00:11:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde4cfef740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c4aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde4cfef740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c4b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde4cfef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c4c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c4aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde4cfef740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fde30011320 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde4cfef740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fde30010c50 con 0x55fdb6c3c2e0 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde4cfef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fde3000de90 con 0x55fdb6c41370 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c4aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43122/0 (socket says 172.21.15.6:43122) 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde437fe640 1 -- 172.21.15.6:0/2996778625 learned_addr learned my addr 172.21.15.6:0/2996778625 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde4cfef740 10 client.0 _ll_register_callbacks cb 0x7fde34006e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde42ffd640 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c4b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.363+0000 7fde43fff640 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c4c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde437fe640 1 -- 172.21.15.6:0/2996778625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 msgr2=0x55fdb6c4c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde437fe640 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c4c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde437fe640 1 -- 172.21.15.6:0/2996778625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3c2e0 msgr2=0x55fdb6c4b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:11:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde437fe640 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c4b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:11:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde437fe640 1 -- 172.21.15.6:0/2996778625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb6c4c700 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde43fff640 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c4c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:11:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde437fe640 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c4aba0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0049d0 tx=0x7fde3c03b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e19320117df9976 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:11:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-12T00:11:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde22ffd640 1 -- 172.21.15.6:0/2996778625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0ed070 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde22ffd640 1 -- 172.21.15.6:0/2996778625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fde3c0d6fd0 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde4cfef740 1 -- 172.21.15.6:0/2996778625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde38017e20 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde22ffd640 1 -- 172.21.15.6:0/2996778625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fde3c0ed210 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde4cfef740 10 client.16242 fetch_fsmap learned FSMap version 33 2024-09-12T00:11:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde4cfef740 1 -- 172.21.15.6:0/2996778625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fdb6cbc9d0 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.364+0000 7fde22ffd640 1 -- 172.21.15.6:0/2996778625 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fde38017e20 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.365+0000 7fde22ffd640 1 -- 172.21.15.6:0/2996778625 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fde3c0cfb20 con 0x55fdb6c3b9a0 2024-09-12T00:11:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.365+0000 7fde4cfef740 10 client.16242 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:11:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.365+0000 7fde4cfef740 10 client.16242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T00:11:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.365+0000 7fde4cfef740 20 client.16242 populate_metadata read hostname 'smithi006' 2024-09-12T00:11:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.365+0000 7fde4cfef740 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fdb6c515c0 0x55fdb6cbf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:11:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.365+0000 7fde4cfef740 4 client.16242 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T00:11:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.365+0000 7fde4cfef740 1 -- 172.21.15.6:0/2996778625 --> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fdb6c41130 con 0x55fdb6c515c0 2024-09-12T00:11:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.365+0000 7fde42ffd640 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fdb6c515c0 0x55fdb6cbf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:11:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.365+0000 7fde42ffd640 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fdb6c515c0 0x55fdb6cbf090 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c08305f3b1eea8d8 server_cookie=b8234449c6266576 in_seq=0 out_seq=0 2024-09-12T00:11:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:11:46.365+0000 7fde22ffd640 10 client.16242 ms_handle_connect on v2:172.21.15.39:6838/3561706320 2024-09-12T00:11:46.620 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:46 smithi006 ceph-mon[30947]: pgmap v732: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 4.08k op/s 2024-09-12T00:11:46.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:46 smithi134 ceph-mon[34893]: pgmap v732: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 4.08k op/s 2024-09-12T00:11:46.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:46 smithi039 ceph-mon[34543]: pgmap v732: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 4.08k op/s 2024-09-12T00:11:48.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:48 smithi006 ceph-mon[30947]: pgmap v733: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 16 MiB/s wr, 4.13k op/s 2024-09-12T00:11:48.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:48 smithi134 ceph-mon[34893]: pgmap v733: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 16 MiB/s wr, 4.13k op/s 2024-09-12T00:11:48.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:48 smithi039 ceph-mon[34543]: pgmap v733: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 16 MiB/s wr, 4.13k op/s 2024-09-12T00:11:50.595 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:50 smithi039 ceph-mon[34543]: pgmap v734: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-12T00:11:50.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:50 smithi006 ceph-mon[30947]: pgmap v734: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-12T00:11:50.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:50 smithi134 ceph-mon[34893]: pgmap v734: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-12T00:11:52.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:52 smithi006 ceph-mon[30947]: pgmap v735: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-09-12T00:11:52.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:52 smithi134 ceph-mon[34893]: pgmap v735: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-09-12T00:11:52.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:52 smithi039 ceph-mon[34543]: pgmap v735: 129 pgs: 129 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-09-12T00:11:54.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:54 smithi134 ceph-mon[34893]: pgmap v736: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-09-12T00:11:54.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:54 smithi039 ceph-mon[34543]: pgmap v736: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-09-12T00:11:54.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:54 smithi006 ceph-mon[30947]: pgmap v736: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-09-12T00:11:56.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:56 smithi134 ceph-mon[34893]: pgmap v737: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2024-09-12T00:11:56.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:56 smithi039 ceph-mon[34543]: pgmap v737: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2024-09-12T00:11:56.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:56 smithi006 ceph-mon[30947]: pgmap v737: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2024-09-12T00:11:58.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:11:58 smithi134 ceph-mon[34893]: pgmap v738: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 4.06k op/s 2024-09-12T00:11:58.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:11:58 smithi039 ceph-mon[34543]: pgmap v738: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 4.06k op/s 2024-09-12T00:11:58.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:11:58 smithi006 ceph-mon[30947]: pgmap v738: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 4.06k op/s 2024-09-12T00:12:00.673 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:00 smithi006 ceph-mon[30947]: pgmap v739: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2024-09-12T00:12:00.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:00 smithi134 ceph-mon[34893]: pgmap v739: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2024-09-12T00:12:00.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:00 smithi039 ceph-mon[34543]: pgmap v739: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2024-09-12T00:12:02.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:02 smithi134 ceph-mon[34893]: pgmap v740: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 14 MiB/s wr, 3.54k op/s 2024-09-12T00:12:02.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:02 smithi039 ceph-mon[34543]: pgmap v740: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 14 MiB/s wr, 3.54k op/s 2024-09-12T00:12:02.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:02 smithi006 ceph-mon[30947]: pgmap v740: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 14 MiB/s wr, 3.54k op/s 2024-09-12T00:12:04.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:04 smithi134 ceph-mon[34893]: pgmap v741: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-09-12T00:12:04.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:04 smithi039 ceph-mon[34543]: pgmap v741: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-09-12T00:12:04.871 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:04 smithi006 ceph-mon[30947]: pgmap v741: 129 pgs: 129 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-09-12T00:12:06.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:06 smithi134 ceph-mon[34893]: pgmap v742: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-09-12T00:12:06.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:06 smithi039 ceph-mon[34543]: pgmap v742: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-09-12T00:12:06.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:06 smithi006 ceph-mon[30947]: pgmap v742: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-09-12T00:12:08.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:08 smithi134 ceph-mon[34893]: pgmap v743: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 16 MiB/s wr, 4.01k op/s 2024-09-12T00:12:08.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:08 smithi039 ceph-mon[34543]: pgmap v743: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 16 MiB/s wr, 4.01k op/s 2024-09-12T00:12:08.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:08 smithi006 ceph-mon[30947]: pgmap v743: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 16 MiB/s wr, 4.01k op/s 2024-09-12T00:12:10.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:10 smithi134 ceph-mon[34893]: pgmap v744: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 17 MiB/s wr, 4.21k op/s 2024-09-12T00:12:10.796 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:10 smithi039 ceph-mon[34543]: pgmap v744: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 17 MiB/s wr, 4.21k op/s 2024-09-12T00:12:10.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:10 smithi006 ceph-mon[30947]: pgmap v744: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 17 MiB/s wr, 4.21k op/s 2024-09-12T00:12:12.702 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:12 smithi134 ceph-mon[34893]: pgmap v745: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 3.25k op/s 2024-09-12T00:12:12.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:12 smithi039 ceph-mon[34543]: pgmap v745: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 3.25k op/s 2024-09-12T00:12:12.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:12 smithi006 ceph-mon[30947]: pgmap v745: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 3.25k op/s 2024-09-12T00:12:14.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:14 smithi134 ceph-mon[34893]: pgmap v746: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.21k op/s 2024-09-12T00:12:14.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:14 smithi039 ceph-mon[34543]: pgmap v746: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.21k op/s 2024-09-12T00:12:14.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:14 smithi006 ceph-mon[30947]: pgmap v746: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.21k op/s 2024-09-12T00:12:16.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:16 smithi039 ceph-mon[34543]: pgmap v747: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 3.65k op/s 2024-09-12T00:12:16.871 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:16 smithi006 ceph-mon[30947]: pgmap v747: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 3.65k op/s 2024-09-12T00:12:16.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:16 smithi134 ceph-mon[34893]: pgmap v747: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 3.65k op/s 2024-09-12T00:12:18.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:18 smithi039 ceph-mon[34543]: pgmap v748: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 3.83k op/s 2024-09-12T00:12:18.872 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:18 smithi006 ceph-mon[30947]: pgmap v748: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 3.83k op/s 2024-09-12T00:12:18.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:18 smithi134 ceph-mon[34893]: pgmap v748: 129 pgs: 129 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 3.83k op/s 2024-09-12T00:12:20.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:20 smithi039 ceph-mon[34543]: pgmap v749: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2024-09-12T00:12:20.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:20 smithi006 ceph-mon[30947]: pgmap v749: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2024-09-12T00:12:20.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:20 smithi134 ceph-mon[34893]: pgmap v749: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2024-09-12T00:12:22.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:22 smithi039 ceph-mon[34543]: pgmap v750: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 3.17k op/s 2024-09-12T00:12:22.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:22 smithi006 ceph-mon[30947]: pgmap v750: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 3.17k op/s 2024-09-12T00:12:22.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:22 smithi134 ceph-mon[34893]: pgmap v750: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 3.17k op/s 2024-09-12T00:12:24.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:24 smithi039 ceph-mon[34543]: pgmap v751: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2024-09-12T00:12:24.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:24 smithi006 ceph-mon[30947]: pgmap v751: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2024-09-12T00:12:24.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:24 smithi134 ceph-mon[34893]: pgmap v751: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2024-09-12T00:12:26.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:26 smithi039 ceph-mon[34543]: pgmap v752: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 3.73k op/s 2024-09-12T00:12:26.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:26 smithi006 ceph-mon[30947]: pgmap v752: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 3.73k op/s 2024-09-12T00:12:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:26 smithi134 ceph-mon[34893]: pgmap v752: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 3.73k op/s 2024-09-12T00:12:27.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:27 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:12:27.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:27 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:12:27.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:27 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:12:28.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:28 smithi039 ceph-mon[34543]: pgmap v753: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 3.65k op/s 2024-09-12T00:12:28.871 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:28 smithi006 ceph-mon[30947]: pgmap v753: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 3.65k op/s 2024-09-12T00:12:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:28 smithi134 ceph-mon[34893]: pgmap v753: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 3.65k op/s 2024-09-12T00:12:30.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:30 smithi039 ceph-mon[34543]: pgmap v754: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.25k op/s 2024-09-12T00:12:30.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:30 smithi006 ceph-mon[30947]: pgmap v754: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.25k op/s 2024-09-12T00:12:30.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:30 smithi134 ceph-mon[34893]: pgmap v754: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.25k op/s 2024-09-12T00:12:32.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:32 smithi039 ceph-mon[34543]: pgmap v755: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 3.28k op/s 2024-09-12T00:12:32.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:32 smithi006 ceph-mon[30947]: pgmap v755: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 3.28k op/s 2024-09-12T00:12:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:32 smithi134 ceph-mon[34893]: pgmap v755: 129 pgs: 129 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 3.28k op/s 2024-09-12T00:12:33.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:33 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:12:33.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:33 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:12:33.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:33 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:12:33.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:33 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:12:33.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:33 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:12:33.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:33 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:12:33.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:33 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:12:33.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:33 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:12:33.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:33 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:12:35.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:34 smithi039 ceph-mon[34543]: pgmap v756: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2024-09-12T00:12:35.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:34 smithi006 ceph-mon[30947]: pgmap v756: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2024-09-12T00:12:35.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:34 smithi134 ceph-mon[34893]: pgmap v756: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2024-09-12T00:12:37.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:36 smithi039 ceph-mon[34543]: pgmap v757: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.65k op/s 2024-09-12T00:12:37.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:36 smithi006 ceph-mon[30947]: pgmap v757: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.65k op/s 2024-09-12T00:12:37.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:36 smithi134 ceph-mon[34893]: pgmap v757: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.65k op/s 2024-09-12T00:12:39.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:39 smithi039 ceph-mon[34543]: pgmap v758: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 3.60k op/s 2024-09-12T00:12:39.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:39 smithi006 ceph-mon[30947]: pgmap v758: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 3.60k op/s 2024-09-12T00:12:39.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:39 smithi134 ceph-mon[34893]: pgmap v758: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 3.60k op/s 2024-09-12T00:12:41.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:41 smithi039 ceph-mon[34543]: pgmap v759: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.35k op/s 2024-09-12T00:12:41.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:41 smithi006 ceph-mon[30947]: pgmap v759: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.35k op/s 2024-09-12T00:12:41.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:41 smithi134 ceph-mon[34893]: pgmap v759: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.35k op/s 2024-09-12T00:12:43.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:43 smithi039 ceph-mon[34543]: pgmap v760: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-09-12T00:12:43.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:43 smithi006 ceph-mon[30947]: pgmap v760: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-09-12T00:12:43.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:43 smithi134 ceph-mon[34893]: pgmap v760: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-09-12T00:12:45.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:45 smithi039 ceph-mon[34543]: pgmap v761: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 3.98k op/s 2024-09-12T00:12:45.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:45 smithi006 ceph-mon[30947]: pgmap v761: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 3.98k op/s 2024-09-12T00:12:45.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:45 smithi134 ceph-mon[34893]: pgmap v761: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 3.98k op/s 2024-09-12T00:12:47.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:47 smithi039 ceph-mon[34543]: pgmap v762: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.61k op/s 2024-09-12T00:12:47.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:47 smithi006 ceph-mon[30947]: pgmap v762: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.61k op/s 2024-09-12T00:12:47.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:47 smithi134 ceph-mon[34893]: pgmap v762: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.61k op/s 2024-09-12T00:12:49.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:49 smithi006 ceph-mon[30947]: pgmap v763: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 3.27k op/s 2024-09-12T00:12:49.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:49 smithi134 ceph-mon[34893]: pgmap v763: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 3.27k op/s 2024-09-12T00:12:49.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:49 smithi039 ceph-mon[34543]: pgmap v763: 129 pgs: 129 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 3.27k op/s 2024-09-12T00:12:51.345 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:51 smithi039 ceph-mon[34543]: pgmap v764: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 3.85k op/s 2024-09-12T00:12:51.372 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:51 smithi006 ceph-mon[30947]: pgmap v764: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 3.85k op/s 2024-09-12T00:12:51.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:51 smithi134 ceph-mon[34893]: pgmap v764: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 3.85k op/s 2024-09-12T00:12:53.374 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:53 smithi006 ceph-mon[30947]: pgmap v765: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 2.88k op/s 2024-09-12T00:12:53.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:53 smithi134 ceph-mon[34893]: pgmap v765: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 2.88k op/s 2024-09-12T00:12:53.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:53 smithi039 ceph-mon[34543]: pgmap v765: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 2.88k op/s 2024-09-12T00:12:55.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:55 smithi006 ceph-mon[30947]: pgmap v766: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.56k op/s 2024-09-12T00:12:55.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:55 smithi134 ceph-mon[34893]: pgmap v766: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.56k op/s 2024-09-12T00:12:55.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:55 smithi039 ceph-mon[34543]: pgmap v766: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.56k op/s 2024-09-12T00:12:57.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:57 smithi006 ceph-mon[30947]: pgmap v767: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 3.28k op/s 2024-09-12T00:12:57.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:57 smithi134 ceph-mon[34893]: pgmap v767: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 3.28k op/s 2024-09-12T00:12:57.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:57 smithi039 ceph-mon[34543]: pgmap v767: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 3.28k op/s 2024-09-12T00:12:59.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:12:59 smithi006 ceph-mon[30947]: pgmap v768: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 3.19k op/s 2024-09-12T00:12:59.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:12:59 smithi134 ceph-mon[34893]: pgmap v768: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 3.19k op/s 2024-09-12T00:12:59.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:12:59 smithi039 ceph-mon[34543]: pgmap v768: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 3.19k op/s 2024-09-12T00:13:01.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:01 smithi006 ceph-mon[30947]: pgmap v769: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 3.83k op/s 2024-09-12T00:13:01.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:01 smithi134 ceph-mon[34893]: pgmap v769: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 3.83k op/s 2024-09-12T00:13:01.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:01 smithi039 ceph-mon[34543]: pgmap v769: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 3.83k op/s 2024-09-12T00:13:03.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:03 smithi006 ceph-mon[30947]: pgmap v770: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 2.98k op/s 2024-09-12T00:13:03.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:03 smithi134 ceph-mon[34893]: pgmap v770: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 2.98k op/s 2024-09-12T00:13:03.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:03 smithi039 ceph-mon[34543]: pgmap v770: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 2.98k op/s 2024-09-12T00:13:05.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:05 smithi006 ceph-mon[30947]: pgmap v771: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.36k op/s 2024-09-12T00:13:05.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:05 smithi134 ceph-mon[34893]: pgmap v771: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.36k op/s 2024-09-12T00:13:05.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:05 smithi039 ceph-mon[34543]: pgmap v771: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.36k op/s 2024-09-12T00:13:07.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:07 smithi134 ceph-mon[34893]: pgmap v772: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.40k op/s 2024-09-12T00:13:07.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:07 smithi039 ceph-mon[34543]: pgmap v772: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.40k op/s 2024-09-12T00:13:07.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:07 smithi006 ceph-mon[30947]: pgmap v772: 129 pgs: 129 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.40k op/s 2024-09-12T00:13:09.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:09 smithi134 ceph-mon[34893]: pgmap v773: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 3.30k op/s 2024-09-12T00:13:09.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:09 smithi039 ceph-mon[34543]: pgmap v773: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 3.30k op/s 2024-09-12T00:13:09.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:09 smithi006 ceph-mon[30947]: pgmap v773: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 3.30k op/s 2024-09-12T00:13:11.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:11 smithi134 ceph-mon[34893]: pgmap v774: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 3.72k op/s 2024-09-12T00:13:11.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:11 smithi039 ceph-mon[34543]: pgmap v774: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 3.72k op/s 2024-09-12T00:13:11.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:11 smithi006 ceph-mon[30947]: pgmap v774: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 3.72k op/s 2024-09-12T00:13:13.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:13 smithi134 ceph-mon[34893]: pgmap v775: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 2.92k op/s 2024-09-12T00:13:13.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:13 smithi039 ceph-mon[34543]: pgmap v775: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 2.92k op/s 2024-09-12T00:13:13.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:13 smithi006 ceph-mon[30947]: pgmap v775: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 2.92k op/s 2024-09-12T00:13:15.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:15 smithi134 ceph-mon[34893]: pgmap v776: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.31k op/s 2024-09-12T00:13:15.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:15 smithi039 ceph-mon[34543]: pgmap v776: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.31k op/s 2024-09-12T00:13:15.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:15 smithi006 ceph-mon[30947]: pgmap v776: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.31k op/s 2024-09-12T00:13:17.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:17 smithi134 ceph-mon[34893]: pgmap v777: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 3.50k op/s 2024-09-12T00:13:17.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:17 smithi039 ceph-mon[34543]: pgmap v777: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 3.50k op/s 2024-09-12T00:13:17.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:17 smithi006 ceph-mon[30947]: pgmap v777: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 3.50k op/s 2024-09-12T00:13:19.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:19 smithi134 ceph-mon[34893]: pgmap v778: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-09-12T00:13:19.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:19 smithi039 ceph-mon[34543]: pgmap v778: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-09-12T00:13:19.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:19 smithi006 ceph-mon[30947]: pgmap v778: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-09-12T00:13:21.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:21 smithi134 ceph-mon[34893]: pgmap v779: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.50k op/s 2024-09-12T00:13:21.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:21 smithi039 ceph-mon[34543]: pgmap v779: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.50k op/s 2024-09-12T00:13:21.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:21 smithi006 ceph-mon[30947]: pgmap v779: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.50k op/s 2024-09-12T00:13:23.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:23 smithi134 ceph-mon[34893]: pgmap v780: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 2.78k op/s 2024-09-12T00:13:23.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:23 smithi039 ceph-mon[34543]: pgmap v780: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 2.78k op/s 2024-09-12T00:13:23.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:23 smithi006 ceph-mon[30947]: pgmap v780: 129 pgs: 129 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 2.78k op/s 2024-09-12T00:13:25.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:25 smithi134 ceph-mon[34893]: pgmap v781: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-09-12T00:13:25.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:25 smithi039 ceph-mon[34543]: pgmap v781: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-09-12T00:13:25.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:25 smithi006 ceph-mon[30947]: pgmap v781: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-09-12T00:13:27.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:27 smithi134 ceph-mon[34893]: pgmap v782: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.42k op/s 2024-09-12T00:13:27.543 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:27 smithi039 ceph-mon[34543]: pgmap v782: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.42k op/s 2024-09-12T00:13:27.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:27 smithi006 ceph-mon[30947]: pgmap v782: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.42k op/s 2024-09-12T00:13:28.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:28 smithi134 ceph-mon[34893]: pgmap v783: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 3.02k op/s 2024-09-12T00:13:28.544 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:28 smithi039 ceph-mon[34543]: pgmap v783: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 3.02k op/s 2024-09-12T00:13:28.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:28 smithi006 ceph-mon[30947]: pgmap v783: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 3.02k op/s 2024-09-12T00:13:30.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:30 smithi006 ceph-mon[30947]: pgmap v784: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 3.48k op/s 2024-09-12T00:13:30.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:30 smithi134 ceph-mon[34893]: pgmap v784: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 3.48k op/s 2024-09-12T00:13:30.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:30 smithi039 ceph-mon[34543]: pgmap v784: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 3.48k op/s 2024-09-12T00:13:32.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:32 smithi006 ceph-mon[30947]: pgmap v785: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 2.84k op/s 2024-09-12T00:13:32.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:32 smithi134 ceph-mon[34893]: pgmap v785: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 2.84k op/s 2024-09-12T00:13:32.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:32 smithi039 ceph-mon[34543]: pgmap v785: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 2.84k op/s 2024-09-12T00:13:33.621 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:33 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:13:33.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:33 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:13:33.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:33 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:13:34.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:34 smithi006 ceph-mon[30947]: pgmap v786: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.31k op/s 2024-09-12T00:13:34.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:13:34.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:34 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:13:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:34 smithi134 ceph-mon[34893]: pgmap v786: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.31k op/s 2024-09-12T00:13:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:13:34.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:34 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:13:34.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:34 smithi039 ceph-mon[34543]: pgmap v786: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.31k op/s 2024-09-12T00:13:34.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:13:34.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:34 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:13:35.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:35 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:13:35.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:35 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:13:35.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:35 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:13:36.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:36 smithi134 ceph-mon[34893]: pgmap v787: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.42k op/s 2024-09-12T00:13:36.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:36 smithi039 ceph-mon[34543]: pgmap v787: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.42k op/s 2024-09-12T00:13:36.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:36 smithi006 ceph-mon[30947]: pgmap v787: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.42k op/s 2024-09-12T00:13:38.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:38 smithi134 ceph-mon[34893]: pgmap v788: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 2.92k op/s 2024-09-12T00:13:38.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:38 smithi039 ceph-mon[34543]: pgmap v788: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 2.92k op/s 2024-09-12T00:13:38.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:38 smithi006 ceph-mon[30947]: pgmap v788: 129 pgs: 129 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 2.92k op/s 2024-09-12T00:13:40.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:40 smithi134 ceph-mon[34893]: pgmap v789: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.40k op/s 2024-09-12T00:13:40.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:40 smithi039 ceph-mon[34543]: pgmap v789: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.40k op/s 2024-09-12T00:13:40.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:40 smithi006 ceph-mon[30947]: pgmap v789: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.40k op/s 2024-09-12T00:13:42.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:42 smithi134 ceph-mon[34893]: pgmap v790: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.76k op/s 2024-09-12T00:13:42.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:42 smithi039 ceph-mon[34543]: pgmap v790: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.76k op/s 2024-09-12T00:13:42.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:42 smithi006 ceph-mon[30947]: pgmap v790: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.76k op/s 2024-09-12T00:13:44.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:44 smithi134 ceph-mon[34893]: pgmap v791: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 3.06k op/s 2024-09-12T00:13:44.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:44 smithi039 ceph-mon[34543]: pgmap v791: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 3.06k op/s 2024-09-12T00:13:44.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:44 smithi006 ceph-mon[30947]: pgmap v791: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 3.06k op/s 2024-09-12T00:13:46.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:46 smithi134 ceph-mon[34893]: pgmap v792: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.30k op/s 2024-09-12T00:13:46.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:46 smithi039 ceph-mon[34543]: pgmap v792: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.30k op/s 2024-09-12T00:13:46.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:46 smithi006 ceph-mon[30947]: pgmap v792: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 3.30k op/s 2024-09-12T00:13:48.703 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:48 smithi134 ceph-mon[34893]: pgmap v793: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 2.91k op/s 2024-09-12T00:13:48.798 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:48 smithi039 ceph-mon[34543]: pgmap v793: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 2.91k op/s 2024-09-12T00:13:48.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:48 smithi006 ceph-mon[30947]: pgmap v793: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 2.91k op/s 2024-09-12T00:13:50.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:50 smithi039 ceph-mon[34543]: pgmap v794: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.30k op/s 2024-09-12T00:13:50.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:50 smithi006 ceph-mon[30947]: pgmap v794: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.30k op/s 2024-09-12T00:13:50.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:50 smithi134 ceph-mon[34893]: pgmap v794: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.30k op/s 2024-09-12T00:13:52.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:52 smithi039 ceph-mon[34543]: pgmap v795: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 2.94k op/s 2024-09-12T00:13:52.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:52 smithi006 ceph-mon[30947]: pgmap v795: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 2.94k op/s 2024-09-12T00:13:52.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:52 smithi134 ceph-mon[34893]: pgmap v795: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 2.94k op/s 2024-09-12T00:13:54.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:54 smithi039 ceph-mon[34543]: pgmap v796: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 3.17k op/s 2024-09-12T00:13:54.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:54 smithi006 ceph-mon[30947]: pgmap v796: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 3.17k op/s 2024-09-12T00:13:54.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:54 smithi134 ceph-mon[34893]: pgmap v796: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 3.17k op/s 2024-09-12T00:13:56.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:56 smithi039 ceph-mon[34543]: pgmap v797: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 3.41k op/s 2024-09-12T00:13:56.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:56 smithi006 ceph-mon[30947]: pgmap v797: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 3.41k op/s 2024-09-12T00:13:56.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:56 smithi134 ceph-mon[34893]: pgmap v797: 129 pgs: 129 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 3.41k op/s 2024-09-12T00:13:58.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:13:58 smithi039 ceph-mon[34543]: pgmap v798: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 2.99k op/s 2024-09-12T00:13:58.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:13:58 smithi006 ceph-mon[30947]: pgmap v798: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 2.99k op/s 2024-09-12T00:13:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.920+0000 7fde22ffd640 1 -- 172.21.15.6:0/2996778625 <== mds.0 v2:172.21.15.39:6838/3561706320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fdb6c41130 con 0x55fdb6c515c0 2024-09-12T00:13:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.920+0000 7fde22ffd640 10 client.16242 handle_command_reply: tid=0 2024-09-12T00:13:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.920+0000 7fde4cfef740 1 client.16242 shutdown 2024-09-12T00:13:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.921+0000 7fde4cfef740 1 -- 172.21.15.6:0/2996778625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3b9a0 msgr2=0x55fdb6c4aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:13:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.921+0000 7fde4cfef740 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c4aba0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0049d0 tx=0x7fde3c03b920 comp rx=0 tx=0).stop 2024-09-12T00:13:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.921+0000 7fde4cfef740 1 -- 172.21.15.6:0/2996778625 shutdown_connections 2024-09-12T00:13:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.921+0000 7fde4cfef740 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.39:6838/3561706320,v1:172.21.15.39:6839/3561706320] conn(0x55fdb6c515c0 0x55fdb6cbf090 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:13:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.921+0000 7fde4cfef740 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb6c41370 0x55fdb6c4c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:13:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.921+0000 7fde4cfef740 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdb6c3c2e0 0x55fdb6c4b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:13:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.921+0000 7fde4cfef740 1 --2- 172.21.15.6:0/2996778625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fdb6c3b9a0 0x55fdb6c4aba0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:13:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.921+0000 7fde4cfef740 1 -- 172.21.15.6:0/2996778625 >> 172.21.15.6:0/2996778625 conn(0x55fdb6c37010 msgr2=0x55fdb6c361c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:13:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.921+0000 7fde22ffd640 0 client.16242 ms_handle_reset on v2:172.21.15.39:6838/3561706320 2024-09-12T00:13:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.921+0000 7fde4cfef740 1 -- 172.21.15.6:0/2996778625 shutdown_connections 2024-09-12T00:13:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.921+0000 7fde4cfef740 1 -- 172.21.15.6:0/2996778625 wait complete. 2024-09-12T00:13:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.921+0000 7fde4cfef740 20 client.16242 trim_cache size 0 max 16384 2024-09-12T00:13:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2024-09-12T00:13:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2024-09-12T00:13:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2024-09-12T00:13:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2024-09-12T00:13:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.922+0000 7fde4a178640 1 -- 172.21.15.6:0/3502192600 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fde2c0a2d90 msgr2=0x7fde2c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:13:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.922+0000 7fde4a178640 1 --2- 172.21.15.6:0/3502192600 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fde2c0a2d90 0x7fde2c0a5250 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fde380143a0 tx=0x7fde38009670 comp rx=0 tx=0).stop 2024-09-12T00:13:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.922+0000 7fde4a178640 1 -- 172.21.15.6:0/3502192600 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde44072d10 msgr2=0x7fde4419e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:13:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.922+0000 7fde4a178640 1 --2- 172.21.15.6:0/3502192600 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde44072d10 0x7fde4419e8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fde3c03bf10 tx=0x7fde3c003ba0 comp rx=0 tx=0).stop 2024-09-12T00:13:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.922+0000 7fde4a178640 1 -- 172.21.15.6:0/3502192600 shutdown_connections 2024-09-12T00:13:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.922+0000 7fde4a178640 1 --2- 172.21.15.6:0/3502192600 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fde2c0a2d90 0x7fde2c0a5250 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:13:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.922+0000 7fde4a178640 1 --2- 172.21.15.6:0/3502192600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde44109700 0x7fde441a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:13:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.922+0000 7fde4a178640 1 --2- 172.21.15.6:0/3502192600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde440736b0 0x7fde4419ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:13:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.922+0000 7fde4a178640 1 --2- 172.21.15.6:0/3502192600 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde44072d10 0x7fde4419e8f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:13:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.922+0000 7fde4a178640 1 -- 172.21.15.6:0/3502192600 >> 172.21.15.6:0/3502192600 conn(0x7fde4406ecd0 msgr2=0x7fde44116150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:13:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.923+0000 7fde4a178640 1 -- 172.21.15.6:0/3502192600 shutdown_connections 2024-09-12T00:13:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2024-09-12T00:13:58.923+0000 7fde4a178640 1 -- 172.21.15.6:0/3502192600 wait complete. 2024-09-12T00:13:58.952 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:13:58 smithi134 ceph-mon[34893]: pgmap v798: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 2.99k op/s 2024-09-12T00:14:00.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:00 smithi039 ceph-mon[34543]: pgmap v799: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 3.12k op/s 2024-09-12T00:14:00.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:00 smithi006 ceph-mon[30947]: pgmap v799: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 3.12k op/s 2024-09-12T00:14:00.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:00 smithi134 ceph-mon[34893]: pgmap v799: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 3.12k op/s 2024-09-12T00:14:02.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:02 smithi039 ceph-mon[34543]: pgmap v800: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 3.37k op/s 2024-09-12T00:14:02.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:02 smithi006 ceph-mon[30947]: pgmap v800: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 3.37k op/s 2024-09-12T00:14:02.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:02 smithi134 ceph-mon[34893]: pgmap v800: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 3.37k op/s 2024-09-12T00:14:04.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:04 smithi039 ceph-mon[34543]: pgmap v801: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 3.00k op/s 2024-09-12T00:14:04.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:04 smithi006 ceph-mon[30947]: pgmap v801: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 3.00k op/s 2024-09-12T00:14:04.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:04 smithi134 ceph-mon[34893]: pgmap v801: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 3.00k op/s 2024-09-12T00:14:06.794 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:06 smithi039 ceph-mon[34543]: pgmap v802: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 3.59k op/s 2024-09-12T00:14:06.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:06 smithi006 ceph-mon[30947]: pgmap v802: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 3.59k op/s 2024-09-12T00:14:06.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:06 smithi134 ceph-mon[34893]: pgmap v802: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 3.59k op/s 2024-09-12T00:14:07.317 INFO:tasks.workunit.client.0.smithi006.stdout:Syncing()...9 sec 2024-09-12T00:14:07.317 INFO:tasks.workunit.client.0.smithi006.stdout:FFSB benchmark finished at: Thu Sep 12 00:14:07 2024 2024-09-12T00:14:07.317 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:14:07.317 INFO:tasks.workunit.client.0.smithi006.stdout:Results: 2024-09-12T00:14:07.317 INFO:tasks.workunit.client.0.smithi006.stdout:Benchmark took 318.08 sec 2024-09-12T00:14:07.317 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:14:07.317 INFO:tasks.workunit.client.0.smithi006.stdout:Total Results 2024-09-12T00:14:07.317 INFO:tasks.workunit.client.0.smithi006.stdout:=============== 2024-09-12T00:14:07.317 INFO:tasks.workunit.client.0.smithi006.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-12T00:14:07.317 INFO:tasks.workunit.client.0.smithi006.stdout: ======= ============ ========= ======= =========== ========== 2024-09-12T00:14:07.318 INFO:tasks.workunit.client.0.smithi006.stdout: write : 1241600 3903.38 100.000% 100.000% 15.2MB/sec 2024-09-12T00:14:07.318 INFO:tasks.workunit.client.0.smithi006.stdout:- 2024-09-12T00:14:07.318 INFO:tasks.workunit.client.0.smithi006.stdout:3903.38 Transactions per Second 2024-09-12T00:14:07.318 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:14:07.318 INFO:tasks.workunit.client.0.smithi006.stdout:Throughput Results 2024-09-12T00:14:07.318 INFO:tasks.workunit.client.0.smithi006.stdout:=================== 2024-09-12T00:14:07.318 INFO:tasks.workunit.client.0.smithi006.stdout:Write Throughput: 15.2MB/sec 2024-09-12T00:14:07.324 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:14:07.324 INFO:tasks.workunit.client.0.smithi006.stdout:System Call Latency statistics in millisecs 2024-09-12T00:14:07.324 INFO:tasks.workunit.client.0.smithi006.stdout:===== 2024-09-12T00:14:07.324 INFO:tasks.workunit.client.0.smithi006.stdout: Min Avg Max Total Calls 2024-09-12T00:14:07.324 INFO:tasks.workunit.client.0.smithi006.stdout: ======== ======== ======== ============ 2024-09-12T00:14:07.324 INFO:tasks.workunit.client.0.smithi006.stdout:[ open] 0.476000 29.973412 226.557999 970 2024-09-12T00:14:07.324 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-12T00:14:07.324 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-12T00:14:07.324 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[4] 200.000000 - 500.000000 : 1 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[5] 100.000000 - 200.000000 : 15 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[6] 50.000000 - 100.000000 : 131 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[7] 20.000000 - 50.000000 : 441 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[8] 10.000000 - 20.000000 : 214 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[9] 5.000000 - 10.000000 : 90 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[10] 2.000000 - 5.000000 : 33 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[11] 1.000000 - 2.000000 : 38 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[12] 0.500000 - 1.000000 : 6 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[13] 0.200000 - 0.500000 : 1 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-09-12T00:14:07.325 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout:[ write] 0.097000 7.820912 3857.989990 1241600 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[1] 2000.000000 - 5000.000000 : 20 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[2] 1000.000000 - 2000.000000 : 13 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[3] 500.000000 - 1000.000000 : 32 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[4] 200.000000 - 500.000000 : 404 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[5] 100.000000 - 200.000000 : 4791 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[6] 50.000000 - 100.000000 : 30575 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[7] 20.000000 - 50.000000 : 112895 2024-09-12T00:14:07.326 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[8] 10.000000 - 20.000000 : 130483 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[9] 5.000000 - 10.000000 : 127056 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[10] 2.000000 - 5.000000 : 96324 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[11] 1.000000 - 2.000000 : 28160 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[12] 0.500000 - 1.000000 : 52573 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[13] 0.200000 - 0.500000 : 327080 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[14] 0.100000 - 0.200000 : 331186 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[15] 0.050000 - 0.100000 : 8 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout:[ lseek] 0.000000 0.001135 4.176000 1241600 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-12T00:14:07.327 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[10] 2.000000 - 5.000000 : 4 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[11] 1.000000 - 2.000000 : 3 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[12] 0.500000 - 1.000000 : 10 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[13] 0.200000 - 0.500000 : 10 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[14] 0.100000 - 0.200000 : 20 2024-09-12T00:14:07.328 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[15] 0.050000 - 0.100000 : 19 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[16] 0.020000 - 0.050000 : 297 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[17] 0.010000 - 0.020000 : 1301 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[18] 0.000000 - 0.010000 : 1239936 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout:[ close] 0.024000 3.960381 205.565994 970 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[4] 200.000000 - 500.000000 : 1 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[5] 100.000000 - 200.000000 : 5 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[6] 50.000000 - 100.000000 : 11 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[7] 20.000000 - 50.000000 : 30 2024-09-12T00:14:07.329 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[8] 10.000000 - 20.000000 : 37 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[9] 5.000000 - 10.000000 : 54 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[10] 2.000000 - 5.000000 : 65 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[11] 1.000000 - 2.000000 : 21 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[12] 0.500000 - 1.000000 : 21 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[13] 0.200000 - 0.500000 : 57 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[14] 0.100000 - 0.200000 : 178 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[15] 0.050000 - 0.100000 : 84 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[16] 0.020000 - 0.050000 : 406 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:14:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-09-12T00:14:07.331 INFO:tasks.workunit.client.0.smithi006.stdout:0.7% User Time 2024-09-12T00:14:07.331 INFO:tasks.workunit.client.0.smithi006.stdout:50.1% System Time 2024-09-12T00:14:07.331 INFO:tasks.workunit.client.0.smithi006.stdout:50.8% CPU Utilization 2024-09-12T00:14:07.342 INFO:tasks.workunit.client.0.smithi006.stderr:+ cd .. 2024-09-12T00:14:07.350 INFO:tasks.workunit.client.0.smithi006.stderr:+ rm -r tmp ffsb 2024-09-12T00:14:08.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:08 smithi039 ceph-mon[34543]: pgmap v803: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 2.95k op/s 2024-09-12T00:14:08.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:08 smithi006 ceph-mon[30947]: pgmap v803: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 2.95k op/s 2024-09-12T00:14:08.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:08 smithi134 ceph-mon[34893]: pgmap v803: 129 pgs: 129 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 2.95k op/s 2024-09-12T00:14:10.500 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:14:10.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:14:10.704 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-12T00:14:10.705 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:14:10.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:10 smithi039 ceph-mon[34543]: pgmap v804: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 2.51k op/s 2024-09-12T00:14:10.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:10 smithi006 ceph-mon[30947]: pgmap v804: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 2.51k op/s 2024-09-12T00:14:10.955 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:10 smithi134 ceph-mon[34893]: pgmap v804: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 2.51k op/s 2024-09-12T00:14:11.168 DEBUG:teuthology.parallel:result is None 2024-09-12T00:14:11.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:14:11.236 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:14:11.237 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-12T00:14:11.767 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi006.front.sepia.ceph.com 2024-09-12T00:14:11.779 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T00:14:12.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:14:12.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.720+0000 7ff19affd640 1 -- 172.21.15.6:0/377629867 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff190031880 con 0x7ff19c1003c0 2024-09-12T00:14:12.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.721+0000 7ff1a2465640 1 -- 172.21.15.6:0/377629867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff19c1003c0 msgr2=0x7ff19c1007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:12.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.721+0000 7ff1a2465640 1 --2- 172.21.15.6:0/377629867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff19c1003c0 0x7ff19c1007c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff190009900 tx=0x7ff19002a440 comp rx=0 tx=0).stop 2024-09-12T00:14:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.721+0000 7ff1a2465640 1 -- 172.21.15.6:0/377629867 shutdown_connections 2024-09-12T00:14:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.721+0000 7ff1a2465640 1 --2- 172.21.15.6:0/377629867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19c1016a0 0x7ff19c101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.721+0000 7ff1a2465640 1 --2- 172.21.15.6:0/377629867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff19c100d00 0x7ff19c101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.721+0000 7ff1a2465640 1 --2- 172.21.15.6:0/377629867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff19c1003c0 0x7ff19c1007c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.721+0000 7ff1a2465640 1 -- 172.21.15.6:0/377629867 >> 172.21.15.6:0/377629867 conn(0x7ff19c0fc1b0 msgr2=0x7ff19c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.721+0000 7ff1a2465640 1 -- 172.21.15.6:0/377629867 shutdown_connections 2024-09-12T00:14:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.721+0000 7ff1a2465640 1 -- 172.21.15.6:0/377629867 wait complete. 2024-09-12T00:14:12.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.722+0000 7ff1a2465640 1 Processor -- start 2024-09-12T00:14:12.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.722+0000 7ff1a2465640 1 -- start start 2024-09-12T00:14:12.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.722+0000 7ff1a2465640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff19c1003c0 0x7ff19c073820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:12.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.722+0000 7ff1a2465640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19c100d00 0x7ff19c073d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:12.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.722+0000 7ff1a2465640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff19c1016a0 0x7ff19c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.722+0000 7ff1a2465640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c06c650 con 0x7ff19c1016a0 2024-09-12T00:14:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.722+0000 7ff1a2465640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c06c4d0 con 0x7ff19c1003c0 2024-09-12T00:14:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.722+0000 7ff1a2465640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c06c7d0 con 0x7ff19c100d00 2024-09-12T00:14:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.723+0000 7ff19bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff19c1003c0 0x7ff19c073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.723+0000 7ff19b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19c100d00 0x7ff19c073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.723+0000 7ff19b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19c100d00 0x7ff19c073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:60492/0 (socket says 172.21.15.6:60492) 2024-09-12T00:14:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.723+0000 7ff19b7fe640 1 -- 172.21.15.6:0/1651306109 learned_addr learned my addr 172.21.15.6:0/1651306109 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:14:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.723+0000 7ff1a0a02640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff19c1016a0 0x7ff19c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.723+0000 7ff19b7fe640 1 -- 172.21.15.6:0/1651306109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff19c1003c0 msgr2=0x7ff19c073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.723+0000 7ff19b7fe640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff19c1003c0 0x7ff19c073820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.723+0000 7ff19b7fe640 1 -- 172.21.15.6:0/1651306109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff19c1016a0 msgr2=0x7ff19c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.723+0000 7ff19b7fe640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff19c1016a0 0x7ff19c071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.723+0000 7ff19b7fe640 1 -- 172.21.15.6:0/1651306109 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19c072720 con 0x7ff19c100d00 2024-09-12T00:14:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.723+0000 7ff1a0a02640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff19c1016a0 0x7ff19c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:14:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.724+0000 7ff19b7fe640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19c100d00 0x7ff19c073d60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00b450 tx=0x7ff18c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.724+0000 7ff1997fa640 1 -- 172.21.15.6:0/1651306109 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c015020 con 0x7ff19c100d00 2024-09-12T00:14:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.724+0000 7ff1997fa640 1 -- 172.21.15.6:0/1651306109 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff18c011d40 con 0x7ff19c100d00 2024-09-12T00:14:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.724+0000 7ff1997fa640 1 -- 172.21.15.6:0/1651306109 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c00f340 con 0x7ff19c100d00 2024-09-12T00:14:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.724+0000 7ff1a2465640 1 -- 172.21.15.6:0/1651306109 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19c0729b0 con 0x7ff19c100d00 2024-09-12T00:14:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.725+0000 7ff1a2465640 1 -- 172.21.15.6:0/1651306109 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff19c1aaed0 con 0x7ff19c100d00 2024-09-12T00:14:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.726+0000 7ff1a2465640 1 -- 172.21.15.6:0/1651306109 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff19c10b310 con 0x7ff19c100d00 2024-09-12T00:14:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.728+0000 7ff1997fa640 1 -- 172.21.15.6:0/1651306109 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7ff18c018020 con 0x7ff19c100d00 2024-09-12T00:14:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.729+0000 7ff1997fa640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff1840a2d90 0x7ff1840a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.729+0000 7ff1997fa640 1 -- 172.21.15.6:0/1651306109 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7ff18c0cf0c0 con 0x7ff19c100d00 2024-09-12T00:14:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.730+0000 7ff19bfff640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff1840a2d90 0x7ff1840a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.731+0000 7ff19bfff640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff1840a2d90 0x7ff1840a5250 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff190006010 tx=0x7ff190000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:12.734+0000 7ff1997fa640 1 -- 172.21.15.6:0/1651306109 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff18c01f020 con 0x7ff19c100d00 2024-09-12T00:14:12.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:12 smithi039 ceph-mon[34543]: pgmap v805: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 8.9 MiB/s wr, 2.24k op/s 2024-09-12T00:14:12.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:12 smithi039 ceph-mon[34543]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:14:12.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:12 smithi006 ceph-mon[30947]: pgmap v805: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 8.9 MiB/s wr, 2.24k op/s 2024-09-12T00:14:12.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:12 smithi006 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:14:12.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:12 smithi134 ceph-mon[34893]: pgmap v805: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 8.9 MiB/s wr, 2.24k op/s 2024-09-12T00:14:12.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:12 smithi134 ceph-mon[34893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:14:13.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.080+0000 7ff1a2465640 1 -- 172.21.15.6:0/1651306109 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff19c02d7c0 con 0x7ff19c100d00 2024-09-12T00:14:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.083+0000 7ff1997fa640 1 -- 172.21.15.6:0/1651306109 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24900 (secure 0 0 0) 0x7ff19c02d7c0 con 0x7ff19c100d00 2024-09-12T00:14:13.082 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-12T00:14:13.082 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":90,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-12T00:00:03.785635+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:56:54.204314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:56:56.327143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:57:02.826677+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":7}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:14:13.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.086+0000 7ff1a2465640 1 -- 172.21.15.6:0/1651306109 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff1840a2d90 msgr2=0x7ff1840a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:13.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.086+0000 7ff1a2465640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff1840a2d90 0x7ff1840a5250 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff190006010 tx=0x7ff190000bc0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.086+0000 7ff1a2465640 1 -- 172.21.15.6:0/1651306109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19c100d00 msgr2=0x7ff19c073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:13.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.086+0000 7ff1a2465640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19c100d00 0x7ff19c073d60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00b450 tx=0x7ff18c00b910 comp rx=0 tx=0).stop 2024-09-12T00:14:13.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.090+0000 7ff1a2465640 1 -- 172.21.15.6:0/1651306109 shutdown_connections 2024-09-12T00:14:13.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.090+0000 7ff1a2465640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ff1840a2d90 0x7ff1840a5250 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.090+0000 7ff1a2465640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff19c1016a0 0x7ff19c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.090+0000 7ff1a2465640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19c100d00 0x7ff19c073d60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.090+0000 7ff1a2465640 1 --2- 172.21.15.6:0/1651306109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff19c1003c0 0x7ff19c073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.090+0000 7ff1a2465640 1 -- 172.21.15.6:0/1651306109 >> 172.21.15.6:0/1651306109 conn(0x7ff19c0fc1b0 msgr2=0x7ff19c0fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:13.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.090+0000 7ff1a2465640 1 -- 172.21.15.6:0/1651306109 shutdown_connections 2024-09-12T00:14:13.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.090+0000 7ff1a2465640 1 -- 172.21.15.6:0/1651306109 wait complete. 2024-09-12T00:14:13.107 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:52:17.346320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T23:56:54.204314+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T23:56:56.327143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-11T23:57:02.826677+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T00:14:13.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T00:14:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.301+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/734644942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa4100a20 msgr2=0x7f7aa4100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.302+0000 7f7aa8b5b640 1 --2- 172.21.15.6:0/734644942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa4100a20 0x7f7aa4100e20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009900 tx=0x7f7a9802a440 comp rx=0 tx=0).stop 2024-09-12T00:14:13.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.306+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/734644942 shutdown_connections 2024-09-12T00:14:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.306+0000 7f7aa8b5b640 1 --2- 172.21.15.6:0/734644942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7aa41025d0 0x7f7aa4108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.306+0000 7f7aa8b5b640 1 --2- 172.21.15.6:0/734644942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa4101c10 0x7f7aa4102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.306+0000 7f7aa8b5b640 1 --2- 172.21.15.6:0/734644942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa4100a20 0x7f7aa4100e20 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.306+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/734644942 >> 172.21.15.6:0/734644942 conn(0x7f7aa40fc1a0 msgr2=0x7f7aa40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:13.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.309+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/734644942 shutdown_connections 2024-09-12T00:14:13.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.310+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/734644942 wait complete. 2024-09-12T00:14:13.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.311+0000 7f7aa8b5b640 1 Processor -- start 2024-09-12T00:14:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.314+0000 7f7aa8b5b640 1 -- start start 2024-09-12T00:14:13.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.314+0000 7f7aa8b5b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa4100a20 0x7f7aa419a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:13.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.314+0000 7f7aa8b5b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa4101c10 0x7f7aa419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:13.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.314+0000 7f7aa8b5b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7aa41025d0 0x7f7aa41a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:13.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.315+0000 7f7aa8b5b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa410b4b0 con 0x7f7aa4101c10 2024-09-12T00:14:13.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.315+0000 7f7aa8b5b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa410b330 con 0x7f7aa41025d0 2024-09-12T00:14:13.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.315+0000 7f7aa2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7aa41025d0 0x7f7aa41a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.315+0000 7f7aa2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7aa41025d0 0x7f7aa41a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:46200/0 (socket says 172.21.15.6:46200) 2024-09-12T00:14:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.315+0000 7f7aa2d9d640 1 -- 172.21.15.6:0/2788321980 learned_addr learned my addr 172.21.15.6:0/2788321980 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:14:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.315+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/2788321980 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa410b630 con 0x7f7aa4100a20 2024-09-12T00:14:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.315+0000 7f7aa1d9b640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa4101c10 0x7f7aa419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.316+0000 7f7aa1d9b640 1 -- 172.21.15.6:0/2788321980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa4100a20 msgr2=0x7f7aa419a040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T00:14:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.316+0000 7f7aa1d9b640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa4100a20 0x7f7aa419a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.316+0000 7f7aa1d9b640 1 -- 172.21.15.6:0/2788321980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7aa41025d0 msgr2=0x7f7aa41a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.316+0000 7f7aa1d9b640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7aa41025d0 0x7f7aa41a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.316+0000 7f7aa1d9b640 1 -- 172.21.15.6:0/2788321980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa41a1c60 con 0x7f7aa4101c10 2024-09-12T00:14:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.316+0000 7f7aa1d9b640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa4101c10 0x7f7aa419a580 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400c970 tx=0x7f7a9400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.317+0000 7f7aa2d9d640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7aa41025d0 0x7f7aa41a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:14:13.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.319+0000 7f7a937fe640 1 -- 172.21.15.6:0/2788321980 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94007bb0 con 0x7f7aa4101c10 2024-09-12T00:14:13.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.319+0000 7f7a937fe640 1 -- 172.21.15.6:0/2788321980 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a94007d50 con 0x7f7aa4101c10 2024-09-12T00:14:13.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.319+0000 7f7a937fe640 1 -- 172.21.15.6:0/2788321980 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94004df0 con 0x7f7aa4101c10 2024-09-12T00:14:13.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.321+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/2788321980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa41a1f50 con 0x7f7aa4101c10 2024-09-12T00:14:13.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.321+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/2788321980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa41a23c0 con 0x7f7aa4101c10 2024-09-12T00:14:13.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.326+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/2788321980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa41a26b0 con 0x7f7aa4101c10 2024-09-12T00:14:13.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.329+0000 7f7a937fe640 1 -- 172.21.15.6:0/2788321980 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f7a94004f90 con 0x7f7aa4101c10 2024-09-12T00:14:13.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.330+0000 7f7a937fe640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7a8c0a2d60 0x7f7a8c0a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:13.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.330+0000 7f7a937fe640 1 -- 172.21.15.6:0/2788321980 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f7a940cf3e0 con 0x7f7aa4101c10 2024-09-12T00:14:13.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.331+0000 7f7aa259c640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7a8c0a2d60 0x7f7a8c0a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:13.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.333+0000 7f7aa259c640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7a8c0a2d60 0x7f7a8c0a5220 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7a980057c0 tx=0x7f7a98005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:13.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.340+0000 7f7a937fe640 1 -- 172.21.15.6:0/2788321980 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a9401d020 con 0x7f7aa4101c10 2024-09-12T00:14:13.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.679+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/2788321980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7aa41a2f50 con 0x7f7aa4101c10 2024-09-12T00:14:13.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.681+0000 7f7a937fe640 1 -- 172.21.15.6:0/2788321980 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f7a94014030 con 0x7f7aa4101c10 2024-09-12T00:14:13.680 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-09-12T00:14:13.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.684+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/2788321980 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7a8c0a2d60 msgr2=0x7f7a8c0a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:13.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.684+0000 7f7aa8b5b640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7a8c0a2d60 0x7f7a8c0a5220 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7a980057c0 tx=0x7f7a98005fd0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.684+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/2788321980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa4101c10 msgr2=0x7f7aa419a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:13.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.684+0000 7f7aa8b5b640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa4101c10 0x7f7aa419a580 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400c970 tx=0x7f7a9400ce30 comp rx=0 tx=0).stop 2024-09-12T00:14:13.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.685+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/2788321980 shutdown_connections 2024-09-12T00:14:13.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.685+0000 7f7aa8b5b640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f7a8c0a2d60 0x7f7a8c0a5220 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.685+0000 7f7aa8b5b640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7aa41025d0 0x7f7aa41a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.685+0000 7f7aa8b5b640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa4101c10 0x7f7aa419a580 secure :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400c970 tx=0x7f7a9400ce30 comp rx=0 tx=0).stop 2024-09-12T00:14:13.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.685+0000 7f7aa8b5b640 1 --2- 172.21.15.6:0/2788321980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa4100a20 0x7f7aa419a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.685+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/2788321980 >> 172.21.15.6:0/2788321980 conn(0x7f7aa40fc1a0 msgr2=0x7f7aa40fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:13.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.685+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/2788321980 shutdown_connections 2024-09-12T00:14:13.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.685+0000 7f7aa8b5b640 1 -- 172.21.15.6:0/2788321980 wait complete. 2024-09-12T00:14:13.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T00:14:13.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:13 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1651306109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:14:13.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.890+0000 7fb2e067b640 1 -- 172.21.15.6:0/4227608977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2d81092f0 msgr2=0x7fb2d8109750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:13.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.890+0000 7fb2e067b640 1 --2- 172.21.15.6:0/4227608977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2d81092f0 0x7fb2d8109750 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb2d401a940 tx=0x7fb2d403b490 comp rx=0 tx=0).stop 2024-09-12T00:14:13.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.891+0000 7fb2e067b640 1 -- 172.21.15.6:0/4227608977 shutdown_connections 2024-09-12T00:14:13.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.891+0000 7fb2e067b640 1 --2- 172.21.15.6:0/4227608977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8109c90 0x7fb2d8119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.891+0000 7fb2e067b640 1 --2- 172.21.15.6:0/4227608977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2d81092f0 0x7fb2d8109750 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.891+0000 7fb2e067b640 1 --2- 172.21.15.6:0/4227608977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2d80733f0 0x7fb2d80737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.891+0000 7fb2e067b640 1 -- 172.21.15.6:0/4227608977 >> 172.21.15.6:0/4227608977 conn(0x7fb2d806ec70 msgr2=0x7fb2d80710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:13.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.891+0000 7fb2e067b640 1 -- 172.21.15.6:0/4227608977 shutdown_connections 2024-09-12T00:14:13.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.891+0000 7fb2e067b640 1 -- 172.21.15.6:0/4227608977 wait complete. 2024-09-12T00:14:13.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.892+0000 7fb2e067b640 1 Processor -- start 2024-09-12T00:14:13.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.892+0000 7fb2e067b640 1 -- start start 2024-09-12T00:14:13.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.892+0000 7fb2e067b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d80733f0 0x7fb2d819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:13.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.892+0000 7fb2e067b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2d81092f0 0x7fb2d819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:13.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.892+0000 7fb2e067b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2d8109c90 0x7fb2d81a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:13.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.892+0000 7fb2e067b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8113410 con 0x7fb2d81092f0 2024-09-12T00:14:13.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.892+0000 7fb2e067b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8113290 con 0x7fb2d80733f0 2024-09-12T00:14:13.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.892+0000 7fb2e067b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8113590 con 0x7fb2d8109c90 2024-09-12T00:14:13.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.893+0000 7fb2de417640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d80733f0 0x7fb2d819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:13.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.893+0000 7fb2de417640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d80733f0 0x7fb2d819e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:46212/0 (socket says 172.21.15.6:46212) 2024-09-12T00:14:13.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.893+0000 7fb2de417640 1 -- 172.21.15.6:0/1914401285 learned_addr learned my addr 172.21.15.6:0/1914401285 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:14:13.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.893+0000 7fb2dec18640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2d8109c90 0x7fb2d81a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:13.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.893+0000 7fb2ddc16640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2d81092f0 0x7fb2d819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:13.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.893+0000 7fb2de417640 1 -- 172.21.15.6:0/1914401285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2d8109c90 msgr2=0x7fb2d81a5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:13.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.893+0000 7fb2de417640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2d8109c90 0x7fb2d81a5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.893+0000 7fb2de417640 1 -- 172.21.15.6:0/1914401285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2d81092f0 msgr2=0x7fb2d819ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:13.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.893+0000 7fb2de417640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2d81092f0 0x7fb2d819ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:13.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.893+0000 7fb2de417640 1 -- 172.21.15.6:0/1914401285 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d81a5fe0 con 0x7fb2d80733f0 2024-09-12T00:14:13.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.894+0000 7fb2de417640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d80733f0 0x7fb2d819e8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800d950 tx=0x7fb2c800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:13.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.894+0000 7fb2cf7fe640 1 -- 172.21.15.6:0/1914401285 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8017070 con 0x7fb2d80733f0 2024-09-12T00:14:13.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.894+0000 7fb2cf7fe640 1 -- 172.21.15.6:0/1914401285 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2c8009c30 con 0x7fb2d80733f0 2024-09-12T00:14:13.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.894+0000 7fb2cf7fe640 1 -- 172.21.15.6:0/1914401285 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800f620 con 0x7fb2d80733f0 2024-09-12T00:14:13.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.895+0000 7fb2e067b640 1 -- 172.21.15.6:0/1914401285 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d81a62d0 con 0x7fb2d80733f0 2024-09-12T00:14:13.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.895+0000 7fb2e067b640 1 -- 172.21.15.6:0/1914401285 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d81a67a0 con 0x7fb2d80733f0 2024-09-12T00:14:13.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.896+0000 7fb2e067b640 1 -- 172.21.15.6:0/1914401285 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d80737f0 con 0x7fb2d80733f0 2024-09-12T00:14:13.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.897+0000 7fb2cf7fe640 1 -- 172.21.15.6:0/1914401285 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fb2c80109a0 con 0x7fb2d80733f0 2024-09-12T00:14:13.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.898+0000 7fb2cf7fe640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb2c40a2be0 0x7fb2c40a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:13.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.898+0000 7fb2ddc16640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb2c40a2be0 0x7fb2c40a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:13.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.898+0000 7fb2cf7fe640 1 -- 172.21.15.6:0/1914401285 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fb2c80cf0f0 con 0x7fb2d80733f0 2024-09-12T00:14:13.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.899+0000 7fb2ddc16640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb2c40a2be0 0x7fb2c40a50a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb2d401a910 tx=0x7fb2d4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:13.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:13.904+0000 7fb2cf7fe640 1 -- 172.21.15.6:0/1914401285 <== mon.2 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb2c8009de0 con 0x7fb2d80733f0 2024-09-12T00:14:13.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:13 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1651306109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:14:14.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:13 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1651306109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:14:14.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.254+0000 7fb2e067b640 1 -- 172.21.15.6:0/1914401285 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb2d802db80 con 0x7fb2d80733f0 2024-09-12T00:14:14.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.255+0000 7fb2cf7fe640 1 -- 172.21.15.6:0/1914401285 <== mon.2 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7fb2c809bc00 con 0x7fb2d80733f0 2024-09-12T00:14:14.254 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-09-12T00:14:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.260+0000 7fb2e067b640 1 -- 172.21.15.6:0/1914401285 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb2c40a2be0 msgr2=0x7fb2c40a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.260+0000 7fb2e067b640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb2c40a2be0 0x7fb2c40a50a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb2d401a910 tx=0x7fb2d4000bc0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.260+0000 7fb2e067b640 1 -- 172.21.15.6:0/1914401285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d80733f0 msgr2=0x7fb2d819e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.260+0000 7fb2e067b640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d80733f0 0x7fb2d819e8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800d950 tx=0x7fb2c800de10 comp rx=0 tx=0).stop 2024-09-12T00:14:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.260+0000 7fb2e067b640 1 -- 172.21.15.6:0/1914401285 shutdown_connections 2024-09-12T00:14:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.260+0000 7fb2e067b640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fb2c40a2be0 0x7fb2c40a50a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.260+0000 7fb2e067b640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2d8109c90 0x7fb2d81a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.260+0000 7fb2e067b640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2d81092f0 0x7fb2d819ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.260+0000 7fb2e067b640 1 --2- 172.21.15.6:0/1914401285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d80733f0 0x7fb2d819e8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.260+0000 7fb2e067b640 1 -- 172.21.15.6:0/1914401285 >> 172.21.15.6:0/1914401285 conn(0x7fb2d806ec70 msgr2=0x7fb2d8116040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.260+0000 7fb2e067b640 1 -- 172.21.15.6:0/1914401285 shutdown_connections 2024-09-12T00:14:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.260+0000 7fb2e067b640 1 -- 172.21.15.6:0/1914401285 wait complete. 2024-09-12T00:14:14.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T00:14:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.462+0000 7fcc9c053640 1 -- 172.21.15.6:0/2711224290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc94100a50 msgr2=0x7fcc94100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.462+0000 7fcc9c053640 1 --2- 172.21.15.6:0/2711224290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc94100a50 0x7fcc94100e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009900 tx=0x7fcc9002a400 comp rx=0 tx=0).stop 2024-09-12T00:14:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.462+0000 7fcc9c053640 1 -- 172.21.15.6:0/2711224290 shutdown_connections 2024-09-12T00:14:14.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.462+0000 7fcc9c053640 1 --2- 172.21.15.6:0/2711224290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc94102600 0x7fcc94108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.462+0000 7fcc9c053640 1 --2- 172.21.15.6:0/2711224290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc94101c40 0x7fcc941020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.462+0000 7fcc9c053640 1 --2- 172.21.15.6:0/2711224290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc94100a50 0x7fcc94100e50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.462+0000 7fcc9c053640 1 -- 172.21.15.6:0/2711224290 >> 172.21.15.6:0/2711224290 conn(0x7fcc940fc1b0 msgr2=0x7fcc940fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:14.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.463+0000 7fcc9c053640 1 -- 172.21.15.6:0/2711224290 shutdown_connections 2024-09-12T00:14:14.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.463+0000 7fcc9c053640 1 -- 172.21.15.6:0/2711224290 wait complete. 2024-09-12T00:14:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.463+0000 7fcc9c053640 1 Processor -- start 2024-09-12T00:14:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.463+0000 7fcc9c053640 1 -- start start 2024-09-12T00:14:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc9c053640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc94100a50 0x7fcc9419e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc9c053640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc94101c40 0x7fcc9419e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc9c053640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc94102600 0x7fcc941a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc9c053640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9410ac90 con 0x7fcc94102600 2024-09-12T00:14:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc9c053640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9410ab10 con 0x7fcc94100a50 2024-09-12T00:14:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc9c053640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9410ae10 con 0x7fcc94101c40 2024-09-12T00:14:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc99def640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc94100a50 0x7fcc9419e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc99def640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc94100a50 0x7fcc9419e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:46234/0 (socket says 172.21.15.6:46234) 2024-09-12T00:14:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc99def640 1 -- 172.21.15.6:0/3553695189 learned_addr learned my addr 172.21.15.6:0/3553695189 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:14:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc9a5f0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc94102600 0x7fcc941a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc995ee640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc94101c40 0x7fcc9419e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc99def640 1 -- 172.21.15.6:0/3553695189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc94101c40 msgr2=0x7fcc9419e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc99def640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc94101c40 0x7fcc9419e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc99def640 1 -- 172.21.15.6:0/3553695189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc94102600 msgr2=0x7fcc941a5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc99def640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc94102600 0x7fcc941a5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.464+0000 7fcc99def640 1 -- 172.21.15.6:0/3553695189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc941a5e00 con 0x7fcc94100a50 2024-09-12T00:14:14.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.465+0000 7fcc99def640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc94100a50 0x7fcc9419e1e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009230 tx=0x7fcc90004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:14.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.465+0000 7fcc8affd640 1 -- 172.21.15.6:0/3553695189 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9003f030 con 0x7fcc94100a50 2024-09-12T00:14:14.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.465+0000 7fcc8affd640 1 -- 172.21.15.6:0/3553695189 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc90003cb0 con 0x7fcc94100a50 2024-09-12T00:14:14.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.465+0000 7fcc9c053640 1 -- 172.21.15.6:0/3553695189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc941a6090 con 0x7fcc94100a50 2024-09-12T00:14:14.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.465+0000 7fcc8affd640 1 -- 172.21.15.6:0/3553695189 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90035070 con 0x7fcc94100a50 2024-09-12T00:14:14.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.465+0000 7fcc9c053640 1 -- 172.21.15.6:0/3553695189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc941a6580 con 0x7fcc94100a50 2024-09-12T00:14:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.466+0000 7fcc9c053640 1 -- 172.21.15.6:0/3553695189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc94105580 con 0x7fcc94100a50 2024-09-12T00:14:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.467+0000 7fcc8affd640 1 -- 172.21.15.6:0/3553695189 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fcc90042030 con 0x7fcc94100a50 2024-09-12T00:14:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.468+0000 7fcc8affd640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcc800a2b90 0x7fcc800a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.468+0000 7fcc8affd640 1 -- 172.21.15.6:0/3553695189 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fcc900ef9e0 con 0x7fcc94100a50 2024-09-12T00:14:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.468+0000 7fcc995ee640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcc800a2b90 0x7fcc800a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:14.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.470+0000 7fcc995ee640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcc800a2b90 0x7fcc800a5050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcc9419f6f0 tx=0x7fcc84005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:14.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.473+0000 7fcc8affd640 1 -- 172.21.15.6:0/3553695189 <== mon.2 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc90049030 con 0x7fcc94100a50 2024-09-12T00:14:14.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.767+0000 7fcc9c053640 1 -- 172.21.15.6:0/3553695189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcc94062ed0 con 0x7fcc94100a50 2024-09-12T00:14:14.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.767+0000 7fcc8affd640 1 -- 172.21.15.6:0/3553695189 <== mon.2 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7fcc900bc550 con 0x7fcc94100a50 2024-09-12T00:14:14.766 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-09-12T00:14:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.771+0000 7fcc9c053640 1 -- 172.21.15.6:0/3553695189 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcc800a2b90 msgr2=0x7fcc800a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.771+0000 7fcc9c053640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcc800a2b90 0x7fcc800a5050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcc9419f6f0 tx=0x7fcc84005c60 comp rx=0 tx=0).stop 2024-09-12T00:14:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.771+0000 7fcc9c053640 1 -- 172.21.15.6:0/3553695189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc94100a50 msgr2=0x7fcc9419e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.771+0000 7fcc9c053640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc94100a50 0x7fcc9419e1e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009230 tx=0x7fcc90004360 comp rx=0 tx=0).stop 2024-09-12T00:14:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.771+0000 7fcc9c053640 1 -- 172.21.15.6:0/3553695189 shutdown_connections 2024-09-12T00:14:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.771+0000 7fcc9c053640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fcc800a2b90 0x7fcc800a5050 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.771+0000 7fcc9c053640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc94102600 0x7fcc941a5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.771+0000 7fcc9c053640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc94101c40 0x7fcc9419e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.771+0000 7fcc9c053640 1 --2- 172.21.15.6:0/3553695189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc94100a50 0x7fcc9419e1e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.771+0000 7fcc9c053640 1 -- 172.21.15.6:0/3553695189 >> 172.21.15.6:0/3553695189 conn(0x7fcc940fc1b0 msgr2=0x7fcc9410d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.776+0000 7fcc9c053640 1 -- 172.21.15.6:0/3553695189 shutdown_connections 2024-09-12T00:14:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.776+0000 7fcc9c053640 1 -- 172.21.15.6:0/3553695189 wait complete. 2024-09-12T00:14:14.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T00:14:14.835 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:14 smithi006 ceph-mon[30947]: pgmap v806: 129 pgs: 129 active+clean; 11 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 5.4 MiB/s wr, 1.39k op/s 2024-09-12T00:14:14.835 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:14 smithi006 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:14:14.836 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:14 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2788321980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T00:14:14.836 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:14 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1914401285' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T00:14:14.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:14 smithi134 ceph-mon[34893]: pgmap v806: 129 pgs: 129 active+clean; 11 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 5.4 MiB/s wr, 1.39k op/s 2024-09-12T00:14:14.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:14 smithi134 ceph-mon[34893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:14:14.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:14 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2788321980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T00:14:14.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:14 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1914401285' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T00:14:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.984+0000 7f683f11f640 1 -- 172.21.15.6:0/1053603513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68381025e0 msgr2=0x7f6838108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:14.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.984+0000 7f683f11f640 1 --2- 172.21.15.6:0/1053603513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68381025e0 0x7f6838108e70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6830009be0 tx=0x7f683002a6f0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.984+0000 7f683f11f640 1 -- 172.21.15.6:0/1053603513 shutdown_connections 2024-09-12T00:14:14.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.984+0000 7f683f11f640 1 --2- 172.21.15.6:0/1053603513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68381025e0 0x7f6838108e70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.984+0000 7f683f11f640 1 --2- 172.21.15.6:0/1053603513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6838101c20 0x7f68381020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.984+0000 7f683f11f640 1 --2- 172.21.15.6:0/1053603513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6838100a30 0x7f6838100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.984+0000 7f683f11f640 1 -- 172.21.15.6:0/1053603513 >> 172.21.15.6:0/1053603513 conn(0x7f68380fc190 msgr2=0x7f68380fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:14.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.986+0000 7f683f11f640 1 -- 172.21.15.6:0/1053603513 shutdown_connections 2024-09-12T00:14:14.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.987+0000 7f683f11f640 1 -- 172.21.15.6:0/1053603513 wait complete. 2024-09-12T00:14:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.988+0000 7f683f11f640 1 Processor -- start 2024-09-12T00:14:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.988+0000 7f683f11f640 1 -- start start 2024-09-12T00:14:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.988+0000 7f683f11f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6838100a30 0x7f6838195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.988+0000 7f683f11f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6838101c20 0x7f6838196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.988+0000 7f683f11f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68381025e0 0x7f683819d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.988+0000 7f683f11f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f683810b4c0 con 0x7f68381025e0 2024-09-12T00:14:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.988+0000 7f683f11f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f683810b340 con 0x7f6838100a30 2024-09-12T00:14:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.988+0000 7f683f11f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f683810b640 con 0x7f6838101c20 2024-09-12T00:14:14.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.989+0000 7f6837fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6838101c20 0x7f6838196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:14.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.989+0000 7f6837fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6838101c20 0x7f6838196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:60574/0 (socket says 172.21.15.6:60574) 2024-09-12T00:14:14.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.989+0000 7f6837fff640 1 -- 172.21.15.6:0/3472366444 learned_addr learned my addr 172.21.15.6:0/3472366444 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:14:14.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.989+0000 7f683d6bc640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68381025e0 0x7f683819d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:14.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.989+0000 7f683d6bc640 1 -- 172.21.15.6:0/3472366444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6838101c20 msgr2=0x7f6838196170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:14.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.989+0000 7f683d6bc640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6838101c20 0x7f6838196170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.989+0000 7f683d6bc640 1 -- 172.21.15.6:0/3472366444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6838100a30 msgr2=0x7f6838195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:14.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.989+0000 7f683d6bc640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6838100a30 0x7f6838195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:14.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.989+0000 7f683d6bc640 1 -- 172.21.15.6:0/3472366444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683819d840 con 0x7f68381025e0 2024-09-12T00:14:14.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.989+0000 7f6837fff640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6838101c20 0x7f6838196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:14:14.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.990+0000 7f683d6bc640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68381025e0 0x7f683819d1a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6830034040 tx=0x7f6830003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:14.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.990+0000 7f6835ffb640 1 -- 172.21.15.6:0/3472366444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830041020 con 0x7f68381025e0 2024-09-12T00:14:14.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.990+0000 7f6835ffb640 1 -- 172.21.15.6:0/3472366444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6830037040 con 0x7f68381025e0 2024-09-12T00:14:14.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.990+0000 7f6835ffb640 1 -- 172.21.15.6:0/3472366444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830036070 con 0x7f68381025e0 2024-09-12T00:14:14.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.990+0000 7f683f11f640 1 -- 172.21.15.6:0/3472366444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683819dad0 con 0x7f68381025e0 2024-09-12T00:14:14.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.991+0000 7f683f11f640 1 -- 172.21.15.6:0/3472366444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f683819df40 con 0x7f68381025e0 2024-09-12T00:14:14.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.992+0000 7f683f11f640 1 -- 172.21.15.6:0/3472366444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6838100e30 con 0x7f68381025e0 2024-09-12T00:14:14.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.995+0000 7f6835ffb640 1 -- 172.21.15.6:0/3472366444 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f6830044020 con 0x7f68381025e0 2024-09-12T00:14:14.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.996+0000 7f6835ffb640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f68200a7070 0x7f68200a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:14.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.997+0000 7f6835ffb640 1 -- 172.21.15.6:0/3472366444 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f68300f0660 con 0x7f68381025e0 2024-09-12T00:14:14.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.997+0000 7f683cebb640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f68200a7070 0x7f68200a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:14.998+0000 7f683cebb640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f68200a7070 0x7f68200a9530 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6828005fd0 tx=0x7f6828005a00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.001+0000 7f6835ffb640 1 -- 172.21.15.6:0/3472366444 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f683004b020 con 0x7f68381025e0 2024-09-12T00:14:15.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:14 smithi039 ceph-mon[34543]: pgmap v806: 129 pgs: 129 active+clean; 11 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 5.4 MiB/s wr, 1.39k op/s 2024-09-12T00:14:15.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:14 smithi039 ceph-mon[34543]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:14:15.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:14 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2788321980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T00:14:15.045 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:14 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1914401285' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T00:14:15.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.347+0000 7f683f11f640 1 -- 172.21.15.6:0/3472366444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f683802d7f0 con 0x7f68381025e0 2024-09-12T00:14:15.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.349+0000 7f6835ffb640 1 -- 172.21.15.6:0/3472366444 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7f68300bd170 con 0x7f68381025e0 2024-09-12T00:14:15.347 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-09-12T00:14:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.357+0000 7f683f11f640 1 -- 172.21.15.6:0/3472366444 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f68200a7070 msgr2=0x7f68200a9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.357+0000 7f683f11f640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f68200a7070 0x7f68200a9530 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6828005fd0 tx=0x7f6828005a00 comp rx=0 tx=0).stop 2024-09-12T00:14:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.357+0000 7f683f11f640 1 -- 172.21.15.6:0/3472366444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68381025e0 msgr2=0x7f683819d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.357+0000 7f683f11f640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68381025e0 0x7f683819d1a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6830034040 tx=0x7f6830003ba0 comp rx=0 tx=0).stop 2024-09-12T00:14:15.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.359+0000 7f683f11f640 1 -- 172.21.15.6:0/3472366444 shutdown_connections 2024-09-12T00:14:15.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.359+0000 7f683f11f640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f68200a7070 0x7f68200a9530 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:15.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.359+0000 7f683f11f640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68381025e0 0x7f683819d1a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:15.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.359+0000 7f683f11f640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6838101c20 0x7f6838196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:15.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.359+0000 7f683f11f640 1 --2- 172.21.15.6:0/3472366444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6838100a30 0x7f6838195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:15.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.359+0000 7f683f11f640 1 -- 172.21.15.6:0/3472366444 >> 172.21.15.6:0/3472366444 conn(0x7f68380fc190 msgr2=0x7f6838105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:15.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.360+0000 7f683f11f640 1 -- 172.21.15.6:0/3472366444 shutdown_connections 2024-09-12T00:14:15.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.360+0000 7f683f11f640 1 -- 172.21.15.6:0/3472366444 wait complete. 2024-09-12T00:14:15.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T00:14:15.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.603+0000 7f18688a5640 1 -- 172.21.15.6:0/3717892970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1864100b30 msgr2=0x7f1864100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:15.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.603+0000 7f18688a5640 1 --2- 172.21.15.6:0/3717892970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1864100b30 0x7f1864100fb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f184c01a910 tx=0x7f184c03b500 comp rx=0 tx=0).stop 2024-09-12T00:14:15.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.604+0000 7f18688a5640 1 -- 172.21.15.6:0/3717892970 shutdown_connections 2024-09-12T00:14:15.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.604+0000 7f18688a5640 1 --2- 172.21.15.6:0/3717892970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18641014f0 0x7f1864105d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:15.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.604+0000 7f18688a5640 1 --2- 172.21.15.6:0/3717892970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1864100b30 0x7f1864100fb0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:15.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.604+0000 7f18688a5640 1 --2- 172.21.15.6:0/3717892970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18640ffa00 0x7f18640ffe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:15.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.605+0000 7f18688a5640 1 -- 172.21.15.6:0/3717892970 >> 172.21.15.6:0/3717892970 conn(0x7f18640fb4d0 msgr2=0x7f18640fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:15.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.607+0000 7f18688a5640 1 -- 172.21.15.6:0/3717892970 shutdown_connections 2024-09-12T00:14:15.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.609+0000 7f18688a5640 1 -- 172.21.15.6:0/3717892970 wait complete. 2024-09-12T00:14:15.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.610+0000 7f18688a5640 1 Processor -- start 2024-09-12T00:14:15.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.610+0000 7f18688a5640 1 -- start start 2024-09-12T00:14:15.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.611+0000 7f18688a5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18640ffa00 0x7f186406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:15.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.611+0000 7f18688a5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1864100b30 0x7f1864070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:15.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.611+0000 7f18688a5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18641014f0 0x7f18640727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:15.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.611+0000 7f18688a5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f18641095d0 con 0x7f18641014f0 2024-09-12T00:14:15.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.611+0000 7f18688a5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1864109450 con 0x7f1864100b30 2024-09-12T00:14:15.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.611+0000 7f18688a5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1864109750 con 0x7f18640ffa00 2024-09-12T00:14:15.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.613+0000 7f186259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18640ffa00 0x7f186406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:15.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.613+0000 7f186259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18640ffa00 0x7f186406dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:60578/0 (socket says 172.21.15.6:60578) 2024-09-12T00:14:15.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.613+0000 7f186259c640 1 -- 172.21.15.6:0/2516508241 learned_addr learned my addr 172.21.15.6:0/2516508241 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:14:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.613+0000 7f185bfff640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1864100b30 0x7f1864070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.615+0000 7f1862d9d640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18641014f0 0x7f18640727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.618+0000 7f185bfff640 1 -- 172.21.15.6:0/2516508241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18640ffa00 msgr2=0x7f186406dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.618+0000 7f185bfff640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18640ffa00 0x7f186406dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.618+0000 7f185bfff640 1 -- 172.21.15.6:0/2516508241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18641014f0 msgr2=0x7f18640727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.618+0000 7f185bfff640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18641014f0 0x7f18640727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.618+0000 7f185bfff640 1 -- 172.21.15.6:0/2516508241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18640730a0 con 0x7f1864100b30 2024-09-12T00:14:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.619+0000 7f185bfff640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1864100b30 0x7f1864070170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f184c006010 tx=0x7f184c004b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.622+0000 7f185b7fe640 1 -- 172.21.15.6:0/2516508241 <== mon.2 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c04f070 con 0x7f1864100b30 2024-09-12T00:14:15.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.622+0000 7f185b7fe640 1 -- 172.21.15.6:0/2516508241 <== mon.2 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f184c040d10 con 0x7f1864100b30 2024-09-12T00:14:15.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.622+0000 7f185b7fe640 1 -- 172.21.15.6:0/2516508241 <== mon.2 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c046030 con 0x7f1864100b30 2024-09-12T00:14:15.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.626+0000 7f18688a5640 1 -- 172.21.15.6:0/2516508241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1864073330 con 0x7f1864100b30 2024-09-12T00:14:15.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.626+0000 7f18688a5640 1 -- 172.21.15.6:0/2516508241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1864073850 con 0x7f1864100b30 2024-09-12T00:14:15.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.628+0000 7f18688a5640 1 -- 172.21.15.6:0/2516508241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f186410af10 con 0x7f1864100b30 2024-09-12T00:14:15.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.630+0000 7f185b7fe640 1 -- 172.21.15.6:0/2516508241 <== mon.2 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f184c052070 con 0x7f1864100b30 2024-09-12T00:14:15.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.631+0000 7f185b7fe640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f18500a2d90 0x7f18500a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:15.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.632+0000 7f185b7fe640 1 -- 172.21.15.6:0/2516508241 <== mon.2 v2:172.21.15.39:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f184c100cb0 con 0x7f1864100b30 2024-09-12T00:14:15.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.634+0000 7f186259c640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f18500a2d90 0x7f18500a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:15.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.635+0000 7f185b7fe640 1 -- 172.21.15.6:0/2516508241 <== mon.2 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f184c059030 con 0x7f1864100b30 2024-09-12T00:14:15.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:15.637+0000 7f186259c640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f18500a2d90 0x7f18500a5250 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1854009a30 tx=0x7f1854009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:15.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:15 smithi006 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:14:15.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:15 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3553695189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T00:14:15.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:15 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/3472366444' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T00:14:15.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:15 smithi134 ceph-mon[34893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:14:15.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:15 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3553695189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T00:14:15.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:15 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/3472366444' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T00:14:16.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:15 smithi039 ceph-mon[34543]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:14:16.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:15 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3553695189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T00:14:16.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:15 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/3472366444' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T00:14:16.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.072+0000 7f18688a5640 1 -- 172.21.15.6:0/2516508241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f1864073cf0 con 0x7f1864100b30 2024-09-12T00:14:16.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.089+0000 7f185b7fe640 1 -- 172.21.15.6:0/2516508241 <== mon.2 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+740356 (secure 0 0 0) 0x7f184c0cd8d0 con 0x7f1864100b30 2024-09-12T00:14:16.099 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-12T00:14:16.100 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-12T00:14:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 20, 2024-09-12T00:14:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: "active_gid": 14150, 2024-09-12T00:14:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: "active_name": "x", 2024-09-12T00:14:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: "active_addrs": { 2024-09-12T00:14:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-12T00:14:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-12T00:14:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2024-09-12T00:14:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 306795778 2024-09-12T00:14:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 306795778 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: "active_addr": "172.21.15.6:6801/306795778", 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: "active_change": "2024-09-11T23:50:00.847130+0000", 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: "available": true, 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: "standbys": [ 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: "gid": 24109, 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "z", 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_features": 4540701547738038271, 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.103 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.104 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.105 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.106 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.106 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.106 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.106 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.106 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.107 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.107 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.107 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.107 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.107 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.107 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.107 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.107 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.107 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.107 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.108 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.108 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.108 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.108 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.108 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.108 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.108 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.108 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.108 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.108 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.108 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.109 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to", 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.110 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.111 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.112 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.112 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.112 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.112 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.112 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2024-09-12T00:14:16.112 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.112 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.112 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.112 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2024-09-12T00:14:16.112 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2024-09-12T00:14:16.113 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2024-09-12T00:14:16.114 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2024-09-12T00:14:16.115 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2024-09-12T00:14:16.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.116 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.116 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.116 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.116 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.116 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.116 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T00:14:16.116 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.116 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.117 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.119 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:16.120 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:16.121 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.122 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.123 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.124 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.125 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.126 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.127 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.127 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.127 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.127 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.127 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.127 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.127 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.127 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.127 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.127 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.127 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.128 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.129 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.129 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.129 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.129 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.129 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.129 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.129 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.129 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.129 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.129 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.132 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "read", 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap", 2024-09-12T00:14:16.133 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap-read" 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.134 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.135 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-12T00:14:16.136 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.137 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.137 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T00:14:16.137 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T00:14:16.137 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.137 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.137 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2024-09-12T00:14:16.137 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2024-09-12T00:14:16.137 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:16.137 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.138 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T00:14:16.139 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T00:14:16.140 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.141 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.142 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.143 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_log_destination": { 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm_log_destination", 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: "file", 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: "file,syslog", 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: "syslog" 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2024-09-12T00:14:16.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2024-09-12T00:14:16.147 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2024-09-12T00:14:16.148 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2024-09-12T00:14:16.149 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2024-09-12T00:14:16.150 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2024-09-12T00:14:16.151 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2024-09-12T00:14:16.152 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2024-09-12T00:14:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.154 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.154 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.154 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T00:14:16.154 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.154 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.154 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.154 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2024-09-12T00:14:16.154 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.154 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.154 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.154 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2024-09-12T00:14:16.155 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2024-09-12T00:14:16.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.155 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.155 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.155 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T00:14:16.155 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.155 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.155 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.155 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2024-09-12T00:14:16.155 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.156 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.156 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.156 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2024-09-12T00:14:16.156 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2024-09-12T00:14:16.156 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.156 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.156 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.156 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.157 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.158 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.159 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T00:14:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2024-09-12T00:14:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2024-09-12T00:14:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2024-09-12T00:14:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.161 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.162 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_samba": { 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_samba", 2024-09-12T00:14:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Samba/SMB container image", 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2024-09-12T00:14:16.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.166 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T00:14:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2024-09-12T00:14:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2024-09-12T00:14:16.168 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2024-09-12T00:14:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.171 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2024-09-12T00:14:16.172 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2024-09-12T00:14:16.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.172 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.172 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.172 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.172 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.172 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.172 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.172 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T00:14:16.172 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.172 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.172 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.173 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2024-09-12T00:14:16.173 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2024-09-12T00:14:16.173 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.173 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.173 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.173 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:16.173 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.173 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "grafana_dashboards_path": { 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "grafana_dashboards_path", 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.174 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.175 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "hw_monitoring": { 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hw_monitoring", 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.176 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.177 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2024-09-12T00:14:16.180 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2024-09-12T00:14:16.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.180 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.180 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.180 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.180 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.180 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.180 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.180 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T00:14:16.180 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.180 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.180 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.181 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.182 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.183 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.184 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.185 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.186 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.187 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2024-09-12T00:14:16.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-09-12T00:14:16.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "oob_default_addr": { 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "oob_default_addr", 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "169.254.1.1", 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.192 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2024-09-12T00:14:16.193 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2024-09-12T00:14:16.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.193 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.193 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.193 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.193 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T00:14:16.193 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.193 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.194 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.194 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2024-09-12T00:14:16.194 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2024-09-12T00:14:16.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.194 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.194 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.194 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.194 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.194 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.196 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.197 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2024-09-12T00:14:16.198 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.199 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.200 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.201 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.202 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.203 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T00:14:16.203 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.203 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.203 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.203 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2024-09-12T00:14:16.203 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2024-09-12T00:14:16.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.203 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.203 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.203 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.204 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.204 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.204 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.204 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T00:14:16.204 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.204 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.204 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.205 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.206 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2024-09-12T00:14:16.206 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.206 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.206 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.206 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.206 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.206 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.206 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.207 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.208 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.208 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.208 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.208 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.208 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.208 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.208 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.210 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.211 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.214 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.215 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.216 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.217 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.218 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.219 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.220 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.220 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.220 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T00:14:16.220 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T00:14:16.220 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.220 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.220 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.220 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.220 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.220 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.220 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.221 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.222 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.223 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.224 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.225 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.227 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.228 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.229 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.230 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.231 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.232 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.234 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.235 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T00:14:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T00:14:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T00:14:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.251 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.252 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.253 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.255 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.256 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.256 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.256 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.256 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.256 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.256 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.259 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2024-09-12T00:14:16.260 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2024-09-12T00:14:16.260 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.260 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.260 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.260 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.260 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.260 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.260 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.260 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2024-09-12T00:14:16.260 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.260 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.261 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.263 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.264 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.265 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.267 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2024-09-12T00:14:16.268 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.269 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.270 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.271 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.272 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.273 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.273 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2024-09-12T00:14:16.273 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2024-09-12T00:14:16.273 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.273 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.273 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.273 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2024-09-12T00:14:16.273 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.273 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-09-12T00:14:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-09-12T00:14:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-09-12T00:14:16.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2024-09-12T00:14:16.276 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.278 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.279 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.280 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.281 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.282 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.283 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.285 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.286 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.287 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.288 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.288 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T00:14:16.288 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.288 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.288 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.288 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2024-09-12T00:14:16.288 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2024-09-12T00:14:16.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.288 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.288 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.289 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2024-09-12T00:14:16.291 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.292 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.293 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.294 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.295 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.297 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.298 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.299 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.300 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.301 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.302 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2024-09-12T00:14:16.302 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.302 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.302 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.302 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T00:14:16.302 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.302 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.302 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.302 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2024-09-12T00:14:16.302 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2024-09-12T00:14:16.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:16.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.305 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.307 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.308 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.308 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.308 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.308 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.308 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.308 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.308 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.308 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.308 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.309 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.310 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.311 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.312 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.313 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.314 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.315 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.317 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2024-09-12T00:14:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2024-09-12T00:14:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T00:14:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2024-09-12T00:14:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T00:14:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2024-09-12T00:14:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2024-09-12T00:14:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2024-09-12T00:14:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2024-09-12T00:14:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2024-09-12T00:14:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2024-09-12T00:14:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2024-09-12T00:14:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2024-09-12T00:14:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2024-09-12T00:14:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T00:14:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2024-09-12T00:14:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2024-09-12T00:14:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2024-09-12T00:14:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-09-12T00:14:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2024-09-12T00:14:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-09-12T00:14:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-09-12T00:14:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.433 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.434 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.435 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.436 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.437 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.438 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.439 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.440 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.441 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.442 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.442 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.442 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.442 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.442 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.442 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.442 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.442 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.442 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.442 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.443 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2024-09-12T00:14:16.443 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.443 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.443 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.443 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.443 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.443 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.443 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.443 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.443 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.444 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.444 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.444 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.444 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.444 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.444 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.444 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.444 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.444 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.444 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.445 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.445 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.445 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.445 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.445 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.445 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.445 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.445 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.445 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.445 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.446 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.447 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.448 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.449 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.451 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.452 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.453 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.454 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.455 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.456 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.456 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.456 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.456 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.456 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.456 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.456 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2024-09-12T00:14:16.456 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2024-09-12T00:14:16.456 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.456 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.456 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.457 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2024-09-12T00:14:16.457 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.457 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.457 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.457 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.457 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.457 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.457 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.458 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2024-09-12T00:14:16.458 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2024-09-12T00:14:16.458 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.458 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.458 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.458 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.458 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.458 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.458 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.458 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.458 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.459 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.459 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.459 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2024-09-12T00:14:16.459 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2024-09-12T00:14:16.459 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.459 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.459 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.459 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.459 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.460 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.460 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.460 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.460 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.460 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.460 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.460 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2024-09-12T00:14:16.460 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2024-09-12T00:14:16.460 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.460 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.460 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.461 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.461 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.461 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.461 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.461 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.461 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.461 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.461 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.461 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2024-09-12T00:14:16.461 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2024-09-12T00:14:16.461 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.462 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.462 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.462 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.462 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.462 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.462 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.462 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.462 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.462 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.462 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.463 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2024-09-12T00:14:16.463 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2024-09-12T00:14:16.463 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.463 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.463 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.463 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.463 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.463 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.463 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.463 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.463 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.463 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.464 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.464 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2024-09-12T00:14:16.464 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2024-09-12T00:14:16.464 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.464 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.464 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.464 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.464 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.464 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.464 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.465 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.465 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.465 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.465 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.465 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2024-09-12T00:14:16.465 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2024-09-12T00:14:16.465 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.465 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.465 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.465 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.466 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-12T00:14:16.466 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2024-09-12T00:14:16.466 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.466 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.466 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.466 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.466 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.466 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2024-09-12T00:14:16.466 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2024-09-12T00:14:16.466 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2024-09-12T00:14:16.468 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2024-09-12T00:14:16.468 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.468 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.468 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.468 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.468 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.468 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.468 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.468 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.468 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.468 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.469 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.469 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2024-09-12T00:14:16.469 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2024-09-12T00:14:16.469 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.469 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.469 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.469 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.469 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.469 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.469 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.470 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.470 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.470 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.470 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.470 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.470 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.470 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2024-09-12T00:14:16.470 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.470 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.470 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.471 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2024-09-12T00:14:16.471 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2024-09-12T00:14:16.471 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.471 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.471 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.471 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.471 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.471 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.471 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.471 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T00:14:16.471 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2024-09-12T00:14:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2024-09-12T00:14:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.473 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.473 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2024-09-12T00:14:16.473 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.473 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.473 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.473 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.473 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.473 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.473 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.473 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.474 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.474 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.474 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.474 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.474 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.474 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.474 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.474 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.474 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.475 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.476 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.476 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.476 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.476 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.476 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.476 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.476 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.476 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.476 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.476 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.476 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.477 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.478 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.479 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.481 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.482 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.483 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.484 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.485 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2024-09-12T00:14:16.485 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.485 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.485 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.485 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.485 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.485 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.485 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.485 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.485 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.486 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.486 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.486 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.486 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.486 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.486 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.486 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.486 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.486 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.486 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.486 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.486 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2024-09-12T00:14:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.492 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2024-09-12T00:14:16.492 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2024-09-12T00:14:16.492 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.492 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.492 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.492 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T00:14:16.492 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.492 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.492 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.492 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2024-09-12T00:14:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.494 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.494 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.494 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.494 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.494 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.494 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.494 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.494 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.494 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.494 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.494 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.495 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.495 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.495 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.495 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.495 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.495 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.495 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.495 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.495 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.495 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.495 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.495 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.496 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.496 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.496 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.496 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.496 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.496 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.496 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.496 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.496 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.496 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.497 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.498 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.498 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.498 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.498 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.498 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.498 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.498 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.498 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.498 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.498 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.498 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.498 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.499 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.499 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.499 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.499 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.499 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.499 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.499 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.499 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.499 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.499 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.500 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.500 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.500 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.500 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.500 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.500 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.500 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2024-09-12T00:14:16.500 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.501 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.501 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.501 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2024-09-12T00:14:16.501 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2024-09-12T00:14:16.501 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.501 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.501 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.501 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.501 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.501 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.501 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.502 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T00:14:16.502 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.502 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.502 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.502 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2024-09-12T00:14:16.502 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2024-09-12T00:14:16.502 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.502 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.502 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.502 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.503 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.503 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.503 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.503 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T00:14:16.503 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.503 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.503 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.503 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2024-09-12T00:14:16.503 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2024-09-12T00:14:16.503 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.503 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.504 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.505 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.506 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.508 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.508 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.508 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.508 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.508 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.508 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.508 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.508 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.508 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.508 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.508 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-09-12T00:14:16.510 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-09-12T00:14:16.510 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.510 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.510 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.510 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.510 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.510 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.510 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.510 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.510 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.510 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.510 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.511 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.512 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.513 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.514 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.515 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.516 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.516 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.516 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.516 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.516 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.516 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.516 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.516 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.516 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.516 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.516 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.518 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.518 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.518 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.518 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.518 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.518 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.518 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.518 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.518 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.518 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.518 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.519 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.519 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.519 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.519 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.519 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.519 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.519 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.519 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.519 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.519 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.519 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.520 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.520 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.520 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.520 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.520 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.520 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.520 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.520 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.520 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.520 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.520 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.520 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.521 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2024-09-12T00:14:16.521 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2024-09-12T00:14:16.521 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.521 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.521 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.521 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.521 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.521 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.521 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.521 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.522 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.522 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.522 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.522 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2024-09-12T00:14:16.522 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2024-09-12T00:14:16.522 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.522 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.522 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.522 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.522 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.522 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.523 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.523 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.523 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.523 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.523 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.523 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2024-09-12T00:14:16.523 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2024-09-12T00:14:16.523 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.523 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.524 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.524 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T00:14:16.524 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.524 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.524 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.524 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.524 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.524 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.524 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.525 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2024-09-12T00:14:16.525 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.525 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.525 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.525 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.525 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.525 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.525 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.525 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.525 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.526 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.526 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.526 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.526 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.526 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.526 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.526 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.526 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.526 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.526 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.526 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.527 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.527 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.527 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.527 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.527 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.527 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.527 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.527 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.527 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.527 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2024-09-12T00:14:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "periodic_async_work": { 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "periodic_async_work", 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Periodically check for async work", 2024-09-12T00:14:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2024-09-12T00:14:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2024-09-12T00:14:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T00:14:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_no_wait": { 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.548 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.548 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.548 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.548 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.548 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.548 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.548 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.548 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.548 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.548 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.549 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.549 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.549 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.549 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.549 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.549 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.549 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.549 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.549 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.549 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.549 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.552 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2024-09-12T00:14:16.552 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2024-09-12T00:14:16.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.552 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.552 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.552 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.552 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.552 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.552 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.552 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.552 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.553 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.553 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.553 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2024-09-12T00:14:16.553 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2024-09-12T00:14:16.553 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.553 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.553 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.553 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2024-09-12T00:14:16.553 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.553 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.553 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.554 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.554 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.554 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.554 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.554 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2024-09-12T00:14:16.554 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2024-09-12T00:14:16.554 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.554 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.554 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.554 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T00:14:16.554 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.555 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.555 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.555 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.555 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.555 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.555 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.555 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-12T00:14:16.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.556 INFO:teuthology.orchestra.run.smithi006.stdout: "gid": 24116, 2024-09-12T00:14:16.556 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "y", 2024-09-12T00:14:16.556 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_features": 4540701547738038271, 2024-09-12T00:14:16.556 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2024-09-12T00:14:16.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.556 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2024-09-12T00:14:16.556 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.556 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.556 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T00:14:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.558 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.558 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.558 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.558 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.558 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.558 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.558 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.558 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.558 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.558 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.559 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.559 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.559 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.559 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.559 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.559 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.559 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.559 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.559 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.559 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.559 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.560 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.560 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.560 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.560 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.560 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.560 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.560 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.560 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.560 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.560 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.561 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.561 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.561 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.561 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.561 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.561 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.561 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.561 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.562 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.562 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.562 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.562 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.562 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.562 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.562 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.562 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.562 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.562 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.562 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.562 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.563 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.564 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to", 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.565 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.566 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.567 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.570 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2024-09-12T00:14:16.573 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2024-09-12T00:14:16.574 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.574 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.574 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.574 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2024-09-12T00:14:16.574 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.574 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.574 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.574 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T00:14:16.574 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.575 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T00:14:16.576 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T00:14:16.576 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.576 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.576 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2024-09-12T00:14:16.576 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2024-09-12T00:14:16.576 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:16.576 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.576 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.576 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2024-09-12T00:14:16.576 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.577 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.578 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.579 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.581 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.585 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.586 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.587 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2024-09-12T00:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2024-09-12T00:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2024-09-12T00:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: "read", 2024-09-12T00:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap", 2024-09-12T00:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap-read" 2024-09-12T00:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2024-09-12T00:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.589 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.590 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.591 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.592 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2024-09-12T00:14:16.593 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2024-09-12T00:14:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.595 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.598 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.599 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_log_destination": { 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm_log_destination", 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "file", 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "file,syslog", 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "syslog" 2024-09-12T00:14:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T00:14:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2024-09-12T00:14:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2024-09-12T00:14:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.604 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.604 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.604 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.604 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T00:14:16.604 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.604 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.604 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.604 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2024-09-12T00:14:16.604 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2024-09-12T00:14:16.604 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.604 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2024-09-12T00:14:16.605 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2024-09-12T00:14:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2024-09-12T00:14:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.610 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2024-09-12T00:14:16.610 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2024-09-12T00:14:16.610 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.610 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.610 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.610 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T00:14:16.610 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.610 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.610 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.610 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2024-09-12T00:14:16.610 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.610 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2024-09-12T00:14:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2024-09-12T00:14:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T00:14:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.613 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.614 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.615 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.616 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.617 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.618 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_samba": { 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_samba", 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.619 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Samba/SMB container image", 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.620 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.621 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.622 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T00:14:16.622 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.622 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.622 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.622 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2024-09-12T00:14:16.622 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2024-09-12T00:14:16.622 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.622 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.622 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.622 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:16.622 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2024-09-12T00:14:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.624 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.625 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.626 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "grafana_dashboards_path": { 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "grafana_dashboards_path", 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.628 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.629 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "hw_monitoring": { 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hw_monitoring", 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.630 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.631 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.633 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: "oob_default_addr": { 2024-09-12T00:14:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "oob_default_addr", 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "169.254.1.1", 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2024-09-12T00:14:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2024-09-12T00:14:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.647 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.648 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.649 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2024-09-12T00:14:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2024-09-12T00:14:16.651 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.652 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2024-09-12T00:14:16.653 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2024-09-12T00:14:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2024-09-12T00:14:16.655 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2024-09-12T00:14:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2024-09-12T00:14:16.657 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.660 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.660 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.660 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.660 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.660 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.660 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.660 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.660 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.660 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.660 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.660 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.661 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.662 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.663 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.664 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.664 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.664 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.664 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.664 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.664 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.664 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2024-09-12T00:14:16.664 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2024-09-12T00:14:16.664 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.664 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.664 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2024-09-12T00:14:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T00:14:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2024-09-12T00:14:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2024-09-12T00:14:16.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.668 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.669 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T00:14:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T00:14:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T00:14:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T00:14:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2024-09-12T00:14:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T00:14:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T00:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T00:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T00:14:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T00:14:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T00:14:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T00:14:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T00:14:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T00:14:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T00:14:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T00:14:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T00:14:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2024-09-12T00:14:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2024-09-12T00:14:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2024-09-12T00:14:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2024-09-12T00:14:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T00:14:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2024-09-12T00:14:16.753 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2024-09-12T00:14:16.754 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.755 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.755 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.755 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2024-09-12T00:14:16.755 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.755 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.755 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.755 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T00:14:16.755 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.755 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.755 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.755 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.758 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.759 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.760 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.762 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.763 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.764 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.765 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.766 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.767 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T00:14:16.768 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.769 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.770 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.771 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.772 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.773 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.774 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.775 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.776 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.777 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.778 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2024-09-12T00:14:16.780 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2024-09-12T00:14:16.781 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.782 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.784 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.785 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.786 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.788 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.789 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.791 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.793 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.794 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.795 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2024-09-12T00:14:16.796 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.796 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.796 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.796 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2024-09-12T00:14:16.796 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2024-09-12T00:14:16.796 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.796 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.796 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.796 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.797 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.798 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2024-09-12T00:14:16.799 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.800 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.804 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.804 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.804 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.804 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.804 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.804 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.804 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.804 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.804 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.804 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.804 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.805 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.806 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.807 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.808 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.809 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.810 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.811 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.812 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.814 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.815 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.815 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.815 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.815 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.815 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.815 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.815 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.816 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.817 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T00:14:16.818 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.819 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.820 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.821 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.822 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2024-09-12T00:14:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.825 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.826 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.827 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.829 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.830 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.832 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.834 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.836 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.836 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.836 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.836 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.836 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.836 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.836 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.836 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.836 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.836 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.836 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.836 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.837 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.839 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.841 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.841 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.841 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.841 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.841 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.841 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.841 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.841 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.841 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.841 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.841 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2024-09-12T00:14:16.843 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.845 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.846 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.847 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.848 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.849 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.850 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.851 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2024-09-12T00:14:16.852 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2024-09-12T00:14:16.853 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2024-09-12T00:14:16.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2024-09-12T00:14:16.855 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.856 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.858 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.859 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.860 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2024-09-12T00:14:16.861 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T00:14:16.862 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2024-09-12T00:14:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-12T00:14:16.864 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-12T00:14:16.865 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2024-09-12T00:14:16.866 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.867 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.867 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.867 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2024-09-12T00:14:16.867 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.867 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.867 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.867 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.867 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.867 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.867 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.867 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.869 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.870 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.871 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.872 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.873 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.874 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.875 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.876 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.877 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2024-09-12T00:14:16.878 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.879 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.880 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.881 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.882 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.883 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.884 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.886 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.887 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.888 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.889 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.890 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.891 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.893 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.893 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.893 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.893 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.893 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.894 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.895 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.896 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.896 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.896 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.896 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.896 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.896 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.896 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.896 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.896 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.896 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.896 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.897 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.899 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.900 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.904 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.905 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.906 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.908 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.909 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.910 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.911 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.912 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.913 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.915 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.917 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2024-09-12T00:14:16.918 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.919 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.920 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.921 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.922 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.923 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.925 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.926 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.929 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.930 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.931 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.932 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.933 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.934 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.935 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.936 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.937 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.938 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.939 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.940 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.942 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.943 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.944 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.945 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2024-09-12T00:14:16.946 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2024-09-12T00:14:16.947 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.948 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.949 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.950 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2024-09-12T00:14:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2024-09-12T00:14:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T00:14:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.959 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.960 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.961 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2024-09-12T00:14:16.962 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2024-09-12T00:14:16.963 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2024-09-12T00:14:16.964 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.966 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.967 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.968 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.969 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.970 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.971 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.972 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.972 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.972 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.972 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.972 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.972 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.972 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.972 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.972 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.972 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.972 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.973 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.974 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.975 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.976 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "periodic_async_work": { 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "periodic_async_work", 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Periodically check for async work", 2024-09-12T00:14:16.978 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.979 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_no_wait": { 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.980 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2024-09-12T00:14:16.981 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2024-09-12T00:14:16.982 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:16.983 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.984 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.985 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2024-09-12T00:14:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2024-09-12T00:14:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2024-09-12T00:14:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "modules": [ 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "dashboard", 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "iostat", 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "nfs", 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "restful" 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T00:14:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to", 2024-09-12T00:14:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "read", 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap", 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap-read" 2024-09-12T00:14:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2024-09-12T00:14:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2024-09-12T00:14:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2024-09-12T00:14:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T00:14:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_log_destination": { 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm_log_destination", 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "file", 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "file,syslog", 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "syslog" 2024-09-12T00:14:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-12T00:14:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-12T00:14:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2024-09-12T00:14:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2024-09-12T00:14:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2024-09-12T00:14:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T00:14:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T00:14:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T00:14:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T00:14:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T00:14:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_samba": { 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_samba", 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Samba/SMB container image", 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2024-09-12T00:14:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2024-09-12T00:14:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2024-09-12T00:14:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2024-09-12T00:14:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2024-09-12T00:14:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "grafana_dashboards_path": { 2024-09-12T00:14:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "grafana_dashboards_path", 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2024-09-12T00:14:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2024-09-12T00:14:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2024-09-12T00:14:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "hw_monitoring": { 2024-09-12T00:14:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hw_monitoring", 2024-09-12T00:14:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T00:14:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T00:14:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2024-09-12T00:14:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2024-09-12T00:14:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T00:14:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "oob_default_addr": { 2024-09-12T00:14:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "oob_default_addr", 2024-09-12T00:14:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "169.254.1.1", 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2024-09-12T00:14:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2024-09-12T00:14:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T00:14:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T00:14:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T00:14:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T00:14:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2024-09-12T00:14:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T00:14:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T00:14:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T00:14:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T00:14:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T00:14:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T00:14:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T00:14:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T00:14:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T00:14:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T00:14:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T00:14:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T00:14:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T00:14:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2024-09-12T00:14:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2024-09-12T00:14:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2024-09-12T00:14:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2024-09-12T00:14:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2024-09-12T00:14:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2024-09-12T00:14:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2024-09-12T00:14:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-09-12T00:14:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.213 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.214 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.215 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.216 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.217 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.218 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.221 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2024-09-12T00:14:17.221 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.224 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T00:14:17.225 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.226 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.227 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.230 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2024-09-12T00:14:17.231 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2024-09-12T00:14:17.232 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2024-09-12T00:14:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T00:14:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.236 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.237 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.237 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.237 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.237 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.237 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.237 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.237 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.237 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.237 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.237 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.237 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.237 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.239 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.240 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.242 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.243 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.244 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.245 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.246 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.248 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.249 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.250 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.252 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.252 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.252 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.252 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.252 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.252 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.252 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.252 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.252 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.252 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T00:14:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.256 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.257 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.259 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2024-09-12T00:14:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.261 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.262 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.263 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.264 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.265 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.267 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.268 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.269 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.270 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.271 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.272 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.273 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.274 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.275 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.277 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.278 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2024-09-12T00:14:17.279 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.281 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.282 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.283 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.284 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.285 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.286 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.287 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.288 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.289 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.290 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.291 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.292 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.293 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.294 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.295 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.296 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2024-09-12T00:14:17.297 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2024-09-12T00:14:17.298 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.299 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-12T00:14:17.303 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.304 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.305 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.306 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.307 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.309 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.311 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.312 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.313 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.314 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.316 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.317 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.318 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.319 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.320 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.321 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.322 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.323 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.324 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.325 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.326 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.327 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.328 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.329 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.331 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.332 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.333 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.334 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.337 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.338 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.339 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.340 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.341 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.342 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.343 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.345 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.346 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2024-09-12T00:14:17.347 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.348 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.349 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.350 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.351 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2024-09-12T00:14:17.352 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.353 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.354 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.355 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.356 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.357 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2024-09-12T00:14:17.358 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.359 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.360 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.361 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.362 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.363 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.364 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.364 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.364 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.364 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2024-09-12T00:14:17.364 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.364 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.364 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.364 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.364 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.364 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.365 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.366 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.367 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.368 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2024-09-12T00:14:17.369 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.370 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.371 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.372 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.373 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.375 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.377 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.380 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.381 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.382 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.383 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.384 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.385 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T00:14:17.386 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2024-09-12T00:14:17.388 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2024-09-12T00:14:17.389 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.390 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.391 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.393 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.394 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.395 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.396 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.397 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.398 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.399 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.400 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.401 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.402 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.403 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.404 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.406 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.408 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.409 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.410 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.411 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "periodic_async_work": { 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "periodic_async_work", 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.412 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Periodically check for async work", 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.413 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_no_wait": { 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.414 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2024-09-12T00:14:17.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2024-09-12T00:14:17.416 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-12T00:14:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-12T00:14:17.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.419 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-12T00:14:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.422 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.423 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.424 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-12T00:14:17.425 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: "services": { 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: "dashboard": "https://172.21.15.6:8443/" 2024-09-12T00:14:17.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "always_on_modules": { 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "octopus": [ 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "pacific": [ 2024-09-12T00:14:17.427 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "quincy": [ 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-09-12T00:14:17.428 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "reef": [ 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-09-12T00:14:17.429 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "squid": [ 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-09-12T00:14:17.430 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: "last_failure_osd_epoch": 3, 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: "active_clients": [ 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3044448245 2024-09-12T00:14:17.431 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "libcephsqlite", 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 107871561 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.432 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 74966729 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-09-12T00:14:17.433 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 395009638 2024-09-12T00:14:17.434 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.434 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-12T00:14:17.434 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:17.434 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-12T00:14:17.434 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-12T00:14:17.435 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:16 smithi039 ceph-mon[34543]: pgmap v807: 129 pgs: 129 active+clean; 9.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 5.2 MiB/s wr, 1.39k op/s 2024-09-12T00:14:17.435 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:16 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2516508241' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T00:14:17.435 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:16 smithi134 ceph-mon[34893]: pgmap v807: 129 pgs: 129 active+clean; 9.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 5.2 MiB/s wr, 1.39k op/s 2024-09-12T00:14:17.435 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:16 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2516508241' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T00:14:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.097+0000 7f18688a5640 1 -- 172.21.15.6:0/2516508241 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f18500a2d90 msgr2=0x7f18500a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.097+0000 7f18688a5640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f18500a2d90 0x7f18500a5250 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1854009a30 tx=0x7f1854009190 comp rx=0 tx=0).stop 2024-09-12T00:14:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.098+0000 7f18688a5640 1 -- 172.21.15.6:0/2516508241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1864100b30 msgr2=0x7f1864070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.098+0000 7f18688a5640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1864100b30 0x7f1864070170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f184c006010 tx=0x7f184c004b90 comp rx=0 tx=0).stop 2024-09-12T00:14:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.098+0000 7f18688a5640 1 -- 172.21.15.6:0/2516508241 shutdown_connections 2024-09-12T00:14:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.098+0000 7f18688a5640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f18500a2d90 0x7f18500a5250 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.098+0000 7f18688a5640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18641014f0 0x7f18640727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.098+0000 7f18688a5640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1864100b30 0x7f1864070170 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.098+0000 7f18688a5640 1 --2- 172.21.15.6:0/2516508241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18640ffa00 0x7f186406dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:17.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.099+0000 7f18688a5640 1 -- 172.21.15.6:0/2516508241 >> 172.21.15.6:0/2516508241 conn(0x7f18640fb4d0 msgr2=0x7f18641040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:17.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.099+0000 7f18688a5640 1 -- 172.21.15.6:0/2516508241 shutdown_connections 2024-09-12T00:14:17.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:16.099+0000 7f18688a5640 1 -- 172.21.15.6:0/2516508241 wait complete. 2024-09-12T00:14:17.444 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T00:14:17.444 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T00:14:17.445 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:16 smithi006 ceph-mon[30947]: pgmap v807: 129 pgs: 129 active+clean; 9.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 5.2 MiB/s wr, 1.39k op/s 2024-09-12T00:14:17.445 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:16 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2516508241' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T00:14:17.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:17 smithi006 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:14:17.914 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:14:17.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:17 smithi134 ceph-mon[34893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:14:18.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:17 smithi039 ceph-mon[34543]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:14:18.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:18 smithi006 ceph-mon[30947]: pgmap v808: 129 pgs: 129 active+clean; 8.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 1.0 MiB/s wr, 366 op/s 2024-09-12T00:14:18.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:18 smithi134 ceph-mon[34893]: pgmap v808: 129 pgs: 129 active+clean; 8.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 1.0 MiB/s wr, 366 op/s 2024-09-12T00:14:19.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:18 smithi039 ceph-mon[34543]: pgmap v808: 129 pgs: 129 active+clean; 8.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 1.0 MiB/s wr, 366 op/s 2024-09-12T00:14:20.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:20 smithi006 ceph-mon[30947]: pgmap v809: 129 pgs: 129 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 743 KiB/s wr, 334 op/s 2024-09-12T00:14:20.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:20 smithi134 ceph-mon[34893]: pgmap v809: 129 pgs: 129 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 743 KiB/s wr, 334 op/s 2024-09-12T00:14:21.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:20 smithi039 ceph-mon[34543]: pgmap v809: 129 pgs: 129 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 743 KiB/s wr, 334 op/s 2024-09-12T00:14:21.408 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-12T00:14:21.408 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:14:21.408 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1307, 2024-09-12T00:14:21.408 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 1290, 2024-09-12T00:14:21.408 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 1196752, 2024-09-12T00:14:21.408 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 493000, 2024-09-12T00:14:21.408 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 5, 2024-09-12T00:14:21.408 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2024-09-12T00:14:21.408 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.142850853, 2024-09-12T00:14:21.408 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.050712410, 2024-09-12T00:14:21.409 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.059273284, 2024-09-12T00:14:21.409 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.029849821, 2024-09-12T00:14:21.409 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:21.409 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 1290, 2024-09-12T00:14:21.409 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.127316529, 2024-09-12T00:14:21.409 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000098694 2024-09-12T00:14:21.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.409 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 862096, 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 176272 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 901, 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 1115, 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 222126, 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 823038, 2024-09-12T00:14:21.410 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 7, 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 4, 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.090145871, 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.031995504, 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.018449044, 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.029335969, 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 1113, 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.079704569, 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000071612 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.411 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.412 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:14:21.412 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 537088 2024-09-12T00:14:21.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.412 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:14:21.412 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1014, 2024-09-12T00:14:21.412 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 1016, 2024-09-12T00:14:21.412 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 1412910, 2024-09-12T00:14:21.412 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 322453, 2024-09-12T00:14:21.412 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 5, 2024-09-12T00:14:21.412 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 3, 2024-09-12T00:14:21.412 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.080803405, 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.024320809, 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.025147738, 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.023129992, 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 1014, 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.054675249, 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000053920 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.413 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:14:21.414 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:14:21.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.414 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2024-09-12T00:14:21.414 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 1, 2024-09-12T00:14:21.414 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2024-09-12T00:14:21.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.414 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-MDSRank": { 2024-09-12T00:14:21.414 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2024-09-12T00:14:21.414 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2024-09-12T00:14:21.414 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 4769, 2024-09-12T00:14:21.414 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.148827604, 2024-09-12T00:14:21.414 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000031207 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-PurgeQueue": { 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: "request": 0, 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: "reply": 0, 2024-09-12T00:14:21.415 INFO:teuthology.orchestra.run.smithi006.stdout: "reply_latency": { 2024-09-12T00:14:21.416 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.416 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.416 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.416 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_reply": 0, 2024-09-12T00:14:21.416 INFO:teuthology.orchestra.run.smithi006.stdout: "forward": 0, 2024-09-12T00:14:21.416 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_complete": 0, 2024-09-12T00:14:21.416 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_keys": 0, 2024-09-12T00:14:21.416 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_commit": 0, 2024-09-12T00:14:21.416 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_split": 0, 2024-09-12T00:14:21.416 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_merge": 0, 2024-09-12T00:14:21.416 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes": 119, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_top": 0, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_bottom": 119, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pin_tail": 0, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pinned": 119, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_expired": 1, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_with_caps": 0, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": 0, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "subtrees": 1, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse": 0, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_hit": 0, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_forward": 0, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_discover": 0, 2024-09-12T00:14:21.417 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_remote_ino": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_lock": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "load_cent": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "q": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "exported": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "exported_inodes": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "imported": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "imported_inodes": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_dir_fetch": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_peer_discover": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rfiles": 0, 2024-09-12T00:14:21.418 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rbytes": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rsnaps": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_set_tag": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_file_inodes": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_grant": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:14:21.419 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps": 0, 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_cap_release": 0, 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "process_request_cap_release": 0 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache": { 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update": 0, 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update_receipt": 0, 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_try_discover": 0, 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_send_discover": 0, 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_handle_discover": 0, 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays": 0, 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_delayed": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_created": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_enqueued": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_reintegrated": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_migrated": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_processing": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_started": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_completed": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:14:21.421 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_exportdir": 0, 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_flush": 0, 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragstats": 0, 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_inodestats": 0 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log": { 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "evlrg": 0, 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "evadd": 0, 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "evex": 0, 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "evtrm": 0, 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "ev": 438, 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "evexg": 0, 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "evexd": 0, 2024-09-12T00:14:21.422 INFO:teuthology.orchestra.run.smithi006.stdout: "segadd": 0, 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "segex": 0, 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "segtrm": 0, 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "seg": 2, 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "segmjr": 2, 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "segexg": 0, 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "segexd": 0, 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "expos": 4194304, 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "wrpos": 5341777, 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "rdpos": 5340126, 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "jlat": { 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "replayed": 438 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_mem": { 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 4, 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "ino+": 135, 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "ino-": 131, 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "dir": 2, 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "dir+": 75, 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "dir-": 73, 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "dn": 119, 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "dn+": 309, 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "dn-": 190, 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "cap": 0, 2024-09-12T00:14:21.424 INFO:teuthology.orchestra.run.smithi006.stdout: "cap+": 0, 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "cap-": 0, 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "rss": 50936, 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "heap": 215328 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_server": { 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_client_request": 0, 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_server_request": 0, 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_request": 0, 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_session": 0, 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_peer_request": 0, 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "req_create_latency": { 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.425 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getattr_latency": { 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getfilelock_latency": { 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: "req_link_latency": { 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.426 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookup_latency": { 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookuphash_latency": { 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupino_latency": { 2024-09-12T00:14:21.427 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupname_latency": { 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupparent_latency": { 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.428 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupsnap_latency": { 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lssnap_latency": { 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mkdir_latency": { 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mknod_latency": { 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mksnap_latency": { 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: "req_open_latency": { 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.430 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: "req_readdir_latency": { 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rename_latency": { 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: "req_renamesnap_latency": { 2024-09-12T00:14:21.431 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: "req_snapdiff_latency": { 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmdir_latency": { 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmsnap_latency": { 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmxattr_latency": { 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setattr_latency": { 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.433 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setdirlayout_latency": { 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setfilelock_latency": { 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setlayout_latency": { 2024-09-12T00:14:21.434 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setxattr_latency": { 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: "req_symlink_latency": { 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.435 INFO:teuthology.orchestra.run.smithi006.stdout: "req_unlink_latency": { 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getvxattr_latency": { 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.436 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_sessions": { 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "session_count": 1, 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "session_add": 1, 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "session_remove": 0, 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_open": 1, 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_stale": 0, 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "total_load": 0, 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "average_load": 0, 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "avg_session_uptime": 1972, 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "mdthresh_evicted": 0 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2024-09-12T00:14:21.437 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:14:21.438 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2024-09-12T00:14:21.439 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:14:21.439 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2024-09-12T00:14:21.439 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:14:21.439 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:14:21.439 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:14:21.439 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:14:21.439 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:14:21.439 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:14:21.439 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:14:21.439 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2024-09-12T00:14:21.439 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:14:21.439 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:14:21.440 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:14:21.440 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2024-09-12T00:14:21.440 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2024-09-12T00:14:21.440 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2024-09-12T00:14:21.440 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:14:21.440 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:14:21.440 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:14:21.440 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:14:21.440 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 191222, 2024-09-12T00:14:21.440 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 53, 2024-09-12T00:14:21.440 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:14:21.441 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2024-09-12T00:14:21.441 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2024-09-12T00:14:21.441 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2024-09-12T00:14:21.441 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:14:21.441 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2024-09-12T00:14:21.441 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:14:21.441 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2024-09-12T00:14:21.441 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 9144, 2024-09-12T00:14:21.441 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 172, 2024-09-12T00:14:21.441 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:14:21.441 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:14:21.442 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2024-09-12T00:14:21.442 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2024-09-12T00:14:21.442 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 95824, 2024-09-12T00:14:21.442 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 504, 2024-09-12T00:14:21.442 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2024-09-12T00:14:21.442 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2024-09-12T00:14:21.442 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2024-09-12T00:14:21.442 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2024-09-12T00:14:21.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.442 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter": { 2024-09-12T00:14:21.442 INFO:teuthology.orchestra.run.smithi006.stdout: "op_active": 0, 2024-09-12T00:14:21.443 INFO:teuthology.orchestra.run.smithi006.stdout: "op_laggy": 0, 2024-09-12T00:14:21.443 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send": 2909, 2024-09-12T00:14:21.443 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send_bytes": 21, 2024-09-12T00:14:21.443 INFO:teuthology.orchestra.run.smithi006.stdout: "op_resend": 3, 2024-09-12T00:14:21.443 INFO:teuthology.orchestra.run.smithi006.stdout: "op_reply": 2909, 2024-09-12T00:14:21.443 INFO:teuthology.orchestra.run.smithi006.stdout: "op_latency": { 2024-09-12T00:14:21.443 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2909, 2024-09-12T00:14:21.443 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 3.167969011, 2024-09-12T00:14:21.443 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.001089023 2024-09-12T00:14:21.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.443 INFO:teuthology.orchestra.run.smithi006.stdout: "op_inflight": 0, 2024-09-12T00:14:21.444 INFO:teuthology.orchestra.run.smithi006.stdout: "oplen_avg": { 2024-09-12T00:14:21.444 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2909, 2024-09-12T00:14:21.444 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 2910 2024-09-12T00:14:21.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.444 INFO:teuthology.orchestra.run.smithi006.stdout: "op": 2909, 2024-09-12T00:14:21.444 INFO:teuthology.orchestra.run.smithi006.stdout: "op_r": 2909, 2024-09-12T00:14:21.444 INFO:teuthology.orchestra.run.smithi006.stdout: "op_w": 0, 2024-09-12T00:14:21.444 INFO:teuthology.orchestra.run.smithi006.stdout: "op_rmw": 0, 2024-09-12T00:14:21.444 INFO:teuthology.orchestra.run.smithi006.stdout: "op_pg": 0, 2024-09-12T00:14:21.444 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_stat": 1892, 2024-09-12T00:14:21.444 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_create": 0, 2024-09-12T00:14:21.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_read": 1015, 2024-09-12T00:14:21.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_write": 0, 2024-09-12T00:14:21.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writefull": 0, 2024-09-12T00:14:21.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writesame": 0, 2024-09-12T00:14:21.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_append": 0, 2024-09-12T00:14:21.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_zero": 0, 2024-09-12T00:14:21.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_truncate": 0, 2024-09-12T00:14:21.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_delete": 0, 2024-09-12T00:14:21.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_mapext": 0, 2024-09-12T00:14:21.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_sparse_read": 0, 2024-09-12T00:14:21.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_clonerange": 0, 2024-09-12T00:14:21.446 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_getxattr": 1, 2024-09-12T00:14:21.446 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_setxattr": 0, 2024-09-12T00:14:21.446 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:14:21.446 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_rmxattr": 0, 2024-09-12T00:14:21.446 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:14:21.446 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_call": 0, 2024-09-12T00:14:21.446 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_watch": 0, 2024-09-12T00:14:21.446 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_notify": 0, 2024-09-12T00:14:21.446 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:14:21.446 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls": 0, 2024-09-12T00:14:21.446 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:14:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_other": 0, 2024-09-12T00:14:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_active": 0, 2024-09-12T00:14:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_send": 0, 2024-09-12T00:14:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_resend": 0, 2024-09-12T00:14:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_ping": 0, 2024-09-12T00:14:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_active": 0, 2024-09-12T00:14:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_send": 0, 2024-09-12T00:14:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_resend": 0, 2024-09-12T00:14:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_active": 0, 2024-09-12T00:14:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_send": 0, 2024-09-12T00:14:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_resend": 0, 2024-09-12T00:14:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_active": 0, 2024-09-12T00:14:21.448 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_send": 0, 2024-09-12T00:14:21.448 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_resend": 0, 2024-09-12T00:14:21.448 INFO:teuthology.orchestra.run.smithi006.stdout: "command_active": 0, 2024-09-12T00:14:21.448 INFO:teuthology.orchestra.run.smithi006.stdout: "command_send": 0, 2024-09-12T00:14:21.448 INFO:teuthology.orchestra.run.smithi006.stdout: "command_resend": 0, 2024-09-12T00:14:21.448 INFO:teuthology.orchestra.run.smithi006.stdout: "map_epoch": 90, 2024-09-12T00:14:21.448 INFO:teuthology.orchestra.run.smithi006.stdout: "map_full": 0, 2024-09-12T00:14:21.448 INFO:teuthology.orchestra.run.smithi006.stdout: "map_inc": 4, 2024-09-12T00:14:21.448 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_sessions": 5, 2024-09-12T00:14:21.448 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_open": 7, 2024-09-12T00:14:21.449 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_close": 2, 2024-09-12T00:14:21.449 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_laggy": 0, 2024-09-12T00:14:21.449 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_wr": 0, 2024-09-12T00:14:21.449 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_rd": 2, 2024-09-12T00:14:21.449 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_del": 0 2024-09-12T00:14:21.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.449 INFO:teuthology.orchestra.run.smithi006.stdout: "oft": { 2024-09-12T00:14:21.449 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_objs": 0, 2024-09-12T00:14:21.449 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:14:21.449 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_updates": 0, 2024-09-12T00:14:21.450 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_removes": 0 2024-09-12T00:14:21.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.450 INFO:teuthology.orchestra.run.smithi006.stdout: "osd-slow-ops": { 2024-09-12T00:14:21.450 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_ops_count": 0 2024-09-12T00:14:21.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.450 INFO:teuthology.orchestra.run.smithi006.stdout: "purge_queue": { 2024-09-12T00:14:21.450 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops": 0, 2024-09-12T00:14:21.450 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T00:14:21.450 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing": 0, 2024-09-12T00:14:21.450 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_high_water": 0, 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executed_ops": 0, 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executed": 0, 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_item_in_journal": 0 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 3218, 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 2523396, 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 3218, 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-09-12T00:14:21.451 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 3218, 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 2523396, 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_bytes": { 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-12T00:14:21.452 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-09-12T00:14:21.453 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-09-12T00:14:21.453 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:21.453 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:21.453 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 2909, 2024-09-12T00:14:21.453 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 1147478, 2024-09-12T00:14:21.453 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 2909, 2024-09-12T00:14:21.453 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 1147478, 2024-09-12T00:14:21.453 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-12T00:14:21.454 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.454 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.454 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.454 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:21.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.454 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_ops": { 2024-09-12T00:14:21.454 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-12T00:14:21.454 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 1024, 2024-09-12T00:14:21.454 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-12T00:14:21.454 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-09-12T00:14:21.454 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-09-12T00:14:21.454 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 2909, 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 2909, 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 2909, 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 2909, 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:14:21.455 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.456 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle-0x56378d7246e0": { 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2024-09-12T00:14:21.457 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2024-09-12T00:14:21.458 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-12T00:14:21.458 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:21.458 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:21.458 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:21.458 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:21.458 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:21.458 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-12T00:14:22.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:22 smithi006 ceph-mon[30947]: pgmap v810: 129 pgs: 129 active+clean; 4.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 744 KiB/s wr, 363 op/s 2024-09-12T00:14:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:22 smithi134 ceph-mon[34893]: pgmap v810: 129 pgs: 129 active+clean; 4.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 744 KiB/s wr, 363 op/s 2024-09-12T00:14:23.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:22 smithi039 ceph-mon[34543]: pgmap v810: 129 pgs: 129 active+clean; 4.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 744 KiB/s wr, 363 op/s 2024-09-12T00:14:23.895 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-12T00:14:23.896 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-12T00:14:23.896 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-09-12T00:14:23.896 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T00:14:23.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T00:14:24.352 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:14:24.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:24 smithi006 ceph-mon[30947]: pgmap v811: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 53 KiB/s wr, 230 op/s 2024-09-12T00:14:24.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:24 smithi134 ceph-mon[34893]: pgmap v811: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 53 KiB/s wr, 230 op/s 2024-09-12T00:14:25.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:24 smithi039 ceph-mon[34543]: pgmap v811: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 53 KiB/s wr, 230 op/s 2024-09-12T00:14:26.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:26 smithi006 ceph-mon[30947]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 12 KiB/s wr, 243 op/s 2024-09-12T00:14:26.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:26 smithi134 ceph-mon[34893]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 12 KiB/s wr, 243 op/s 2024-09-12T00:14:27.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:26 smithi039 ceph-mon[34543]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 12 KiB/s wr, 243 op/s 2024-09-12T00:14:28.885 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:28 smithi006 ceph-mon[30947]: pgmap v813: 129 pgs: 129 active+clean; 634 MiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 KiB/s wr, 215 op/s 2024-09-12T00:14:28.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:28 smithi134 ceph-mon[34893]: pgmap v813: 129 pgs: 129 active+clean; 634 MiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 KiB/s wr, 215 op/s 2024-09-12T00:14:29.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:28 smithi039 ceph-mon[34543]: pgmap v813: 129 pgs: 129 active+clean; 634 MiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 KiB/s wr, 215 op/s 2024-09-12T00:14:30.069 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-12T00:14:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:14:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 4, 2024-09-12T00:14:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 4, 2024-09-12T00:14:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 2992, 2024-09-12T00:14:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 448, 2024-09-12T00:14:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-09-12T00:14:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 0, 2024-09-12T00:14:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.003532746, 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000045927, 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.002439907, 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 3, 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.004230995, 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.001410331 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 2, 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 221, 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 320, 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 196208, 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.016336340, 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.012489898, 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.001748908, 2024-09-12T00:14:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 219, 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.011652989, 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000053209 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 196208 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:14:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 295, 2024-09-12T00:14:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 290, 2024-09-12T00:14:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 775760, 2024-09-12T00:14:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 178480, 2024-09-12T00:14:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 2, 2024-09-12T00:14:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2024-09-12T00:14:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.042470106, 2024-09-12T00:14:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.018249716, 2024-09-12T00:14:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.029714977, 2024-09-12T00:14:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T00:14:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 289, 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.022007212, 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000076149 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 775760, 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 178480 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 0, 2024-09-12T00:14:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:14:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2024-09-12T00:14:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 148951, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 28, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:14:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 928, 2024-09-12T00:14:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2, 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 297, 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 734097, 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 297, 2024-09-12T00:14:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-09-12T00:14:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-09-12T00:14:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 297, 2024-09-12T00:14:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 734097, 2024-09-12T00:14:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-12T00:14:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:30.080 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-12T00:14:30.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:30 smithi134 ceph-mon[34893]: pgmap v814: 129 pgs: 129 active+clean; 81 MiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.1 KiB/s wr, 199 op/s 2024-09-12T00:14:31.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:30 smithi039 ceph-mon[34543]: pgmap v814: 129 pgs: 129 active+clean; 81 MiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.1 KiB/s wr, 199 op/s 2024-09-12T00:14:31.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:30 smithi006 ceph-mon[30947]: pgmap v814: 129 pgs: 129 active+clean; 81 MiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.1 KiB/s wr, 199 op/s 2024-09-12T00:14:32.946 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:32 smithi006 ceph-mon[30947]: pgmap v815: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 165 op/s 2024-09-12T00:14:32.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:32 smithi134 ceph-mon[34893]: pgmap v815: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 165 op/s 2024-09-12T00:14:33.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:32 smithi039 ceph-mon[34543]: pgmap v815: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 165 op/s 2024-09-12T00:14:34.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:34 smithi134 ceph-mon[34893]: pgmap v816: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 135 op/s 2024-09-12T00:14:35.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:34 smithi039 ceph-mon[34543]: pgmap v816: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 135 op/s 2024-09-12T00:14:35.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:34 smithi006 ceph-mon[30947]: pgmap v816: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 135 op/s 2024-09-12T00:14:35.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:35 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:14:36.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:35 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:14:36.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:35 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:14:36.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:36 smithi134 ceph-mon[34893]: pgmap v817: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 107 op/s 2024-09-12T00:14:37.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:36 smithi039 ceph-mon[34543]: pgmap v817: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 107 op/s 2024-09-12T00:14:37.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:36 smithi006 ceph-mon[30947]: pgmap v817: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 107 op/s 2024-09-12T00:14:37.886 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T00:14:37.886 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T00:14:37.886 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-12T00:14:37.886 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T00:14:37.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T00:14:37.912 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:37 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:14:37.913 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:37 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:14:37.913 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:37 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:14:37.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:37 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:14:37.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:37 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:14:37.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:37 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:14:38.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:37 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:14:38.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:37 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:14:38.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:37 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' 2024-09-12T00:14:38.154 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:14:39.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:38 smithi039 ceph-mon[34543]: pgmap v818: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 60 op/s 2024-09-12T00:14:39.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:38 smithi006 ceph-mon[30947]: pgmap v818: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 60 op/s 2024-09-12T00:14:39.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:38 smithi134 ceph-mon[34893]: pgmap v818: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 60 op/s 2024-09-12T00:14:40.756 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-12T00:14:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:14:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1175, 2024-09-12T00:14:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 1160, 2024-09-12T00:14:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 1150432, 2024-09-12T00:14:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 453458, 2024-09-12T00:14:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 5, 2024-09-12T00:14:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2024-09-12T00:14:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.137536583, 2024-09-12T00:14:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.053793146, 2024-09-12T00:14:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.054443279, 2024-09-12T00:14:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.028570549, 2024-09-12T00:14:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 1159, 2024-09-12T00:14:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.092232641, 2024-09-12T00:14:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000079579 2024-09-12T00:14:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 860464, 2024-09-12T00:14:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 179024 2024-09-12T00:14:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:14:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1655, 2024-09-12T00:14:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 1873, 2024-09-12T00:14:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 422447, 2024-09-12T00:14:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 1068351, 2024-09-12T00:14:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 6, 2024-09-12T00:14:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 4, 2024-09-12T00:14:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.123677682, 2024-09-12T00:14:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.042614907, 2024-09-12T00:14:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.030374209, 2024-09-12T00:14:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.041509524, 2024-09-12T00:14:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 1871, 2024-09-12T00:14:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.102076778, 2024-09-12T00:14:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000054557 2024-09-12T00:14:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:14:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 542640 2024-09-12T00:14:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:14:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 8, 2024-09-12T00:14:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 8, 2024-09-12T00:14:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 4621, 2024-09-12T00:14:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 1732, 2024-09-12T00:14:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 8, 2024-09-12T00:14:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 4, 2024-09-12T00:14:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.004667649, 2024-09-12T00:14:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000142927, 2024-09-12T00:14:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.004295949, 2024-09-12T00:14:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000084725, 2024-09-12T00:14:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 7, 2024-09-12T00:14:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.007321574, 2024-09-12T00:14:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.001045939 2024-09-12T00:14:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 1, 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-MDSRank": { 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 4189, 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.103647158, 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000024742 2024-09-12T00:14:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-PurgeQueue": { 2024-09-12T00:14:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2024-09-12T00:14:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2024-09-12T00:14:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-09-12T00:14:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "request": 0, 2024-09-12T00:14:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "reply": 0, 2024-09-12T00:14:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "reply_latency": { 2024-09-12T00:14:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_reply": 0, 2024-09-12T00:14:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "forward": 0, 2024-09-12T00:14:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_complete": 0, 2024-09-12T00:14:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_keys": 0, 2024-09-12T00:14:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_commit": 0, 2024-09-12T00:14:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_split": 0, 2024-09-12T00:14:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_merge": 0, 2024-09-12T00:14:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes": 0, 2024-09-12T00:14:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_top": 0, 2024-09-12T00:14:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_bottom": 0, 2024-09-12T00:14:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pin_tail": 0, 2024-09-12T00:14:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pinned": 0, 2024-09-12T00:14:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_expired": 0, 2024-09-12T00:14:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_with_caps": 0, 2024-09-12T00:14:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": 0, 2024-09-12T00:14:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "subtrees": 1, 2024-09-12T00:14:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse": 0, 2024-09-12T00:14:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_hit": 0, 2024-09-12T00:14:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_forward": 0, 2024-09-12T00:14:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_discover": 0, 2024-09-12T00:14:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:14:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_remote_ino": 0, 2024-09-12T00:14:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_lock": 0, 2024-09-12T00:14:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "load_cent": 0, 2024-09-12T00:14:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "q": 0, 2024-09-12T00:14:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "exported": 0, 2024-09-12T00:14:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "exported_inodes": 0, 2024-09-12T00:14:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "imported": 0, 2024-09-12T00:14:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "imported_inodes": 0, 2024-09-12T00:14:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_dir_fetch": 0, 2024-09-12T00:14:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:14:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_peer_discover": 0, 2024-09-12T00:14:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rfiles": 0, 2024-09-12T00:14:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rbytes": 0, 2024-09-12T00:14:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rsnaps": 0, 2024-09-12T00:14:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:14:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_set_tag": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_file_inodes": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_grant": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:14:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps": 0, 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_cap_release": 0, 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "process_request_cap_release": 0 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache": { 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update": 0, 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update_receipt": 0, 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_try_discover": 0, 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_send_discover": 0, 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_handle_discover": 0, 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays": 0, 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_delayed": 0, 2024-09-12T00:14:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:14:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_created": 0, 2024-09-12T00:14:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_enqueued": 0, 2024-09-12T00:14:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_reintegrated": 0, 2024-09-12T00:14:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_migrated": 0, 2024-09-12T00:14:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_processing": 0, 2024-09-12T00:14:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:14:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:14:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_started": 0, 2024-09-12T00:14:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_completed": 0, 2024-09-12T00:14:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:14:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_exportdir": 0, 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_flush": 0, 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragstats": 0, 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_inodestats": 0 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log": { 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "evlrg": 0, 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "evadd": 0, 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "evex": 0, 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "evtrm": 0, 2024-09-12T00:14:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "ev": 5, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "evexg": 0, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "evexd": 0, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "segadd": 0, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "segex": 0, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "segtrm": 0, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "seg": 2, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "segmjr": 2, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "segexg": 0, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "segexd": 0, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "expos": 4194304, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "wrpos": 4195921, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "rdpos": 4195426, 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "jlat": { 2024-09-12T00:14:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "replayed": 5 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_mem": { 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 3, 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "ino+": 3, 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "ino-": 0, 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "dir": 1, 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "dir+": 1, 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "dir-": 0, 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "dn": 0, 2024-09-12T00:14:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "dn+": 0, 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "dn-": 0, 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "cap": 0, 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "cap+": 0, 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "cap-": 0, 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "rss": 48984, 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "heap": 215328 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_server": { 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_client_request": 0, 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_server_request": 0, 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_request": 0, 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_session": 0, 2024-09-12T00:14:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_peer_request": 0, 2024-09-12T00:14:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "req_create_latency": { 2024-09-12T00:14:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getattr_latency": { 2024-09-12T00:14:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getfilelock_latency": { 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "req_link_latency": { 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookup_latency": { 2024-09-12T00:14:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookuphash_latency": { 2024-09-12T00:14:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupino_latency": { 2024-09-12T00:14:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupname_latency": { 2024-09-12T00:14:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupparent_latency": { 2024-09-12T00:14:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupsnap_latency": { 2024-09-12T00:14:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lssnap_latency": { 2024-09-12T00:14:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mkdir_latency": { 2024-09-12T00:14:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mknod_latency": { 2024-09-12T00:14:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mksnap_latency": { 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "req_open_latency": { 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "req_readdir_latency": { 2024-09-12T00:14:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rename_latency": { 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "req_renamesnap_latency": { 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "req_snapdiff_latency": { 2024-09-12T00:14:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmdir_latency": { 2024-09-12T00:14:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmsnap_latency": { 2024-09-12T00:14:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmxattr_latency": { 2024-09-12T00:14:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setattr_latency": { 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setdirlayout_latency": { 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setfilelock_latency": { 2024-09-12T00:14:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setlayout_latency": { 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setxattr_latency": { 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "req_symlink_latency": { 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "req_unlink_latency": { 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getvxattr_latency": { 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_sessions": { 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "session_count": 1, 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "session_add": 2, 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "session_remove": 1, 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_open": 1, 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_stale": 0, 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "total_load": 0, 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "average_load": 0, 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "avg_session_uptime": 1989, 2024-09-12T00:14:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "mdthresh_evicted": 0 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:14:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:14:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 197447, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 53, 2024-09-12T00:14:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 9144, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 172, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2024-09-12T00:14:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 8512, 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 13, 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter": { 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "op_active": 0, 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "op_laggy": 0, 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send": 2520, 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send_bytes": 21, 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "op_resend": 3, 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "op_reply": 2520, 2024-09-12T00:14:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "op_latency": { 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2520, 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 154.851518304, 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.061449015 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "op_inflight": 0, 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "oplen_avg": { 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2520, 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 2521 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "op": 2520, 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "op_r": 2520, 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "op_w": 0, 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "op_rmw": 0, 2024-09-12T00:14:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "op_pg": 0, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_stat": 1648, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_create": 0, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_read": 870, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_write": 0, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writefull": 0, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writesame": 0, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_append": 0, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_zero": 0, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_truncate": 0, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_delete": 0, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_mapext": 0, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_sparse_read": 0, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_clonerange": 0, 2024-09-12T00:14:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_getxattr": 1, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_setxattr": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_rmxattr": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_call": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_watch": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_notify": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_other": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_active": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_send": 0, 2024-09-12T00:14:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_resend": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_ping": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_active": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_send": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_resend": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_active": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_send": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_resend": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_active": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_send": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_resend": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "command_active": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "command_send": 0, 2024-09-12T00:14:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "command_resend": 0, 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "map_epoch": 90, 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "map_full": 0, 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "map_inc": 4, 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_sessions": 6, 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_open": 9, 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_close": 3, 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_laggy": 0, 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_wr": 0, 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_rd": 2, 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_del": 0 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "oft": { 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_objs": 0, 2024-09-12T00:14:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_updates": 0, 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_removes": 0 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "osd-slow-ops": { 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_ops_count": 0 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "purge_queue": { 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops": 0, 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing": 0, 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_high_water": 0, 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executed_ops": 0, 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executed": 0, 2024-09-12T00:14:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_item_in_journal": 0 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 2834, 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 1303408, 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 2834, 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 2834, 2024-09-12T00:14:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 1303408, 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_bytes": { 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:40.809 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 2520, 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 1622, 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 2520, 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 1622, 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_ops": { 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-12T00:14:40.810 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 1024, 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 2520, 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 2520, 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 2520, 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 2520, 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.811 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2024-09-12T00:14:40.812 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle-0x55bc2df0a6e0": { 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:40.813 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-09-12T00:14:40.814 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-09-12T00:14:40.814 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2024-09-12T00:14:40.814 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2024-09-12T00:14:40.814 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-12T00:14:40.814 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:40.814 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:40.814 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:40.814 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:40.814 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:40.814 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-12T00:14:41.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:40 smithi039 ceph-mon[34543]: pgmap v819: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 35 op/s 2024-09-12T00:14:41.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:40 smithi006 ceph-mon[30947]: pgmap v819: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 35 op/s 2024-09-12T00:14:41.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:40 smithi134 ceph-mon[34893]: pgmap v819: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 35 op/s 2024-09-12T00:14:41.790 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-12T00:14:42.219 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-12T00:14:42.219 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-09-12T00:14:42.219 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T00:14:42.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T00:14:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:14:42.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:42 smithi006 ceph-mon[30947]: pgmap v820: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 17 op/s 2024-09-12T00:14:42.984 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 0, 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 2, 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 0, 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 0, 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 0, 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.001285089, 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.000214763, 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:42.985 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:14:42.986 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 300, 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 295, 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 777120, 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 181680, 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 2, 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.043703442, 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.017870935, 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.032442336, 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 294, 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.013590627, 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000046226 2024-09-12T00:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 777120, 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 181680 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 6, 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 227, 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 3312, 2024-09-12T00:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 197360, 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.018780764, 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.012768770, 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.003609718, 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 226, 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.017943506, 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000079396 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 197360 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 0, 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2024-09-12T00:14:42.990 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2024-09-12T00:14:42.991 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:14:42.992 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 148704, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 29, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2024-09-12T00:14:42.993 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 0, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 0, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 928, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2024-09-12T00:14:42.994 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 302, 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 734747, 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 302, 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 302, 2024-09-12T00:14:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 734747, 2024-09-12T00:14:42.996 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-12T00:14:42.996 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-12T00:14:42.996 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-12T00:14:42.996 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-12T00:14:42.996 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:42.996 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-12T00:14:42.996 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-12T00:14:43.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:42 smithi039 ceph-mon[34543]: pgmap v820: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 17 op/s 2024-09-12T00:14:43.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:42 smithi134 ceph-mon[34893]: pgmap v820: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 17 op/s 2024-09-12T00:14:43.679 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T00:14:43.679 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T00:14:43.679 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-12T00:14:43.679 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T00:14:43.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T00:14:44.013 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:14:44.586 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T00:14:44.586 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:14:44.586 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 18988, 2024-09-12T00:14:44.586 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 23252, 2024-09-12T00:14:44.586 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 6071998, 2024-09-12T00:14:44.586 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 22627757, 2024-09-12T00:14:44.586 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 23, 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 3, 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 1.449694371, 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.487794682, 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.830559954, 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.188711564, 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 23250, 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 1.925510365, 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000082817 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 31996, 2024-09-12T00:14:44.587 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.006025130, 2024-09-12T00:14:44.588 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000188 2024-09-12T00:14:44.588 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.588 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 51664, 2024-09-12T00:14:44.588 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 29744 2024-09-12T00:14:44.588 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.588 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:14:44.588 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 8165, 2024-09-12T00:14:44.588 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 9059, 2024-09-12T00:14:44.588 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 2415719, 2024-09-12T00:14:44.588 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 8459841, 2024-09-12T00:14:44.588 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 13, 2024-09-12T00:14:44.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 6, 2024-09-12T00:14:44.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.593977054, 2024-09-12T00:14:44.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.198551933, 2024-09-12T00:14:44.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.256157229, 2024-09-12T00:14:44.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.141222836, 2024-09-12T00:14:44.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 9057, 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 1.481324007, 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000163555 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 6795, 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.001633012, 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000240 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 562240 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.590 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 7637, 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 9861, 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 3059633, 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 8966063, 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 114, 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 6, 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.765888676, 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.281180110, 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.341050142, 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.146130251, 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 9861, 2024-09-12T00:14:44.591 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 1.120461884, 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000113625 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 7278, 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.001760554, 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000241 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 935504, 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 190432 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 1, 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-12T00:14:44.592 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-MDSRank": { 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 6346, 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 3.610563340, 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000568951 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-PurgeQueue": { 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 7515, 2024-09-12T00:14:44.593 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.306808128, 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000040826 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": { 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: "request": 6937, 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: "reply": 6877, 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: "reply_latency": { 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 6877, 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 9.313317543, 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.001354270 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_reply": 0, 2024-09-12T00:14:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: "forward": 60, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_complete": 0, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_keys": 0, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_commit": 627, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_split": 1, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_merge": 0, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes": 20, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_top": 2, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_bottom": 4, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pin_tail": 14, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pinned": 17, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_expired": 256, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_with_caps": 2, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": 2, 2024-09-12T00:14:44.595 INFO:teuthology.orchestra.run.smithi039.stdout: "subtrees": 3, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse": 11541, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_hit": 5802, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_forward": 59, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_discover": 0, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_remote_ino": 0, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_lock": 54, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "load_cent": 0, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "q": 0, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "exported": 59, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "exported_inodes": 181, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "imported": 3, 2024-09-12T00:14:44.596 INFO:teuthology.orchestra.run.smithi039.stdout: "imported_inodes": 23, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_dir_fetch": 0, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_peer_discover": 0, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rfiles": 4, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rbytes": 234, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rsnaps": 0, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_set_tag": 0, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:14:44.597 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_file_inodes": 0, 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_revoke": 1472, 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_grant": 3261, 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_trunc": 6, 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps": 5418, 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps_dirty": 2881, 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_cap_release": 40, 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "process_request_cap_release": 2639 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_cache": { 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update": 1, 2024-09-12T00:14:44.598 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update_receipt": 0, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_try_discover": 0, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_send_discover": 0, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_handle_discover": 73, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays": 2, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_delayed": 0, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_created": 814, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_enqueued": 751, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_reintegrated": 61, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_migrated": 0, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_processing": 0, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_started": 0, 2024-09-12T00:14:44.599 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_completed": 0, 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_exportdir": 61, 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_flush": 0, 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragmentdir": 1, 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragstats": 0, 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_inodestats": 0 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_log": { 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: "evlrg": 0, 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: "evadd": 7575, 2024-09-12T00:14:44.600 INFO:teuthology.orchestra.run.smithi039.stdout: "evex": 6379, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "evtrm": 6379, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "ev": 1196, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "evexg": 0, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "evexd": 138, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "segadd": 64, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "segex": 62, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "segtrm": 62, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "seg": 2, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "segmjr": 1, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "segexg": 0, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "segexd": 2, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "expos": 21209146, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "wrpos": 24272674, 2024-09-12T00:14:44.601 INFO:teuthology.orchestra.run.smithi039.stdout: "rdpos": 0, 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: "jlat": { 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2867, 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 189.063109234, 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.065944579 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: "replayed": 0 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_mem": { 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 21, 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: "ino+": 898, 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: "ino-": 877, 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: "dir": 20, 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: "dir+": 127, 2024-09-12T00:14:44.602 INFO:teuthology.orchestra.run.smithi039.stdout: "dir-": 107, 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "dn": 20, 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "dn+": 1699, 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "dn-": 1679, 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "cap": 2, 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "cap+": 912, 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "cap-": 910, 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "rss": 68508, 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "heap": 231712 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_server": { 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_client_request": 7657, 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_server_request": 64, 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_request": 6937, 2024-09-12T00:14:44.603 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_session": 84, 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_peer_request": 133, 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: "req_create_latency": { 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 765, 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.814260924, 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.001064393 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getattr_latency": { 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 923, 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.290454429, 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000314685 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getfilelock_latency": { 2024-09-12T00:14:44.604 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: "req_link_latency": { 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 61, 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.111151746, 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.001822159 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookup_latency": { 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 3172, 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 1.106341975, 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000348783 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.605 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookuphash_latency": { 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupino_latency": { 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupname_latency": { 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.606 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupparent_latency": { 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupsnap_latency": { 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lssnap_latency": { 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.607 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mkdir_latency": { 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 105, 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.103544558, 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000986138 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mknod_latency": { 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mksnap_latency": { 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.608 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: "req_open_latency": { 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 802, 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 1.193659564, 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.001488353 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: "req_readdir_latency": { 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 124, 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.605712634, 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.004884779 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rename_latency": { 2024-09-12T00:14:44.609 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 113, 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 3.489580860, 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.030881246 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: "req_renamesnap_latency": { 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: "req_snapdiff_latency": { 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.610 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmdir_latency": { 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 40, 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.564109850, 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.014102746 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmsnap_latency": { 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmxattr_latency": { 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.611 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setattr_latency": { 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 5, 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.012045099, 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.002409019 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setdirlayout_latency": { 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setfilelock_latency": { 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 4, 2024-09-12T00:14:44.612 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.001783170, 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000445792 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setlayout_latency": { 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setxattr_latency": { 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 9, 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.023213593, 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.002579288 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.613 INFO:teuthology.orchestra.run.smithi039.stdout: "req_symlink_latency": { 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 13, 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.009354335, 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000719564 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: "req_unlink_latency": { 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 741, 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.988104806, 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.001333474 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getvxattr_latency": { 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.614 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.615 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.615 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:44.615 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.615 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_sessions": { 2024-09-12T00:14:44.615 INFO:teuthology.orchestra.run.smithi039.stdout: "session_count": 1, 2024-09-12T00:14:44.615 INFO:teuthology.orchestra.run.smithi039.stdout: "session_add": 4, 2024-09-12T00:14:44.616 INFO:teuthology.orchestra.run.smithi039.stdout: "session_remove": 3, 2024-09-12T00:14:44.616 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_open": 1, 2024-09-12T00:14:44.616 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_stale": 0, 2024-09-12T00:14:44.616 INFO:teuthology.orchestra.run.smithi039.stdout: "total_load": 776, 2024-09-12T00:14:44.616 INFO:teuthology.orchestra.run.smithi039.stdout: "average_load": 776, 2024-09-12T00:14:44.616 INFO:teuthology.orchestra.run.smithi039.stdout: "avg_session_uptime": 919, 2024-09-12T00:14:44.616 INFO:teuthology.orchestra.run.smithi039.stdout: "mdthresh_evicted": 0 2024-09-12T00:14:44.616 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.616 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-12T00:14:44.616 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 360, 2024-09-12T00:14:44.616 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 360, 2024-09-12T00:14:44.616 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:14:44.617 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:14:44.618 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 316505, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 125, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:14:44.619 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 9144, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 172, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 92965, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 774, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-12T00:14:44.620 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: "objecter": { 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: "op_active": 0, 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: "op_laggy": 0, 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send": 13386, 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send_bytes": 21877378, 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: "op_resend": 37, 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: "op_reply": 13386, 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: "op_latency": { 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 13386, 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 742.609132291, 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.055476552 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.621 INFO:teuthology.orchestra.run.smithi039.stdout: "op_inflight": 0, 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "oplen_avg": { 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 13386, 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 16611 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "op": 13386, 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "op_r": 39, 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "op_w": 13347, 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "op_rmw": 0, 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "op_pg": 0, 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_stat": 574, 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_create": 916, 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_read": 39, 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_write": 2906, 2024-09-12T00:14:44.622 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writefull": 211, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writesame": 0, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_append": 0, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_zero": 0, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_truncate": 1, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_delete": 8145, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_mapext": 0, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_sparse_read": 0, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_clonerange": 0, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_getxattr": 0, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_setxattr": 1429, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_rmxattr": 0, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:14:44.623 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_call": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_watch": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_notify": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_other": 6, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_active": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_send": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_resend": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_ping": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_active": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_send": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_resend": 0, 2024-09-12T00:14:44.624 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_active": 0, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_send": 0, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_resend": 0, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_active": 0, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_send": 0, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_resend": 0, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "command_active": 0, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "command_send": 0, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "command_resend": 0, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "map_epoch": 90, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "map_full": 0, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "map_inc": 10, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_sessions": 12, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_open": 12, 2024-09-12T00:14:44.625 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_close": 0, 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_laggy": 0, 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_wr": 2099, 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_rd": 0, 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_del": 285 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: "oft": { 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_objs": 1, 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_updates": 0, 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_removes": 0 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: "osd-slow-ops": { 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_ops_count": 0 2024-09-12T00:14:44.626 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "purge_queue": { 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops": 0, 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops_high_water": 60, 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing": 0, 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_high_water": 7, 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed_ops": 7625, 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed": 751, 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_item_in_journal": 0 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:44.627 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 34786, 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 8386106, 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 34786, 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 34786, 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 8386106, 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.628 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_bytes": { 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 13386, 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 21958837, 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 13386, 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 21958837, 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_ops": { 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 1024, 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 13386, 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 13386, 2024-09-12T00:14:44.630 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 13386, 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 13386, 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 751, 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 81459, 2024-09-12T00:14:44.631 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 751, 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 39, 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 81459, 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle-0x559dd2b3a500": { 2024-09-12T00:14:44.632 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 7575, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 20078370, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 7575, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 2867, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 20078370, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:44.633 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:44.634 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:44.634 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:44.634 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T00:14:45.115 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:44 smithi039 ceph-mon[34543]: pgmap v821: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-12T00:14:45.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:44 smithi006 ceph-mon[30947]: pgmap v821: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-12T00:14:45.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:44 smithi134 ceph-mon[34893]: pgmap v821: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-12T00:14:45.632 INFO:tasks.check_counter:Daemon mds.b mds.exported=59 2024-09-12T00:14:45.633 INFO:tasks.check_counter:Daemon mds.b mds.imported=3 2024-09-12T00:14:45.633 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=1 2024-09-12T00:14:45.633 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T00:14:45.633 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T00:14:45.907 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:14:46.447 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T00:14:46.447 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:14:46.447 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1610, 2024-09-12T00:14:46.447 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1612, 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 7983963, 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 511990, 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 6, 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.155944071, 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.055739793, 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.039783984, 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.045615993, 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1610, 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.081367489, 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000050538 2024-09-12T00:14:46.448 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1831, 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1814, 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 9635176, 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 662794, 2024-09-12T00:14:46.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-09-12T00:14:46.450 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 3, 2024-09-12T00:14:46.450 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.167446640, 2024-09-12T00:14:46.450 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.047499469, 2024-09-12T00:14:46.450 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.077832589, 2024-09-12T00:14:46.450 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.041548193, 2024-09-12T00:14:46.450 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:46.450 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1814, 2024-09-12T00:14:46.450 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.067400254, 2024-09-12T00:14:46.450 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000037155 2024-09-12T00:14:46.450 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.450 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:46.450 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.451 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.451 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.451 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.451 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 865872, 2024-09-12T00:14:46.451 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 183184 2024-09-12T00:14:46.451 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.451 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:14:46.451 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 479, 2024-09-12T00:14:46.451 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 701, 2024-09-12T00:14:46.451 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 4313285, 2024-09-12T00:14:46.451 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 698263, 2024-09-12T00:14:46.451 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 6, 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 4, 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.059045443, 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.019814359, 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.016450636, 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.016864648, 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 699, 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.042978569, 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000061485 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.452 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 546576 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 1, 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-MDSRank": { 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 6172, 2024-09-12T00:14:46.453 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.157133173, 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000025459 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-PurgeQueue": { 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": { 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: "request": 0, 2024-09-12T00:14:46.454 INFO:teuthology.orchestra.run.smithi039.stdout: "reply": 0, 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: "reply_latency": { 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_reply": 0, 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: "forward": 0, 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_complete": 0, 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_keys": 0, 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_commit": 0, 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_split": 0, 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_merge": 0, 2024-09-12T00:14:46.455 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes": 855, 2024-09-12T00:14:46.456 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_top": 380, 2024-09-12T00:14:46.456 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_bottom": 475, 2024-09-12T00:14:46.456 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pin_tail": 0, 2024-09-12T00:14:46.456 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pinned": 311, 2024-09-12T00:14:46.456 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_expired": 0, 2024-09-12T00:14:46.456 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_with_caps": 0, 2024-09-12T00:14:46.456 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": 0, 2024-09-12T00:14:46.456 INFO:teuthology.orchestra.run.smithi039.stdout: "subtrees": 2, 2024-09-12T00:14:46.456 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse": 0, 2024-09-12T00:14:46.456 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_hit": 0, 2024-09-12T00:14:46.456 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_forward": 0, 2024-09-12T00:14:46.456 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_discover": 0, 2024-09-12T00:14:46.457 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:14:46.457 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_remote_ino": 0, 2024-09-12T00:14:46.457 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_lock": 0, 2024-09-12T00:14:46.457 INFO:teuthology.orchestra.run.smithi039.stdout: "load_cent": 0, 2024-09-12T00:14:46.457 INFO:teuthology.orchestra.run.smithi039.stdout: "q": 0, 2024-09-12T00:14:46.457 INFO:teuthology.orchestra.run.smithi039.stdout: "exported": 0, 2024-09-12T00:14:46.457 INFO:teuthology.orchestra.run.smithi039.stdout: "exported_inodes": 0, 2024-09-12T00:14:46.457 INFO:teuthology.orchestra.run.smithi039.stdout: "imported": 0, 2024-09-12T00:14:46.457 INFO:teuthology.orchestra.run.smithi039.stdout: "imported_inodes": 0, 2024-09-12T00:14:46.457 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_dir_fetch": 0, 2024-09-12T00:14:46.457 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:14:46.458 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_peer_discover": 0, 2024-09-12T00:14:46.458 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rfiles": 4, 2024-09-12T00:14:46.458 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rbytes": 234, 2024-09-12T00:14:46.458 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rsnaps": 0, 2024-09-12T00:14:46.458 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:14:46.458 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_set_tag": 0, 2024-09-12T00:14:46.458 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:14:46.458 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:14:46.459 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:14:46.459 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:14:46.459 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:14:46.459 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_file_inodes": 0, 2024-09-12T00:14:46.459 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:14:46.459 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T00:14:46.459 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_grant": 0, 2024-09-12T00:14:46.459 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:14:46.459 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:14:46.459 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:14:46.460 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps": 0, 2024-09-12T00:14:46.460 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:14:46.460 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_cap_release": 0, 2024-09-12T00:14:46.460 INFO:teuthology.orchestra.run.smithi039.stdout: "process_request_cap_release": 0 2024-09-12T00:14:46.460 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.460 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_cache": { 2024-09-12T00:14:46.460 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update": 0, 2024-09-12T00:14:46.460 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update_receipt": 0, 2024-09-12T00:14:46.460 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_try_discover": 0, 2024-09-12T00:14:46.460 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_send_discover": 0, 2024-09-12T00:14:46.460 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_handle_discover": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_delayed": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_created": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_enqueued": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_reintegrated": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_migrated": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_processing": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_started": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_completed": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:14:46.461 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_exportdir": 0, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_flush": 0, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragstats": 0, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_inodestats": 0 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_log": { 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "evlrg": 0, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "evadd": 0, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "evex": 0, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "evtrm": 0, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "ev": 7575, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "evexg": 0, 2024-09-12T00:14:46.462 INFO:teuthology.orchestra.run.smithi039.stdout: "evexd": 0, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "segadd": 0, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "segex": 0, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "segtrm": 0, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "seg": 2, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "segmjr": 57, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "segexg": 0, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "segexd": 0, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "expos": 21209146, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "wrpos": 24272674, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "rdpos": 24270762, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "jlat": { 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.463 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: "replayed": 7575 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_mem": { 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 22, 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: "ino+": 893, 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: "ino-": 871, 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: "dir": 17, 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: "dir+": 122, 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: "dir-": 105, 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: "dn": 855, 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: "dn+": 1443, 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: "dn-": 588, 2024-09-12T00:14:46.464 INFO:teuthology.orchestra.run.smithi039.stdout: "cap": 0, 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "cap+": 0, 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "cap-": 0, 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "rss": 55876, 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "heap": 215328 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_server": { 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_client_request": 0, 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_server_request": 0, 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_request": 0, 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_session": 0, 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_peer_request": 0, 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "req_create_latency": { 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.465 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.466 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.466 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.466 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getattr_latency": { 2024-09-12T00:14:46.466 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.466 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.466 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.466 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.466 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getfilelock_latency": { 2024-09-12T00:14:46.466 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.466 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: "req_link_latency": { 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookup_latency": { 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookuphash_latency": { 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.467 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupino_latency": { 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupname_latency": { 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.468 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupparent_latency": { 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupsnap_latency": { 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lssnap_latency": { 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.469 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mkdir_latency": { 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mknod_latency": { 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mksnap_latency": { 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.470 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: "req_open_latency": { 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: "req_readdir_latency": { 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rename_latency": { 2024-09-12T00:14:46.471 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: "req_renamesnap_latency": { 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: "req_snapdiff_latency": { 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.472 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmdir_latency": { 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmsnap_latency": { 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmxattr_latency": { 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.473 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setattr_latency": { 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setdirlayout_latency": { 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setfilelock_latency": { 2024-09-12T00:14:46.474 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setlayout_latency": { 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setxattr_latency": { 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.475 INFO:teuthology.orchestra.run.smithi039.stdout: "req_symlink_latency": { 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: "req_unlink_latency": { 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getvxattr_latency": { 2024-09-12T00:14:46.476 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_sessions": { 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: "session_count": 1, 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: "session_add": 4, 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: "session_remove": 3, 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_open": 2, 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_stale": 0, 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: "total_load": 0, 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: "average_load": 0, 2024-09-12T00:14:46.477 INFO:teuthology.orchestra.run.smithi039.stdout: "avg_session_uptime": 3012, 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: "mdthresh_evicted": 0 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:14:46.478 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:14:46.479 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:14:46.480 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 198247, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 56, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 9144, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 172, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:14:46.481 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 673131, 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 3863, 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "objecter": { 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "op_active": 0, 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "op_laggy": 0, 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send": 3595, 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send_bytes": 26, 2024-09-12T00:14:46.482 INFO:teuthology.orchestra.run.smithi039.stdout: "op_resend": 4, 2024-09-12T00:14:46.483 INFO:teuthology.orchestra.run.smithi039.stdout: "op_reply": 3595, 2024-09-12T00:14:46.483 INFO:teuthology.orchestra.run.smithi039.stdout: "op_latency": { 2024-09-12T00:14:46.483 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 3595, 2024-09-12T00:14:46.483 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 62.815822013, 2024-09-12T00:14:46.483 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.017473107 2024-09-12T00:14:46.483 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.483 INFO:teuthology.orchestra.run.smithi039.stdout: "op_inflight": 0, 2024-09-12T00:14:46.483 INFO:teuthology.orchestra.run.smithi039.stdout: "oplen_avg": { 2024-09-12T00:14:46.483 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 3595, 2024-09-12T00:14:46.483 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 3596 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "op": 3595, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "op_r": 3595, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "op_w": 0, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "op_rmw": 0, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "op_pg": 0, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_stat": 1920, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_create": 0, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_read": 1672, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_write": 0, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writefull": 0, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writesame": 0, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_append": 0, 2024-09-12T00:14:46.484 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_zero": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_truncate": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_delete": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_mapext": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_sparse_read": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_clonerange": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_getxattr": 2, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_setxattr": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_rmxattr": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_call": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_watch": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_notify": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:14:46.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_other": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_active": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_send": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_resend": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_ping": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_active": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_send": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_resend": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_active": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_send": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_resend": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_active": 0, 2024-09-12T00:14:46.486 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_send": 0, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_resend": 0, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "command_active": 0, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "command_send": 0, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "command_resend": 0, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "map_epoch": 90, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "map_full": 0, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "map_inc": 4, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_sessions": 6, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_open": 6, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_close": 0, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_laggy": 0, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_wr": 0, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_rd": 2, 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_del": 0 2024-09-12T00:14:46.487 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.488 INFO:teuthology.orchestra.run.smithi039.stdout: "oft": { 2024-09-12T00:14:46.488 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_objs": 0, 2024-09-12T00:14:46.488 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:14:46.488 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_updates": 0, 2024-09-12T00:14:46.488 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_removes": 0 2024-09-12T00:14:46.488 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.488 INFO:teuthology.orchestra.run.smithi039.stdout: "osd-slow-ops": { 2024-09-12T00:14:46.488 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_ops_count": 0 2024-09-12T00:14:46.488 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.488 INFO:teuthology.orchestra.run.smithi039.stdout: "purge_queue": { 2024-09-12T00:14:46.488 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops": 0, 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing": 0, 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_high_water": 0, 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed_ops": 0, 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed": 0, 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_item_in_journal": 0 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 3916, 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 21560607, 2024-09-12T00:14:46.489 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 3916, 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 3916, 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 21560607, 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_bytes": { 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:46.490 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T00:14:46.491 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:46.491 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:46.491 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:46.491 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:46.491 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:46.491 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 3595, 2024-09-12T00:14:46.491 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 20078380, 2024-09-12T00:14:46.491 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 3595, 2024-09-12T00:14:46.491 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 20078380, 2024-09-12T00:14:46.492 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:46.493 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.493 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.493 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.493 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:46.493 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.493 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_ops": { 2024-09-12T00:14:46.493 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:46.493 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 1024, 2024-09-12T00:14:46.493 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:46.493 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:46.493 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:46.493 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 3595, 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 3595, 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 3595, 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 3595, 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:46.494 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-12T00:14:46.495 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:46.495 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:46.495 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:46.495 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:46.495 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:46.495 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T00:14:46.495 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T00:14:46.495 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-12T00:14:46.495 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-12T00:14:46.495 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:46.495 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.495 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.496 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.496 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:46.496 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:46.496 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle-0x55a7b5b7a6e0": { 2024-09-12T00:14:46.496 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:46.496 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-12T00:14:46.496 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:46.496 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:46.496 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:46.496 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:46.496 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:46.496 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T00:14:46.497 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T00:14:46.497 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-12T00:14:46.497 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-12T00:14:46.497 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:46.497 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:46.497 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:46.497 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:46.497 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:46.497 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:46.497 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T00:14:47.068 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:46 smithi039 ceph-mon[34543]: pgmap v822: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-12T00:14:47.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:46 smithi006 ceph-mon[30947]: pgmap v822: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-12T00:14:47.207 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:46 smithi134 ceph-mon[34893]: pgmap v822: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-12T00:14:47.717 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-12T00:14:47.717 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-12T00:14:47.717 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-12T00:14:47.717 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T00:14:47.717 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T00:14:47.988 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:14:48.542 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T00:14:48.542 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:14:48.542 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 380, 2024-09-12T00:14:48.542 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 365, 2024-09-12T00:14:48.542 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 881630, 2024-09-12T00:14:48.543 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 221005, 2024-09-12T00:14:48.543 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 12, 2024-09-12T00:14:48.543 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 4, 2024-09-12T00:14:48.543 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.053044807, 2024-09-12T00:14:48.543 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.021696166, 2024-09-12T00:14:48.543 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.037485260, 2024-09-12T00:14:48.543 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000332566, 2024-09-12T00:14:48.543 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:48.543 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 362, 2024-09-12T00:14:48.543 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.027379980, 2024-09-12T00:14:48.543 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000075635 2024-09-12T00:14:48.544 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.544 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:48.544 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 37, 2024-09-12T00:14:48.544 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000007862, 2024-09-12T00:14:48.544 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000212 2024-09-12T00:14:48.544 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.544 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 876336, 2024-09-12T00:14:48.544 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 188016 2024-09-12T00:14:48.544 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.544 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:14:48.544 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 2426, 2024-09-12T00:14:48.545 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1545, 2024-09-12T00:14:48.545 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 627581, 2024-09-12T00:14:48.545 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 1022654, 2024-09-12T00:14:48.545 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 11, 2024-09-12T00:14:48.545 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 4, 2024-09-12T00:14:48.545 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.174198688, 2024-09-12T00:14:48.545 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.081695751, 2024-09-12T00:14:48.545 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.109812475, 2024-09-12T00:14:48.545 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.005469499, 2024-09-12T00:14:48.545 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:48.545 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1546, 2024-09-12T00:14:48.546 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.094059822, 2024-09-12T00:14:48.546 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000060840 2024-09-12T00:14:48.546 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.546 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:48.546 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 3442, 2024-09-12T00:14:48.546 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000863022, 2024-09-12T00:14:48.546 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000250 2024-09-12T00:14:48.546 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.546 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-12T00:14:48.546 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 546848 2024-09-12T00:14:48.547 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.547 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:14:48.547 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 21, 2024-09-12T00:14:48.547 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 23, 2024-09-12T00:14:48.547 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 5351, 2024-09-12T00:14:48.547 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 33606, 2024-09-12T00:14:48.547 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 10, 2024-09-12T00:14:48.547 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 4, 2024-09-12T00:14:48.547 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.004889973, 2024-09-12T00:14:48.548 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000359837, 2024-09-12T00:14:48.548 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.002909114, 2024-09-12T00:14:48.548 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.001356621, 2024-09-12T00:14:48.548 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:48.548 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 21, 2024-09-12T00:14:48.548 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.022286022, 2024-09-12T00:14:48.548 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.001061239 2024-09-12T00:14:48.548 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.549 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:48.549 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2, 2024-09-12T00:14:48.549 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000156, 2024-09-12T00:14:48.549 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000078 2024-09-12T00:14:48.549 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.549 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:14:48.549 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:14:48.549 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.549 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-12T00:14:48.549 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 1, 2024-09-12T00:14:48.550 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-12T00:14:48.550 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.550 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-MDSRank": { 2024-09-12T00:14:48.550 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-12T00:14:48.550 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-12T00:14:48.550 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 40, 2024-09-12T00:14:48.550 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.002389586, 2024-09-12T00:14:48.550 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000059739 2024-09-12T00:14:48.550 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:48.551 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.551 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-PurgeQueue": { 2024-09-12T00:14:48.551 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-12T00:14:48.551 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-12T00:14:48.551 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2, 2024-09-12T00:14:48.551 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000008353, 2024-09-12T00:14:48.551 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000004176 2024-09-12T00:14:48.551 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:48.551 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.551 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": { 2024-09-12T00:14:48.551 INFO:teuthology.orchestra.run.smithi039.stdout: "request": 2, 2024-09-12T00:14:48.552 INFO:teuthology.orchestra.run.smithi039.stdout: "reply": 1, 2024-09-12T00:14:48.552 INFO:teuthology.orchestra.run.smithi039.stdout: "reply_latency": { 2024-09-12T00:14:48.552 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1, 2024-09-12T00:14:48.552 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000244222, 2024-09-12T00:14:48.552 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000244222 2024-09-12T00:14:48.552 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.552 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_reply": 0, 2024-09-12T00:14:48.552 INFO:teuthology.orchestra.run.smithi039.stdout: "forward": 1, 2024-09-12T00:14:48.552 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_complete": 0, 2024-09-12T00:14:48.552 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_keys": 0, 2024-09-12T00:14:48.552 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_commit": 11, 2024-09-12T00:14:48.552 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_split": 0, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_merge": 0, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes": 15, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_top": 0, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_bottom": 15, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pin_tail": 0, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pinned": 13, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_expired": 6, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_with_caps": 0, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": 0, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "subtrees": 3, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse": 6, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_hit": 3, 2024-09-12T00:14:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_forward": 0, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_discover": 2, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_remote_ino": 0, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_lock": 0, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "load_cent": 0, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "q": 0, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "exported": 0, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "exported_inodes": 0, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "imported": 0, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "imported_inodes": 0, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_dir_fetch": 0, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:14:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_peer_discover": 0, 2024-09-12T00:14:48.555 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rfiles": 4, 2024-09-12T00:14:48.555 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rbytes": 234, 2024-09-12T00:14:48.555 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rsnaps": 0, 2024-09-12T00:14:48.555 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:14:48.555 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_set_tag": 0, 2024-09-12T00:14:48.555 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:14:48.555 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:14:48.555 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:14:48.556 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:14:48.556 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:14:48.556 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_file_inodes": 0, 2024-09-12T00:14:48.556 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:14:48.556 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T00:14:48.556 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_grant": 0, 2024-09-12T00:14:48.556 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:14:48.556 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:14:48.556 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:14:48.556 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps": 0, 2024-09-12T00:14:48.556 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:14:48.557 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_cap_release": 0, 2024-09-12T00:14:48.557 INFO:teuthology.orchestra.run.smithi039.stdout: "process_request_cap_release": 1 2024-09-12T00:14:48.557 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.557 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_cache": { 2024-09-12T00:14:48.557 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update": 0, 2024-09-12T00:14:48.557 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update_receipt": 3, 2024-09-12T00:14:48.557 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_try_discover": 2, 2024-09-12T00:14:48.557 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_send_discover": 4, 2024-09-12T00:14:48.557 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_handle_discover": 0, 2024-09-12T00:14:48.557 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays": 0, 2024-09-12T00:14:48.558 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_delayed": 0, 2024-09-12T00:14:48.558 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:14:48.558 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_created": 0, 2024-09-12T00:14:48.558 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_enqueued": 0, 2024-09-12T00:14:48.558 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_reintegrated": 0, 2024-09-12T00:14:48.558 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_migrated": 0, 2024-09-12T00:14:48.558 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_processing": 0, 2024-09-12T00:14:48.558 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:14:48.558 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:14:48.558 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_started": 0, 2024-09-12T00:14:48.559 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_completed": 0, 2024-09-12T00:14:48.559 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:14:48.559 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:14:48.559 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:14:48.559 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_exportdir": 0, 2024-09-12T00:14:48.559 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_flush": 0, 2024-09-12T00:14:48.559 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:14:48.559 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragstats": 0, 2024-09-12T00:14:48.559 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_inodestats": 0 2024-09-12T00:14:48.559 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.560 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_log": { 2024-09-12T00:14:48.560 INFO:teuthology.orchestra.run.smithi039.stdout: "evlrg": 0, 2024-09-12T00:14:48.560 INFO:teuthology.orchestra.run.smithi039.stdout: "evadd": 5, 2024-09-12T00:14:48.560 INFO:teuthology.orchestra.run.smithi039.stdout: "evex": 0, 2024-09-12T00:14:48.560 INFO:teuthology.orchestra.run.smithi039.stdout: "evtrm": 0, 2024-09-12T00:14:48.560 INFO:teuthology.orchestra.run.smithi039.stdout: "ev": 5, 2024-09-12T00:14:48.560 INFO:teuthology.orchestra.run.smithi039.stdout: "evexg": 0, 2024-09-12T00:14:48.560 INFO:teuthology.orchestra.run.smithi039.stdout: "evexd": 0, 2024-09-12T00:14:48.560 INFO:teuthology.orchestra.run.smithi039.stdout: "segadd": 2, 2024-09-12T00:14:48.560 INFO:teuthology.orchestra.run.smithi039.stdout: "segex": 0, 2024-09-12T00:14:48.561 INFO:teuthology.orchestra.run.smithi039.stdout: "segtrm": 0, 2024-09-12T00:14:48.561 INFO:teuthology.orchestra.run.smithi039.stdout: "seg": 2, 2024-09-12T00:14:48.561 INFO:teuthology.orchestra.run.smithi039.stdout: "segmjr": 2, 2024-09-12T00:14:48.561 INFO:teuthology.orchestra.run.smithi039.stdout: "segexg": 0, 2024-09-12T00:14:48.561 INFO:teuthology.orchestra.run.smithi039.stdout: "segexd": 0, 2024-09-12T00:14:48.561 INFO:teuthology.orchestra.run.smithi039.stdout: "expos": 4194304, 2024-09-12T00:14:48.561 INFO:teuthology.orchestra.run.smithi039.stdout: "wrpos": 4195921, 2024-09-12T00:14:48.561 INFO:teuthology.orchestra.run.smithi039.stdout: "rdpos": 0, 2024-09-12T00:14:48.562 INFO:teuthology.orchestra.run.smithi039.stdout: "jlat": { 2024-09-12T00:14:48.562 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 4, 2024-09-12T00:14:48.562 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.006777791, 2024-09-12T00:14:48.562 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.001694447 2024-09-12T00:14:48.562 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.563 INFO:teuthology.orchestra.run.smithi039.stdout: "replayed": 0 2024-09-12T00:14:48.563 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.563 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_mem": { 2024-09-12T00:14:48.563 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 19, 2024-09-12T00:14:48.563 INFO:teuthology.orchestra.run.smithi039.stdout: "ino+": 22, 2024-09-12T00:14:48.563 INFO:teuthology.orchestra.run.smithi039.stdout: "ino-": 3, 2024-09-12T00:14:48.563 INFO:teuthology.orchestra.run.smithi039.stdout: "dir": 18, 2024-09-12T00:14:48.563 INFO:teuthology.orchestra.run.smithi039.stdout: "dir+": 22, 2024-09-12T00:14:48.563 INFO:teuthology.orchestra.run.smithi039.stdout: "dir-": 4, 2024-09-12T00:14:48.564 INFO:teuthology.orchestra.run.smithi039.stdout: "dn": 15, 2024-09-12T00:14:48.564 INFO:teuthology.orchestra.run.smithi039.stdout: "dn+": 21, 2024-09-12T00:14:48.564 INFO:teuthology.orchestra.run.smithi039.stdout: "dn-": 6, 2024-09-12T00:14:48.564 INFO:teuthology.orchestra.run.smithi039.stdout: "cap": 0, 2024-09-12T00:14:48.564 INFO:teuthology.orchestra.run.smithi039.stdout: "cap+": 1, 2024-09-12T00:14:48.564 INFO:teuthology.orchestra.run.smithi039.stdout: "cap-": 1, 2024-09-12T00:14:48.564 INFO:teuthology.orchestra.run.smithi039.stdout: "rss": 53064, 2024-09-12T00:14:48.564 INFO:teuthology.orchestra.run.smithi039.stdout: "heap": 223520 2024-09-12T00:14:48.564 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.565 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_server": { 2024-09-12T00:14:48.565 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_client_request": 3, 2024-09-12T00:14:48.565 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_server_request": 0, 2024-09-12T00:14:48.565 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_request": 2, 2024-09-12T00:14:48.565 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_session": 16, 2024-09-12T00:14:48.565 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_peer_request": 0, 2024-09-12T00:14:48.565 INFO:teuthology.orchestra.run.smithi039.stdout: "req_create_latency": { 2024-09-12T00:14:48.565 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.566 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.566 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.566 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.566 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getattr_latency": { 2024-09-12T00:14:48.566 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1, 2024-09-12T00:14:48.566 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000244222, 2024-09-12T00:14:48.566 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000244222 2024-09-12T00:14:48.566 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.567 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getfilelock_latency": { 2024-09-12T00:14:48.567 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.567 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.567 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.567 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.567 INFO:teuthology.orchestra.run.smithi039.stdout: "req_link_latency": { 2024-09-12T00:14:48.567 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.568 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.568 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.568 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.568 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookup_latency": { 2024-09-12T00:14:48.568 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.568 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.568 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.569 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.569 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookuphash_latency": { 2024-09-12T00:14:48.569 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.569 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.569 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.569 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.569 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupino_latency": { 2024-09-12T00:14:48.569 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.569 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.569 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.570 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.570 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupname_latency": { 2024-09-12T00:14:48.570 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.570 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.570 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.570 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.570 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupparent_latency": { 2024-09-12T00:14:48.570 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.570 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.570 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.570 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.571 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupsnap_latency": { 2024-09-12T00:14:48.571 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.571 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.571 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.571 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.571 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lssnap_latency": { 2024-09-12T00:14:48.571 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.571 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.572 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.572 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.572 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mkdir_latency": { 2024-09-12T00:14:48.572 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.573 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.573 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.573 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.573 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mknod_latency": { 2024-09-12T00:14:48.573 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.574 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.574 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.574 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.574 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mksnap_latency": { 2024-09-12T00:14:48.574 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.574 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.574 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.574 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.574 INFO:teuthology.orchestra.run.smithi039.stdout: "req_open_latency": { 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: "req_readdir_latency": { 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rename_latency": { 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.575 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.576 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.576 INFO:teuthology.orchestra.run.smithi039.stdout: "req_renamesnap_latency": { 2024-09-12T00:14:48.576 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.576 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.577 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.577 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.577 INFO:teuthology.orchestra.run.smithi039.stdout: "req_snapdiff_latency": { 2024-09-12T00:14:48.577 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.577 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.577 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.577 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.578 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmdir_latency": { 2024-09-12T00:14:48.578 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.578 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.578 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.578 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.578 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmsnap_latency": { 2024-09-12T00:14:48.578 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.578 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.578 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.578 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmxattr_latency": { 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setattr_latency": { 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setdirlayout_latency": { 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.579 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.580 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.580 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.580 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setfilelock_latency": { 2024-09-12T00:14:48.580 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.580 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.580 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.580 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.580 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setlayout_latency": { 2024-09-12T00:14:48.580 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.580 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.581 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.581 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.581 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setxattr_latency": { 2024-09-12T00:14:48.581 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.581 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.581 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.581 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.581 INFO:teuthology.orchestra.run.smithi039.stdout: "req_symlink_latency": { 2024-09-12T00:14:48.581 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.581 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.581 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.582 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.582 INFO:teuthology.orchestra.run.smithi039.stdout: "req_unlink_latency": { 2024-09-12T00:14:48.582 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.582 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.582 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.582 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.582 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:14:48.582 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:14:48.582 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getvxattr_latency": { 2024-09-12T00:14:48.582 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.583 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.583 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.583 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:48.583 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.583 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_sessions": { 2024-09-12T00:14:48.583 INFO:teuthology.orchestra.run.smithi039.stdout: "session_count": 1, 2024-09-12T00:14:48.583 INFO:teuthology.orchestra.run.smithi039.stdout: "session_add": 2, 2024-09-12T00:14:48.583 INFO:teuthology.orchestra.run.smithi039.stdout: "session_remove": 1, 2024-09-12T00:14:48.583 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_open": 1, 2024-09-12T00:14:48.583 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_stale": 0, 2024-09-12T00:14:48.583 INFO:teuthology.orchestra.run.smithi039.stdout: "total_load": 1, 2024-09-12T00:14:48.583 INFO:teuthology.orchestra.run.smithi039.stdout: "average_load": 1, 2024-09-12T00:14:48.584 INFO:teuthology.orchestra.run.smithi039.stdout: "avg_session_uptime": 923, 2024-09-12T00:14:48.584 INFO:teuthology.orchestra.run.smithi039.stdout: "mdthresh_evicted": 0 2024-09-12T00:14:48.584 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.584 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-12T00:14:48.584 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:14:48.584 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-12T00:14:48.584 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:14:48.584 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:14:48.584 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:14:48.584 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:14:48.584 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:14:48.584 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:14:48.585 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:14:48.585 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:14:48.585 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:14:48.585 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:14:48.585 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:14:48.585 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:14:48.585 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:14:48.585 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-12T00:14:48.585 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:14:48.586 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-12T00:14:48.586 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:14:48.586 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:14:48.586 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:14:48.586 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:14:48.586 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:14:48.586 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:14:48.587 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:14:48.587 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-12T00:14:48.587 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:14:48.587 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:14:48.587 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:14:48.587 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-12T00:14:48.587 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-12T00:14:48.587 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-12T00:14:48.587 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:14:48.588 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:14:48.588 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:14:48.588 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:14:48.588 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 239255, 2024-09-12T00:14:48.588 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 78, 2024-09-12T00:14:48.588 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:14:48.588 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-12T00:14:48.589 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-12T00:14:48.589 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-12T00:14:48.589 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:14:48.589 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-12T00:14:48.589 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:14:48.589 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-12T00:14:48.590 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 9144, 2024-09-12T00:14:48.590 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 172, 2024-09-12T00:14:48.590 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:14:48.590 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:14:48.590 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-12T00:14:48.590 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-12T00:14:48.591 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 76709, 2024-09-12T00:14:48.591 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 306, 2024-09-12T00:14:48.591 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-12T00:14:48.591 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-12T00:14:48.591 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-12T00:14:48.591 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-12T00:14:48.592 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.592 INFO:teuthology.orchestra.run.smithi039.stdout: "objecter": { 2024-09-12T00:14:48.592 INFO:teuthology.orchestra.run.smithi039.stdout: "op_active": 0, 2024-09-12T00:14:48.592 INFO:teuthology.orchestra.run.smithi039.stdout: "op_laggy": 0, 2024-09-12T00:14:48.592 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send": 40, 2024-09-12T00:14:48.592 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send_bytes": 11919, 2024-09-12T00:14:48.592 INFO:teuthology.orchestra.run.smithi039.stdout: "op_resend": 32, 2024-09-12T00:14:48.592 INFO:teuthology.orchestra.run.smithi039.stdout: "op_reply": 40, 2024-09-12T00:14:48.593 INFO:teuthology.orchestra.run.smithi039.stdout: "op_latency": { 2024-09-12T00:14:48.593 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 40, 2024-09-12T00:14:48.593 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.219995977, 2024-09-12T00:14:48.593 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.005499899 2024-09-12T00:14:48.593 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.593 INFO:teuthology.orchestra.run.smithi039.stdout: "op_inflight": 0, 2024-09-12T00:14:48.593 INFO:teuthology.orchestra.run.smithi039.stdout: "oplen_avg": { 2024-09-12T00:14:48.593 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 40, 2024-09-12T00:14:48.593 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 62 2024-09-12T00:14:48.593 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.594 INFO:teuthology.orchestra.run.smithi039.stdout: "op": 40, 2024-09-12T00:14:48.594 INFO:teuthology.orchestra.run.smithi039.stdout: "op_r": 0, 2024-09-12T00:14:48.594 INFO:teuthology.orchestra.run.smithi039.stdout: "op_w": 40, 2024-09-12T00:14:48.594 INFO:teuthology.orchestra.run.smithi039.stdout: "op_rmw": 0, 2024-09-12T00:14:48.594 INFO:teuthology.orchestra.run.smithi039.stdout: "op_pg": 0, 2024-09-12T00:14:48.594 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_stat": 0, 2024-09-12T00:14:48.594 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_create": 10, 2024-09-12T00:14:48.594 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_read": 0, 2024-09-12T00:14:48.594 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_write": 4, 2024-09-12T00:14:48.594 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writefull": 7, 2024-09-12T00:14:48.595 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writesame": 0, 2024-09-12T00:14:48.595 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_append": 0, 2024-09-12T00:14:48.595 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_zero": 0, 2024-09-12T00:14:48.595 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_truncate": 0, 2024-09-12T00:14:48.595 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_delete": 6, 2024-09-12T00:14:48.595 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_mapext": 0, 2024-09-12T00:14:48.595 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_sparse_read": 0, 2024-09-12T00:14:48.595 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_clonerange": 0, 2024-09-12T00:14:48.596 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_getxattr": 0, 2024-09-12T00:14:48.596 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_setxattr": 20, 2024-09-12T00:14:48.596 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:14:48.596 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_rmxattr": 0, 2024-09-12T00:14:48.596 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:14:48.596 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_call": 0, 2024-09-12T00:14:48.596 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_watch": 0, 2024-09-12T00:14:48.596 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_notify": 0, 2024-09-12T00:14:48.597 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:14:48.597 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls": 0, 2024-09-12T00:14:48.597 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:14:48.597 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_other": 0, 2024-09-12T00:14:48.597 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_active": 0, 2024-09-12T00:14:48.597 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_send": 0, 2024-09-12T00:14:48.598 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_resend": 0, 2024-09-12T00:14:48.598 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_ping": 0, 2024-09-12T00:14:48.598 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_active": 0, 2024-09-12T00:14:48.598 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_send": 0, 2024-09-12T00:14:48.598 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_resend": 0, 2024-09-12T00:14:48.598 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_active": 0, 2024-09-12T00:14:48.598 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_send": 0, 2024-09-12T00:14:48.598 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_resend": 0, 2024-09-12T00:14:48.598 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_active": 0, 2024-09-12T00:14:48.599 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_send": 0, 2024-09-12T00:14:48.599 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_resend": 0, 2024-09-12T00:14:48.599 INFO:teuthology.orchestra.run.smithi039.stdout: "command_active": 0, 2024-09-12T00:14:48.599 INFO:teuthology.orchestra.run.smithi039.stdout: "command_send": 0, 2024-09-12T00:14:48.599 INFO:teuthology.orchestra.run.smithi039.stdout: "command_resend": 0, 2024-09-12T00:14:48.599 INFO:teuthology.orchestra.run.smithi039.stdout: "map_epoch": 90, 2024-09-12T00:14:48.600 INFO:teuthology.orchestra.run.smithi039.stdout: "map_full": 0, 2024-09-12T00:14:48.600 INFO:teuthology.orchestra.run.smithi039.stdout: "map_inc": 4, 2024-09-12T00:14:48.600 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_sessions": 9, 2024-09-12T00:14:48.600 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_open": 15, 2024-09-12T00:14:48.600 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_close": 6, 2024-09-12T00:14:48.600 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_laggy": 0, 2024-09-12T00:14:48.600 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_wr": 14, 2024-09-12T00:14:48.600 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_rd": 0, 2024-09-12T00:14:48.600 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_del": 1 2024-09-12T00:14:48.600 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.600 INFO:teuthology.orchestra.run.smithi039.stdout: "oft": { 2024-09-12T00:14:48.601 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_objs": 1, 2024-09-12T00:14:48.601 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:14:48.601 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_updates": 0, 2024-09-12T00:14:48.601 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_removes": 0 2024-09-12T00:14:48.601 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.601 INFO:teuthology.orchestra.run.smithi039.stdout: "osd-slow-ops": { 2024-09-12T00:14:48.601 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_ops_count": 0 2024-09-12T00:14:48.601 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.602 INFO:teuthology.orchestra.run.smithi039.stdout: "purge_queue": { 2024-09-12T00:14:48.602 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops": 0, 2024-09-12T00:14:48.602 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T00:14:48.602 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing": 0, 2024-09-12T00:14:48.602 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_high_water": 0, 2024-09-12T00:14:48.602 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed_ops": 0, 2024-09-12T00:14:48.602 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed": 0, 2024-09-12T00:14:48.603 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_item_in_journal": 0 2024-09-12T00:14:48.603 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.603 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:14:48.603 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:48.603 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T00:14:48.603 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:48.603 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 2823, 2024-09-12T00:14:48.603 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 1239528, 2024-09-12T00:14:48.603 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:48.604 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 2823, 2024-09-12T00:14:48.605 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T00:14:48.605 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T00:14:48.605 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 2823, 2024-09-12T00:14:48.605 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 1239528, 2024-09-12T00:14:48.605 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:48.606 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.606 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.606 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.606 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:48.606 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.606 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_bytes": { 2024-09-12T00:14:48.606 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:48.606 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T00:14:48.607 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:48.607 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:48.607 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:48.607 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:48.607 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:48.607 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 40, 2024-09-12T00:14:48.607 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 11919, 2024-09-12T00:14:48.608 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 40, 2024-09-12T00:14:48.608 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 11919, 2024-09-12T00:14:48.608 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:48.608 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.609 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.609 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.609 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:48.609 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.609 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_ops": { 2024-09-12T00:14:48.609 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:48.609 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 1024, 2024-09-12T00:14:48.610 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:48.610 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:48.610 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:48.610 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:48.610 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:48.610 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 40, 2024-09-12T00:14:48.610 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 40, 2024-09-12T00:14:48.610 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 40, 2024-09-12T00:14:48.610 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 40, 2024-09-12T00:14:48.610 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:48.611 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.611 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.611 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.611 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:48.611 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.611 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:14:48.612 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:48.612 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-12T00:14:48.612 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:48.612 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:48.612 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:48.612 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:48.612 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:48.612 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T00:14:48.613 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T00:14:48.613 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-12T00:14:48.613 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-12T00:14:48.613 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:48.613 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.613 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.613 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.613 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:48.613 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:48.613 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle-0x55e0e3d90500": { 2024-09-12T00:14:48.614 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:48.614 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-12T00:14:48.614 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:48.614 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 5, 2024-09-12T00:14:48.614 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 1617, 2024-09-12T00:14:48.614 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:48.614 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 5, 2024-09-12T00:14:48.614 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T00:14:48.614 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T00:14:48.614 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 4, 2024-09-12T00:14:48.615 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 1617, 2024-09-12T00:14:48.615 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:48.615 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:48.615 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:48.615 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:48.615 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:48.615 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:48.615 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T00:14:49.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:48 smithi039 ceph-mon[34543]: pgmap v823: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T00:14:49.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:48 smithi006 ceph-mon[30947]: pgmap v823: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T00:14:49.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:48 smithi134 ceph-mon[34893]: pgmap v823: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T00:14:49.279 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-12T00:14:49.279 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-12T00:14:49.279 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-12T00:14:49.279 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T00:14:49.279 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T00:14:49.541 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:14:50.171 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T00:14:50.171 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:14:50.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1023, 2024-09-12T00:14:50.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1023, 2024-09-12T00:14:50.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 295108, 2024-09-12T00:14:50.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 324554, 2024-09-12T00:14:50.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 7, 2024-09-12T00:14:50.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.091826016, 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.034515758, 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.023795448, 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.023785113, 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1022, 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.041903428, 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000041001 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.172 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 909, 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1134, 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 223550, 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 749181, 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 5, 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 4, 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.094873887, 2024-09-12T00:14:50.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.030081281, 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.021665041, 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.034117002, 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1132, 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.049564418, 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000043784 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T00:14:50.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 460432 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1327, 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1312, 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 1201552, 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 504404, 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 3, 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.159323110, 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.055199949, 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.063801785, 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.036763319, 2024-09-12T00:14:50.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1311, 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.071653936, 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000054655 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 863536, 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 184496 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.176 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 1, 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-MDSRank": { 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 4843, 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.143995358, 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000029732 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-PurgeQueue": { 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-12T00:14:50.177 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": { 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: "request": 0, 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: "reply": 0, 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: "reply_latency": { 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.178 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_reply": 0, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "forward": 0, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_complete": 0, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_keys": 0, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_commit": 0, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_split": 0, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_merge": 0, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes": 2, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_top": 0, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_bottom": 2, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pin_tail": 0, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pinned": 2, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_expired": 0, 2024-09-12T00:14:50.179 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_with_caps": 0, 2024-09-12T00:14:50.180 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": 0, 2024-09-12T00:14:50.180 INFO:teuthology.orchestra.run.smithi039.stdout: "subtrees": 1, 2024-09-12T00:14:50.180 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse": 0, 2024-09-12T00:14:50.180 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_hit": 0, 2024-09-12T00:14:50.180 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_forward": 0, 2024-09-12T00:14:50.180 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_discover": 0, 2024-09-12T00:14:50.180 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:14:50.180 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_remote_ino": 0, 2024-09-12T00:14:50.180 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_lock": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "load_cent": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "q": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "exported": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "exported_inodes": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "imported": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "imported_inodes": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_dir_fetch": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_peer_discover": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rfiles": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rbytes": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rsnaps": 0, 2024-09-12T00:14:50.181 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:14:50.182 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_set_tag": 0, 2024-09-12T00:14:50.182 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:14:50.182 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:14:50.182 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:14:50.182 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:14:50.182 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:14:50.182 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_file_inodes": 0, 2024-09-12T00:14:50.182 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:14:50.182 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_grant": 0, 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps": 0, 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_cap_release": 0, 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: "process_request_cap_release": 0 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_cache": { 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update": 0, 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update_receipt": 0, 2024-09-12T00:14:50.183 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_try_discover": 0, 2024-09-12T00:14:50.184 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_send_discover": 0, 2024-09-12T00:14:50.184 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_handle_discover": 0, 2024-09-12T00:14:50.184 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays": 0, 2024-09-12T00:14:50.184 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_delayed": 0, 2024-09-12T00:14:50.184 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:14:50.184 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_created": 0, 2024-09-12T00:14:50.184 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_enqueued": 0, 2024-09-12T00:14:50.184 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_reintegrated": 0, 2024-09-12T00:14:50.184 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_migrated": 0, 2024-09-12T00:14:50.184 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_processing": 0, 2024-09-12T00:14:50.184 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:14:50.184 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:14:50.185 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_started": 0, 2024-09-12T00:14:50.185 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_completed": 0, 2024-09-12T00:14:50.185 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:14:50.185 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:14:50.185 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:14:50.185 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_exportdir": 0, 2024-09-12T00:14:50.185 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_flush": 0, 2024-09-12T00:14:50.185 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:14:50.185 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragstats": 0, 2024-09-12T00:14:50.185 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_inodestats": 0 2024-09-12T00:14:50.185 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_log": { 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "evlrg": 0, 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "evadd": 0, 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "evex": 0, 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "evtrm": 0, 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "ev": 17, 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "evexg": 0, 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "evexd": 0, 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "segadd": 0, 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "segex": 0, 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "segtrm": 0, 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "seg": 2, 2024-09-12T00:14:50.186 INFO:teuthology.orchestra.run.smithi039.stdout: "segmjr": 2, 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: "segexg": 0, 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: "segexd": 0, 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: "expos": 4194304, 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: "wrpos": 4218963, 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: "rdpos": 4217312, 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: "jlat": { 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: "replayed": 17 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.187 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_mem": { 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 4, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "ino+": 17, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "ino-": 13, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "dir": 2, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "dir+": 15, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "dir-": 13, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "dn": 2, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "dn+": 16, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "dn-": 14, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "cap": 0, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "cap+": 0, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "cap-": 0, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "rss": 48520, 2024-09-12T00:14:50.188 INFO:teuthology.orchestra.run.smithi039.stdout: "heap": 215328 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_server": { 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_client_request": 0, 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_server_request": 0, 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_request": 0, 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_session": 0, 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_peer_request": 0, 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: "req_create_latency": { 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.189 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getattr_latency": { 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getfilelock_latency": { 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: "req_link_latency": { 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.190 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookup_latency": { 2024-09-12T00:14:50.191 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.191 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.191 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.191 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.191 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookuphash_latency": { 2024-09-12T00:14:50.191 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.191 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.191 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.192 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.192 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupino_latency": { 2024-09-12T00:14:50.192 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.192 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.192 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.192 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.192 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupname_latency": { 2024-09-12T00:14:50.192 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.193 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.193 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.193 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.193 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupparent_latency": { 2024-09-12T00:14:50.193 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.193 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.193 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.193 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.193 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupsnap_latency": { 2024-09-12T00:14:50.193 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.193 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.194 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.194 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.194 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lssnap_latency": { 2024-09-12T00:14:50.194 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.194 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.194 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.194 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.195 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mkdir_latency": { 2024-09-12T00:14:50.195 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.195 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.195 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.196 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.196 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mknod_latency": { 2024-09-12T00:14:50.196 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.196 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.196 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.196 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.196 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mksnap_latency": { 2024-09-12T00:14:50.196 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.196 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.197 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.197 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.197 INFO:teuthology.orchestra.run.smithi039.stdout: "req_open_latency": { 2024-09-12T00:14:50.197 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.197 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.197 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.197 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.197 INFO:teuthology.orchestra.run.smithi039.stdout: "req_readdir_latency": { 2024-09-12T00:14:50.197 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.197 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.197 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.198 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.198 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rename_latency": { 2024-09-12T00:14:50.198 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.198 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.198 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.198 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.198 INFO:teuthology.orchestra.run.smithi039.stdout: "req_renamesnap_latency": { 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: "req_snapdiff_latency": { 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmdir_latency": { 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.199 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.200 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.200 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmsnap_latency": { 2024-09-12T00:14:50.200 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.200 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.200 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.200 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.200 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmxattr_latency": { 2024-09-12T00:14:50.200 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.200 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.200 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.200 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.200 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setattr_latency": { 2024-09-12T00:14:50.201 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.201 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.201 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.201 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.201 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setdirlayout_latency": { 2024-09-12T00:14:50.201 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.201 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.201 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.201 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.201 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setfilelock_latency": { 2024-09-12T00:14:50.201 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.201 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setlayout_latency": { 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setxattr_latency": { 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: "req_symlink_latency": { 2024-09-12T00:14:50.202 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.203 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.203 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.203 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.203 INFO:teuthology.orchestra.run.smithi039.stdout: "req_unlink_latency": { 2024-09-12T00:14:50.203 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.203 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.203 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.203 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.203 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:14:50.203 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:14:50.204 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getvxattr_latency": { 2024-09-12T00:14:50.204 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.204 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.204 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.204 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:50.204 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.204 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_sessions": { 2024-09-12T00:14:50.204 INFO:teuthology.orchestra.run.smithi039.stdout: "session_count": 1, 2024-09-12T00:14:50.204 INFO:teuthology.orchestra.run.smithi039.stdout: "session_add": 2, 2024-09-12T00:14:50.205 INFO:teuthology.orchestra.run.smithi039.stdout: "session_remove": 1, 2024-09-12T00:14:50.205 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_open": 2, 2024-09-12T00:14:50.205 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_stale": 0, 2024-09-12T00:14:50.205 INFO:teuthology.orchestra.run.smithi039.stdout: "total_load": 0, 2024-09-12T00:14:50.205 INFO:teuthology.orchestra.run.smithi039.stdout: "average_load": 0, 2024-09-12T00:14:50.205 INFO:teuthology.orchestra.run.smithi039.stdout: "avg_session_uptime": 3017, 2024-09-12T00:14:50.205 INFO:teuthology.orchestra.run.smithi039.stdout: "mdthresh_evicted": 0 2024-09-12T00:14:50.205 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.206 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-12T00:14:50.206 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:14:50.206 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-12T00:14:50.206 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:14:50.206 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:14:50.206 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:14:50.206 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:14:50.207 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:14:50.207 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:14:50.207 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:14:50.207 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:14:50.207 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:14:50.207 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:14:50.207 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:14:50.207 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:14:50.207 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:14:50.208 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-12T00:14:50.208 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:14:50.208 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-12T00:14:50.208 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:14:50.208 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:14:50.208 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:14:50.209 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:14:50.209 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:14:50.209 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:14:50.209 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:14:50.209 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-12T00:14:50.209 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:14:50.209 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:14:50.209 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:14:50.209 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-12T00:14:50.209 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-12T00:14:50.209 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-12T00:14:50.209 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:14:50.210 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:14:50.210 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:14:50.210 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:14:50.210 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 191960, 2024-09-12T00:14:50.210 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 55, 2024-09-12T00:14:50.210 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:14:50.210 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-12T00:14:50.210 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-12T00:14:50.210 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-12T00:14:50.210 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:14:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-12T00:14:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:14:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-12T00:14:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 9144, 2024-09-12T00:14:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 172, 2024-09-12T00:14:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:14:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:14:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-12T00:14:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-12T00:14:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 13456, 2024-09-12T00:14:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 36, 2024-09-12T00:14:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-12T00:14:50.212 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-12T00:14:50.212 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-12T00:14:50.212 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-12T00:14:50.212 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.212 INFO:teuthology.orchestra.run.smithi039.stdout: "objecter": { 2024-09-12T00:14:50.212 INFO:teuthology.orchestra.run.smithi039.stdout: "op_active": 0, 2024-09-12T00:14:50.212 INFO:teuthology.orchestra.run.smithi039.stdout: "op_laggy": 0, 2024-09-12T00:14:50.212 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send": 2933, 2024-09-12T00:14:50.212 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send_bytes": 21, 2024-09-12T00:14:50.212 INFO:teuthology.orchestra.run.smithi039.stdout: "op_resend": 3, 2024-09-12T00:14:50.212 INFO:teuthology.orchestra.run.smithi039.stdout: "op_reply": 2933, 2024-09-12T00:14:50.212 INFO:teuthology.orchestra.run.smithi039.stdout: "op_latency": { 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2933, 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 21.763593103, 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.007420249 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: "op_inflight": 0, 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: "oplen_avg": { 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2933, 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 2934 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: "op": 2933, 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: "op_r": 2933, 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: "op_w": 0, 2024-09-12T00:14:50.213 INFO:teuthology.orchestra.run.smithi039.stdout: "op_rmw": 0, 2024-09-12T00:14:50.214 INFO:teuthology.orchestra.run.smithi039.stdout: "op_pg": 0, 2024-09-12T00:14:50.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_stat": 1912, 2024-09-12T00:14:50.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_create": 0, 2024-09-12T00:14:50.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_read": 1019, 2024-09-12T00:14:50.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_write": 0, 2024-09-12T00:14:50.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writefull": 0, 2024-09-12T00:14:50.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writesame": 0, 2024-09-12T00:14:50.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_append": 0, 2024-09-12T00:14:50.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_zero": 0, 2024-09-12T00:14:50.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_truncate": 0, 2024-09-12T00:14:50.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_delete": 0, 2024-09-12T00:14:50.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_mapext": 0, 2024-09-12T00:14:50.215 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_sparse_read": 0, 2024-09-12T00:14:50.215 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_clonerange": 0, 2024-09-12T00:14:50.215 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_getxattr": 1, 2024-09-12T00:14:50.215 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_setxattr": 0, 2024-09-12T00:14:50.215 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:14:50.215 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_rmxattr": 0, 2024-09-12T00:14:50.215 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:14:50.215 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_call": 0, 2024-09-12T00:14:50.215 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_watch": 0, 2024-09-12T00:14:50.215 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_notify": 0, 2024-09-12T00:14:50.215 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_other": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_active": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_send": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_resend": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_ping": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_active": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_send": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_resend": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_active": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_send": 0, 2024-09-12T00:14:50.216 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_resend": 0, 2024-09-12T00:14:50.217 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_active": 0, 2024-09-12T00:14:50.217 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_send": 0, 2024-09-12T00:14:50.217 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_resend": 0, 2024-09-12T00:14:50.217 INFO:teuthology.orchestra.run.smithi039.stdout: "command_active": 0, 2024-09-12T00:14:50.217 INFO:teuthology.orchestra.run.smithi039.stdout: "command_send": 0, 2024-09-12T00:14:50.217 INFO:teuthology.orchestra.run.smithi039.stdout: "command_resend": 0, 2024-09-12T00:14:50.217 INFO:teuthology.orchestra.run.smithi039.stdout: "map_epoch": 90, 2024-09-12T00:14:50.217 INFO:teuthology.orchestra.run.smithi039.stdout: "map_full": 0, 2024-09-12T00:14:50.217 INFO:teuthology.orchestra.run.smithi039.stdout: "map_inc": 4, 2024-09-12T00:14:50.217 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_sessions": 5, 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_open": 6, 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_close": 1, 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_laggy": 0, 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_wr": 0, 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_rd": 2, 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_del": 0 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: "oft": { 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_objs": 0, 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_updates": 0, 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_removes": 0 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.218 INFO:teuthology.orchestra.run.smithi039.stdout: "osd-slow-ops": { 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_ops_count": 0 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: "purge_queue": { 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops": 0, 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing": 0, 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_high_water": 0, 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed_ops": 0, 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed": 0, 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_item_in_journal": 0 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:50.219 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T00:14:50.220 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:50.220 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 3255, 2024-09-12T00:14:50.220 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 1407816, 2024-09-12T00:14:50.220 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:50.220 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 3255, 2024-09-12T00:14:50.220 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T00:14:50.220 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T00:14:50.220 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 3255, 2024-09-12T00:14:50.220 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 1407816, 2024-09-12T00:14:50.220 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:50.220 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_bytes": { 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:50.221 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 2933, 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 24664, 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 2933, 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 24664, 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_ops": { 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 1024, 2024-09-12T00:14:50.222 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:50.223 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:50.223 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:50.223 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:50.223 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:50.223 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 2933, 2024-09-12T00:14:50.223 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 2933, 2024-09-12T00:14:50.223 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 2933, 2024-09-12T00:14:50.223 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 2933, 2024-09-12T00:14:50.223 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:50.223 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.223 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.224 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.224 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:50.224 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.224 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:14:50.224 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:50.224 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-12T00:14:50.224 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:50.224 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:50.224 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:50.224 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:50.224 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:50.224 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle-0x5572c66026e0": { 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-12T00:14:50.225 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:50.226 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T00:14:50.227 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T00:14:50.960 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:50 smithi039 ceph-mon[34543]: pgmap v824: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-12T00:14:50.990 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-12T00:14:50.990 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-12T00:14:50.990 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-12T00:14:50.990 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T00:14:50.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T00:14:51.055 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:50 smithi134 ceph-mon[34893]: pgmap v824: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-12T00:14:51.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:50 smithi006 ceph-mon[30947]: pgmap v824: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-12T00:14:51.288 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:14:51.992 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-12T00:14:51.992 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:14:51.992 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 2977, 2024-09-12T00:14:51.992 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 1767, 2024-09-12T00:14:51.992 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 1579058, 2024-09-12T00:14:51.992 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 711866, 2024-09-12T00:14:51.992 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 9, 2024-09-12T00:14:51.992 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 3, 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.188393128, 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.072895339, 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.141333175, 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.006843119, 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1768, 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.108692558, 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000061477 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3757, 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000821057, 2024-09-12T00:14:51.993 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000218 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 886832, 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 187552 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 31, 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 251, 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 9978, 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 565219, 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 11, 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 6, 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.019082208, 2024-09-12T00:14:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.009880019, 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.006439329, 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000566213, 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 250, 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.028418781, 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000113675 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 7, 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000961, 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000137 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 4240, 2024-09-12T00:14:51.995 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 549376 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 119, 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 108, 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 69174, 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 109278, 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 13, 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 8, 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.011561735, 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.002946986, 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.008596346, 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000462006, 2024-09-12T00:14:51.996 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 104, 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.018312625, 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000176082 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 174, 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000030811, 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000177 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:51.997 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 73, 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.004718527, 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000064637 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T00:14:51.998 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 15, 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000442566, 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000029504 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 13, 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 5, 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 5, 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.017642813, 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.003528562 2024-09-12T00:14:51.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 8, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 11, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 17, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 2, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 15, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 13, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 12, 2024-09-12T00:14:52.000 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 1, 2024-09-12T00:14:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 1, 2024-09-12T00:14:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 4, 2024-09-12T00:14:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 22, 2024-09-12T00:14:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 9, 2024-09-12T00:14:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 8, 2024-09-12T00:14:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 2, 2024-09-12T00:14:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:14:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-09-12T00:14:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-09-12T00:14:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-09-12T00:14:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-09-12T00:14:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 1, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 1, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 2, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 4, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 234, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:14:52.002 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 2, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 2, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 6, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 3, 2024-09-12T00:14:52.003 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 2 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 3, 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 2, 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 1, 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 1, 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-09-12T00:14:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 1, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-09-12T00:14:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 17, 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 17, 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 2, 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 2, 2024-09-12T00:14:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 4218963, 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 0, 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 14, 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.075934388, 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.005423884 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 0 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 22, 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 29, 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 7, 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 21, 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 28, 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 7, 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 17, 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 32, 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 15, 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 1, 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 4, 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 3, 2024-09-12T00:14:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 52072, 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 223520 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 20, 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 2, 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 13, 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 16, 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 7, 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000537687, 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000537687 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2, 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.014002215, 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.007001107 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000262361, 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000262361 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-09-12T00:14:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.019 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.002840550, 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002840550 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 2, 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 1, 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 2, 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 2, 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 925, 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-12T00:14:52.021 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:14:52.022 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:14:52.023 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 273615, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 103, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-12T00:14:52.024 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 9144, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 172, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 89013, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 351, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-12T00:14:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 67, 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 36467, 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 33, 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 67, 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 67, 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.466989022, 2024-09-12T00:14:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.006969985 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 67, 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 94 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 67, 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 1, 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 66, 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 0, 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 10, 2024-09-12T00:14:52.027 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 1, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 15, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 10, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 14, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 0, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 20, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:14:52.028 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-09-12T00:14:52.029 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 90, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 4, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 10, 2024-09-12T00:14:52.030 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 14, 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 4, 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 21, 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 0, 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 3 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 1, 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-09-12T00:14:52.031 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 2, 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 1, 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 2, 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 1, 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:52.032 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 3123, 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 1355985, 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 3123, 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 3123, 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1355985, 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 67, 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 36576, 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 67, 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 36576, 2024-09-12T00:14:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:52.035 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.035 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.035 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:52.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.035 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-09-12T00:14:52.035 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:52.035 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-09-12T00:14:52.035 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:52.035 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T00:14:52.035 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T00:14:52.035 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 67, 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 67, 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 67, 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 67, 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:52.036 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 1, 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 109, 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 1, 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 1, 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 109, 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x5560adb18500": { 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 17, 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 24659, 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 17, 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 14, 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 24659, 2024-09-12T00:14:52.038 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:52.039 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:52.039 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:52.039 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:52.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:52.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:52.039 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-12T00:14:53.058 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:52 smithi134 ceph-mon[34893]: pgmap v825: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T00:14:53.060 INFO:tasks.check_counter:Daemon mds.c mds.exported=1 2024-09-12T00:14:53.060 INFO:tasks.check_counter:Daemon mds.c mds.imported=1 2024-09-12T00:14:53.060 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-09-12T00:14:53.060 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T00:14:53.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T00:14:53.096 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:52 smithi039 ceph-mon[34543]: pgmap v825: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T00:14:53.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:52 smithi006 ceph-mon[30947]: pgmap v825: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T00:14:53.317 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:14:53.908 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-12T00:14:53.908 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:14:53.908 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 4614, 2024-09-12T00:14:53.908 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 3922, 2024-09-12T00:14:53.908 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 2233793, 2024-09-12T00:14:53.908 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 2509478, 2024-09-12T00:14:53.908 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 9, 2024-09-12T00:14:53.908 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 4, 2024-09-12T00:14:53.909 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.278363962, 2024-09-12T00:14:53.909 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.111099943, 2024-09-12T00:14:53.909 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.189653354, 2024-09-12T00:14:53.909 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.014479737, 2024-09-12T00:14:53.909 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:53.909 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3923, 2024-09-12T00:14:53.909 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.247257407, 2024-09-12T00:14:53.909 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000063027 2024-09-12T00:14:53.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.909 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:53.909 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 6816, 2024-09-12T00:14:53.910 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.001111795, 2024-09-12T00:14:53.910 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000163 2024-09-12T00:14:53.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.910 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 882160, 2024-09-12T00:14:53.910 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 189344 2024-09-12T00:14:53.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.910 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:14:53.910 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 129, 2024-09-12T00:14:53.910 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 364, 2024-09-12T00:14:53.910 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 63119, 2024-09-12T00:14:53.910 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 633146, 2024-09-12T00:14:53.911 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 12, 2024-09-12T00:14:53.911 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 6, 2024-09-12T00:14:53.911 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.026761855, 2024-09-12T00:14:53.911 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.013894915, 2024-09-12T00:14:53.911 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.008112578, 2024-09-12T00:14:53.911 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.002430538, 2024-09-12T00:14:53.911 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:53.911 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 362, 2024-09-12T00:14:53.912 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.045131064, 2024-09-12T00:14:53.912 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000124671 2024-09-12T00:14:53.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.912 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:53.912 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 101, 2024-09-12T00:14:53.913 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000018063, 2024-09-12T00:14:53.913 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000178 2024-09-12T00:14:53.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.913 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:14:53.913 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 549984 2024-09-12T00:14:53.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.913 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:14:53.913 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 943, 2024-09-12T00:14:53.913 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 1338, 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 313294, 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 756791, 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 15, 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 9, 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.068481674, 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.025029064, 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.044964512, 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.002688304, 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1335, 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.070454484, 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000052774 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.914 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1970, 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000304850, 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000154 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-09-12T00:14:53.915 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T00:14:53.916 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T00:14:53.916 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 396, 2024-09-12T00:14:53.916 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.156065328, 2024-09-12T00:14:53.916 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000394104 2024-09-12T00:14:53.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:53.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.916 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-09-12T00:14:53.917 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T00:14:53.917 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T00:14:53.917 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 256, 2024-09-12T00:14:53.917 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.016279713, 2024-09-12T00:14:53.917 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000063592 2024-09-12T00:14:53.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:53.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.918 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-09-12T00:14:53.918 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 570, 2024-09-12T00:14:53.918 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 567, 2024-09-12T00:14:53.918 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-09-12T00:14:53.918 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 567, 2024-09-12T00:14:53.918 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.994719561, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001754355 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 3, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 11, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 15, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 0, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 1, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 14, 2024-09-12T00:14:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 14, 2024-09-12T00:14:53.920 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 35, 2024-09-12T00:14:53.920 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 1, 2024-09-12T00:14:53.920 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 1, 2024-09-12T00:14:53.920 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 3, 2024-09-12T00:14:53.920 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 1195, 2024-09-12T00:14:53.920 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 962, 2024-09-12T00:14:53.920 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 0, 2024-09-12T00:14:53.920 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 58, 2024-09-12T00:14:53.920 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:14:53.920 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 3, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 23, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 59, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 177, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 4, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 234, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-09-12T00:14:53.921 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 40, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 112, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 174, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 194, 2024-09-12T00:14:53.922 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:14:53.923 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 4, 2024-09-12T00:14:53.923 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 237 2024-09-12T00:14:53.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.923 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-09-12T00:14:53.923 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-09-12T00:14:53.923 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-09-12T00:14:53.923 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 67, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 0, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 118, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 118, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-09-12T00:14:53.924 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-09-12T00:14:53.925 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:14:53.925 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:14:53.925 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:14:53.925 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 3, 2024-09-12T00:14:53.925 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-09-12T00:14:53.925 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:14:53.925 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-09-12T00:14:53.925 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-09-12T00:14:53.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.925 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-09-12T00:14:53.925 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 438, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 438, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 2, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 2, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-09-12T00:14:53.926 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 5341777, 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 0, 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 185, 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.709189183, 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.003833455 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 0 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 19, 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 143, 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 124, 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 18, 2024-09-12T00:14:53.927 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 86, 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 68, 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 15, 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 321, 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 306, 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 1, 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 120, 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 119, 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 55364, 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 223520 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 1055, 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 8, 2024-09-12T00:14:53.928 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 570, 2024-09-12T00:14:53.929 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 12, 2024-09-12T00:14:53.929 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 86, 2024-09-12T00:14:53.929 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-09-12T00:14:53.929 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.929 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.929 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.929 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-09-12T00:14:53.929 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 294, 2024-09-12T00:14:53.929 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.068046796, 2024-09-12T00:14:53.929 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000231451 2024-09-12T00:14:53.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.930 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-09-12T00:14:53.930 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.930 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.930 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.930 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-09-12T00:14:53.930 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.930 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.930 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.930 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 99, 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.043257896, 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000436948 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.932 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.933 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-09-12T00:14:53.933 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.933 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.933 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.934 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-09-12T00:14:53.934 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.934 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.934 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.934 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-09-12T00:14:53.934 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.934 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.934 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.934 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 56, 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.018059551, 2024-09-12T00:14:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000322491 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-09-12T00:14:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.937 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.937 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.937 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-09-12T00:14:53.937 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 59, 2024-09-12T00:14:53.937 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.753232850, 2024-09-12T00:14:53.937 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.012766658 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-09-12T00:14:53.938 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.939 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.939 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.939 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-09-12T00:14:53.939 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.939 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.939 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.940 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-09-12T00:14:53.940 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.940 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.940 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.940 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-09-12T00:14:53.940 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.940 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.940 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.940 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-09-12T00:14:53.940 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.941 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.941 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.941 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-09-12T00:14:53.941 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.941 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.941 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.941 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-09-12T00:14:53.941 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 59, 2024-09-12T00:14:53.941 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.112122468, 2024-09-12T00:14:53.942 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001900380 2024-09-12T00:14:53.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.942 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:14:53.942 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:14:53.942 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-09-12T00:14:53.942 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.942 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.942 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.942 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:53.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.942 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-09-12T00:14:53.943 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-09-12T00:14:53.943 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 1, 2024-09-12T00:14:53.943 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 0, 2024-09-12T00:14:53.943 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-09-12T00:14:53.943 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-09-12T00:14:53.943 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 389, 2024-09-12T00:14:53.943 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 389, 2024-09-12T00:14:53.943 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 928, 2024-09-12T00:14:53.943 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-09-12T00:14:53.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.943 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-12T00:14:53.944 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:14:53.944 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-12T00:14:53.944 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:14:53.944 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:14:53.944 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:14:53.944 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:14:53.944 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:14:53.944 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:14:53.944 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:14:53.944 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:14:53.944 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:14:53.945 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:14:53.946 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 305475, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 123, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 9144, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 172, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:14:53.947 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-12T00:14:53.948 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-12T00:14:53.948 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 77909, 2024-09-12T00:14:53.948 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 352, 2024-09-12T00:14:53.948 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-12T00:14:53.948 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-12T00:14:53.948 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-12T00:14:53.948 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-12T00:14:53.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.948 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-09-12T00:14:53.948 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-09-12T00:14:53.948 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 449, 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 1177507, 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 33, 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 449, 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 449, 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 4.506893348, 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.010037624 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 449, 2024-09-12T00:14:53.949 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 480 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 449, 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 13, 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 436, 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 0, 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 10, 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 13, 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 198, 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 19, 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-09-12T00:14:53.950 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 189, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 0, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 20, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-09-12T00:14:53.951 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-09-12T00:14:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 90, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 4, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 12, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 17, 2024-09-12T00:14:53.953 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 5, 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 27, 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 0, 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 4 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 1, 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-09-12T00:14:53.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 10, 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 9, 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 177, 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 118, 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T00:14:53.955 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 5682, 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 2077833, 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 5682, 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 5682, 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 2077833, 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 449, 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 1189897, 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 449, 2024-09-12T00:14:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1189897, 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:53.958 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 449, 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 449, 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 449, 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 449, 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 118, 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 12390, 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 118, 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 13, 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 12390, 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x55f481826500": { 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 438, 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 1147473, 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 438, 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 185, 2024-09-12T00:14:53.961 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1147473, 2024-09-12T00:14:53.962 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:53.962 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:53.962 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:53.962 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:53.962 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:53.962 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:53.962 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-12T00:14:54.821 INFO:tasks.check_counter:Daemon mds.f mds.exported=3 2024-09-12T00:14:54.821 INFO:tasks.check_counter:Daemon mds.f mds.imported=59 2024-09-12T00:14:54.821 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-12T00:14:54.821 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T00:14:54.821 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T00:14:55.077 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:14:55.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:54 smithi006 ceph-mon[30947]: pgmap v826: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-12T00:14:55.197 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:54 smithi134 ceph-mon[34893]: pgmap v826: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-12T00:14:55.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:54 smithi039 ceph-mon[34543]: pgmap v826: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-12T00:14:55.599 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-12T00:14:55.599 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:14:55.599 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 2766, 2024-09-12T00:14:55.599 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 1526, 2024-09-12T00:14:55.599 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 755618, 2024-09-12T00:14:55.599 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 560678, 2024-09-12T00:14:55.599 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 9, 2024-09-12T00:14:55.599 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 3, 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.155207721, 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.057950553, 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.115505878, 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.006923368, 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1526, 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.089823363, 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000058861 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3980, 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000723898, 2024-09-12T00:14:55.600 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000181 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 58, 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 280, 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 14424, 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 615437, 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 16, 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 6, 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.020138525, 2024-09-12T00:14:55.601 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.010727109, 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.006944901, 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000403847, 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 276, 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.023496328, 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000085131 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 77, 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000021670, 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000281 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:14:55.602 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 551424 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 379, 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 355, 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 899262, 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 202147, 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 8, 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 4, 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.048579815, 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.020144765, 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.033077885, 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000530994, 2024-09-12T00:14:55.603 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:55.604 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 355, 2024-09-12T00:14:55.604 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.034568838, 2024-09-12T00:14:55.604 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000097377 2024-09-12T00:14:55.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.604 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:55.604 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 7, 2024-09-12T00:14:55.604 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000001136, 2024-09-12T00:14:55.604 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000162 2024-09-12T00:14:55.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.605 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 894528, 2024-09-12T00:14:55.605 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 188896 2024-09-12T00:14:55.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.605 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-12T00:14:55.605 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-09-12T00:14:55.605 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-12T00:14:55.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.605 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-09-12T00:14:55.605 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T00:14:55.605 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T00:14:55.606 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 78, 2024-09-12T00:14:55.606 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.003930258, 2024-09-12T00:14:55.606 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000050387 2024-09-12T00:14:55.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:55.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.606 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-09-12T00:14:55.606 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T00:14:55.606 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T00:14:55.606 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 15, 2024-09-12T00:14:55.606 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000372599, 2024-09-12T00:14:55.607 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000024839 2024-09-12T00:14:55.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:55.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-09-12T00:14:55.607 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 19, 2024-09-12T00:14:55.607 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 5, 2024-09-12T00:14:55.607 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-09-12T00:14:55.607 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 5, 2024-09-12T00:14:55.607 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.004460411, 2024-09-12T00:14:55.608 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000892082 2024-09-12T00:14:55.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.608 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-09-12T00:14:55.608 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 14, 2024-09-12T00:14:55.608 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-09-12T00:14:55.608 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-09-12T00:14:55.608 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 11, 2024-09-12T00:14:55.608 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-09-12T00:14:55.608 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-09-12T00:14:55.608 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 17, 2024-09-12T00:14:55.608 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 2, 2024-09-12T00:14:55.609 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 15, 2024-09-12T00:14:55.609 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-09-12T00:14:55.609 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 13, 2024-09-12T00:14:55.609 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 12, 2024-09-12T00:14:55.609 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 2, 2024-09-12T00:14:55.609 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 2, 2024-09-12T00:14:55.609 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 4, 2024-09-12T00:14:55.609 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 28, 2024-09-12T00:14:55.609 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 9, 2024-09-12T00:14:55.609 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 14, 2024-09-12T00:14:55.609 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 2, 2024-09-12T00:14:55.610 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:14:55.610 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-09-12T00:14:55.610 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-09-12T00:14:55.610 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-09-12T00:14:55.610 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-09-12T00:14:55.610 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 1, 2024-09-12T00:14:55.610 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-09-12T00:14:55.610 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 1, 2024-09-12T00:14:55.610 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 2, 2024-09-12T00:14:55.610 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-09-12T00:14:55.610 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 4, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 234, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:14:55.611 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 2, 2024-09-12T00:14:55.612 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 1, 2024-09-12T00:14:55.612 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:14:55.612 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:14:55.612 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:14:55.612 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 6, 2024-09-12T00:14:55.612 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:14:55.612 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 1, 2024-09-12T00:14:55.612 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 2 2024-09-12T00:14:55.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 3, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 2, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 1, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 1, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-09-12T00:14:55.613 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 1, 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-09-12T00:14:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-09-12T00:14:55.615 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 17, 2024-09-12T00:14:55.615 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-09-12T00:14:55.615 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-09-12T00:14:55.615 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 17, 2024-09-12T00:14:55.615 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-09-12T00:14:55.615 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-09-12T00:14:55.615 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 2, 2024-09-12T00:14:55.615 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-09-12T00:14:55.615 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-09-12T00:14:55.615 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 2, 2024-09-12T00:14:55.615 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-09-12T00:14:55.616 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-09-12T00:14:55.616 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-09-12T00:14:55.616 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-09-12T00:14:55.616 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 4218963, 2024-09-12T00:14:55.616 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 0, 2024-09-12T00:14:55.616 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-09-12T00:14:55.616 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 14, 2024-09-12T00:14:55.616 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.022596132, 2024-09-12T00:14:55.616 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001614009 2024-09-12T00:14:55.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.616 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 0 2024-09-12T00:14:55.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-09-12T00:14:55.617 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 22, 2024-09-12T00:14:55.617 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 29, 2024-09-12T00:14:55.617 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 7, 2024-09-12T00:14:55.617 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 21, 2024-09-12T00:14:55.617 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 28, 2024-09-12T00:14:55.617 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 7, 2024-09-12T00:14:55.617 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 17, 2024-09-12T00:14:55.617 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 32, 2024-09-12T00:14:55.617 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 15, 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 2, 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 4, 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 2, 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 51744, 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 223520 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 26, 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 2, 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 19, 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 16, 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 7, 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.618 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2, 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.001882873, 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000941436 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-09-12T00:14:55.619 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000278870, 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000278870 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.621 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-09-12T00:14:55.622 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.623 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.623 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.623 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-09-12T00:14:55.623 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.623 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.624 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.624 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-09-12T00:14:55.624 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.624 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.624 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.624 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-09-12T00:14:55.624 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.624 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.624 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000215100, 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000215100 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.625 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.626 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.627 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.627 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-09-12T00:14:55.627 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.627 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.627 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.627 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-09-12T00:14:55.627 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.627 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.627 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.628 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-09-12T00:14:55.629 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.002083568, 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002083568 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-09-12T00:14:55.630 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 2, 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 1, 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 1, 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 1, 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 931, 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:14:55.631 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:14:55.632 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-12T00:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 266047, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 98, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-12T00:14:55.634 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 9144, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 172, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 89421, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 358, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-12T00:14:55.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 67, 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 36393, 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 30, 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 67, 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 67, 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.489988507, 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.007313261 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-09-12T00:14:55.636 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 67, 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 93 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 67, 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 1, 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 66, 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 0, 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 10, 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 1, 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 15, 2024-09-12T00:14:55.637 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 10, 2024-09-12T00:14:55.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-09-12T00:14:55.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-09-12T00:14:55.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-09-12T00:14:55.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-09-12T00:14:55.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 14, 2024-09-12T00:14:55.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-09-12T00:14:55.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-09-12T00:14:55.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-09-12T00:14:55.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 20, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-09-12T00:14:55.639 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-09-12T00:14:55.640 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-09-12T00:14:55.640 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-09-12T00:14:55.640 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-09-12T00:14:55.640 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-09-12T00:14:55.640 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-09-12T00:14:55.640 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-09-12T00:14:55.640 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-09-12T00:14:55.640 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-09-12T00:14:55.640 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 90, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 4, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 9, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 14, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 5, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 21, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 0, 2024-09-12T00:14:55.641 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 2 2024-09-12T00:14:55.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.642 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-09-12T00:14:55.642 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 1, 2024-09-12T00:14:55.642 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:14:55.642 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-09-12T00:14:55.642 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-09-12T00:14:55.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-09-12T00:14:55.642 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-09-12T00:14:55.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.642 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-09-12T00:14:55.642 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 2, 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 1, 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 2, 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 1, 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 3199, 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 1360235, 2024-09-12T00:14:55.643 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 3199, 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 3199, 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1360235, 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-09-12T00:14:55.644 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 67, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 36502, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 67, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 36502, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.645 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 67, 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 67, 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 67, 2024-09-12T00:14:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 67, 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 1, 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 109, 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:55.647 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 1, 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 1, 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 109, 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x55b25353e500": { 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T00:14:55.648 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 17, 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 24659, 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 17, 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 14, 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 24659, 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:55.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:55.650 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-12T00:14:56.408 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-09-12T00:14:56.408 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-09-12T00:14:56.408 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-09-12T00:14:56.408 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T00:14:56.408 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T00:14:56.656 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:14:57.057 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:56 smithi134 ceph-mon[34893]: pgmap v827: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-12T00:14:57.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:56 smithi006 ceph-mon[30947]: pgmap v827: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-12T00:14:57.159 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-12T00:14:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:14:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 3008, 2024-09-12T00:14:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 3010, 2024-09-12T00:14:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 874642, 2024-09-12T00:14:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 956551, 2024-09-12T00:14:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 6, 2024-09-12T00:14:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 2, 2024-09-12T00:14:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.239809150, 2024-09-12T00:14:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.073882262, 2024-09-12T00:14:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.065148804, 2024-09-12T00:14:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.083487158, 2024-09-12T00:14:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3008, 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.105699882, 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000035139 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:14:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 4, 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 231, 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 876, 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 551386, 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 5, 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 3, 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.013275874, 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.009643338, 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.001513133, 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000070612, 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 229, 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.015078279, 2024-09-12T00:14:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000065844 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 550688 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 329, 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 312, 2024-09-12T00:14:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 867612, 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 187182, 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 4, 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 2, 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.047430442, 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.020609502, 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.034390086, 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000033755, 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 312, 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.026549596, 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000085094 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:14:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 867344, 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 186864 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T00:14:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 5021, 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.127566435, 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000025406 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 0, 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 0, 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 0, 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-09-12T00:14:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 0, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 2, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 0, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 2, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 2, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 0, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 0, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 0, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 1, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 0, 2024-09-12T00:14:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:14:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T00:14:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 0, 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 0, 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 0, 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 0 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 0, 2024-09-12T00:14:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-09-12T00:14:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 0, 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 0, 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-09-12T00:14:57.173 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 17, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 0, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 2, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 4218963, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 4216740, 2024-09-12T00:14:57.174 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 17 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 4, 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 17, 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 13, 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 2, 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 15, 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 13, 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 2, 2024-09-12T00:14:57.175 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 16, 2024-09-12T00:14:57.176 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 14, 2024-09-12T00:14:57.176 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 0, 2024-09-12T00:14:57.176 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 0, 2024-09-12T00:14:57.176 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 0, 2024-09-12T00:14:57.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 48028, 2024-09-12T00:14:57.176 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 215328 2024-09-12T00:14:57.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.177 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-09-12T00:14:57.177 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 0, 2024-09-12T00:14:57.177 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 0, 2024-09-12T00:14:57.177 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 0, 2024-09-12T00:14:57.177 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 0, 2024-09-12T00:14:57.177 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 0, 2024-09-12T00:14:57.177 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-09-12T00:14:57.177 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.177 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.177 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.178 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-09-12T00:14:57.178 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.178 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.178 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.178 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-09-12T00:14:57.178 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.178 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.178 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.179 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-09-12T00:14:57.179 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.179 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.179 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.179 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-09-12T00:14:57.179 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.179 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.179 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.179 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.180 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.181 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-09-12T00:14:57.181 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.181 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.181 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.181 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-09-12T00:14:57.181 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.182 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.182 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.182 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-09-12T00:14:57.182 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.182 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.182 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.182 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-09-12T00:14:57.182 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.183 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.183 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.183 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-09-12T00:14:57.184 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.184 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.184 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.184 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-09-12T00:14:57.184 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.184 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.184 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.185 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-09-12T00:14:57.185 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.185 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.185 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.185 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-09-12T00:14:57.185 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.185 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.185 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.186 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-09-12T00:14:57.186 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.186 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.186 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.186 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-09-12T00:14:57.186 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.186 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.187 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.187 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-09-12T00:14:57.187 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.187 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.187 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.187 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-09-12T00:14:57.187 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.187 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.188 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.188 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-09-12T00:14:57.188 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.188 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.189 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-09-12T00:14:57.190 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.190 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.190 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.190 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-09-12T00:14:57.190 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.190 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.190 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.191 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-09-12T00:14:57.191 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.191 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.191 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.191 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-09-12T00:14:57.191 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.191 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.192 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.192 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-09-12T00:14:57.192 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.192 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.192 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.192 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-09-12T00:14:57.192 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.192 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.193 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.193 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:14:57.193 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:14:57.193 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-09-12T00:14:57.193 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.193 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.193 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.193 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:57.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.194 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-09-12T00:14:57.194 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-09-12T00:14:57.194 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 2, 2024-09-12T00:14:57.194 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 1, 2024-09-12T00:14:57.194 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 2, 2024-09-12T00:14:57.194 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-09-12T00:14:57.194 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 0, 2024-09-12T00:14:57.194 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 0, 2024-09-12T00:14:57.194 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 3087, 2024-09-12T00:14:57.195 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-09-12T00:14:57.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.195 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-12T00:14:57.195 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:14:57.195 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-12T00:14:57.195 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:14:57.195 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:14:57.195 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:14:57.195 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:14:57.195 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:14:57.195 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:14:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 182855, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 49, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 9144, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 172, 2024-09-12T00:14:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 13456, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 36, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 3011, 2024-09-12T00:14:57.199 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 21, 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 3, 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 3011, 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3011, 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 3.495917196, 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001161048 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3011, 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 3012 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.200 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 3011, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 3011, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 0, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 1964, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 0, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 1045, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 0, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 0, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-09-12T00:14:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 1, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:14:57.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-09-12T00:14:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 90, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 4, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 4, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 5, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 1, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 0, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 2, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 0 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.204 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 0, 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 0, 2024-09-12T00:14:57.205 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 0, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 0, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 3337, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 1423157, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 3337, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 3337, 2024-09-12T00:14:57.206 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1423157, 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 3011, 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 24664, 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 3011, 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 24664, 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-09-12T00:14:57.208 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:57.209 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T00:14:57.209 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T00:14:57.209 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:57.209 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:57.209 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 3011, 2024-09-12T00:14:57.209 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 3011, 2024-09-12T00:14:57.209 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 3011, 2024-09-12T00:14:57.209 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 3011, 2024-09-12T00:14:57.209 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:57.209 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.209 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.209 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T00:14:57.210 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x55d53f4706e0": { 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T00:14:57.211 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T00:14:57.212 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T00:14:57.212 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T00:14:57.212 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T00:14:57.212 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-09-12T00:14:57.212 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-09-12T00:14:57.212 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T00:14:57.212 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T00:14:57.212 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T00:14:57.212 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T00:14:57.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:57.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T00:14:57.213 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-12T00:14:57.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:56 smithi039 ceph-mon[34543]: pgmap v827: 129 pgs: 129 active+clean; 4.9 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-12T00:14:57.985 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-12T00:14:57.985 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-12T00:14:57.986 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-12T00:14:57.986 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-12T00:14:57.996 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-12T00:14:57.996 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-12T00:14:57.996 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T00:14:58.029 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-12T00:14:58.029 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T00:14:58.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T00:14:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:14:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.874+0000 7f5e66411640 1 -- 172.21.15.6:0/2421073036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e60102d90 msgr2=0x7f5e60103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.874+0000 7f5e66411640 1 --2- 172.21.15.6:0/2421073036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e60102d90 0x7f5e60103170 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009930 tx=0x7f5e5002a420 comp rx=0 tx=0).stop 2024-09-12T00:14:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.875+0000 7f5e66411640 1 -- 172.21.15.6:0/2421073036 shutdown_connections 2024-09-12T00:14:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.875+0000 7f5e66411640 1 --2- 172.21.15.6:0/2421073036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e60108290 0x7f5e6010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.875+0000 7f5e66411640 1 --2- 172.21.15.6:0/2421073036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e60103740 0x7f5e60107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.875+0000 7f5e66411640 1 --2- 172.21.15.6:0/2421073036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e60102d90 0x7f5e60103170 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.875+0000 7f5e66411640 1 -- 172.21.15.6:0/2421073036 >> 172.21.15.6:0/2421073036 conn(0x7f5e600fc7d0 msgr2=0x7f5e600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.875+0000 7f5e66411640 1 -- 172.21.15.6:0/2421073036 shutdown_connections 2024-09-12T00:14:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.875+0000 7f5e66411640 1 -- 172.21.15.6:0/2421073036 wait complete. 2024-09-12T00:14:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.875+0000 7f5e66411640 1 Processor -- start 2024-09-12T00:14:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.875+0000 7f5e66411640 1 -- start start 2024-09-12T00:14:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e66411640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e60102d90 0x7f5e601009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e66411640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e60103740 0x7f5e60100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e66411640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e60108290 0x7f5e60101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e66411640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5e60111f40 con 0x7f5e60103740 2024-09-12T00:14:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e66411640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5e60111dc0 con 0x7f5e60108290 2024-09-12T00:14:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e66411640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601120c0 con 0x7f5e60102d90 2024-09-12T00:14:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e5f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e60103740 0x7f5e60100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e5f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e60103740 0x7f5e60100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46420/0 (socket says 172.21.15.6:46420) 2024-09-12T00:14:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e5f7fe640 1 -- 172.21.15.6:0/1864947951 learned_addr learned my addr 172.21.15.6:0/1864947951 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:14:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e5ffff640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e60102d90 0x7f5e601009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e649ae640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e60108290 0x7f5e60101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e5f7fe640 1 -- 172.21.15.6:0/1864947951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e60102d90 msgr2=0x7f5e601009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e5f7fe640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e60102d90 0x7f5e601009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e5f7fe640 1 -- 172.21.15.6:0/1864947951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e60108290 msgr2=0x7f5e60101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e5f7fe640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e60108290 0x7f5e60101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e5f7fe640 1 -- 172.21.15.6:0/1864947951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e601a69a0 con 0x7f5e60103740 2024-09-12T00:14:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e649ae640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e60108290 0x7f5e60101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:14:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.876+0000 7f5e5f7fe640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e60103740 0x7f5e60100f30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400c970 tx=0x7f5e5400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.877+0000 7f5e5d7fa640 1 -- 172.21.15.6:0/1864947951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e54007bb0 con 0x7f5e60103740 2024-09-12T00:14:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.877+0000 7f5e66411640 1 -- 172.21.15.6:0/1864947951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e601a6c90 con 0x7f5e60103740 2024-09-12T00:14:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.877+0000 7f5e5d7fa640 1 -- 172.21.15.6:0/1864947951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e54007d50 con 0x7f5e60103740 2024-09-12T00:14:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.877+0000 7f5e5d7fa640 1 -- 172.21.15.6:0/1864947951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5400f450 con 0x7f5e60103740 2024-09-12T00:14:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.877+0000 7f5e66411640 1 -- 172.21.15.6:0/1864947951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e601a7180 con 0x7f5e60103740 2024-09-12T00:14:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.878+0000 7f5e66411640 1 -- 172.21.15.6:0/1864947951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e6006a7f0 con 0x7f5e60103740 2024-09-12T00:14:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.879+0000 7f5e5d7fa640 1 -- 172.21.15.6:0/1864947951 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f5e54004eb0 con 0x7f5e60103740 2024-09-12T00:14:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.880+0000 7f5e5d7fa640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5e480a2b80 0x7f5e480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:14:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.880+0000 7f5e5ffff640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5e480a2b80 0x7f5e480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:14:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.880+0000 7f5e5d7fa640 1 -- 172.21.15.6:0/1864947951 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f5e540cf150 con 0x7f5e60103740 2024-09-12T00:14:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.881+0000 7f5e5ffff640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5e480a2b80 0x7f5e480a5040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009900 tx=0x7f5e50000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:14:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:58.885+0000 7f5e5d7fa640 1 -- 172.21.15.6:0/1864947951 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e54014030 con 0x7f5e60103740 2024-09-12T00:14:59.072 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:58 smithi006 ceph-mon[30947]: pgmap v828: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T00:14:59.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.075+0000 7f5e66411640 1 -- 172.21.15.6:0/1864947951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5e6010a2a0 con 0x7f5e60103740 2024-09-12T00:14:59.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.076+0000 7f5e5d7fa640 1 -- 172.21.15.6:0/1864947951 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+581 (secure 0 0 0) 0x7f5e5409bcc0 con 0x7f5e60103740 2024-09-12T00:14:59.076 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4111388064 2024-09-12T23:50:00.847021+0000 2024-09-12T00:14:59.076 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2784482923 2024-09-12T23:50:00.847021+0000 2024-09-12T00:14:59.076 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/2279576750 2024-09-12T23:50:00.847021+0000 2024-09-12T00:14:59.076 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/1826197239 2024-09-12T23:49:36.127456+0000 2024-09-12T00:14:59.076 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/1826197239 2024-09-12T23:49:36.127456+0000 2024-09-12T00:14:59.076 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/619991212 2024-09-12T23:50:00.847021+0000 2024-09-12T00:14:59.076 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3073584278 2024-09-12T23:49:36.127456+0000 2024-09-12T00:14:59.076 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/2279576750 2024-09-12T23:50:00.847021+0000 2024-09-12T00:14:59.077 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3649466939 2024-09-12T23:49:36.127456+0000 2024-09-12T00:14:59.077 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2071921193 2024-09-12T23:49:36.127456+0000 2024-09-12T00:14:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:listed 10 entries 2024-09-12T00:14:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.078+0000 7f5e66411640 1 -- 172.21.15.6:0/1864947951 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5e480a2b80 msgr2=0x7f5e480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.078+0000 7f5e66411640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5e480a2b80 0x7f5e480a5040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009900 tx=0x7f5e50000bc0 comp rx=0 tx=0).stop 2024-09-12T00:14:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.078+0000 7f5e66411640 1 -- 172.21.15.6:0/1864947951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e60103740 msgr2=0x7f5e60100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:14:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.078+0000 7f5e66411640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e60103740 0x7f5e60100f30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400c970 tx=0x7f5e5400ce30 comp rx=0 tx=0).stop 2024-09-12T00:14:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.078+0000 7f5e66411640 1 -- 172.21.15.6:0/1864947951 shutdown_connections 2024-09-12T00:14:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.078+0000 7f5e66411640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f5e480a2b80 0x7f5e480a5040 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.078+0000 7f5e66411640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e60108290 0x7f5e60101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.078+0000 7f5e66411640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e60103740 0x7f5e60100f30 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.078+0000 7f5e66411640 1 --2- 172.21.15.6:0/1864947951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e60102d90 0x7f5e601009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:14:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.078+0000 7f5e66411640 1 -- 172.21.15.6:0/1864947951 >> 172.21.15.6:0/1864947951 conn(0x7f5e600fc7d0 msgr2=0x7f5e60106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:14:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.079+0000 7f5e66411640 1 -- 172.21.15.6:0/1864947951 shutdown_connections 2024-09-12T00:14:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:14:59.079+0000 7f5e66411640 1 -- 172.21.15.6:0/1864947951 wait complete. 2024-09-12T00:14:59.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:58 smithi134 ceph-mon[34893]: pgmap v828: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T00:14:59.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:58 smithi039 ceph-mon[34543]: pgmap v828: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T00:14:59.755 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-12T00:14:59.755 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T00:14:59.774 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T00:15:00.076 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:15:00.101 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:14:59 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1864947951' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T00:15:00.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:14:59 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1864947951' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T00:15:00.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:14:59 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1864947951' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T00:15:00.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.558+0000 7f766eba3640 1 -- 172.21.15.6:0/224507573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7668101de0 msgr2=0x7f76681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:00.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.558+0000 7f766eba3640 1 --2- 172.21.15.6:0/224507573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7668101de0 0x7f76681021c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f765c009900 tx=0x7f765c02a410 comp rx=0 tx=0).stop 2024-09-12T00:15:00.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.558+0000 7f766eba3640 1 -- 172.21.15.6:0/224507573 shutdown_connections 2024-09-12T00:15:00.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.558+0000 7f766eba3640 1 --2- 172.21.15.6:0/224507573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668106f10 0x7f766810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.558+0000 7f766eba3640 1 --2- 172.21.15.6:0/224507573 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7668102790 0x7f76681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.558+0000 7f766eba3640 1 --2- 172.21.15.6:0/224507573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7668101de0 0x7f76681021c0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.558+0000 7f766eba3640 1 -- 172.21.15.6:0/224507573 >> 172.21.15.6:0/224507573 conn(0x7f76680fd8c0 msgr2=0x7f76680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.558+0000 7f766eba3640 1 -- 172.21.15.6:0/224507573 shutdown_connections 2024-09-12T00:15:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.558+0000 7f766eba3640 1 -- 172.21.15.6:0/224507573 wait complete. 2024-09-12T00:15:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.559+0000 7f766eba3640 1 Processor -- start 2024-09-12T00:15:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.559+0000 7f766eba3640 1 -- start start 2024-09-12T00:15:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.559+0000 7f766eba3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7668101de0 0x7f7668198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.559+0000 7f766eba3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668102790 0x7f76681988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.559+0000 7f766eba3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7668106f10 0x7f766819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.559+0000 7f766eba3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7668111e20 con 0x7f7668101de0 2024-09-12T00:15:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.559+0000 7f766eba3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7668111ca0 con 0x7f7668106f10 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.559+0000 7f766eba3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7668111fa0 con 0x7f7668102790 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.559+0000 7f766c93f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7668101de0 0x7f7668198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.559+0000 7f766c93f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7668101de0 0x7f7668198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49448/0 (socket says 172.21.15.6:49448) 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.559+0000 7f766c93f640 1 -- 172.21.15.6:0/2692651014 learned_addr learned my addr 172.21.15.6:0/2692651014 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f766d140640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7668106f10 0x7f766819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f766c93f640 1 -- 172.21.15.6:0/2692651014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668102790 msgr2=0x7f76681988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f7667fff640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668102790 0x7f76681988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f766c93f640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668102790 0x7f76681988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f766c93f640 1 -- 172.21.15.6:0/2692651014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7668106f10 msgr2=0x7f766819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f766c93f640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7668106f10 0x7f766819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f766c93f640 1 -- 172.21.15.6:0/2692651014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766819d330 con 0x7f7668101de0 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f7667fff640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668102790 0x7f76681988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:15:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f766d140640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7668106f10 0x7f766819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f766c93f640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7668101de0 0x7f7668198380 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f765c005940 tx=0x7f765c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f7665ffb640 1 -- 172.21.15.6:0/2692651014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c03f030 con 0x7f7668101de0 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f766eba3640 1 -- 172.21.15.6:0/2692651014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766819d5c0 con 0x7f7668101de0 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f7665ffb640 1 -- 172.21.15.6:0/2692651014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f765c003aa0 con 0x7f7668101de0 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f7665ffb640 1 -- 172.21.15.6:0/2692651014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c035070 con 0x7f7668101de0 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.560+0000 7f766eba3640 1 -- 172.21.15.6:0/2692651014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76681a4f00 con 0x7f7668101de0 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.561+0000 7f766eba3640 1 -- 172.21.15.6:0/2692651014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76681021c0 con 0x7f7668101de0 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.563+0000 7f7665ffb640 1 -- 172.21.15.6:0/2692651014 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f765c042030 con 0x7f7668101de0 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.563+0000 7f7665ffb640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f76580a2b80 0x7f76580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.563+0000 7f7665ffb640 1 -- 172.21.15.6:0/2692651014 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f765c0efc90 con 0x7f7668101de0 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.563+0000 7f7667fff640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f76580a2b80 0x7f76580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.564+0000 7f7667fff640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f76580a2b80 0x7f76580a5040 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f76680fdce0 tx=0x7f7654005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.568+0000 7f7665ffb640 1 -- 172.21.15.6:0/2692651014 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f765c0bc800 con 0x7f7668101de0 2024-09-12T00:15:00.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.757+0000 7f766eba3640 1 -- 172.21.15.6:0/2692651014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f76681996e0 con 0x7f7668101de0 2024-09-12T00:15:00.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.757+0000 7f7665ffb640 1 -- 172.21.15.6:0/2692651014 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+581 (secure 0 0 0) 0x7f765c0bc100 con 0x7f7668101de0 2024-09-12T00:15:00.757 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4111388064 2024-09-12T23:50:00.847021+0000 2024-09-12T00:15:00.757 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2784482923 2024-09-12T23:50:00.847021+0000 2024-09-12T00:15:00.758 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/2279576750 2024-09-12T23:50:00.847021+0000 2024-09-12T00:15:00.758 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/1826197239 2024-09-12T23:49:36.127456+0000 2024-09-12T00:15:00.758 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/1826197239 2024-09-12T23:49:36.127456+0000 2024-09-12T00:15:00.758 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/619991212 2024-09-12T23:50:00.847021+0000 2024-09-12T00:15:00.758 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3073584278 2024-09-12T23:49:36.127456+0000 2024-09-12T00:15:00.758 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/2279576750 2024-09-12T23:50:00.847021+0000 2024-09-12T00:15:00.758 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3649466939 2024-09-12T23:49:36.127456+0000 2024-09-12T00:15:00.758 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2071921193 2024-09-12T23:49:36.127456+0000 2024-09-12T00:15:00.758 INFO:teuthology.orchestra.run.smithi006.stderr:listed 10 entries 2024-09-12T00:15:00.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.760+0000 7f766eba3640 1 -- 172.21.15.6:0/2692651014 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f76580a2b80 msgr2=0x7f76580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:00.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.760+0000 7f766eba3640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f76580a2b80 0x7f76580a5040 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f76680fdce0 tx=0x7f7654005e50 comp rx=0 tx=0).stop 2024-09-12T00:15:00.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.760+0000 7f766eba3640 1 -- 172.21.15.6:0/2692651014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7668101de0 msgr2=0x7f7668198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:00.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.760+0000 7f766eba3640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7668101de0 0x7f7668198380 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f765c005940 tx=0x7f765c004270 comp rx=0 tx=0).stop 2024-09-12T00:15:00.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.760+0000 7f766eba3640 1 -- 172.21.15.6:0/2692651014 shutdown_connections 2024-09-12T00:15:00.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.761+0000 7f766eba3640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f76580a2b80 0x7f76580a5040 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:00.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.761+0000 7f766eba3640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7668106f10 0x7f766819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:00.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.761+0000 7f766eba3640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668102790 0x7f76681988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:00.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.761+0000 7f766eba3640 1 --2- 172.21.15.6:0/2692651014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7668101de0 0x7f7668198380 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:00.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.761+0000 7f766eba3640 1 -- 172.21.15.6:0/2692651014 >> 172.21.15.6:0/2692651014 conn(0x7f76680fd8c0 msgr2=0x7f76680fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:00.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.761+0000 7f766eba3640 1 -- 172.21.15.6:0/2692651014 shutdown_connections 2024-09-12T00:15:00.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:00.761+0000 7f766eba3640 1 -- 172.21.15.6:0/2692651014 wait complete. 2024-09-12T00:15:01.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:00 smithi006 ceph-mon[30947]: pgmap v829: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T00:15:01.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:00 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2692651014' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T00:15:01.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:00 smithi134 ceph-mon[34893]: pgmap v829: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T00:15:01.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:00 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2692651014' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T00:15:01.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:00 smithi039 ceph-mon[34543]: pgmap v829: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T00:15:01.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:00 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2692651014' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T00:15:01.467 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2024-09-12T00:15:01.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:15:01.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T00:15:01.509 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:15:01.515 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[85882]: fuse finished with error 0 and tester_r 0 2024-09-12T00:15:03.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:02 smithi006 ceph-mon[30947]: pgmap v830: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T00:15:03.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:02 smithi134 ceph-mon[34893]: pgmap v830: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T00:15:03.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:02 smithi039 ceph-mon[34543]: pgmap v830: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T00:15:05.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:04 smithi006 ceph-mon[30947]: pgmap v831: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-12T00:15:05.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:04 smithi134 ceph-mon[34893]: pgmap v831: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-12T00:15:05.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:04 smithi039 ceph-mon[34543]: pgmap v831: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-12T00:15:07.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:06 smithi006 ceph-mon[30947]: pgmap v832: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-12T00:15:07.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:06 smithi134 ceph-mon[34893]: pgmap v832: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-12T00:15:07.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:06 smithi039 ceph-mon[34543]: pgmap v832: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-12T00:15:07.610 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-09-12T00:15:07.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:15:07.611 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T00:15:07.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:15:07.633 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-12T00:15:07.722 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T00:15:07.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:15:07.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T00:15:07.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:15:07.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-09-12T00:15:07.857 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T00:15:07.872 INFO:tasks.cephadm:Teardown begin 2024-09-12T00:15:07.872 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T00:15:07.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:15:08.136 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:15:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.635+0000 7fa559d02640 1 -- 172.21.15.6:0/2891890769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa554101de0 msgr2=0x7fa5541021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.635+0000 7fa559d02640 1 --2- 172.21.15.6:0/2891890769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa554101de0 0x7fa5541021c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa544009900 tx=0x7fa54402a410 comp rx=0 tx=0).stop 2024-09-12T00:15:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.635+0000 7fa559d02640 1 -- 172.21.15.6:0/2891890769 shutdown_connections 2024-09-12T00:15:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.635+0000 7fa559d02640 1 --2- 172.21.15.6:0/2891890769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa554106f10 0x7fa55410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.635+0000 7fa559d02640 1 --2- 172.21.15.6:0/2891890769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa554102790 0x7fa5541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.635+0000 7fa559d02640 1 --2- 172.21.15.6:0/2891890769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa554101de0 0x7fa5541021c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.635+0000 7fa559d02640 1 -- 172.21.15.6:0/2891890769 >> 172.21.15.6:0/2891890769 conn(0x7fa5540fd8c0 msgr2=0x7fa5540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.635+0000 7fa559d02640 1 -- 172.21.15.6:0/2891890769 shutdown_connections 2024-09-12T00:15:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.635+0000 7fa559d02640 1 -- 172.21.15.6:0/2891890769 wait complete. 2024-09-12T00:15:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa559d02640 1 Processor -- start 2024-09-12T00:15:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa559d02640 1 -- start start 2024-09-12T00:15:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa559d02640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa554101de0 0x7fa554198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa559d02640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa554102790 0x7fa5541988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa559d02640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa554106f10 0x7fa55419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa559d02640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa554111e30 con 0x7fa554106f10 2024-09-12T00:15:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa559d02640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa554111cb0 con 0x7fa554101de0 2024-09-12T00:15:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa559d02640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa554111fb0 con 0x7fa554102790 2024-09-12T00:15:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa553fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa554106f10 0x7fa55419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa5537fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa554101de0 0x7fa554198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa553fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa554106f10 0x7fa55419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49464/0 (socket says 172.21.15.6:49464) 2024-09-12T00:15:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa5537fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa554101de0 0x7fa554198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.6:36110/0 (socket says 172.21.15.6:36110) 2024-09-12T00:15:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa553fff640 1 -- 172.21.15.6:0/1224519322 learned_addr learned my addr 172.21.15.6:0/1224519322 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:15:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.636+0000 7fa552ffd640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa554102790 0x7fa5541988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.637+0000 7fa553fff640 1 -- 172.21.15.6:0/1224519322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa554102790 msgr2=0x7fa5541988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.637+0000 7fa553fff640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa554102790 0x7fa5541988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.637+0000 7fa553fff640 1 -- 172.21.15.6:0/1224519322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa554101de0 msgr2=0x7fa554198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.637+0000 7fa553fff640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa554101de0 0x7fa554198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.637+0000 7fa553fff640 1 -- 172.21.15.6:0/1224519322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55419d340 con 0x7fa554106f10 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.637+0000 7fa5537fe640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa554101de0 0x7fa554198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.637+0000 7fa553fff640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa554106f10 0x7fa55419cc60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00eaa0 tx=0x7fa54c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.637+0000 7fa550ff9640 1 -- 172.21.15.6:0/1224519322 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c00cdb0 con 0x7fa554106f10 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.637+0000 7fa559d02640 1 -- 172.21.15.6:0/1224519322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55419d630 con 0x7fa554106f10 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.637+0000 7fa550ff9640 1 -- 172.21.15.6:0/1224519322 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa54c005020 con 0x7fa554106f10 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.637+0000 7fa550ff9640 1 -- 172.21.15.6:0/1224519322 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0116d0 con 0x7fa554106f10 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.637+0000 7fa559d02640 1 -- 172.21.15.6:0/1224519322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5541a4f10 con 0x7fa554106f10 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.638+0000 7fa559d02640 1 -- 172.21.15.6:0/1224519322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5541021c0 con 0x7fa554106f10 2024-09-12T00:15:08.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.640+0000 7fa550ff9640 1 -- 172.21.15.6:0/1224519322 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fa54c0051d0 con 0x7fa554106f10 2024-09-12T00:15:08.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.640+0000 7fa550ff9640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa53c0a2b80 0x7fa53c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:08.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.640+0000 7fa5537fe640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa53c0a2b80 0x7fa53c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:08.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.640+0000 7fa550ff9640 1 -- 172.21.15.6:0/1224519322 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fa54c0cf860 con 0x7fa554106f10 2024-09-12T00:15:08.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.641+0000 7fa5537fe640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa53c0a2b80 0x7fa53c0a5040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa544005ab0 tx=0x7fa544005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:08.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.644+0000 7fa550ff9640 1 -- 172.21.15.6:0/1224519322 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa54c016030 con 0x7fa554106f10 2024-09-12T00:15:08.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.855+0000 7fa559d02640 1 -- 172.21.15.6:0/1224519322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5541996f0 con 0x7fa554106f10 2024-09-12T00:15:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.856+0000 7fa550ff9640 1 -- 172.21.15.6:0/1224519322 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11955 (secure 0 0 0) 0x7fa5541996f0 con 0x7fa554106f10 2024-09-12T00:15:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-12T00:15:08.856 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"btime":"2024-09-12T00:14:16:568514+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:56:58.063963+0000","modified":"2024-09-12T00:14:15.908070+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24478,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/809129212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":809129212},{"type":"v1","addr":"172.21.15.6:6839","nonce":809129212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/500771395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":500771395},{"type":"v1","addr":"172.21.15.6:6841","nonce":500771395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":18,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":19,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":18,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.39:6839/3561706320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3561706320},{"type":"v1","addr":"172.21.15.39:6839","nonce":3561706320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24490,24491,24478,24472,24461]},"id":1}]} 2024-09-12T00:15:08.857 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 37 2024-09-12T00:15:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.858+0000 7fa559d02640 1 -- 172.21.15.6:0/1224519322 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa53c0a2b80 msgr2=0x7fa53c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.858+0000 7fa559d02640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa53c0a2b80 0x7fa53c0a5040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa544005ab0 tx=0x7fa544005a20 comp rx=0 tx=0).stop 2024-09-12T00:15:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.858+0000 7fa559d02640 1 -- 172.21.15.6:0/1224519322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa554106f10 msgr2=0x7fa55419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.858+0000 7fa559d02640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa554106f10 0x7fa55419cc60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00eaa0 tx=0x7fa54c00ef60 comp rx=0 tx=0).stop 2024-09-12T00:15:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.858+0000 7fa559d02640 1 -- 172.21.15.6:0/1224519322 shutdown_connections 2024-09-12T00:15:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.858+0000 7fa559d02640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fa53c0a2b80 0x7fa53c0a5040 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.858+0000 7fa559d02640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa554106f10 0x7fa55419cc60 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:08.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.858+0000 7fa559d02640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa554102790 0x7fa5541988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:08.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.858+0000 7fa559d02640 1 --2- 172.21.15.6:0/1224519322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa554101de0 0x7fa554198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:08.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.858+0000 7fa559d02640 1 -- 172.21.15.6:0/1224519322 >> 172.21.15.6:0/1224519322 conn(0x7fa5540fd8c0 msgr2=0x7fa5540fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:08.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.859+0000 7fa559d02640 1 -- 172.21.15.6:0/1224519322 shutdown_connections 2024-09-12T00:15:08.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:08.859+0000 7fa559d02640 1 -- 172.21.15.6:0/1224519322 wait complete. 2024-09-12T00:15:09.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:08 smithi006 ceph-mon[30947]: pgmap v833: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-12T00:15:09.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:08 smithi134 ceph-mon[34893]: pgmap v833: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-12T00:15:09.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:08 smithi039 ceph-mon[34543]: pgmap v833: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-12T00:15:09.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:15:09.758 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:15:10.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:09 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1224519322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:15:10.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:09 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1224519322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:15:10.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.276+0000 7f75ad9e1640 1 -- 172.21.15.6:0/3447729996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a8101de0 msgr2=0x7f75a81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:10.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.276+0000 7f75ad9e1640 1 --2- 172.21.15.6:0/3447729996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a8101de0 0x7f75a81021c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7598009900 tx=0x7f759802a410 comp rx=0 tx=0).stop 2024-09-12T00:15:10.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.277+0000 7f75ad9e1640 1 -- 172.21.15.6:0/3447729996 shutdown_connections 2024-09-12T00:15:10.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.277+0000 7f75ad9e1640 1 --2- 172.21.15.6:0/3447729996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75a8106f10 0x7f75a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:10.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.277+0000 7f75ad9e1640 1 --2- 172.21.15.6:0/3447729996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75a8102790 0x7f75a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:10.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.277+0000 7f75ad9e1640 1 --2- 172.21.15.6:0/3447729996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a8101de0 0x7f75a81021c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:10.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.277+0000 7f75ad9e1640 1 -- 172.21.15.6:0/3447729996 >> 172.21.15.6:0/3447729996 conn(0x7f75a80fd8c0 msgr2=0x7f75a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:10.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.277+0000 7f75ad9e1640 1 -- 172.21.15.6:0/3447729996 shutdown_connections 2024-09-12T00:15:10.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.277+0000 7f75ad9e1640 1 -- 172.21.15.6:0/3447729996 wait complete. 2024-09-12T00:15:10.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.277+0000 7f75ad9e1640 1 Processor -- start 2024-09-12T00:15:10.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.277+0000 7f75ad9e1640 1 -- start start 2024-09-12T00:15:10.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75ad9e1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75a8101de0 0x7f75a80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:10.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75ad9e1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a8102790 0x7f75a8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:10.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75ad9e1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75a8106f10 0x7f75a8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:10.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75ad9e1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f75a8111e20 con 0x7f75a8102790 2024-09-12T00:15:10.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75ad9e1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f75a8111ca0 con 0x7f75a8106f10 2024-09-12T00:15:10.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75ad9e1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75a8111fa0 con 0x7f75a8101de0 2024-09-12T00:15:10.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75a67fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a8102790 0x7f75a8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:10.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75a67fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a8102790 0x7f75a8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49482/0 (socket says 172.21.15.6:49482) 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75a67fc640 1 -- 172.21.15.6:0/2485502037 learned_addr learned my addr 172.21.15.6:0/2485502037 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75a6ffd640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75a8101de0 0x7f75a80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75a77fe640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75a8106f10 0x7f75a8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75a67fc640 1 -- 172.21.15.6:0/2485502037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75a8101de0 msgr2=0x7f75a80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75a67fc640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75a8101de0 0x7f75a80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75a67fc640 1 -- 172.21.15.6:0/2485502037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75a8106f10 msgr2=0x7f75a8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75a67fc640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75a8106f10 0x7f75a8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75a67fc640 1 -- 172.21.15.6:0/2485502037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a81a6840 con 0x7f75a8102790 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.278+0000 7f75a67fc640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a8102790 0x7f75a8074a30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f759c00e9f0 tx=0x7f759c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.279+0000 7f75ac9df640 1 -- 172.21.15.6:0/2485502037 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c00cd80 con 0x7f75a8102790 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.279+0000 7f75ac9df640 1 -- 172.21.15.6:0/2485502037 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f759c0108e0 con 0x7f75a8102790 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.279+0000 7f75ad9e1640 1 -- 172.21.15.6:0/2485502037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a81a6b30 con 0x7f75a8102790 2024-09-12T00:15:10.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.279+0000 7f75ac9df640 1 -- 172.21.15.6:0/2485502037 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c018920 con 0x7f75a8102790 2024-09-12T00:15:10.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.279+0000 7f75ad9e1640 1 -- 172.21.15.6:0/2485502037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a81a70c0 con 0x7f75a8102790 2024-09-12T00:15:10.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.280+0000 7f75ad9e1640 1 -- 172.21.15.6:0/2485502037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a81021c0 con 0x7f75a8102790 2024-09-12T00:15:10.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.281+0000 7f75ac9df640 1 -- 172.21.15.6:0/2485502037 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f759c010a90 con 0x7f75a8102790 2024-09-12T00:15:10.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.282+0000 7f75ac9df640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75900a2c00 0x7f75900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:10.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.282+0000 7f75a6ffd640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75900a2c00 0x7f75900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:10.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.282+0000 7f75ac9df640 1 -- 172.21.15.6:0/2485502037 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f759c0cfaf0 con 0x7f75a8102790 2024-09-12T00:15:10.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.282+0000 7f75a6ffd640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75900a2c00 0x7f75900a50c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7598031440 tx=0x7f7598005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:10.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.285+0000 7f75ac9df640 1 -- 172.21.15.6:0/2485502037 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f759c09c010 con 0x7f75a8102790 2024-09-12T00:15:10.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:09 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1224519322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:15:10.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.497+0000 7f75ad9e1640 1 -- 172.21.15.6:0/2485502037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75a8075a20 con 0x7f75a8102790 2024-09-12T00:15:10.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.498+0000 7f75ac9df640 1 -- 172.21.15.6:0/2485502037 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11955 (secure 0 0 0) 0x7f75a8075a20 con 0x7f75a8102790 2024-09-12T00:15:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-12T00:15:10.498 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"btime":"2024-09-12T00:14:16:568514+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3405315500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3405315500},{"type":"v1","addr":"172.21.15.6:6835","nonce":3405315500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2319638912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2319638912},{"type":"v1","addr":"172.21.15.6:6837","nonce":2319638912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:56:58.063963+0000","modified":"2024-09-12T00:14:15.908070+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24478,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/809129212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":809129212},{"type":"v1","addr":"172.21.15.6:6839","nonce":809129212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/500771395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":500771395},{"type":"v1","addr":"172.21.15.6:6841","nonce":500771395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6833/3540998066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3540998066},{"type":"v1","addr":"172.21.15.39:6833","nonce":3540998066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3891726228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3891726228},{"type":"v1","addr":"172.21.15.134:6833","nonce":3891726228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2372527607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2372527607},{"type":"v1","addr":"172.21.15.39:6835","nonce":2372527607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":18,"addr":"172.21.15.39:6837/902336458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":902336458},{"type":"v1","addr":"172.21.15.39:6837","nonce":902336458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":19,"addr":"172.21.15.134:6835/530621436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":530621436},{"type":"v1","addr":"172.21.15.134:6835","nonce":530621436}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":18,"addr":"172.21.15.134:6837/4248937946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4248937946},{"type":"v1","addr":"172.21.15.134:6837","nonce":4248937946}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6839/45989022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":45989022},{"type":"v1","addr":"172.21.15.134:6839","nonce":45989022}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.39:6839/3561706320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3561706320},{"type":"v1","addr":"172.21.15.39:6839","nonce":3561706320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24490,24491,24478,24472,24461]},"id":1}]} 2024-09-12T00:15:10.499 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 37 2024-09-12T00:15:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.500+0000 7f75ad9e1640 1 -- 172.21.15.6:0/2485502037 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75900a2c00 msgr2=0x7f75900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.500+0000 7f75ad9e1640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75900a2c00 0x7f75900a50c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7598031440 tx=0x7f7598005b50 comp rx=0 tx=0).stop 2024-09-12T00:15:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.500+0000 7f75ad9e1640 1 -- 172.21.15.6:0/2485502037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a8102790 msgr2=0x7f75a8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.500+0000 7f75ad9e1640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a8102790 0x7f75a8074a30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f759c00e9f0 tx=0x7f759c00eeb0 comp rx=0 tx=0).stop 2024-09-12T00:15:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.500+0000 7f75ad9e1640 1 -- 172.21.15.6:0/2485502037 shutdown_connections 2024-09-12T00:15:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.500+0000 7f75ad9e1640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f75900a2c00 0x7f75900a50c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.500+0000 7f75ad9e1640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75a8106f10 0x7f75a8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.500+0000 7f75ad9e1640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a8102790 0x7f75a8074a30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.500+0000 7f75ad9e1640 1 --2- 172.21.15.6:0/2485502037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75a8101de0 0x7f75a80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.500+0000 7f75ad9e1640 1 -- 172.21.15.6:0/2485502037 >> 172.21.15.6:0/2485502037 conn(0x7f75a80fd8c0 msgr2=0x7f75a80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.500+0000 7f75ad9e1640 1 -- 172.21.15.6:0/2485502037 shutdown_connections 2024-09-12T00:15:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:10.500+0000 7f75ad9e1640 1 -- 172.21.15.6:0/2485502037 wait complete. 2024-09-12T00:15:11.109 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:10 smithi006 ceph-mon[30947]: pgmap v834: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T00:15:11.109 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:10 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2485502037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:15:11.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T00:15:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:10 smithi134 ceph-mon[34893]: pgmap v834: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T00:15:11.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:10 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2485502037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:15:11.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:10 smithi039 ceph-mon[34543]: pgmap v834: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T00:15:11.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:10 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2485502037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:15:11.395 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:15:11.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.888+0000 7f9b3c012640 1 -- 172.21.15.6:0/533772005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34112b90 msgr2=0x7f9b34114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.888+0000 7f9b3c012640 1 --2- 172.21.15.6:0/533772005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34112b90 0x7f9b34114f80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009ca0 tx=0x7f9b2c02a950 comp rx=0 tx=0).stop 2024-09-12T00:15:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.888+0000 7f9b3c012640 1 -- 172.21.15.6:0/533772005 shutdown_connections 2024-09-12T00:15:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.888+0000 7f9b3c012640 1 --2- 172.21.15.6:0/533772005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34112b90 0x7f9b34114f80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.888+0000 7f9b3c012640 1 --2- 172.21.15.6:0/533772005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b34074eb0 0x7f9b34112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.888+0000 7f9b3c012640 1 --2- 172.21.15.6:0/533772005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b34074590 0x7f9b34074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.888+0000 7f9b3c012640 1 -- 172.21.15.6:0/533772005 >> 172.21.15.6:0/533772005 conn(0x7f9b340fd8c0 msgr2=0x7f9b340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.888+0000 7f9b3c012640 1 -- 172.21.15.6:0/533772005 shutdown_connections 2024-09-12T00:15:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.888+0000 7f9b3c012640 1 -- 172.21.15.6:0/533772005 wait complete. 2024-09-12T00:15:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b3c012640 1 Processor -- start 2024-09-12T00:15:11.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b3c012640 1 -- start start 2024-09-12T00:15:11.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b3c012640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b34074590 0x7f9b341a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:11.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b3c012640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34074eb0 0x7f9b341a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:11.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b3c012640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b34112b90 0x7f9b3419e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:11.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b3c012640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9b341184e0 con 0x7f9b34074eb0 2024-09-12T00:15:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b3c012640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9b34118360 con 0x7f9b34112b90 2024-09-12T00:15:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b3c012640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b34118660 con 0x7f9b34074590 2024-09-12T00:15:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b395ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34074eb0 0x7f9b341a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b395ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34074eb0 0x7f9b341a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40426/0 (socket says 172.21.15.6:40426) 2024-09-12T00:15:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b395ad640 1 -- 172.21.15.6:0/559764517 learned_addr learned my addr 172.21.15.6:0/559764517 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:15:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b39dae640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b34074590 0x7f9b341a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.889+0000 7f9b3a5af640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b34112b90 0x7f9b3419e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:11.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.890+0000 7f9b395ad640 1 -- 172.21.15.6:0/559764517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b34074590 msgr2=0x7f9b341a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:11.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.890+0000 7f9b395ad640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b34074590 0x7f9b341a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:11.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.890+0000 7f9b395ad640 1 -- 172.21.15.6:0/559764517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b34112b90 msgr2=0x7f9b3419e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:11.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.890+0000 7f9b395ad640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b34112b90 0x7f9b3419e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:11.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.890+0000 7f9b395ad640 1 -- 172.21.15.6:0/559764517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3419f080 con 0x7f9b34074eb0 2024-09-12T00:15:11.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.890+0000 7f9b39dae640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b34074590 0x7f9b341a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:15:11.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.890+0000 7f9b395ad640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34074eb0 0x7f9b341a4cd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400b4a0 tx=0x7f9b2400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.890+0000 7f9b2affd640 1 -- 172.21.15.6:0/559764517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24014070 con 0x7f9b34074eb0 2024-09-12T00:15:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.890+0000 7f9b2affd640 1 -- 172.21.15.6:0/559764517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b24010ac0 con 0x7f9b34074eb0 2024-09-12T00:15:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.890+0000 7f9b3c012640 1 -- 172.21.15.6:0/559764517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3419f370 con 0x7f9b34074eb0 2024-09-12T00:15:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.890+0000 7f9b2affd640 1 -- 172.21.15.6:0/559764517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24017c30 con 0x7f9b34074eb0 2024-09-12T00:15:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.890+0000 7f9b3c012640 1 -- 172.21.15.6:0/559764517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b341ab660 con 0x7f9b34074eb0 2024-09-12T00:15:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.891+0000 7f9b3c012640 1 -- 172.21.15.6:0/559764517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b340749f0 con 0x7f9b34074eb0 2024-09-12T00:15:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.892+0000 7f9b2affd640 1 -- 172.21.15.6:0/559764517 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f9b24017070 con 0x7f9b34074eb0 2024-09-12T00:15:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.893+0000 7f9b2affd640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9b200a2c00 0x7f9b200a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.893+0000 7f9b2affd640 1 -- 172.21.15.6:0/559764517 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7f9b240ceb60 con 0x7f9b34074eb0 2024-09-12T00:15:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.893+0000 7f9b39dae640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9b200a2c00 0x7f9b200a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.894+0000 7f9b39dae640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9b200a2c00 0x7f9b200a50c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9b3419fa90 tx=0x7f9b30008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:11.896+0000 7f9b2affd640 1 -- 172.21.15.6:0/559764517 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b2409b6d0 con 0x7f9b34074eb0 2024-09-12T00:15:12.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.072+0000 7f9b3c012640 1 -- 172.21.15.6:0/559764517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b3419fe80 con 0x7f9b34074eb0 2024-09-12T00:15:12.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.073+0000 7f9b2affd640 1 -- 172.21.15.6:0/559764517 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24900 (secure 0 0 0) 0x7f9b3419fe80 con 0x7f9b34074eb0 2024-09-12T00:15:12.073 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-12T00:15:12.074 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":90,"fsid":"4901345a-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:14.063848+0000","modified":"2024-09-12T00:00:03.785635+0000","last_up_change":"2024-09-11T23:56:05.741809+0000","last_in_change":"2024-09-11T23:55:43.119643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:17.346320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:56:54.204314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:56:56.327143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:57:02.826677+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"32cb5f2f-250f-4cf6-ad78-a79f03f5cc10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6803","nonce":2698750681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6805","nonce":2698750681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6809","nonce":2698750681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":2698750681},{"type":"v1","addr":"172.21.15.6:6807","nonce":2698750681}]},"public_addr":"172.21.15.6:6803/2698750681","cluster_addr":"172.21.15.6:6805/2698750681","heartbeat_back_addr":"172.21.15.6:6809/2698750681","heartbeat_front_addr":"172.21.15.6:6807/2698750681","state":["exists","up"]},{"osd":1,"uuid":"748f368e-0065-4cd1-bf7d-09eb7144226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6801","nonce":1024701609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6803","nonce":1024701609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6807","nonce":1024701609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1024701609},{"type":"v1","addr":"172.21.15.39:6805","nonce":1024701609}]},"public_addr":"172.21.15.39:6801/1024701609","cluster_addr":"172.21.15.39:6803/1024701609","heartbeat_back_addr":"172.21.15.39:6807/1024701609","heartbeat_front_addr":"172.21.15.39:6805/1024701609","state":["exists","up"]},{"osd":2,"uuid":"c143215f-b1f7-4095-9015-1d810941ece5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6801","nonce":3895287235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6803","nonce":3895287235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6807","nonce":3895287235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3895287235},{"type":"v1","addr":"172.21.15.134:6805","nonce":3895287235}]},"public_addr":"172.21.15.134:6801/3895287235","cluster_addr":"172.21.15.134:6803/3895287235","heartbeat_back_addr":"172.21.15.134:6807/3895287235","heartbeat_front_addr":"172.21.15.134:6805/3895287235","state":["exists","up"]},{"osd":3,"uuid":"9278237a-27a1-40bc-9bac-9b234b7b82b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6811","nonce":2291614871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6813","nonce":2291614871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6817","nonce":2291614871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2291614871},{"type":"v1","addr":"172.21.15.6:6815","nonce":2291614871}]},"public_addr":"172.21.15.6:6811/2291614871","cluster_addr":"172.21.15.6:6813/2291614871","heartbeat_back_addr":"172.21.15.6:6817/2291614871","heartbeat_front_addr":"172.21.15.6:6815/2291614871","state":["exists","up"]},{"osd":4,"uuid":"1945486a-37b3-40c9-8854-0c9d0b63f3aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6809","nonce":1537139335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6811","nonce":1537139335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6815","nonce":1537139335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1537139335},{"type":"v1","addr":"172.21.15.39:6813","nonce":1537139335}]},"public_addr":"172.21.15.39:6809/1537139335","cluster_addr":"172.21.15.39:6811/1537139335","heartbeat_back_addr":"172.21.15.39:6815/1537139335","heartbeat_front_addr":"172.21.15.39:6813/1537139335","state":["exists","up"]},{"osd":5,"uuid":"d57840a8-4d24-432a-9368-863496d55a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6809","nonce":1350729565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6811","nonce":1350729565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6815","nonce":1350729565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1350729565},{"type":"v1","addr":"172.21.15.134:6813","nonce":1350729565}]},"public_addr":"172.21.15.134:6809/1350729565","cluster_addr":"172.21.15.134:6811/1350729565","heartbeat_back_addr":"172.21.15.134:6815/1350729565","heartbeat_front_addr":"172.21.15.134:6813/1350729565","state":["exists","up"]},{"osd":6,"uuid":"de6a7236-3d15-4b09-b2be-4b23a03e512f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6819","nonce":1313356243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6821","nonce":1313356243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6825","nonce":1313356243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1313356243},{"type":"v1","addr":"172.21.15.6:6823","nonce":1313356243}]},"public_addr":"172.21.15.6:6819/1313356243","cluster_addr":"172.21.15.6:6821/1313356243","heartbeat_back_addr":"172.21.15.6:6825/1313356243","heartbeat_front_addr":"172.21.15.6:6823/1313356243","state":["exists","up"]},{"osd":7,"uuid":"1534560b-9f95-476e-8c70-a6e62eb0621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6817","nonce":2076370620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6819","nonce":2076370620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6823","nonce":2076370620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2076370620},{"type":"v1","addr":"172.21.15.39:6821","nonce":2076370620}]},"public_addr":"172.21.15.39:6817/2076370620","cluster_addr":"172.21.15.39:6819/2076370620","heartbeat_back_addr":"172.21.15.39:6823/2076370620","heartbeat_front_addr":"172.21.15.39:6821/2076370620","state":["exists","up"]},{"osd":8,"uuid":"dfe976d0-c581-4c77-a075-77eeb02e9153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6817","nonce":3894059543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6819","nonce":3894059543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6823","nonce":3894059543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3894059543},{"type":"v1","addr":"172.21.15.134:6821","nonce":3894059543}]},"public_addr":"172.21.15.134:6817/3894059543","cluster_addr":"172.21.15.134:6819/3894059543","heartbeat_back_addr":"172.21.15.134:6823/3894059543","heartbeat_front_addr":"172.21.15.134:6821/3894059543","state":["exists","up"]},{"osd":9,"uuid":"65dd99b2-6515-4d89-b660-26fe171e8323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6827","nonce":4076879536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6829","nonce":4076879536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6833","nonce":4076879536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4076879536},{"type":"v1","addr":"172.21.15.6:6831","nonce":4076879536}]},"public_addr":"172.21.15.6:6827/4076879536","cluster_addr":"172.21.15.6:6829/4076879536","heartbeat_back_addr":"172.21.15.6:6833/4076879536","heartbeat_front_addr":"172.21.15.6:6831/4076879536","state":["exists","up"]},{"osd":10,"uuid":"59380dc6-81fd-4f46-84a1-a5c18746b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6825","nonce":3939755012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6827","nonce":3939755012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6831","nonce":3939755012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3939755012},{"type":"v1","addr":"172.21.15.39:6829","nonce":3939755012}]},"public_addr":"172.21.15.39:6825/3939755012","cluster_addr":"172.21.15.39:6827/3939755012","heartbeat_back_addr":"172.21.15.39:6831/3939755012","heartbeat_front_addr":"172.21.15.39:6829/3939755012","state":["exists","up"]},{"osd":11,"uuid":"dd4acadd-641f-4a0f-abda-589d1a0482e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6825","nonce":932807401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6827","nonce":932807401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6831","nonce":932807401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":932807401},{"type":"v1","addr":"172.21.15.134:6829","nonce":932807401}]},"public_addr":"172.21.15.134:6825/932807401","cluster_addr":"172.21.15.134:6827/932807401","heartbeat_back_addr":"172.21.15.134:6831/932807401","heartbeat_front_addr":"172.21.15.134:6829/932807401","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:23.920241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:51:49.713936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:13.616679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:39.440425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:05.464439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:31.077910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:56.857184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:22.014908+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:46.926039+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:13.420933+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:39.244715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:04.331292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":7}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4111388064":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/2784482923":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6800/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:6801/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6800/1826197239":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/619991212":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3073584278":"2024-09-12T23:49:36.127456+0000","172.21.15.6:6801/2279576750":"2024-09-12T23:50:00.847021+0000","172.21.15.6:0/3649466939":"2024-09-12T23:49:36.127456+0000","172.21.15.6:0/2071921193":"2024-09-12T23:49:36.127456+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:15:12.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.075+0000 7f9b3c012640 1 -- 172.21.15.6:0/559764517 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9b200a2c00 msgr2=0x7f9b200a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:12.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.075+0000 7f9b3c012640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9b200a2c00 0x7f9b200a50c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9b3419fa90 tx=0x7f9b30008040 comp rx=0 tx=0).stop 2024-09-12T00:15:12.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.075+0000 7f9b3c012640 1 -- 172.21.15.6:0/559764517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34074eb0 msgr2=0x7f9b341a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:12.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.075+0000 7f9b3c012640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34074eb0 0x7f9b341a4cd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400b4a0 tx=0x7f9b2400b960 comp rx=0 tx=0).stop 2024-09-12T00:15:12.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.076+0000 7f9b3c012640 1 -- 172.21.15.6:0/559764517 shutdown_connections 2024-09-12T00:15:12.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.076+0000 7f9b3c012640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f9b200a2c00 0x7f9b200a50c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:12.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.076+0000 7f9b3c012640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b34112b90 0x7f9b3419e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:12.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.076+0000 7f9b3c012640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34074eb0 0x7f9b341a4cd0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:12.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.076+0000 7f9b3c012640 1 --2- 172.21.15.6:0/559764517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b34074590 0x7f9b341a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:12.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.076+0000 7f9b3c012640 1 -- 172.21.15.6:0/559764517 >> 172.21.15.6:0/559764517 conn(0x7f9b340fd8c0 msgr2=0x7f9b340ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:12.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.076+0000 7f9b3c012640 1 -- 172.21.15.6:0/559764517 shutdown_connections 2024-09-12T00:15:12.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:12.076+0000 7f9b3c012640 1 -- 172.21.15.6:0/559764517 wait complete. 2024-09-12T00:15:12.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T00:15:13.022 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:15:13.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:12 smithi006 ceph-mon[30947]: pgmap v835: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T00:15:13.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:12 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/559764517' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:15:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:12 smithi134 ceph-mon[34893]: pgmap v835: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T00:15:13.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:12 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/559764517' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:15:13.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:12 smithi039 ceph-mon[34543]: pgmap v835: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T00:15:13.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:12 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/559764517' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:15:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.594+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/3956079805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0102d30 msgr2=0x7fdcf0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.594+0000 7fdcf5a6b640 1 --2- 172.21.15.6:0/3956079805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0102d30 0x7fdcf0103110 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009930 tx=0x7fdce002a440 comp rx=0 tx=0).stop 2024-09-12T00:15:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.594+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/3956079805 shutdown_connections 2024-09-12T00:15:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.594+0000 7fdcf5a6b640 1 --2- 172.21.15.6:0/3956079805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf01082a0 0x7fdcf010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.594+0000 7fdcf5a6b640 1 --2- 172.21.15.6:0/3956079805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcf01036e0 0x7fdcf0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.594+0000 7fdcf5a6b640 1 --2- 172.21.15.6:0/3956079805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0102d30 0x7fdcf0103110 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.594+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/3956079805 >> 172.21.15.6:0/3956079805 conn(0x7fdcf00fc7d0 msgr2=0x7fdcf00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.594+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/3956079805 shutdown_connections 2024-09-12T00:15:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.594+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/3956079805 wait complete. 2024-09-12T00:15:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.594+0000 7fdcf5a6b640 1 Processor -- start 2024-09-12T00:15:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdcf5a6b640 1 -- start start 2024-09-12T00:15:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdcf5a6b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf0102d30 0x7fdcf01a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdcf5a6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf01036e0 0x7fdcf01a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdcf5a6b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcf01082a0 0x7fdcf019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdcf5a6b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf0111f90 con 0x7fdcf01036e0 2024-09-12T00:15:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdcf5a6b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf0111e10 con 0x7fdcf01082a0 2024-09-12T00:15:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdcf5a6b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf0112110 con 0x7fdcf0102d30 2024-09-12T00:15:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdceeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf01036e0 0x7fdcf01a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdceeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf01036e0 0x7fdcf01a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40444/0 (socket says 172.21.15.6:40444) 2024-09-12T00:15:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdceeffd640 1 -- 172.21.15.6:0/2067065659 learned_addr learned my addr 172.21.15.6:0/2067065659 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:15:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdcef7fe640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf0102d30 0x7fdcf01a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdceffff640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcf01082a0 0x7fdcf019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdceeffd640 1 -- 172.21.15.6:0/2067065659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf0102d30 msgr2=0x7fdcf01a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdceeffd640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf0102d30 0x7fdcf01a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdceeffd640 1 -- 172.21.15.6:0/2067065659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcf01082a0 msgr2=0x7fdcf019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdceeffd640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcf01082a0 0x7fdcf019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.595+0000 7fdceeffd640 1 -- 172.21.15.6:0/2067065659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf019acf0 con 0x7fdcf01036e0 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.596+0000 7fdceeffd640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf01036e0 0x7fdcf01a0940 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fdce4006fd0 tx=0x7fdce400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.596+0000 7fdcecff9640 1 -- 172.21.15.6:0/2067065659 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4011830 con 0x7fdcf01036e0 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.596+0000 7fdcecff9640 1 -- 172.21.15.6:0/2067065659 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdce4016070 con 0x7fdcf01036e0 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.596+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/2067065659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf019afe0 con 0x7fdcf01036e0 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.596+0000 7fdcecff9640 1 -- 172.21.15.6:0/2067065659 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4010df0 con 0x7fdcf01036e0 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.596+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/2067065659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf01a72d0 con 0x7fdcf01036e0 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.597+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/2067065659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcf006a850 con 0x7fdcf01036e0 2024-09-12T00:15:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.598+0000 7fdcecff9640 1 -- 172.21.15.6:0/2067065659 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fdce40119d0 con 0x7fdcf01036e0 2024-09-12T00:15:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.599+0000 7fdcecff9640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdcd80a2c00 0x7fdcd80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.599+0000 7fdcef7fe640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdcd80a2c00 0x7fdcd80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.599+0000 7fdcecff9640 1 -- 172.21.15.6:0/2067065659 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9237+0+0 (secure 0 0 0) 0x7fdce40cf0d0 con 0x7fdcf01036e0 2024-09-12T00:15:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.600+0000 7fdcef7fe640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdcd80a2c00 0x7fdcd80a50c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009900 tx=0x7fdce0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.603+0000 7fdcecff9640 1 -- 172.21.15.6:0/2067065659 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdce409bc40 con 0x7fdcf01036e0 2024-09-12T00:15:13.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.812+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/2067065659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdcf0103110 con 0x7fdcf01036e0 2024-09-12T00:15:13.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.815+0000 7fdcecff9640 1 -- 172.21.15.6:0/2067065659 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) ==== 161+0+0 (secure 0 0 0) 0x7fdcf0103110 con 0x7fdcf01036e0 2024-09-12T00:15:13.814 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T00:15:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.818+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/2067065659 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdcd80a2c00 msgr2=0x7fdcd80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.818+0000 7fdcf5a6b640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdcd80a2c00 0x7fdcd80a50c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009900 tx=0x7fdce0000bc0 comp rx=0 tx=0).stop 2024-09-12T00:15:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.818+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/2067065659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf01036e0 msgr2=0x7fdcf01a0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.818+0000 7fdcf5a6b640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf01036e0 0x7fdcf01a0940 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fdce4006fd0 tx=0x7fdce400b8e0 comp rx=0 tx=0).stop 2024-09-12T00:15:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.819+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/2067065659 shutdown_connections 2024-09-12T00:15:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.819+0000 7fdcf5a6b640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fdcd80a2c00 0x7fdcd80a50c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.819+0000 7fdcf5a6b640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcf01082a0 0x7fdcf019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.819+0000 7fdcf5a6b640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf01036e0 0x7fdcf01a0940 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.819+0000 7fdcf5a6b640 1 --2- 172.21.15.6:0/2067065659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf0102d30 0x7fdcf01a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.819+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/2067065659 >> 172.21.15.6:0/2067065659 conn(0x7fdcf00fc7d0 msgr2=0x7fdcf0100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:13.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.820+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/2067065659 shutdown_connections 2024-09-12T00:15:13.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:13.820+0000 7fdcf5a6b640 1 -- 172.21.15.6:0/2067065659 wait complete. 2024-09-12T00:15:14.118 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-a[72594]: ignoring --setuser ceph since I am not root 2024-09-12T00:15:14.118 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-a[72594]: ignoring --setgroup ceph since I am not root 2024-09-12T00:15:14.118 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-mds[72600]: -- 172.21.15.6:0/482106810 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55831c2abc20 con 0x55831c289400 2024-09-12T00:15:14.119 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-a[72594]: starting mds.a at 2024-09-12T00:15:14.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a[30943]: 2024-09-12T00:15:13.813+0000 7f1944b0d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T00:15:14.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2067065659' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T00:15:14.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-mon[30947]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T00:15:14.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-mon[30947]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T00:15:14.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/2067065659' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T00:15:14.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-mon[30947]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T00:15:14.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-mon[30947]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T00:15:14.120 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-g[72270]: ignoring --setuser ceph since I am not root 2024-09-12T00:15:14.120 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-g[72270]: ignoring --setgroup ceph since I am not root 2024-09-12T00:15:14.120 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-mds[72274]: -- 172.21.15.6:0/3945398325 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5612b0731c20 con 0x5612b070f400 2024-09-12T00:15:14.120 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 12 00:15:13 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-g[72270]: starting mds.g at 2024-09-12T00:15:14.203 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-f[65034]: ignoring --setuser ceph since I am not root 2024-09-12T00:15:14.203 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-f[65034]: ignoring --setgroup ceph since I am not root 2024-09-12T00:15:14.203 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-mds[65038]: -- 172.21.15.134:0/1540295445 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555ce6ebb860 con 0x555ce6e98800 2024-09-12T00:15:14.203 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-f[65034]: starting mds.f at 2024-09-12T00:15:14.203 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l[64732]: ignoring --setuser ceph since I am not root 2024-09-12T00:15:14.204 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l[64732]: ignoring --setgroup ceph since I am not root 2024-09-12T00:15:14.204 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-mds[64736]: -- 172.21.15.134:0/3335178196 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc99ee7860 con 0x55dc99ec5400 2024-09-12T00:15:14.204 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l[64732]: starting mds.l at 2024-09-12T00:15:14.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2067065659' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T00:15:14.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-mon[34893]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T00:15:14.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-mon[34893]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T00:15:14.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/2067065659' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T00:15:14.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-mon[34893]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T00:15:14.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-mon[34893]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T00:15:14.205 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-c[65336]: ignoring --setuser ceph since I am not root 2024-09-12T00:15:14.205 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-c[65336]: ignoring --setgroup ceph since I am not root 2024-09-12T00:15:14.205 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-mds[65340]: -- 172.21.15.134:0/1153634650 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5563506de680 con 0x5563506b2800 2024-09-12T00:15:14.205 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-mds[65340]: -- 172.21.15.134:0/1153634650 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5563506d5c20 con 0x5563506b2800 2024-09-12T00:15:14.205 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-c[65336]: starting mds.c at 2024-09-12T00:15:14.205 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-i[65649]: ignoring --setuser ceph since I am not root 2024-09-12T00:15:14.205 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-i[65649]: ignoring --setgroup ceph since I am not root 2024-09-12T00:15:14.205 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-mds[65653]: -- 172.21.15.134:0/636790908 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c8aff7c20 con 0x558c8afd4800 2024-09-12T00:15:14.206 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 12 00:15:13 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-i[65649]: starting mds.i at 2024-09-12T00:15:14.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2067065659' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T00:15:14.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-mon[34543]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T00:15:14.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-mon[34543]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T00:15:14.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/2067065659' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T00:15:14.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-mon[34543]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T00:15:14.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-mon[34543]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T00:15:14.295 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b[64956]: ignoring --setuser ceph since I am not root 2024-09-12T00:15:14.295 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b[64956]: ignoring --setgroup ceph since I am not root 2024-09-12T00:15:14.295 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-mds[64960]: -- 172.21.15.39:0/3308791170 <== mon.2 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556cc75a3860 con 0x556cc7581000 2024-09-12T00:15:14.295 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b[64956]: starting mds.b at 2024-09-12T00:15:14.295 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-e[64341]: ignoring --setuser ceph since I am not root 2024-09-12T00:15:14.295 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-e[64341]: ignoring --setgroup ceph since I am not root 2024-09-12T00:15:14.295 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-mds[64345]: -- 172.21.15.39:0/2451433041 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5560672e5c20 con 0x5560672c2800 2024-09-12T00:15:14.296 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-e[64341]: starting mds.e at 2024-09-12T00:15:14.296 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-k[64038]: ignoring --setuser ceph since I am not root 2024-09-12T00:15:14.296 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-k[64038]: ignoring --setgroup ceph since I am not root 2024-09-12T00:15:14.296 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-mds[64042]: -- 172.21.15.39:0/1447591139 <== mon.2 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a9439b1c20 con 0x55a94398f000 2024-09-12T00:15:14.296 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-k[64038]: starting mds.k at 2024-09-12T00:15:14.296 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-h[64640]: ignoring --setuser ceph since I am not root 2024-09-12T00:15:14.296 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-h[64640]: ignoring --setgroup ceph since I am not root 2024-09-12T00:15:14.297 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-mds[64644]: -- 172.21.15.39:0/3231131184 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ee3865860 con 0x556ee3843400 2024-09-12T00:15:14.297 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 12 00:15:13 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-h[64640]: starting mds.h at 2024-09-12T00:15:14.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T00:15:14.811 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:15:15.116 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:14 smithi006 ceph-mon[30947]: pgmap v836: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T00:15:15.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:14 smithi134 ceph-mon[34893]: pgmap v836: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T00:15:15.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:14 smithi039 ceph-mon[34543]: pgmap v836: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T00:15:15.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.354+0000 7f1a1bed3640 1 -- 172.21.15.6:0/3705435033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a14102ef0 msgr2=0x7f1a1410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:15.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.354+0000 7f1a1bed3640 1 --2- 172.21.15.6:0/3705435033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a14102ef0 0x7f1a1410da40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009900 tx=0x7f1a0c02a480 comp rx=0 tx=0).stop 2024-09-12T00:15:15.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.354+0000 7f1a1bed3640 1 -- 172.21.15.6:0/3705435033 shutdown_connections 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.354+0000 7f1a1bed3640 1 --2- 172.21.15.6:0/3705435033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a14102ef0 0x7f1a1410da40 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.354+0000 7f1a1bed3640 1 --2- 172.21.15.6:0/3705435033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a14102570 0x7f1a141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.354+0000 7f1a1bed3640 1 --2- 172.21.15.6:0/3705435033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a14100e20 0x7f1a14101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.354+0000 7f1a1bed3640 1 -- 172.21.15.6:0/3705435033 >> 172.21.15.6:0/3705435033 conn(0x7f1a140fc7d0 msgr2=0x7f1a140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.354+0000 7f1a1bed3640 1 -- 172.21.15.6:0/3705435033 shutdown_connections 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.354+0000 7f1a1bed3640 1 -- 172.21.15.6:0/3705435033 wait complete. 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a1bed3640 1 Processor -- start 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a1bed3640 1 -- start start 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a1bed3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a14100e20 0x7f1a14197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a1bed3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a14102570 0x7f1a141977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a1bed3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a14102ef0 0x7f1a1419bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a1bed3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1a14110e80 con 0x7f1a14102ef0 2024-09-12T00:15:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a1bed3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1a14110d00 con 0x7f1a14100e20 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a1bed3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1a14111000 con 0x7f1a14102570 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a1a470640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a14102ef0 0x7f1a1419bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a1a470640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a14102ef0 0x7f1a1419bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40484/0 (socket says 172.21.15.6:40484) 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a1a470640 1 -- 172.21.15.6:0/1441111939 learned_addr learned my addr 172.21.15.6:0/1441111939 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a1946e640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a14102570 0x7f1a141977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.355+0000 7f1a19c6f640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a14100e20 0x7f1a14197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.356+0000 7f1a1a470640 1 -- 172.21.15.6:0/1441111939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a14102570 msgr2=0x7f1a141977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.356+0000 7f1a1a470640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a14102570 0x7f1a141977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.356+0000 7f1a1a470640 1 -- 172.21.15.6:0/1441111939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a14100e20 msgr2=0x7f1a14197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.356+0000 7f1a1a470640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a14100e20 0x7f1a14197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.356+0000 7f1a1a470640 1 -- 172.21.15.6:0/1441111939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1419c220 con 0x7f1a14102ef0 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.356+0000 7f1a1a470640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a14102ef0 0x7f1a1419bb40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c004770 tx=0x7f1a0c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.356+0000 7f1a12ffd640 1 -- 172.21.15.6:0/1441111939 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c03f070 con 0x7f1a14102ef0 2024-09-12T00:15:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.356+0000 7f1a12ffd640 1 -- 172.21.15.6:0/1441111939 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a0c03bd20 con 0x7f1a14102ef0 2024-09-12T00:15:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.356+0000 7f1a1bed3640 1 -- 172.21.15.6:0/1441111939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1419c4b0 con 0x7f1a14102ef0 2024-09-12T00:15:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.356+0000 7f1a12ffd640 1 -- 172.21.15.6:0/1441111939 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c035030 con 0x7f1a14102ef0 2024-09-12T00:15:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.356+0000 7f1a1bed3640 1 -- 172.21.15.6:0/1441111939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a141a3df0 con 0x7f1a14102ef0 2024-09-12T00:15:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.357+0000 7f1a1bed3640 1 -- 172.21.15.6:0/1441111939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a14101200 con 0x7f1a14102ef0 2024-09-12T00:15:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.358+0000 7f1a12ffd640 1 -- 172.21.15.6:0/1441111939 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f1a0c042070 con 0x7f1a14102ef0 2024-09-12T00:15:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.359+0000 7f1a12ffd640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f19fc0a2c00 0x7f19fc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.359+0000 7f1a19c6f640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f19fc0a2c00 0x7f19fc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.359+0000 7f1a12ffd640 1 -- 172.21.15.6:0/1441111939 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9667+0+0 (secure 0 0 0) 0x7f1a0c0f0080 con 0x7f1a14102ef0 2024-09-12T00:15:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.359+0000 7f1a19c6f640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f19fc0a2c00 0x7f19fc0a50c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a04005fd0 tx=0x7f1a04009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.362+0000 7f1a12ffd640 1 -- 172.21.15.6:0/1441111939 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a0c0bc390 con 0x7f1a14102ef0 2024-09-12T00:15:15.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.575+0000 7f1a1bed3640 1 -- 172.21.15.6:0/1441111939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1a141a3fc0 con 0x7f1a14102ef0 2024-09-12T00:15:15.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.870+0000 7f1a12ffd640 1 -- 172.21.15.6:0/1441111939 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) ==== 104+0+0 (secure 0 0 0) 0x7f1a0c0c0690 con 0x7f1a14102ef0 2024-09-12T00:15:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.872+0000 7f1a1bed3640 1 -- 172.21.15.6:0/1441111939 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f19fc0a2c00 msgr2=0x7f19fc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.872+0000 7f1a1bed3640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f19fc0a2c00 0x7f19fc0a50c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a04005fd0 tx=0x7f1a04009680 comp rx=0 tx=0).stop 2024-09-12T00:15:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.872+0000 7f1a1bed3640 1 -- 172.21.15.6:0/1441111939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a14102ef0 msgr2=0x7f1a1419bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.872+0000 7f1a1bed3640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a14102ef0 0x7f1a1419bb40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c004770 tx=0x7f1a0c003cd0 comp rx=0 tx=0).stop 2024-09-12T00:15:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.872+0000 7f1a1bed3640 1 -- 172.21.15.6:0/1441111939 shutdown_connections 2024-09-12T00:15:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.872+0000 7f1a1bed3640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f19fc0a2c00 0x7f19fc0a50c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.872+0000 7f1a1bed3640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a14102ef0 0x7f1a1419bb40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.872+0000 7f1a1bed3640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a14102570 0x7f1a141977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.872+0000 7f1a1bed3640 1 --2- 172.21.15.6:0/1441111939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a14100e20 0x7f1a14197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.872+0000 7f1a1bed3640 1 -- 172.21.15.6:0/1441111939 >> 172.21.15.6:0/1441111939 conn(0x7f1a140fc7d0 msgr2=0x7f1a140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.872+0000 7f1a1bed3640 1 -- 172.21.15.6:0/1441111939 shutdown_connections 2024-09-12T00:15:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:15.872+0000 7f1a1bed3640 1 -- 172.21.15.6:0/1441111939 wait complete. 2024-09-12T00:15:16.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.39:6832/587283799,v1:172.21.15.39:6834/587283799] up:boot 2024-09-12T00:15:16.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.39:6833/933547452,v1:172.21.15.39:6835/933547452] up:boot 2024-09-12T00:15:16.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.134:6832/3930173989,v1:172.21.15.134:6833/3930173989] up:boot 2024-09-12T00:15:16.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.134:6834/3027436266,v1:172.21.15.134:6836/3027436266] up:boot 2024-09-12T00:15:16.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.134:6835/893981502,v1:172.21.15.134:6837/893981502] up:boot 2024-09-12T00:15:16.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.134:6838/117620118,v1:172.21.15.134:6839/117620118] up:boot 2024-09-12T00:15:16.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.39:6836/1111406830,v1:172.21.15.39:6837/1111406830] up:boot 2024-09-12T00:15:16.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.39:6838/4238739007,v1:172.21.15.39:6839/4238739007] up:boot 2024-09-12T00:15:16.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.6:6838/1083463140,v1:172.21.15.6:6840/1083463140] up:boot 2024-09-12T00:15:16.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: mds.? [v2:172.21.15.6:6839/4276196191,v1:172.21.15.6:6841/4276196191] up:boot 2024-09-12T00:15:16.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T00:15:16.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T00:15:16.192 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T00:15:16.192 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T00:15:16.192 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T00:15:16.192 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T00:15:16.192 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T00:15:16.192 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T00:15:16.192 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T00:15:16.192 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T00:15:16.192 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T00:15:16.192 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:15 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1441111939' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T00:15:16.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.39:6832/587283799,v1:172.21.15.39:6834/587283799] up:boot 2024-09-12T00:15:16.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.39:6833/933547452,v1:172.21.15.39:6835/933547452] up:boot 2024-09-12T00:15:16.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.134:6832/3930173989,v1:172.21.15.134:6833/3930173989] up:boot 2024-09-12T00:15:16.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.134:6834/3027436266,v1:172.21.15.134:6836/3027436266] up:boot 2024-09-12T00:15:16.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.134:6835/893981502,v1:172.21.15.134:6837/893981502] up:boot 2024-09-12T00:15:16.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.134:6838/117620118,v1:172.21.15.134:6839/117620118] up:boot 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.39:6836/1111406830,v1:172.21.15.39:6837/1111406830] up:boot 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.39:6838/4238739007,v1:172.21.15.39:6839/4238739007] up:boot 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.6:6838/1083463140,v1:172.21.15.6:6840/1083463140] up:boot 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: mds.? [v2:172.21.15.6:6839/4276196191,v1:172.21.15.6:6841/4276196191] up:boot 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T00:15:16.204 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T00:15:16.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T00:15:16.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T00:15:16.205 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:15 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1441111939' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T00:15:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.39:6832/587283799,v1:172.21.15.39:6834/587283799] up:boot 2024-09-12T00:15:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.39:6833/933547452,v1:172.21.15.39:6835/933547452] up:boot 2024-09-12T00:15:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.134:6832/3930173989,v1:172.21.15.134:6833/3930173989] up:boot 2024-09-12T00:15:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.134:6834/3027436266,v1:172.21.15.134:6836/3027436266] up:boot 2024-09-12T00:15:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.134:6835/893981502,v1:172.21.15.134:6837/893981502] up:boot 2024-09-12T00:15:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.134:6838/117620118,v1:172.21.15.134:6839/117620118] up:boot 2024-09-12T00:15:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.39:6836/1111406830,v1:172.21.15.39:6837/1111406830] up:boot 2024-09-12T00:15:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.39:6838/4238739007,v1:172.21.15.39:6839/4238739007] up:boot 2024-09-12T00:15:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.6:6838/1083463140,v1:172.21.15.6:6840/1083463140] up:boot 2024-09-12T00:15:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: mds.? [v2:172.21.15.6:6839/4276196191,v1:172.21.15.6:6841/4276196191] up:boot 2024-09-12T00:15:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T00:15:16.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T00:15:16.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T00:15:16.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T00:15:16.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T00:15:16.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T00:15:16.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T00:15:16.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T00:15:16.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T00:15:16.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T00:15:16.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: from='mgr.14150 172.21.15.6:0/4107490381' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T00:15:16.295 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:15 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1441111939' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T00:15:16.595 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T00:15:16.861 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:15:17.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:16 smithi006 ceph-mon[30947]: pgmap v838: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-12T00:15:17.135 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:16 smithi006 ceph-mon[30947]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T00:15:17.135 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:16 smithi006 ceph-mon[30947]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T00:15:17.135 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:16 smithi006 ceph-mon[30947]: Cluster is now healthy 2024-09-12T00:15:17.135 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:16 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1441111939' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T00:15:17.135 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:16 smithi006 ceph-mon[30947]: fsmap 12 up:standby 2024-09-12T00:15:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:16 smithi134 ceph-mon[34893]: pgmap v838: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-12T00:15:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:16 smithi134 ceph-mon[34893]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T00:15:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:16 smithi134 ceph-mon[34893]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T00:15:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:16 smithi134 ceph-mon[34893]: Cluster is now healthy 2024-09-12T00:15:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:16 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1441111939' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T00:15:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:16 smithi134 ceph-mon[34893]: fsmap 12 up:standby 2024-09-12T00:15:17.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:16 smithi039 ceph-mon[34543]: pgmap v838: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-12T00:15:17.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:16 smithi039 ceph-mon[34543]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T00:15:17.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:16 smithi039 ceph-mon[34543]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T00:15:17.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:16 smithi039 ceph-mon[34543]: Cluster is now healthy 2024-09-12T00:15:17.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:16 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1441111939' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T00:15:17.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:16 smithi039 ceph-mon[34543]: fsmap 12 up:standby 2024-09-12T00:15:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.366+0000 7fe8c10e7640 1 -- 172.21.15.6:0/116656680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc102ef0 msgr2=0x7fe8bc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.366+0000 7fe8c10e7640 1 --2- 172.21.15.6:0/116656680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc102ef0 0x7fe8bc10da40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009900 tx=0x7fe8b402a480 comp rx=0 tx=0).stop 2024-09-12T00:15:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.366+0000 7fe8c10e7640 1 -- 172.21.15.6:0/116656680 shutdown_connections 2024-09-12T00:15:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.366+0000 7fe8c10e7640 1 --2- 172.21.15.6:0/116656680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc102ef0 0x7fe8bc10da40 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.366+0000 7fe8c10e7640 1 --2- 172.21.15.6:0/116656680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8bc102570 0x7fe8bc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.366+0000 7fe8c10e7640 1 --2- 172.21.15.6:0/116656680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100e20 0x7fe8bc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.366+0000 7fe8c10e7640 1 -- 172.21.15.6:0/116656680 >> 172.21.15.6:0/116656680 conn(0x7fe8bc0fc7d0 msgr2=0x7fe8bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.366+0000 7fe8c10e7640 1 -- 172.21.15.6:0/116656680 shutdown_connections 2024-09-12T00:15:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.366+0000 7fe8c10e7640 1 -- 172.21.15.6:0/116656680 wait complete. 2024-09-12T00:15:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.367+0000 7fe8c10e7640 1 Processor -- start 2024-09-12T00:15:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.367+0000 7fe8c10e7640 1 -- start start 2024-09-12T00:15:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8c10e7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100e20 0x7fe8bc199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8c10e7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8bc102570 0x7fe8bc199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8c10e7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc102ef0 0x7fe8bc1a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8c10e7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc110e30 con 0x7fe8bc102ef0 2024-09-12T00:15:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8c10e7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc110cb0 con 0x7fe8bc102570 2024-09-12T00:15:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8c10e7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc110fb0 con 0x7fe8bc100e20 2024-09-12T00:15:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8bb59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc102ef0 0x7fe8bc1a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8ba59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8bc102570 0x7fe8bc199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8bb59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc102ef0 0x7fe8bc1a42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40506/0 (socket says 172.21.15.6:40506) 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8bb59e640 1 -- 172.21.15.6:0/1645814822 learned_addr learned my addr 172.21.15.6:0/1645814822 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8bad9d640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100e20 0x7fe8bc199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8bb59e640 1 -- 172.21.15.6:0/1645814822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100e20 msgr2=0x7fe8bc199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8bb59e640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100e20 0x7fe8bc199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8bb59e640 1 -- 172.21.15.6:0/1645814822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8bc102570 msgr2=0x7fe8bc199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8bb59e640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8bc102570 0x7fe8bc199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8bb59e640 1 -- 172.21.15.6:0/1645814822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8bc1a47e0 con 0x7fe8bc102ef0 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8bad9d640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100e20 0x7fe8bc199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8bb59e640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc102ef0 0x7fe8bc1a42a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4005ab0 tx=0x7fe8b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8b3fff640 1 -- 172.21.15.6:0/1645814822 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b403f030 con 0x7fe8bc102ef0 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8b3fff640 1 -- 172.21.15.6:0/1645814822 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe8b4003cb0 con 0x7fe8bc102ef0 2024-09-12T00:15:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.368+0000 7fe8c10e7640 1 -- 172.21.15.6:0/1645814822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8bc1a49b0 con 0x7fe8bc102ef0 2024-09-12T00:15:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.369+0000 7fe8b3fff640 1 -- 172.21.15.6:0/1645814822 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4035070 con 0x7fe8bc102ef0 2024-09-12T00:15:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.369+0000 7fe8c10e7640 1 -- 172.21.15.6:0/1645814822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8bc1a4e00 con 0x7fe8bc102ef0 2024-09-12T00:15:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.370+0000 7fe8c10e7640 1 -- 172.21.15.6:0/1645814822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8bc101200 con 0x7fe8bc102ef0 2024-09-12T00:15:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.371+0000 7fe8b3fff640 1 -- 172.21.15.6:0/1645814822 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7fe8b4042030 con 0x7fe8bc102ef0 2024-09-12T00:15:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.372+0000 7fe8b3fff640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe8a80a2b80 0x7fe8a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.372+0000 7fe8bad9d640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe8a80a2b80 0x7fe8a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.372+0000 7fe8b3fff640 1 -- 172.21.15.6:0/1645814822 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9667+0+0 (secure 0 0 0) 0x7fe8b40efdb0 con 0x7fe8bc102ef0 2024-09-12T00:15:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.372+0000 7fe8bad9d640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe8a80a2b80 0x7fe8a80a5040 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac005fd0 tx=0x7fe8ac009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.376+0000 7fe8b3fff640 1 -- 172.21.15.6:0/1645814822 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8b40bc770 con 0x7fe8bc102ef0 2024-09-12T00:15:17.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.554+0000 7fe8c10e7640 1 -- 172.21.15.6:0/1645814822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe8bc1090c0 con 0x7fe8bc102ef0 2024-09-12T00:15:17.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.879+0000 7fe8b3fff640 1 -- 172.21.15.6:0/1645814822 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) ==== 181+0+0 (secure 0 0 0) 0x7fe8b40bc070 con 0x7fe8bc102ef0 2024-09-12T00:15:17.879 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-09-12T00:15:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.881+0000 7fe8c10e7640 1 -- 172.21.15.6:0/1645814822 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe8a80a2b80 msgr2=0x7fe8a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.881+0000 7fe8c10e7640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe8a80a2b80 0x7fe8a80a5040 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac005fd0 tx=0x7fe8ac009520 comp rx=0 tx=0).stop 2024-09-12T00:15:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.881+0000 7fe8c10e7640 1 -- 172.21.15.6:0/1645814822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc102ef0 msgr2=0x7fe8bc1a42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.881+0000 7fe8c10e7640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc102ef0 0x7fe8bc1a42a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4005ab0 tx=0x7fe8b40042f0 comp rx=0 tx=0).stop 2024-09-12T00:15:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.881+0000 7fe8c10e7640 1 -- 172.21.15.6:0/1645814822 shutdown_connections 2024-09-12T00:15:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.881+0000 7fe8c10e7640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7fe8a80a2b80 0x7fe8a80a5040 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:17.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.881+0000 7fe8c10e7640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc102ef0 0x7fe8bc1a42a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:17.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.881+0000 7fe8c10e7640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8bc102570 0x7fe8bc199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:17.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.881+0000 7fe8c10e7640 1 --2- 172.21.15.6:0/1645814822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100e20 0x7fe8bc199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:17.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.881+0000 7fe8c10e7640 1 -- 172.21.15.6:0/1645814822 >> 172.21.15.6:0/1645814822 conn(0x7fe8bc0fc7d0 msgr2=0x7fe8bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:17.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.881+0000 7fe8c10e7640 1 -- 172.21.15.6:0/1645814822 shutdown_connections 2024-09-12T00:15:17.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:17.882+0000 7fe8c10e7640 1 -- 172.21.15.6:0/1645814822 wait complete. 2024-09-12T00:15:18.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:17 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1645814822' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:15:18.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:17 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1645814822' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:15:18.297 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:17 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1645814822' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:15:18.644 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T00:15:18.908 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:15:19.155 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:18 smithi006 ceph-mon[30947]: pgmap v839: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:15:19.155 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:18 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1645814822' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:15:19.155 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:18 smithi006 ceph-mon[30947]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T00:15:19.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:18 smithi134 ceph-mon[34893]: pgmap v839: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:15:19.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:18 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1645814822' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:15:19.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:18 smithi134 ceph-mon[34893]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T00:15:19.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:18 smithi039 ceph-mon[34543]: pgmap v839: 129 pgs: 129 active+clean; 5.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:15:19.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:18 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1645814822' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:15:19.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:18 smithi039 ceph-mon[34543]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T00:15:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.392+0000 7f9568634640 1 -- 172.21.15.6:0/3138928985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560100a80 msgr2=0x7f9560100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.392+0000 7f9568634640 1 --2- 172.21.15.6:0/3138928985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560100a80 0x7f9560100ee0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9550009930 tx=0x7f955002a420 comp rx=0 tx=0).stop 2024-09-12T00:15:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.392+0000 7f9568634640 1 -- 172.21.15.6:0/3138928985 shutdown_connections 2024-09-12T00:15:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.392+0000 7f9568634640 1 --2- 172.21.15.6:0/3138928985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9560101420 0x7f956010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.392+0000 7f9568634640 1 --2- 172.21.15.6:0/3138928985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560100a80 0x7f9560100ee0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.392+0000 7f9568634640 1 --2- 172.21.15.6:0/3138928985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9560106a80 0x7f9560106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.392+0000 7f9568634640 1 -- 172.21.15.6:0/3138928985 >> 172.21.15.6:0/3138928985 conn(0x7f95600fc7a0 msgr2=0x7f95600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.392+0000 7f9568634640 1 -- 172.21.15.6:0/3138928985 shutdown_connections 2024-09-12T00:15:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.392+0000 7f9568634640 1 -- 172.21.15.6:0/3138928985 wait complete. 2024-09-12T00:15:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f9568634640 1 Processor -- start 2024-09-12T00:15:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f9568634640 1 -- start start 2024-09-12T00:15:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f9568634640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9560100a80 0x7f95601983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f9568634640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9560101420 0x7f9560198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f9568634640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560106a80 0x7f956019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f9568634640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9560111e50 con 0x7f9560106a80 2024-09-12T00:15:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f9568634640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9560111cd0 con 0x7f9560101420 2024-09-12T00:15:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f9568634640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9560111fd0 con 0x7f9560100a80 2024-09-12T00:15:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f9566bd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560106a80 0x7f956019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f9566bd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560106a80 0x7f956019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40518/0 (socket says 172.21.15.6:40518) 2024-09-12T00:15:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f9566bd1640 1 -- 172.21.15.6:0/1126616502 learned_addr learned my addr 172.21.15.6:0/1126616502 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:15:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f9565bcf640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9560101420 0x7f9560198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.393+0000 7f95663d0640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9560100a80 0x7f95601983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.394+0000 7f9566bd1640 1 -- 172.21.15.6:0/1126616502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9560100a80 msgr2=0x7f95601983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.394+0000 7f9566bd1640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9560100a80 0x7f95601983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.394+0000 7f9566bd1640 1 -- 172.21.15.6:0/1126616502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9560101420 msgr2=0x7f9560198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.394+0000 7f9566bd1640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9560101420 0x7f9560198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.394+0000 7f9566bd1640 1 -- 172.21.15.6:0/1126616502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956019d3a0 con 0x7f9560106a80 2024-09-12T00:15:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.394+0000 7f9566bd1640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560106a80 0x7f956019ccc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f955800eaa0 tx=0x7f955800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.394+0000 7f95577fe640 1 -- 172.21.15.6:0/1126616502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955800cdb0 con 0x7f9560106a80 2024-09-12T00:15:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.394+0000 7f95577fe640 1 -- 172.21.15.6:0/1126616502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9558005020 con 0x7f9560106a80 2024-09-12T00:15:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.394+0000 7f9568634640 1 -- 172.21.15.6:0/1126616502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956019d690 con 0x7f9560106a80 2024-09-12T00:15:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.394+0000 7f95577fe640 1 -- 172.21.15.6:0/1126616502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95580116d0 con 0x7f9560106a80 2024-09-12T00:15:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.394+0000 7f9568634640 1 -- 172.21.15.6:0/1126616502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95601a4f70 con 0x7f9560106a80 2024-09-12T00:15:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.395+0000 7f9568634640 1 -- 172.21.15.6:0/1126616502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9560100ee0 con 0x7f9560106a80 2024-09-12T00:15:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.396+0000 7f95577fe640 1 -- 172.21.15.6:0/1126616502 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7f95580051d0 con 0x7f9560106a80 2024-09-12T00:15:19.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.397+0000 7f95577fe640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f954c0a2c00 0x7f954c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:19.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.397+0000 7f95663d0640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f954c0a2c00 0x7f954c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:19.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.397+0000 7f95577fe640 1 -- 172.21.15.6:0/1126616502 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9113+0+0 (secure 0 0 0) 0x7f95580cf500 con 0x7f9560106a80 2024-09-12T00:15:19.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.398+0000 7f95663d0640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f954c0a2c00 0x7f954c0a50c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f955c005fd0 tx=0x7f955c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:19.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.401+0000 7f95577fe640 1 -- 172.21.15.6:0/1126616502 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9558016030 con 0x7f9560106a80 2024-09-12T00:15:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.577+0000 7f9568634640 1 -- 172.21.15.6:0/1126616502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f956002d7c0 con 0x7f9560106a80 2024-09-12T00:15:19.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.888+0000 7f95577fe640 1 -- 172.21.15.6:0/1126616502 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) ==== 169+0+0 (secure 0 0 0) 0x7f955809ba40 con 0x7f9560106a80 2024-09-12T00:15:19.888 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-09-12T00:15:19.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.891+0000 7f9568634640 1 -- 172.21.15.6:0/1126616502 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f954c0a2c00 msgr2=0x7f954c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:19.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.891+0000 7f9568634640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f954c0a2c00 0x7f954c0a50c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f955c005fd0 tx=0x7f955c00b390 comp rx=0 tx=0).stop 2024-09-12T00:15:19.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.891+0000 7f9568634640 1 -- 172.21.15.6:0/1126616502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560106a80 msgr2=0x7f956019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:19.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.891+0000 7f9568634640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560106a80 0x7f956019ccc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f955800eaa0 tx=0x7f955800ef60 comp rx=0 tx=0).stop 2024-09-12T00:15:19.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.893+0000 7f9568634640 1 -- 172.21.15.6:0/1126616502 shutdown_connections 2024-09-12T00:15:19.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.893+0000 7f9568634640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7f954c0a2c00 0x7f954c0a50c0 secure :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f955c005fd0 tx=0x7f955c00b390 comp rx=0 tx=0).stop 2024-09-12T00:15:19.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.893+0000 7f9568634640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560106a80 0x7f956019ccc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:19.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.893+0000 7f9568634640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9560101420 0x7f9560198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:19.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.893+0000 7f9568634640 1 --2- 172.21.15.6:0/1126616502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9560100a80 0x7f95601983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:19.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.893+0000 7f9568634640 1 -- 172.21.15.6:0/1126616502 >> 172.21.15.6:0/1126616502 conn(0x7f95600fc7a0 msgr2=0x7f95600fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:19.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.893+0000 7f9568634640 1 -- 172.21.15.6:0/1126616502 shutdown_connections 2024-09-12T00:15:19.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:19.894+0000 7f9568634640 1 -- 172.21.15.6:0/1126616502 wait complete. 2024-09-12T00:15:20.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:19 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1126616502' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:15:20.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:19 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1126616502' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:15:20.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:19 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1126616502' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:15:20.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4901345a-7098-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-12T00:15:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:15:21.150 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:20 smithi006 ceph-mon[30947]: pgmap v841: 97 pgs: 97 active+clean; 577 KiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:15:21.151 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:20 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1126616502' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:15:21.151 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:20 smithi006 ceph-mon[30947]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T00:15:21.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:20 smithi134 ceph-mon[34893]: pgmap v841: 97 pgs: 97 active+clean; 577 KiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:15:21.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:20 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1126616502' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:15:21.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:20 smithi134 ceph-mon[34893]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T00:15:21.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:20 smithi039 ceph-mon[34543]: pgmap v841: 97 pgs: 97 active+clean; 577 KiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:15:21.293 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:20 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1126616502' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:15:21.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:20 smithi039 ceph-mon[34543]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T00:15:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.350+0000 7ffa44041640 1 -- 172.21.15.6:0/1603250750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa3c1036e0 msgr2=0x7ffa3c10bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.350+0000 7ffa44041640 1 --2- 172.21.15.6:0/1603250750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa3c1036e0 0x7ffa3c10bbd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009900 tx=0x7ffa3002a480 comp rx=0 tx=0).stop 2024-09-12T00:15:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 -- 172.21.15.6:0/1603250750 shutdown_connections 2024-09-12T00:15:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 --2- 172.21.15.6:0/1603250750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa3c10c1a0 0x7ffa3c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 --2- 172.21.15.6:0/1603250750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa3c1036e0 0x7ffa3c10bbd0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 --2- 172.21.15.6:0/1603250750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa3c102dc0 0x7ffa3c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 -- 172.21.15.6:0/1603250750 >> 172.21.15.6:0/1603250750 conn(0x7ffa3c0fc7a0 msgr2=0x7ffa3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 -- 172.21.15.6:0/1603250750 shutdown_connections 2024-09-12T00:15:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 -- 172.21.15.6:0/1603250750 wait complete. 2024-09-12T00:15:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 Processor -- start 2024-09-12T00:15:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 -- start start 2024-09-12T00:15:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa3c102dc0 0x7ffa3c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa3c1036e0 0x7ffa3c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa3c10c1a0 0x7ffa3c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c111e20 con 0x7ffa3c1036e0 2024-09-12T00:15:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c111ca0 con 0x7ffa3c102dc0 2024-09-12T00:15:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.351+0000 7ffa44041640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c111fa0 con 0x7ffa3c10c1a0 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa415dc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa3c1036e0 0x7ffa3c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa415dc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa3c1036e0 0x7ffa3c198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48550/0 (socket says 172.21.15.6:48550) 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa415dc640 1 -- 172.21.15.6:0/1578727022 learned_addr learned my addr 172.21.15.6:0/1578727022 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa41ddd640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa3c102dc0 0x7ffa3c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa425de640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa3c10c1a0 0x7ffa3c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa415dc640 1 -- 172.21.15.6:0/1578727022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa3c10c1a0 msgr2=0x7ffa3c19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa415dc640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa3c10c1a0 0x7ffa3c19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa415dc640 1 -- 172.21.15.6:0/1578727022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa3c102dc0 msgr2=0x7ffa3c1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa415dc640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa3c102dc0 0x7ffa3c1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa415dc640 1 -- 172.21.15.6:0/1578727022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c19d370 con 0x7ffa3c1036e0 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa415dc640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa3c1036e0 0x7ffa3c198900 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ffa30005940 tx=0x7ffa30004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa2effd640 1 -- 172.21.15.6:0/1578727022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3003f030 con 0x7ffa3c1036e0 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa2effd640 1 -- 172.21.15.6:0/1578727022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa30003aa0 con 0x7ffa3c1036e0 2024-09-12T00:15:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa44041640 1 -- 172.21.15.6:0/1578727022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3c19d600 con 0x7ffa3c1036e0 2024-09-12T00:15:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa2effd640 1 -- 172.21.15.6:0/1578727022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30035070 con 0x7ffa3c1036e0 2024-09-12T00:15:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.352+0000 7ffa44041640 1 -- 172.21.15.6:0/1578727022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa3c1a4f40 con 0x7ffa3c1036e0 2024-09-12T00:15:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.353+0000 7ffa44041640 1 -- 172.21.15.6:0/1578727022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa3c06aff0 con 0x7ffa3c1036e0 2024-09-12T00:15:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.354+0000 7ffa2effd640 1 -- 172.21.15.6:0/1578727022 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 137832+0+0 (secure 0 0 0) 0x7ffa30042030 con 0x7ffa3c1036e0 2024-09-12T00:15:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.355+0000 7ffa2effd640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffa280a2c00 0x7ffa280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:15:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.355+0000 7ffa41ddd640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffa280a2c00 0x7ffa280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:15:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.355+0000 7ffa2effd640 1 -- 172.21.15.6:0/1578727022 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8496+0+0 (secure 0 0 0) 0x7ffa300ef530 con 0x7ffa3c1036e0 2024-09-12T00:15:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.356+0000 7ffa41ddd640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffa280a2c00 0x7ffa280a50c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800bbe0 tx=0x7ffa3800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:15:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.359+0000 7ffa2effd640 1 -- 172.21.15.6:0/1578727022 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa300bc390 con 0x7ffa3c1036e0 2024-09-12T00:15:21.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.537+0000 7ffa44041640 1 -- 172.21.15.6:0/1578727022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7ffa3c106c50 con 0x7ffa3c1036e0 2024-09-12T00:15:21.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.896+0000 7ffa2effd640 1 -- 172.21.15.6:0/1578727022 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v94) ==== 178+0+0 (secure 0 0 0) 0x7ffa300bbc90 con 0x7ffa3c1036e0 2024-09-12T00:15:21.896 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data_ec' removed 2024-09-12T00:15:21.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.899+0000 7ffa44041640 1 -- 172.21.15.6:0/1578727022 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffa280a2c00 msgr2=0x7ffa280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.899+0000 7ffa44041640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffa280a2c00 0x7ffa280a50c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800bbe0 tx=0x7ffa3800b390 comp rx=0 tx=0).stop 2024-09-12T00:15:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.899+0000 7ffa44041640 1 -- 172.21.15.6:0/1578727022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa3c1036e0 msgr2=0x7ffa3c198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:15:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.899+0000 7ffa44041640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa3c1036e0 0x7ffa3c198900 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ffa30005940 tx=0x7ffa30004270 comp rx=0 tx=0).stop 2024-09-12T00:15:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.899+0000 7ffa44041640 1 -- 172.21.15.6:0/1578727022 shutdown_connections 2024-09-12T00:15:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.899+0000 7ffa44041640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.6:6800/306795778,v1:172.21.15.6:6801/306795778] conn(0x7ffa280a2c00 0x7ffa280a50c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.899+0000 7ffa44041640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa3c10c1a0 0x7ffa3c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.899+0000 7ffa44041640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa3c1036e0 0x7ffa3c198900 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.899+0000 7ffa44041640 1 --2- 172.21.15.6:0/1578727022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa3c102dc0 0x7ffa3c1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:15:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.899+0000 7ffa44041640 1 -- 172.21.15.6:0/1578727022 >> 172.21.15.6:0/1578727022 conn(0x7ffa3c0fc7a0 msgr2=0x7ffa3c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:15:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.899+0000 7ffa44041640 1 -- 172.21.15.6:0/1578727022 shutdown_connections 2024-09-12T00:15:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-12T00:15:21.899+0000 7ffa44041640 1 -- 172.21.15.6:0/1578727022 wait complete. 2024-09-12T00:15:22.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:21 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1578727022' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:15:22.270 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:21 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1578727022' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:15:22.297 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:21 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1578727022' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:15:22.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:15:22.640 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:15:22.669 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:15:22.698 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T00:15:22.698 DEBUG:teuthology.orchestra.run.smithi006:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T00:15:22.734 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T00:15:22.770 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T00:15:22.802 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T00:15:22.802 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T00:15:22.802 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.a 2024-09-12T00:15:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:22 smithi134 ceph-mon[34893]: pgmap v843: 33 pgs: 33 active+clean; 577 KiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:15:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:22 smithi134 ceph-mon[34893]: from='client.? 172.21.15.6:0/1578727022' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:15:22.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:22 smithi134 ceph-mon[34893]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T00:15:23.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:22 smithi039 ceph-mon[34543]: pgmap v843: 33 pgs: 33 active+clean; 577 KiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:15:23.043 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:22 smithi039 ceph-mon[34543]: from='client.? 172.21.15.6:0/1578727022' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:15:23.044 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:22 smithi039 ceph-mon[34543]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T00:15:23.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:22 smithi006 systemd[1]: Stopping Ceph mon.a for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:15:23.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:22 smithi006 ceph-mon[30947]: pgmap v843: 33 pgs: 33 active+clean; 577 KiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:15:23.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:22 smithi006 ceph-mon[30947]: from='client.? 172.21.15.6:0/1578727022' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:15:23.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:22 smithi006 ceph-mon[30947]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T00:15:23.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:23 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a[30943]: 2024-09-12T00:15:23.217+0000 7f194a318640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:15:23.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:23 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a[30943]: 2024-09-12T00:15:23.217+0000 7f194a318640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T00:15:23.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:23 smithi006 podman[109997]: 2024-09-12 00:15:23.463757834 +0000 UTC m=+0.384578504 container died 83d8db6a4319eed79704dd35066d2ac258d7f18be00d820bc74dd82fd2c16176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:15:24.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:23 smithi006 podman[109997]: 2024-09-12 00:15:23.902208352 +0000 UTC m=+0.823029026 container cleanup 83d8db6a4319eed79704dd35066d2ac258d7f18be00d820bc74dd82fd2c16176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T00:15:24.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:23 smithi006 bash[109997]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a 2024-09-12T00:15:24.378 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 12 00:15:24 smithi006 podman[110010]: 2024-09-12 00:15:24.129042823 +0000 UTC m=+0.662840067 container remove 83d8db6a4319eed79704dd35066d2ac258d7f18be00d820bc74dd82fd2c16176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T00:15:24.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T00:15:24.450 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:15:24.451 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T00:15:24.451 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T00:15:24.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.b 2024-09-12T00:15:24.793 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:24 smithi039 systemd[1]: Stopping Ceph mon.b for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:15:25.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:24 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-b[34539]: 2024-09-12T00:15:24.799+0000 7f00d66b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:15:25.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:24 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-b[34539]: 2024-09-12T00:15:24.799+0000 7f00d66b3640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T00:15:25.294 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:25 smithi039 podman[70539]: 2024-09-12 00:15:25.003680307 +0000 UTC m=+0.322434747 container died 5251c8b9cc65fbefb3aff73c7502c41a37a036b50a635945a586d7590d131cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T00:15:25.674 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:25 smithi039 podman[70539]: 2024-09-12 00:15:25.40820457 +0000 UTC m=+0.726959008 container cleanup 5251c8b9cc65fbefb3aff73c7502c41a37a036b50a635945a586d7590d131cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-b, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T00:15:25.675 INFO:journalctl@ceph.mon.b.smithi039.stdout:Sep 12 00:15:25 smithi039 bash[70539]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-b 2024-09-12T00:15:25.810 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T00:15:25.860 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:15:25.861 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T00:15:25.861 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T00:15:25.861 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.c 2024-09-12T00:15:26.194 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:25 smithi134 systemd[1]: Stopping Ceph mon.c for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:15:26.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:26 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-c[34876]: 2024-09-12T00:15:26.194+0000 7f68ffbd8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:15:26.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:26 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-c[34876]: 2024-09-12T00:15:26.194+0000 7f68ffbd8640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T00:15:26.453 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:26 smithi134 podman[70661]: 2024-09-12 00:15:26.246117646 +0000 UTC m=+0.168875568 container died e1bedf32451d4e9a4291ca7c14041b7723204a901d5d9d8528de454d6c0a3bd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T00:15:26.896 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:26 smithi134 podman[70661]: 2024-09-12 00:15:26.637390327 +0000 UTC m=+0.560148241 container cleanup e1bedf32451d4e9a4291ca7c14041b7723204a901d5d9d8528de454d6c0a3bd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T00:15:26.896 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 12 00:15:26 smithi134 bash[70661]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mon-c 2024-09-12T00:15:27.052 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T00:15:27.102 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:15:27.102 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T00:15:27.102 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T00:15:27.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.x 2024-09-12T00:15:27.432 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 12 00:15:27 smithi006 systemd[1]: Stopping Ceph mgr.x for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:15:27.868 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 12 00:15:27 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x[31173]: 2024-09-12T00:15:27.431+0000 7fa5696a5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:15:27.868 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 12 00:15:27 smithi006 podman[110121]: 2024-09-12 00:15:27.463647918 +0000 UTC m=+0.158552430 container died 3fff39688a1e81bc114eeda65082e59104cea72e7a33412f25eceaababfc7bbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T00:15:28.326 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 12 00:15:28 smithi006 podman[110121]: 2024-09-12 00:15:28.091954683 +0000 UTC m=+0.786859194 container cleanup 3fff39688a1e81bc114eeda65082e59104cea72e7a33412f25eceaababfc7bbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:15:28.326 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 12 00:15:28 smithi006 bash[110121]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x 2024-09-12T00:15:28.579 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 12 00:15:28 smithi006 podman[110133]: 2024-09-12 00:15:28.327559036 +0000 UTC m=+0.860766703 container remove 3fff39688a1e81bc114eeda65082e59104cea72e7a33412f25eceaababfc7bbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T00:15:28.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T00:15:28.621 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:15:28.621 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T00:15:28.622 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T00:15:28.622 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.y 2024-09-12T00:15:28.976 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 12 00:15:28 smithi039 systemd[1]: Stopping Ceph mgr.y for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:15:29.280 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 12 00:15:28 smithi039 podman[70662]: 2024-09-12 00:15:28.977679264 +0000 UTC m=+0.154152775 container died 68268aeae500ffbaaf3db49b4ef84f4913e7dca15151d6091faded395a79efca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T00:15:29.543 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 12 00:15:29 smithi039 podman[70662]: 2024-09-12 00:15:29.364745405 +0000 UTC m=+0.541218913 container cleanup 68268aeae500ffbaaf3db49b4ef84f4913e7dca15151d6091faded395a79efca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T00:15:29.544 INFO:journalctl@ceph.mgr.y.smithi039.stdout:Sep 12 00:15:29 smithi039 bash[70662]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-y 2024-09-12T00:15:29.892 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T00:15:29.929 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:15:29.930 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T00:15:29.930 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T00:15:29.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.z 2024-09-12T00:15:30.242 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 12 00:15:29 smithi134 systemd[1]: Stopping Ceph mgr.z for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:15:30.534 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 12 00:15:30 smithi134 podman[70782]: 2024-09-12 00:15:30.239762962 +0000 UTC m=+0.117575722 container died 8d7ce96313ecc51db189c15c76805520e3939dc087809860887b58f3d14f330f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T00:15:30.902 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 12 00:15:30 smithi134 podman[70782]: 2024-09-12 00:15:30.635473388 +0000 UTC m=+0.513286148 container cleanup 8d7ce96313ecc51db189c15c76805520e3939dc087809860887b58f3d14f330f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T00:15:30.902 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 12 00:15:30 smithi134 bash[70782]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mgr-z 2024-09-12T00:15:31.069 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T00:15:31.105 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:15:31.106 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T00:15:31.106 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T00:15:31.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.0 2024-09-12T00:15:31.429 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:31 smithi006 systemd[1]: Stopping Ceph osd.0 for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:15:31.868 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:31 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0[45313]: 2024-09-12T00:15:31.430+0000 7f7fd667d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:15:31.868 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:31 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0[45313]: 2024-09-12T00:15:31.430+0000 7f7fd667d640 -1 osd.0 94 *** Got signal Terminated *** 2024-09-12T00:15:31.868 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:31 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0[45313]: 2024-09-12T00:15:31.430+0000 7f7fd667d640 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:15:37.274 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:36 smithi006 podman[110246]: 2024-09-12 00:15:36.998637433 +0000 UTC m=+5.689344794 container died b0a56c975ab01261742592fadeb0cad932580ec9b80fe43a08d8e2587ca9f87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T00:15:37.618 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:37 smithi006 podman[110246]: 2024-09-12 00:15:37.414048735 +0000 UTC m=+6.104756096 container cleanup b0a56c975ab01261742592fadeb0cad932580ec9b80fe43a08d8e2587ca9f87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T00:15:37.618 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:37 smithi006 bash[110246]: ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0 2024-09-12T00:15:38.030 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:37 smithi006 podman[110263]: 2024-09-12 00:15:37.69118614 +0000 UTC m=+0.684603612 container remove b0a56c975ab01261742592fadeb0cad932580ec9b80fe43a08d8e2587ca9f87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T00:15:38.318 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:38 smithi006 podman[110355]: 2024-09-12 00:15:37.93502679 +0000 UTC m=+0.016325718 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:15:38.319 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:38 smithi006 podman[110355]: 2024-09-12 00:15:38.058719825 +0000 UTC m=+0.140018735 container create 2864f51e8d8d364729490e397e55dbca6cafdcf5101875fa5be00768fa404954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:15:38.618 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:38 smithi006 podman[110355]: 2024-09-12 00:15:38.320462437 +0000 UTC m=+0.401761356 container init 2864f51e8d8d364729490e397e55dbca6cafdcf5101875fa5be00768fa404954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:15:38.618 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:38 smithi006 podman[110355]: 2024-09-12 00:15:38.324283511 +0000 UTC m=+0.405582422 container start 2864f51e8d8d364729490e397e55dbca6cafdcf5101875fa5be00768fa404954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T00:15:38.618 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:38 smithi006 podman[110355]: 2024-09-12 00:15:38.437674472 +0000 UTC m=+0.518973398 container attach 2864f51e8d8d364729490e397e55dbca6cafdcf5101875fa5be00768fa404954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-12T00:15:39.082 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 12 00:15:38 smithi006 podman[110355]: 2024-09-12 00:15:38.76405833 +0000 UTC m=+0.845357252 container died 2864f51e8d8d364729490e397e55dbca6cafdcf5101875fa5be00768fa404954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T00:15:39.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T00:15:39.446 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:15:39.447 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T00:15:39.447 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T00:15:39.447 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.1 2024-09-12T00:15:39.768 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:39 smithi039 systemd[1]: Stopping Ceph osd.1 for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:15:40.043 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:39 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1[39003]: 2024-09-12T00:15:39.768+0000 7f2262f12640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:15:40.043 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:39 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1[39003]: 2024-09-12T00:15:39.768+0000 7f2262f12640 -1 osd.1 94 *** Got signal Terminated *** 2024-09-12T00:15:40.044 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:39 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1[39003]: 2024-09-12T00:15:39.768+0000 7f2262f12640 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:15:45.644 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:45 smithi039 podman[70790]: 2024-09-12 00:15:45.351442484 +0000 UTC m=+5.704150095 container died 2f89cabb1d15d84e2444ba36f9fe14cc4a08278112c5f6b79a5f9b22e2646bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T00:15:46.043 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:45 smithi039 podman[70790]: 2024-09-12 00:15:45.728496311 +0000 UTC m=+6.081203920 container cleanup 2f89cabb1d15d84e2444ba36f9fe14cc4a08278112c5f6b79a5f9b22e2646bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T00:15:46.043 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:45 smithi039 bash[70790]: ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1 2024-09-12T00:15:46.475 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:46 smithi039 podman[70805]: 2024-09-12 00:15:46.155253688 +0000 UTC m=+0.799014678 container remove 2f89cabb1d15d84e2444ba36f9fe14cc4a08278112c5f6b79a5f9b22e2646bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T00:15:46.732 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:46 smithi039 podman[70894]: 2024-09-12 00:15:46.37976036 +0000 UTC m=+0.016560491 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:15:46.733 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:46 smithi039 podman[70894]: 2024-09-12 00:15:46.489757985 +0000 UTC m=+0.126558102 container create 7d8a596ae11619e14ec4531ea8021592811782baf3eafcc624cf6c7fecc528ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T00:15:46.733 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:46 smithi039 podman[70894]: 2024-09-12 00:15:46.734484646 +0000 UTC m=+0.371284768 container init 7d8a596ae11619e14ec4531ea8021592811782baf3eafcc624cf6c7fecc528ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:15:47.043 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:46 smithi039 podman[70894]: 2024-09-12 00:15:46.738008141 +0000 UTC m=+0.374808268 container start 7d8a596ae11619e14ec4531ea8021592811782baf3eafcc624cf6c7fecc528ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T00:15:47.044 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:46 smithi039 podman[70894]: 2024-09-12 00:15:46.818128077 +0000 UTC m=+0.454928195 container attach 7d8a596ae11619e14ec4531ea8021592811782baf3eafcc624cf6c7fecc528ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T00:15:47.377 INFO:journalctl@ceph.osd.1.smithi039.stdout:Sep 12 00:15:47 smithi039 podman[70894]: 2024-09-12 00:15:47.096196263 +0000 UTC m=+0.732996390 container died 7d8a596ae11619e14ec4531ea8021592811782baf3eafcc624cf6c7fecc528ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:15:47.698 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T00:15:47.739 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:15:47.739 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T00:15:47.739 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T00:15:47.740 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.2 2024-09-12T00:15:48.038 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:47 smithi134 systemd[1]: Stopping Ceph osd.2 for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:15:48.293 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:48 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2[39886]: 2024-09-12T00:15:48.039+0000 7fee86a31640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:15:48.293 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:48 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2[39886]: 2024-09-12T00:15:48.039+0000 7fee86a31640 -1 osd.2 94 *** Got signal Terminated *** 2024-09-12T00:15:48.293 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:48 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2[39886]: 2024-09-12T00:15:48.039+0000 7fee86a31640 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:15:53.881 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:53 smithi134 podman[70907]: 2024-09-12 00:15:53.588814214 +0000 UTC m=+5.655765864 container died ea27079d9aad7e533d6e3507a7465765d9e4c4734347806110119be8939a44e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:15:54.203 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:53 smithi134 podman[70907]: 2024-09-12 00:15:53.981793766 +0000 UTC m=+6.048745414 container cleanup ea27079d9aad7e533d6e3507a7465765d9e4c4734347806110119be8939a44e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:15:54.203 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:53 smithi134 bash[70907]: ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2 2024-09-12T00:15:54.652 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:54 smithi134 podman[70936]: 2024-09-12 00:15:54.233611066 +0000 UTC m=+0.641076814 container remove ea27079d9aad7e533d6e3507a7465765d9e4c4734347806110119be8939a44e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T00:15:54.930 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:54 smithi134 podman[71021]: 2024-09-12 00:15:54.556143214 +0000 UTC m=+0.015581704 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:15:54.930 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:54 smithi134 podman[71021]: 2024-09-12 00:15:54.676225171 +0000 UTC m=+0.135663654 container create 16725c8cb91af01ec9cd51c0e9c247832fb4045686149aba88fbd6cd1c1b3115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T00:15:55.184 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:54 smithi134 podman[71021]: 2024-09-12 00:15:54.931321064 +0000 UTC m=+0.390759545 container init 16725c8cb91af01ec9cd51c0e9c247832fb4045686149aba88fbd6cd1c1b3115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-12T00:15:55.184 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:54 smithi134 podman[71021]: 2024-09-12 00:15:54.934769461 +0000 UTC m=+0.394207929 container start 16725c8cb91af01ec9cd51c0e9c247832fb4045686149aba88fbd6cd1c1b3115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T00:15:55.184 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:55 smithi134 podman[71021]: 2024-09-12 00:15:55.039644755 +0000 UTC m=+0.499083232 container attach 16725c8cb91af01ec9cd51c0e9c247832fb4045686149aba88fbd6cd1c1b3115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T00:15:55.184 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 12 00:15:55 smithi134 podman[71021]: 2024-09-12 00:15:55.168981558 +0000 UTC m=+0.628420027 container died 16725c8cb91af01ec9cd51c0e9c247832fb4045686149aba88fbd6cd1c1b3115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-09-12T00:15:55.813 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T00:15:55.858 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:15:55.858 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T00:15:55.859 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T00:15:55.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.3 2024-09-12T00:15:56.186 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:15:55 smithi006 systemd[1]: Stopping Ceph osd.3 for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:15:56.618 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:15:56 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3[52056]: 2024-09-12T00:15:56.187+0000 7ffa64b69640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:15:56.618 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:15:56 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3[52056]: 2024-09-12T00:15:56.187+0000 7ffa64b69640 -1 osd.3 94 *** Got signal Terminated *** 2024-09-12T00:15:56.618 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:15:56 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3[52056]: 2024-09-12T00:15:56.187+0000 7ffa64b69640 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:16:02.187 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:16:01 smithi006 podman[110468]: 2024-09-12 00:16:01.883246608 +0000 UTC m=+5.815610617 container died afb68bdd50f58a8cb9fe7ca922d9759dd609cf085160021bb42f7c75206b2143 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T00:16:02.546 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:16:02 smithi006 podman[110468]: 2024-09-12 00:16:02.28743152 +0000 UTC m=+6.219795575 container cleanup afb68bdd50f58a8cb9fe7ca922d9759dd609cf085160021bb42f7c75206b2143 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T00:16:02.546 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:16:02 smithi006 bash[110468]: ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3 2024-09-12T00:16:02.868 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:16:02 smithi006 podman[110484]: 2024-09-12 00:16:02.547244823 +0000 UTC m=+0.657853446 container remove afb68bdd50f58a8cb9fe7ca922d9759dd609cf085160021bb42f7c75206b2143 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T00:16:03.208 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:16:02 smithi006 podman[110572]: 2024-09-12 00:16:02.820085428 +0000 UTC m=+0.016384117 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:16:03.208 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:16:02 smithi006 podman[110572]: 2024-09-12 00:16:02.965283082 +0000 UTC m=+0.161581804 container create b309a769de8b5b43c39e39abf649cdaa762a8e231c6909bac9ee1d9ac279a885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T00:16:03.208 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:16:03 smithi006 podman[110572]: 2024-09-12 00:16:03.209671679 +0000 UTC m=+0.405970356 container init b309a769de8b5b43c39e39abf649cdaa762a8e231c6909bac9ee1d9ac279a885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T00:16:03.618 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:16:03 smithi006 podman[110572]: 2024-09-12 00:16:03.213230303 +0000 UTC m=+0.409528982 container start b309a769de8b5b43c39e39abf649cdaa762a8e231c6909bac9ee1d9ac279a885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:16:03.618 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:16:03 smithi006 podman[110572]: 2024-09-12 00:16:03.35908857 +0000 UTC m=+0.555387258 container attach b309a769de8b5b43c39e39abf649cdaa762a8e231c6909bac9ee1d9ac279a885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T00:16:03.618 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 12 00:16:03 smithi006 podman[110572]: 2024-09-12 00:16:03.41263803 +0000 UTC m=+0.608936722 container died b309a769de8b5b43c39e39abf649cdaa762a8e231c6909bac9ee1d9ac279a885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:16:04.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T00:16:04.062 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:16:04.063 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T00:16:04.063 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T00:16:04.063 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.4 2024-09-12T00:16:04.391 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:04 smithi039 systemd[1]: Stopping Ceph osd.4 for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:16:04.793 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:04 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4[45873]: 2024-09-12T00:16:04.392+0000 7fa51e9ca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:16:04.793 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:04 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4[45873]: 2024-09-12T00:16:04.392+0000 7fa51e9ca640 -1 osd.4 94 *** Got signal Terminated *** 2024-09-12T00:16:04.793 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:04 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4[45873]: 2024-09-12T00:16:04.392+0000 7fa51e9ca640 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:16:10.457 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:10 smithi039 podman[71007]: 2024-09-12 00:16:10.103764685 +0000 UTC m=+5.830111108 container died cc6f5ed7732242f052c3603f0262e79f40f909af186fcf3a246fe3544d28d0a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T00:16:10.733 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:10 smithi039 podman[71007]: 2024-09-12 00:16:10.459270682 +0000 UTC m=+6.185617096 container cleanup cc6f5ed7732242f052c3603f0262e79f40f909af186fcf3a246fe3544d28d0a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T00:16:10.734 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:10 smithi039 bash[71007]: ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4 2024-09-12T00:16:11.043 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:10 smithi039 podman[71023]: 2024-09-12 00:16:10.735684016 +0000 UTC m=+0.633853423 container remove cc6f5ed7732242f052c3603f0262e79f40f909af186fcf3a246fe3544d28d0a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T00:16:11.346 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:11 smithi039 podman[71116]: 2024-09-12 00:16:10.954512018 +0000 UTC m=+0.016234356 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:16:11.346 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:11 smithi039 podman[71116]: 2024-09-12 00:16:11.053312734 +0000 UTC m=+0.115035062 container create 53235cd55d0e64b243b9d9d854e5957c4f71f39b1a00a9683a84f75eab1c34f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T00:16:11.346 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:11 smithi039 podman[71116]: 2024-09-12 00:16:11.348189603 +0000 UTC m=+0.409911947 container init 53235cd55d0e64b243b9d9d854e5957c4f71f39b1a00a9683a84f75eab1c34f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T00:16:11.794 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:11 smithi039 podman[71116]: 2024-09-12 00:16:11.35162232 +0000 UTC m=+0.413344648 container start 53235cd55d0e64b243b9d9d854e5957c4f71f39b1a00a9683a84f75eab1c34f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:16:11.794 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:11 smithi039 podman[71116]: 2024-09-12 00:16:11.448346152 +0000 UTC m=+0.510068489 container attach 53235cd55d0e64b243b9d9d854e5957c4f71f39b1a00a9683a84f75eab1c34f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T00:16:11.794 INFO:journalctl@ceph.osd.4.smithi039.stdout:Sep 12 00:16:11 smithi039 podman[71116]: 2024-09-12 00:16:11.556835992 +0000 UTC m=+0.618558320 container died 53235cd55d0e64b243b9d9d854e5957c4f71f39b1a00a9683a84f75eab1c34f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T00:16:12.178 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T00:16:12.222 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:16:12.222 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T00:16:12.222 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T00:16:12.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.5 2024-09-12T00:16:12.544 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:12 smithi134 systemd[1]: Stopping Ceph osd.5 for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:16:12.953 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:12 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5[46759]: 2024-09-12T00:16:12.545+0000 7fc62f33f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:16:12.953 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:12 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5[46759]: 2024-09-12T00:16:12.545+0000 7fc62f33f640 -1 osd.5 94 *** Got signal Terminated *** 2024-09-12T00:16:12.953 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:12 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5[46759]: 2024-09-12T00:16:12.545+0000 7fc62f33f640 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:16:18.453 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:18 smithi134 podman[71125]: 2024-09-12 00:16:18.148501828 +0000 UTC m=+5.723316523 container died 7554b50df916ae09db5a87a7de551acab7e2df2ed56fc64c88f8a73366387305 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T00:16:18.754 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:18 smithi134 podman[71125]: 2024-09-12 00:16:18.545832034 +0000 UTC m=+6.120646727 container cleanup 7554b50df916ae09db5a87a7de551acab7e2df2ed56fc64c88f8a73366387305 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T00:16:18.754 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:18 smithi134 bash[71125]: ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5 2024-09-12T00:16:19.101 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:18 smithi134 podman[71143]: 2024-09-12 00:16:18.755567944 +0000 UTC m=+0.606474823 container remove 7554b50df916ae09db5a87a7de551acab7e2df2ed56fc64c88f8a73366387305 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:16:19.352 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:19 smithi134 podman[71240]: 2024-09-12 00:16:19.005257364 +0000 UTC m=+0.017242622 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:16:19.352 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:19 smithi134 podman[71240]: 2024-09-12 00:16:19.1147576 +0000 UTC m=+0.126742853 container create a9b72c811591fbd3be52afbb85f8f882bc16150923b6cf31ca68fe3b992e5816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T00:16:19.353 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:19 smithi134 podman[71240]: 2024-09-12 00:16:19.350485468 +0000 UTC m=+0.362470711 container init a9b72c811591fbd3be52afbb85f8f882bc16150923b6cf31ca68fe3b992e5816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T00:16:19.647 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:19 smithi134 podman[71240]: 2024-09-12 00:16:19.353871889 +0000 UTC m=+0.365857142 container start a9b72c811591fbd3be52afbb85f8f882bc16150923b6cf31ca68fe3b992e5816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:16:19.647 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:19 smithi134 podman[71240]: 2024-09-12 00:16:19.475720849 +0000 UTC m=+0.487706094 container attach a9b72c811591fbd3be52afbb85f8f882bc16150923b6cf31ca68fe3b992e5816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T00:16:19.647 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 12 00:16:19 smithi134 podman[71240]: 2024-09-12 00:16:19.547356873 +0000 UTC m=+0.559342116 container died a9b72c811591fbd3be52afbb85f8f882bc16150923b6cf31ca68fe3b992e5816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T00:16:20.182 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T00:16:20.223 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:16:20.223 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T00:16:20.223 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T00:16:20.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.6 2024-09-12T00:16:20.548 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:20 smithi006 systemd[1]: Stopping Ceph osd.6 for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:16:20.868 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:20 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6[58820]: 2024-09-12T00:16:20.548+0000 7f45b6428640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:16:20.868 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:20 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6[58820]: 2024-09-12T00:16:20.548+0000 7f45b6428640 -1 osd.6 94 *** Got signal Terminated *** 2024-09-12T00:16:20.868 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:20 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6[58820]: 2024-09-12T00:16:20.548+0000 7f45b6428640 -1 osd.6 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:16:26.575 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:26 smithi006 podman[110674]: 2024-09-12 00:16:26.295698252 +0000 UTC m=+5.866527717 container died 725e326b69846c4b74c498a2ec399f943336c6d2950ed3c91328ac29f69293f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T00:16:26.868 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:26 smithi006 podman[110674]: 2024-09-12 00:16:26.674760249 +0000 UTC m=+6.245589714 container cleanup 725e326b69846c4b74c498a2ec399f943336c6d2950ed3c91328ac29f69293f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-12T00:16:26.868 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:26 smithi006 bash[110674]: ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6 2024-09-12T00:16:27.298 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:26 smithi006 podman[110700]: 2024-09-12 00:16:26.967867765 +0000 UTC m=+0.672231825 container remove 725e326b69846c4b74c498a2ec399f943336c6d2950ed3c91328ac29f69293f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:16:27.578 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:27 smithi006 podman[110790]: 2024-09-12 00:16:27.202958396 +0000 UTC m=+0.016714196 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:16:27.578 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:27 smithi006 podman[110790]: 2024-09-12 00:16:27.318653336 +0000 UTC m=+0.132409123 container create 56f667ccab5e965fd871cc5851d39955a719391dc73996bcc6d90d259c371363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T00:16:27.578 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:27 smithi006 podman[110790]: 2024-09-12 00:16:27.579814131 +0000 UTC m=+0.393569917 container init 56f667ccab5e965fd871cc5851d39955a719391dc73996bcc6d90d259c371363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:16:27.868 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:27 smithi006 podman[110790]: 2024-09-12 00:16:27.583481399 +0000 UTC m=+0.397237186 container start 56f667ccab5e965fd871cc5851d39955a719391dc73996bcc6d90d259c371363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T00:16:27.868 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:27 smithi006 podman[110790]: 2024-09-12 00:16:27.654815122 +0000 UTC m=+0.468570920 container attach 56f667ccab5e965fd871cc5851d39955a719391dc73996bcc6d90d259c371363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T00:16:27.869 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 12 00:16:27 smithi006 podman[110790]: 2024-09-12 00:16:27.788428669 +0000 UTC m=+0.602184469 container died 56f667ccab5e965fd871cc5851d39955a719391dc73996bcc6d90d259c371363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T00:16:28.391 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T00:16:28.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:16:28.440 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T00:16:28.440 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T00:16:28.440 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.7 2024-09-12T00:16:28.761 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:28 smithi039 systemd[1]: Stopping Ceph osd.7 for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:16:29.043 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:28 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7[52771]: 2024-09-12T00:16:28.763+0000 7fb6f9ee8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:16:29.043 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:28 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7[52771]: 2024-09-12T00:16:28.763+0000 7fb6f9ee8640 -1 osd.7 94 *** Got signal Terminated *** 2024-09-12T00:16:29.044 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:28 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7[52771]: 2024-09-12T00:16:28.763+0000 7fb6f9ee8640 -1 osd.7 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:16:34.854 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:34 smithi039 podman[71219]: 2024-09-12 00:16:34.584978943 +0000 UTC m=+5.941666582 container died ca8ffffaeaceef00029d88055c9a345e920f93d13c4b9def2e0906aa03e39979 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:16:35.213 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:34 smithi039 podman[71219]: 2024-09-12 00:16:34.938987778 +0000 UTC m=+6.295675414 container cleanup ca8ffffaeaceef00029d88055c9a345e920f93d13c4b9def2e0906aa03e39979 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T00:16:35.213 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:34 smithi039 bash[71219]: ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7 2024-09-12T00:16:35.531 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:35 smithi039 podman[71249]: 2024-09-12 00:16:35.215279734 +0000 UTC m=+0.629656141 container remove ca8ffffaeaceef00029d88055c9a345e920f93d13c4b9def2e0906aa03e39979 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T00:16:35.784 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:35 smithi039 podman[71339]: 2024-09-12 00:16:35.436200358 +0000 UTC m=+0.016240666 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:16:35.784 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:35 smithi039 podman[71339]: 2024-09-12 00:16:35.541132914 +0000 UTC m=+0.121173269 container create 8d9e32431be2db569659ddd3a59f98e62a80da0fe0829e4c0dbed1d9791626a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-12T00:16:35.784 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:35 smithi039 podman[71339]: 2024-09-12 00:16:35.785999478 +0000 UTC m=+0.366039786 container init 8d9e32431be2db569659ddd3a59f98e62a80da0fe0829e4c0dbed1d9791626a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T00:16:36.044 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:35 smithi039 podman[71339]: 2024-09-12 00:16:35.789844563 +0000 UTC m=+0.369884859 container start 8d9e32431be2db569659ddd3a59f98e62a80da0fe0829e4c0dbed1d9791626a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T00:16:36.044 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:35 smithi039 podman[71339]: 2024-09-12 00:16:35.869301145 +0000 UTC m=+0.449341454 container attach 8d9e32431be2db569659ddd3a59f98e62a80da0fe0829e4c0dbed1d9791626a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T00:16:36.044 INFO:journalctl@ceph.osd.7.smithi039.stdout:Sep 12 00:16:35 smithi039 podman[71339]: 2024-09-12 00:16:35.987213088 +0000 UTC m=+0.567253400 container died 8d9e32431be2db569659ddd3a59f98e62a80da0fe0829e4c0dbed1d9791626a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T00:16:36.609 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T00:16:36.652 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:16:36.653 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T00:16:36.653 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T00:16:36.653 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.8 2024-09-12T00:16:36.953 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:36 smithi134 systemd[1]: Stopping Ceph osd.8 for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:16:37.453 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:36 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8[53256]: 2024-09-12T00:16:36.964+0000 7f9185f26640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:16:37.453 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:36 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8[53256]: 2024-09-12T00:16:36.964+0000 7f9185f26640 -1 osd.8 94 *** Got signal Terminated *** 2024-09-12T00:16:37.453 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:36 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8[53256]: 2024-09-12T00:16:36.964+0000 7f9185f26640 -1 osd.8 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:16:39.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:39 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:39.214+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:40.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:39 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:39.942+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:40.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:40 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:40.210+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:40.868 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:40 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:40.383+0000 7fb73069a640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:34.333181+0000 front 2024-09-12T00:15:34.333255+0000 (oldest deadline 2024-09-12T00:16:39.633319+0000) 2024-09-12T00:16:41.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:40 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:40.973+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:41.453 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:41 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:41.177+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:41.868 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:41 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:41.378+0000 7fb73069a640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:34.333181+0000 front 2024-09-12T00:15:34.333255+0000 (oldest deadline 2024-09-12T00:16:39.633319+0000) 2024-09-12T00:16:42.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:42 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:42.000+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:42.453 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:42 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:42.197+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:42.868 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:42 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:42.378+0000 7fb73069a640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:34.333181+0000 front 2024-09-12T00:15:34.333255+0000 (oldest deadline 2024-09-12T00:16:39.633319+0000) 2024-09-12T00:16:42.938 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:42 smithi134 podman[71345]: 2024-09-12 00:16:42.653895962 +0000 UTC m=+5.803028274 container died 45377378fd163f20f7c481e92b9ba7f848ac92ca66667c1b69dbc828ef444e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T00:16:43.203 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:43 smithi134 podman[71345]: 2024-09-12 00:16:43.055894679 +0000 UTC m=+6.205026981 container cleanup 45377378fd163f20f7c481e92b9ba7f848ac92ca66667c1b69dbc828ef444e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:16:43.203 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:43 smithi134 bash[71345]: ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8 2024-09-12T00:16:43.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:43 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:43.004+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:43.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:43 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:43.355+0000 7fb73069a640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:34.333181+0000 front 2024-09-12T00:15:34.333255+0000 (oldest deadline 2024-09-12T00:16:39.633319+0000) 2024-09-12T00:16:43.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:43 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:43.216+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:43.703 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:43 smithi134 podman[71360]: 2024-09-12 00:16:43.332467014 +0000 UTC m=+0.679989112 container remove 45377378fd163f20f7c481e92b9ba7f848ac92ca66667c1b69dbc828ef444e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T00:16:44.084 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:43 smithi134 podman[71447]: 2024-09-12 00:16:43.728550092 +0000 UTC m=+0.015887489 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:16:44.084 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:43 smithi134 podman[71447]: 2024-09-12 00:16:43.85001391 +0000 UTC m=+0.137362985 container create c3311b386461223a67f886048b5fafedc9383dc1e07581dcbdc2fc2a034f859d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T00:16:44.084 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:44 smithi134 podman[71447]: 2024-09-12 00:16:44.085790886 +0000 UTC m=+0.373128281 container init c3311b386461223a67f886048b5fafedc9383dc1e07581dcbdc2fc2a034f859d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:16:44.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:44 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:44.016+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:44.358 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:44 smithi134 podman[71447]: 2024-09-12 00:16:44.089485206 +0000 UTC m=+0.376822592 container start c3311b386461223a67f886048b5fafedc9383dc1e07581dcbdc2fc2a034f859d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T00:16:44.358 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:44 smithi134 podman[71447]: 2024-09-12 00:16:44.202273847 +0000 UTC m=+0.489611248 container attach c3311b386461223a67f886048b5fafedc9383dc1e07581dcbdc2fc2a034f859d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T00:16:44.358 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 12 00:16:44 smithi134 podman[71447]: 2024-09-12 00:16:44.289189313 +0000 UTC m=+0.576526700 container died c3311b386461223a67f886048b5fafedc9383dc1e07581dcbdc2fc2a034f859d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T00:16:44.359 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:44 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:44.245+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:44.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:44 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:44.361+0000 7fb73069a640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:34.333181+0000 front 2024-09-12T00:15:34.333255+0000 (oldest deadline 2024-09-12T00:16:39.633319+0000) 2024-09-12T00:16:44.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T00:16:44.958 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:16:44.958 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T00:16:44.958 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T00:16:44.959 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.9 2024-09-12T00:16:45.293 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:45 smithi006 systemd[1]: Stopping Ceph osd.9 for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:16:45.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:44 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:44.986+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:45.453 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:45 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:45.198+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:45.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:45 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:45.293+0000 7fb73808c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:16:45.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:45 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:45.293+0000 7fb73808c640 -1 osd.9 94 *** Got signal Terminated *** 2024-09-12T00:16:45.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:45 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:45.293+0000 7fb73808c640 -1 osd.9 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:16:45.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:45 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:45.332+0000 7fb73069a640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:34.333181+0000 front 2024-09-12T00:15:34.333255+0000 (oldest deadline 2024-09-12T00:16:39.633319+0000) 2024-09-12T00:16:46.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:46 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:46.017+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:46.453 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:46 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:46.169+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:46.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:46 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:46.296+0000 7fb73069a640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:34.333181+0000 front 2024-09-12T00:15:34.333255+0000 (oldest deadline 2024-09-12T00:16:39.633319+0000) 2024-09-12T00:16:47.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:46 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:46.978+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:47.453 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:47 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:47.179+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:47.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:47 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:47.293+0000 7fb73069a640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:34.333181+0000 front 2024-09-12T00:15:34.333255+0000 (oldest deadline 2024-09-12T00:16:39.633319+0000) 2024-09-12T00:16:48.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:48 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:48.027+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:48.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:48 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:48.330+0000 7fb73069a640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:34.333181+0000 front 2024-09-12T00:15:34.333255+0000 (oldest deadline 2024-09-12T00:16:39.633319+0000) 2024-09-12T00:16:48.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:48 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:48.226+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:49.297 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:49 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:49.014+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:49.297 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:49 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:49.014+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:42.858203+0000 front 2024-09-12T00:15:42.858113+0000 (oldest deadline 2024-09-12T00:16:48.158102+0000) 2024-09-12T00:16:49.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:49 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9[65807]: 2024-09-12T00:16:49.328+0000 7fb73069a640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:34.333181+0000 front 2024-09-12T00:15:34.333255+0000 (oldest deadline 2024-09-12T00:16:39.633319+0000) 2024-09-12T00:16:49.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:49 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:49.265+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:49.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:49 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:49.265+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:16:50.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:50 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:50.007+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:50.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:50 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:50.007+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:42.858203+0000 front 2024-09-12T00:15:42.858113+0000 (oldest deadline 2024-09-12T00:16:48.158102+0000) 2024-09-12T00:16:50.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:50 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:50.279+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:50.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:50 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:50.279+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:16:51.275 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:50 smithi006 podman[110894]: 2024-09-12 00:16:50.952703848 +0000 UTC m=+5.793428862 container died 4454061ad4d2fbe4f5bf14d5d7bd0ee6040a22d8ef60f88a19e56d1a17dafcc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T00:16:51.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:50 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:50.965+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:51.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:50 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:50.965+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:42.858203+0000 front 2024-09-12T00:15:42.858113+0000 (oldest deadline 2024-09-12T00:16:48.158102+0000) 2024-09-12T00:16:51.610 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:51 smithi006 podman[110894]: 2024-09-12 00:16:51.377566514 +0000 UTC m=+6.218291533 container cleanup 4454061ad4d2fbe4f5bf14d5d7bd0ee6040a22d8ef60f88a19e56d1a17dafcc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T00:16:51.610 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:51 smithi006 bash[110894]: ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9 2024-09-12T00:16:51.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:51 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:51.308+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:51.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:51 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:51.308+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:16:51.868 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:51 smithi006 podman[110909]: 2024-09-12 00:16:51.611929239 +0000 UTC m=+0.655654616 container remove 4454061ad4d2fbe4f5bf14d5d7bd0ee6040a22d8ef60f88a19e56d1a17dafcc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:16:52.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:51 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:51.956+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:52.294 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:51 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:51.956+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:42.858203+0000 front 2024-09-12T00:15:42.858113+0000 (oldest deadline 2024-09-12T00:16:48.158102+0000) 2024-09-12T00:16:52.313 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:52 smithi006 podman[110999]: 2024-09-12 00:16:51.95274413 +0000 UTC m=+0.016197915 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:16:52.314 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:52 smithi006 podman[110999]: 2024-09-12 00:16:52.063129213 +0000 UTC m=+0.126582989 container create 70b7a0a9006bdc357709a6794fc88636e55ce5818b0a7017143cdd0abe3554ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T00:16:52.314 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:52 smithi006 podman[110999]: 2024-09-12 00:16:52.3156027 +0000 UTC m=+0.379056476 container init 70b7a0a9006bdc357709a6794fc88636e55ce5818b0a7017143cdd0abe3554ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T00:16:52.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:52 smithi006 podman[110999]: 2024-09-12 00:16:52.319082991 +0000 UTC m=+0.382536768 container start 70b7a0a9006bdc357709a6794fc88636e55ce5818b0a7017143cdd0abe3554ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T00:16:52.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:52 smithi006 podman[110999]: 2024-09-12 00:16:52.398759711 +0000 UTC m=+0.462213503 container attach 70b7a0a9006bdc357709a6794fc88636e55ce5818b0a7017143cdd0abe3554ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T00:16:52.618 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 12 00:16:52 smithi006 podman[110999]: 2024-09-12 00:16:52.510495984 +0000 UTC m=+0.573949761 container died 70b7a0a9006bdc357709a6794fc88636e55ce5818b0a7017143cdd0abe3554ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T00:16:52.702 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:52 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:52.308+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:52.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:52 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:52.308+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:16:53.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T00:16:53.189 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:16:53.189 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T00:16:53.189 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T00:16:53.189 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.10 2024-09-12T00:16:53.217 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:52 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:52.910+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:53.217 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:52 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:52.910+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:42.858203+0000 front 2024-09-12T00:15:42.858113+0000 (oldest deadline 2024-09-12T00:16:48.158102+0000) 2024-09-12T00:16:53.499 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:53 smithi039 systemd[1]: Stopping Ceph osd.10 for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:16:53.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:53 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:53.313+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:53.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:53 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:53.313+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:16:53.793 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:53 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:53.499+0000 7f7c38664640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:16:53.794 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:53 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:53.499+0000 7f7c38664640 -1 osd.10 94 *** Got signal Terminated *** 2024-09-12T00:16:53.794 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:53 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:53.499+0000 7f7c38664640 -1 osd.10 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:16:54.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:53 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:53.938+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:54.294 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:53 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:53.938+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:42.858203+0000 front 2024-09-12T00:15:42.858113+0000 (oldest deadline 2024-09-12T00:16:48.158102+0000) 2024-09-12T00:16:54.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:54 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:54.353+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:54.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:54 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:54.353+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:16:54.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:54 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:54.353+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:16:55.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:54 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:54.906+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:55.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:54 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:54.906+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:42.858203+0000 front 2024-09-12T00:15:42.858113+0000 (oldest deadline 2024-09-12T00:16:48.158102+0000) 2024-09-12T00:16:55.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:55 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:55.341+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:55.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:55 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:55.341+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:16:55.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:55 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:55.341+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:16:56.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:55 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:55.877+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:56.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:55 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:55.877+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:42.858203+0000 front 2024-09-12T00:15:42.858113+0000 (oldest deadline 2024-09-12T00:16:48.158102+0000) 2024-09-12T00:16:56.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:56 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:56.307+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:56.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:56 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:56.307+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:16:56.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:56 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:56.307+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:16:57.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:56 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:56.910+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:57.293 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:56 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:56.910+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:42.858203+0000 front 2024-09-12T00:15:42.858113+0000 (oldest deadline 2024-09-12T00:16:48.158102+0000) 2024-09-12T00:16:57.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:57 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:57.301+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:57.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:57 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:57.301+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:16:57.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:57 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:57.301+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:16:58.210 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:57 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:57.951+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:31.256051+0000 front 2024-09-12T00:15:31.255864+0000 (oldest deadline 2024-09-12T00:16:39.456703+0000) 2024-09-12T00:16:58.210 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:57 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:57.951+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:42.858203+0000 front 2024-09-12T00:15:42.858113+0000 (oldest deadline 2024-09-12T00:16:48.158102+0000) 2024-09-12T00:16:58.210 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:57 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10[59612]: 2024-09-12T00:16:57.951+0000 7f7c34c7a640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:51.659048+0000 front 2024-09-12T00:15:51.659211+0000 (oldest deadline 2024-09-12T00:16:56.959028+0000) 2024-09-12T00:16:58.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:58 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:58.281+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:58.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:58 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:58.281+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:16:58.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:58 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:58.281+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:16:59.383 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:59 smithi039 podman[71441]: 2024-09-12 00:16:59.106613809 +0000 UTC m=+5.709106365 container died 0ad1b0104ec164b5d5494ca7c7337e5dd67f576529afccd45722a0a1b6e62f00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:16:59.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:59 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:59.282+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:16:59.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:59 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:59.282+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:16:59.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:16:59 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:16:59.282+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:16:59.734 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:59 smithi039 podman[71441]: 2024-09-12 00:16:59.484166797 +0000 UTC m=+6.086659353 container cleanup 0ad1b0104ec164b5d5494ca7c7337e5dd67f576529afccd45722a0a1b6e62f00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T00:16:59.734 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:59 smithi039 bash[71441]: ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10 2024-09-12T00:17:00.043 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:16:59 smithi039 podman[71468]: 2024-09-12 00:16:59.735635747 +0000 UTC m=+0.627230826 container remove 0ad1b0104ec164b5d5494ca7c7337e5dd67f576529afccd45722a0a1b6e62f00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T00:17:00.378 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:17:00 smithi039 podman[71556]: 2024-09-12 00:17:00.086582011 +0000 UTC m=+0.102783903 container create 38cf49195feb435ad192c10f4a30505aadc5a2831a74a7d40b7e34e60ba73a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T00:17:00.379 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:17:00 smithi039 podman[71556]: 2024-09-12 00:16:59.999834916 +0000 UTC m=+0.016036766 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:17:00.379 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:17:00 smithi039 podman[71556]: 2024-09-12 00:17:00.297402299 +0000 UTC m=+0.313604149 container init 38cf49195feb435ad192c10f4a30505aadc5a2831a74a7d40b7e34e60ba73a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-12T00:17:00.379 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:17:00 smithi039 podman[71556]: 2024-09-12 00:17:00.300901482 +0000 UTC m=+0.317103333 container start 38cf49195feb435ad192c10f4a30505aadc5a2831a74a7d40b7e34e60ba73a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True) 2024-09-12T00:17:00.379 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:17:00 smithi039 podman[71556]: 2024-09-12 00:17:00.38051537 +0000 UTC m=+0.396717240 container attach 38cf49195feb435ad192c10f4a30505aadc5a2831a74a7d40b7e34e60ba73a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T00:17:00.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:00 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:00.287+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:17:00.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:00 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:00.287+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:17:00.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:00 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:00.287+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:17:00.793 INFO:journalctl@ceph.osd.10.smithi039.stdout:Sep 12 00:17:00 smithi039 podman[71556]: 2024-09-12 00:17:00.495034217 +0000 UTC m=+0.511236076 container died 38cf49195feb435ad192c10f4a30505aadc5a2831a74a7d40b7e34e60ba73a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T00:17:01.076 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T00:17:01.166 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:01.166 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T00:17:01.166 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T00:17:01.166 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.11 2024-09-12T00:17:01.453 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:01 smithi134 systemd[1]: Stopping Ceph osd.11 for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:01.453 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:01 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:01.278+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:17:01.454 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:01 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:01.278+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:17:01.454 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:01 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:01.278+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:17:01.953 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:01 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:01.666+0000 7f6be1ee4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:01.953 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:01 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:01.666+0000 7f6be1ee4640 -1 osd.11 94 *** Got signal Terminated *** 2024-09-12T00:17:01.953 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:01 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:01.666+0000 7f6be1ee4640 -1 osd.11 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:17:02.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:02 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:02.229+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:17:02.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:02 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:02.229+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:17:02.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:02 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:02.229+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:17:03.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:03.245+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:17:03.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:03.245+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:17:03.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:03 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:03.245+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:17:04.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:04 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:04.277+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:17:04.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:04 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:04.277+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:17:04.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:04 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:04.277+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:17:05.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:05 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:05.272+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:17:05.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:05 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:05.272+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:17:05.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:05 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:05.272+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:17:06.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:06 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:06.252+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-12T00:15:33.103230+0000 front 2024-09-12T00:15:33.103027+0000 (oldest deadline 2024-09-12T00:16:39.003105+0000) 2024-09-12T00:17:06.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:06 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:06.253+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.39:6804 osd.1 since back 2024-09-12T00:15:44.304589+0000 front 2024-09-12T00:15:44.304546+0000 (oldest deadline 2024-09-12T00:16:48.404440+0000) 2024-09-12T00:17:06.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:06 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11[60230]: 2024-09-12T00:17:06.253+0000 7f6bde4fa640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-12T00:15:48.404767+0000 front 2024-09-12T00:15:48.404792+0000 (oldest deadline 2024-09-12T00:16:53.705050+0000) 2024-09-12T00:17:07.639 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:07 smithi134 podman[71560]: 2024-09-12 00:17:07.325304471 +0000 UTC m=+5.954372852 container died b57a69d1ffc90ea2168cc711d090dab406a060106e512ddba75762fc4bf81651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-12T00:17:07.640 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:07 smithi134 podman[71560]: 2024-09-12 00:17:07.64108394 +0000 UTC m=+6.270152322 container cleanup b57a69d1ffc90ea2168cc711d090dab406a060106e512ddba75762fc4bf81651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T00:17:07.953 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:07 smithi134 bash[71560]: ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11 2024-09-12T00:17:07.953 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:07 smithi134 podman[71578]: 2024-09-12 00:17:07.833977827 +0000 UTC m=+0.505484390 container remove b57a69d1ffc90ea2168cc711d090dab406a060106e512ddba75762fc4bf81651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T00:17:08.427 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:08 smithi134 podman[71664]: 2024-09-12 00:17:08.142995924 +0000 UTC m=+0.109892416 container create be1e9d1861aaac4c4104d5e83996d5e9c4ca60b63f2432af5c450690de7c3cff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T00:17:08.427 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:08 smithi134 podman[71664]: 2024-09-12 00:17:08.048823908 +0000 UTC m=+0.015720407 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:17:08.427 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:08 smithi134 podman[71664]: 2024-09-12 00:17:08.353561969 +0000 UTC m=+0.320458454 container init be1e9d1861aaac4c4104d5e83996d5e9c4ca60b63f2432af5c450690de7c3cff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T00:17:08.427 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:08 smithi134 podman[71664]: 2024-09-12 00:17:08.356724159 +0000 UTC m=+0.323620653 container start be1e9d1861aaac4c4104d5e83996d5e9c4ca60b63f2432af5c450690de7c3cff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T00:17:08.427 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:08 smithi134 podman[71664]: 2024-09-12 00:17:08.428759741 +0000 UTC m=+0.395656248 container attach be1e9d1861aaac4c4104d5e83996d5e9c4ca60b63f2432af5c450690de7c3cff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T00:17:08.703 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:08 smithi134 podman[71664]: 2024-09-12 00:17:08.551355975 +0000 UTC m=+0.518252476 container died be1e9d1861aaac4c4104d5e83996d5e9c4ca60b63f2432af5c450690de7c3cff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:17:09.091 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 12 00:17:09 smithi134 podman[71687]: 2024-09-12 00:17:09.073531807 +0000 UTC m=+0.516552700 container remove be1e9d1861aaac4c4104d5e83996d5e9c4ca60b63f2432af5c450690de7c3cff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T00:17:09.097 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T00:17:09.135 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:09.135 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T00:17:09.135 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T00:17:09.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.a 2024-09-12T00:17:09.471 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 12 00:17:09 smithi006 systemd[1]: Stopping Ceph mds.a for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:09.868 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 12 00:17:09 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-a[72594]: 2024-09-12T00:17:09.471+0000 7fd369df3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:09.868 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 12 00:17:09 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-a[72594]: 2024-09-12T00:17:09.471+0000 7fd369df3640 -1 mds.a *** got signal Terminated *** 2024-09-12T00:17:13.762 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 12 00:17:13 smithi006 podman[111102]: 2024-09-12 00:17:13.484540018 +0000 UTC m=+4.149873127 container died 8541334edb50cdf17972933e4393b4286ab094899603952902a44a945dce9241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T00:17:14.118 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 12 00:17:13 smithi006 podman[111102]: 2024-09-12 00:17:13.862975522 +0000 UTC m=+4.528308630 container cleanup 8541334edb50cdf17972933e4393b4286ab094899603952902a44a945dce9241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T00:17:14.118 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 12 00:17:13 smithi006 bash[111102]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-a 2024-09-12T00:17:14.289 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T00:17:14.326 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:14.326 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T00:17:14.326 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T00:17:14.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.d 2024-09-12T00:17:14.665 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 12 00:17:14 smithi006 systemd[1]: Stopping Ceph mds.d for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:15.118 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 12 00:17:14 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-d[71386]: 2024-09-12T00:17:14.665+0000 7fdec1748640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:15.118 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 12 00:17:14 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-d[71386]: 2024-09-12T00:17:14.666+0000 7fdec1748640 -1 mds.d *** got signal Terminated *** 2024-09-12T00:17:17.891 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 12 00:17:17 smithi006 podman[111224]: 2024-09-12 00:17:17.622605424 +0000 UTC m=+3.071518511 container died 74910b18e73354137377d733d7fd3419374167726931d93edb2d4df4e386bd11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:17:18.258 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 12 00:17:17 smithi006 podman[111224]: 2024-09-12 00:17:17.975309385 +0000 UTC m=+3.424222502 container cleanup 74910b18e73354137377d733d7fd3419374167726931d93edb2d4df4e386bd11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T00:17:18.258 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 12 00:17:17 smithi006 bash[111224]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-d 2024-09-12T00:17:18.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T00:17:18.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:18.440 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T00:17:18.440 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T00:17:18.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.g 2024-09-12T00:17:18.778 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 12 00:17:18 smithi006 systemd[1]: Stopping Ceph mds.g for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:19.118 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 12 00:17:18 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-g[72270]: 2024-09-12T00:17:18.779+0000 7fa8bcb4c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:19.118 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 12 00:17:18 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-g[72270]: 2024-09-12T00:17:18.779+0000 7fa8bcb4c640 -1 mds.g *** got signal Terminated *** 2024-09-12T00:17:22.253 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 12 00:17:21 smithi006 podman[111346]: 2024-09-12 00:17:21.961025125 +0000 UTC m=+3.288873341 container died d4c228503df0730ec48d4c20bf6c37a6b2766542a8d96172a631a378c1b9667c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T00:17:22.595 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 12 00:17:22 smithi006 podman[111346]: 2024-09-12 00:17:22.371067972 +0000 UTC m=+3.698916179 container cleanup d4c228503df0730ec48d4c20bf6c37a6b2766542a8d96172a631a378c1b9667c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T00:17:22.595 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 12 00:17:22 smithi006 bash[111346]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-g 2024-09-12T00:17:22.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T00:17:22.760 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:22.760 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T00:17:22.760 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T00:17:22.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.j 2024-09-12T00:17:22.868 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 12 00:17:22 smithi006 systemd[1]: Stopping Ceph mds.j for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:23.368 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 12 00:17:23 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-j[70987]: 2024-09-12T00:17:23.074+0000 7f001c8f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:23.368 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 12 00:17:23 smithi006 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-j[70987]: 2024-09-12T00:17:23.074+0000 7f001c8f2640 -1 mds.j *** got signal Terminated *** 2024-09-12T00:17:26.273 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 12 00:17:25 smithi006 podman[111467]: 2024-09-12 00:17:25.957837991 +0000 UTC m=+2.973140120 container died d581500acb011c572a0bd8a3cf991febea49b9b0341ead764e7d78302f5476b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T00:17:26.273 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 12 00:17:26 smithi006 podman[111467]: 2024-09-12 00:17:26.275199716 +0000 UTC m=+3.290501845 container cleanup d581500acb011c572a0bd8a3cf991febea49b9b0341ead764e7d78302f5476b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-j, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T00:17:26.618 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 12 00:17:26 smithi006 bash[111467]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-j 2024-09-12T00:17:26.618 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 12 00:17:26 smithi006 podman[111492]: 2024-09-12 00:17:26.484741128 +0000 UTC m=+0.524239278 container remove d581500acb011c572a0bd8a3cf991febea49b9b0341ead764e7d78302f5476b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-12T00:17:26.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T00:17:26.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:26.736 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T00:17:26.736 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T00:17:26.737 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.b 2024-09-12T00:17:27.042 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 12 00:17:26 smithi039 systemd[1]: Stopping Ceph mds.b for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:27.293 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 12 00:17:27 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b[64956]: 2024-09-12T00:17:27.043+0000 7fe794bc6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:27.293 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 12 00:17:27 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b[64956]: 2024-09-12T00:17:27.043+0000 7fe794bc6640 -1 mds.b *** got signal Terminated *** 2024-09-12T00:17:30.192 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 12 00:17:29 smithi039 podman[71660]: 2024-09-12 00:17:29.902287741 +0000 UTC m=+2.953697484 container died af7e0b346c48122f849b39048d9fda8e71162bddc8a1139f2092fe4d3d749801 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-12T00:17:30.505 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 12 00:17:30 smithi039 podman[71660]: 2024-09-12 00:17:30.30193581 +0000 UTC m=+3.353345565 container cleanup af7e0b346c48122f849b39048d9fda8e71162bddc8a1139f2092fe4d3d749801 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T00:17:30.505 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 12 00:17:30 smithi039 bash[71660]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b 2024-09-12T00:17:30.793 INFO:journalctl@ceph.mds.b.smithi039.stdout:Sep 12 00:17:30 smithi039 podman[71672]: 2024-09-12 00:17:30.670240187 +0000 UTC m=+0.762782283 container remove af7e0b346c48122f849b39048d9fda8e71162bddc8a1139f2092fe4d3d749801 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-b, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T00:17:30.877 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T00:17:30.914 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:30.914 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T00:17:30.914 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T00:17:30.915 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.e 2024-09-12T00:17:31.255 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 12 00:17:30 smithi039 systemd[1]: Stopping Ceph mds.e for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:31.543 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 12 00:17:31 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-e[64341]: 2024-09-12T00:17:31.255+0000 7f9f64883640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:31.543 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 12 00:17:31 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-e[64341]: 2024-09-12T00:17:31.255+0000 7f9f64883640 -1 mds.e *** got signal Terminated *** 2024-09-12T00:17:34.155 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 12 00:17:33 smithi039 podman[71792]: 2024-09-12 00:17:33.893840799 +0000 UTC m=+2.744183929 container died 6701705a598455db479d892fa8b9eafd9d6ab0370699d923fb4d8e2802cb57ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T00:17:34.543 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 12 00:17:34 smithi039 podman[71792]: 2024-09-12 00:17:34.248083875 +0000 UTC m=+3.098427006 container cleanup 6701705a598455db479d892fa8b9eafd9d6ab0370699d923fb4d8e2802cb57ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-e, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T00:17:34.544 INFO:journalctl@ceph.mds.e.smithi039.stdout:Sep 12 00:17:34 smithi039 bash[71792]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-e 2024-09-12T00:17:34.736 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T00:17:34.772 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:34.773 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T00:17:34.773 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T00:17:34.773 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.h 2024-09-12T00:17:35.109 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 12 00:17:34 smithi039 systemd[1]: Stopping Ceph mds.h for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:35.543 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 12 00:17:35 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-h[64640]: 2024-09-12T00:17:35.109+0000 7f13cfbf7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:35.544 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 12 00:17:35 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-h[64640]: 2024-09-12T00:17:35.109+0000 7f13cfbf7640 -1 mds.h *** got signal Terminated *** 2024-09-12T00:17:38.159 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 12 00:17:37 smithi039 podman[71912]: 2024-09-12 00:17:37.890112928 +0000 UTC m=+2.884368478 container died 8d283df81d1e12e74f06efccd732132b0ddabe3167f6ad5ddbfc5b715e7e0935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T00:17:38.535 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 12 00:17:38 smithi039 podman[71912]: 2024-09-12 00:17:38.260489347 +0000 UTC m=+3.254744902 container cleanup 8d283df81d1e12e74f06efccd732132b0ddabe3167f6ad5ddbfc5b715e7e0935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T00:17:38.535 INFO:journalctl@ceph.mds.h.smithi039.stdout:Sep 12 00:17:38 smithi039 bash[71912]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-h 2024-09-12T00:17:38.704 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T00:17:38.739 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:38.739 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T00:17:38.740 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T00:17:38.740 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.k 2024-09-12T00:17:39.063 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 12 00:17:38 smithi039 systemd[1]: Stopping Ceph mds.k for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:39.543 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 12 00:17:39 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-k[64038]: 2024-09-12T00:17:39.063+0000 7f0299b5c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:39.544 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 12 00:17:39 smithi039 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-k[64038]: 2024-09-12T00:17:39.063+0000 7f0299b5c640 -1 mds.k *** got signal Terminated *** 2024-09-12T00:17:42.147 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 12 00:17:41 smithi039 podman[72034]: 2024-09-12 00:17:41.891356633 +0000 UTC m=+2.920572358 container died 0897b5e624143833118cb4d1fb0ed29251f1ad5d42a30e04121bb8f99db15401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T00:17:42.530 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 12 00:17:42 smithi039 podman[72034]: 2024-09-12 00:17:42.247901109 +0000 UTC m=+3.277116799 container cleanup 0897b5e624143833118cb4d1fb0ed29251f1ad5d42a30e04121bb8f99db15401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T00:17:42.531 INFO:journalctl@ceph.mds.k.smithi039.stdout:Sep 12 00:17:42 smithi039 bash[72034]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-k 2024-09-12T00:17:42.678 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T00:17:42.712 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:42.712 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T00:17:42.712 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T00:17:42.712 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.c 2024-09-12T00:17:43.030 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 12 00:17:42 smithi134 systemd[1]: Stopping Ceph mds.c for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:43.285 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 12 00:17:43 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-c[65336]: 2024-09-12T00:17:43.030+0000 7fda72d56640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:43.285 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 12 00:17:43 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-c[65336]: 2024-09-12T00:17:43.030+0000 7fda72d56640 -1 mds.c *** got signal Terminated *** 2024-09-12T00:17:46.203 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 12 00:17:45 smithi134 podman[71766]: 2024-09-12 00:17:45.889778092 +0000 UTC m=+2.969717776 container died ef0578a1e4080cb506c2358f60d31bdcddb612c8348846a3c9fae35c225d0d9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T00:17:46.513 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 12 00:17:46 smithi134 podman[71766]: 2024-09-12 00:17:46.288546569 +0000 UTC m=+3.368486262 container cleanup ef0578a1e4080cb506c2358f60d31bdcddb612c8348846a3c9fae35c225d0d9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T00:17:46.513 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 12 00:17:46 smithi134 bash[71766]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-c 2024-09-12T00:17:46.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T00:17:46.683 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:46.683 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T00:17:46.684 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T00:17:46.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.f 2024-09-12T00:17:46.953 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 12 00:17:46 smithi134 systemd[1]: Stopping Ceph mds.f for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:47.453 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 12 00:17:47 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-f[65034]: 2024-09-12T00:17:47.000+0000 7effa2649640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:47.453 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 12 00:17:47 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-f[65034]: 2024-09-12T00:17:47.000+0000 7effa2649640 -1 mds.f *** got signal Terminated *** 2024-09-12T00:17:50.167 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 12 00:17:49 smithi134 podman[71898]: 2024-09-12 00:17:49.890077755 +0000 UTC m=+2.991549949 container died 0df0a443c5a9e88dca44b657a2d5de0820c3221be28b6df61df69186b9ff9da7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:17:50.453 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 12 00:17:50 smithi134 podman[71898]: 2024-09-12 00:17:50.24216098 +0000 UTC m=+3.343633168 container cleanup 0df0a443c5a9e88dca44b657a2d5de0820c3221be28b6df61df69186b9ff9da7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T00:17:50.453 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 12 00:17:50 smithi134 bash[71898]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-f 2024-09-12T00:17:50.662 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T00:17:50.696 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:50.696 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T00:17:50.696 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T00:17:50.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.i 2024-09-12T00:17:50.953 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 12 00:17:50 smithi134 systemd[1]: Stopping Ceph mds.i for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:51.453 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 12 00:17:51 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-i[65649]: 2024-09-12T00:17:51.041+0000 7f8dc8f3b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:51.453 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 12 00:17:51 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-i[65649]: 2024-09-12T00:17:51.041+0000 7f8dc8f3b640 -1 mds.i *** got signal Terminated *** 2024-09-12T00:17:54.186 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 12 00:17:53 smithi134 podman[72020]: 2024-09-12 00:17:53.887380348 +0000 UTC m=+2.965159617 container died df762ac0fc029b3f606f526655cab96417d940e9e532f261e4e346049ba97318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T00:17:54.453 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 12 00:17:54 smithi134 podman[72020]: 2024-09-12 00:17:54.287635967 +0000 UTC m=+3.365415225 container cleanup df762ac0fc029b3f606f526655cab96417d940e9e532f261e4e346049ba97318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-i, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T00:17:54.453 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 12 00:17:54 smithi134 bash[72020]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-i 2024-09-12T00:17:54.672 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T00:17:54.704 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:54.705 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T00:17:54.705 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T00:17:54.705 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.l 2024-09-12T00:17:54.953 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:17:54 smithi134 systemd[1]: Stopping Ceph mds.l for 4901345a-7098-11ef-bcea-c7b262605968... 2024-09-12T00:17:55.453 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:17:55 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l[64732]: 2024-09-12T00:17:55.041+0000 7f8b57391640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:17:55.453 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:17:55 smithi134 ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l[64732]: 2024-09-12T00:17:55.041+0000 7f8b57391640 -1 mds.l *** got signal Terminated *** 2024-09-12T00:17:58.173 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:17:57 smithi134 podman[72142]: 2024-09-12 00:17:57.900449921 +0000 UTC m=+2.975865592 container died 750e15f3a5c661915950d36da8bf4e42defdc5ee60563e474af02bfcb0842d35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T00:17:58.424 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:17:58 smithi134 podman[72142]: 2024-09-12 00:17:58.241337377 +0000 UTC m=+3.316753048 container cleanup 750e15f3a5c661915950d36da8bf4e42defdc5ee60563e474af02bfcb0842d35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T00:17:58.424 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:17:58 smithi134 bash[72142]: ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l 2024-09-12T00:17:58.661 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T00:17:58.682 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:17:58 smithi134 podman[72153]: 2024-09-12 00:17:58.425699944 +0000 UTC m=+0.522567539 container remove 750e15f3a5c661915950d36da8bf4e42defdc5ee60563e474af02bfcb0842d35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4901345a-7098-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T00:17:58.683 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:17:58 smithi134 systemd[1]: ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.l.service: Deactivated successfully. 2024-09-12T00:17:58.683 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:17:58 smithi134 systemd[1]: Stopped Ceph mds.l for 4901345a-7098-11ef-bcea-c7b262605968. 2024-09-12T00:17:58.683 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 12 00:17:58 smithi134 systemd[1]: ceph-4901345a-7098-11ef-bcea-c7b262605968@mds.l.service: Consumed 2.442s CPU time. 2024-09-12T00:17:58.693 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:17:58.693 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T00:17:58.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4901345a-7098-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T00:17:58.907 INFO:teuthology.orchestra.run.smithi006.stdout:Deleting cluster with fsid: 4901345a-7098-11ef-bcea-c7b262605968 2024-09-12T00:18:01.597 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4901345a-7098-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T00:18:01.813 INFO:teuthology.orchestra.run.smithi039.stdout:Deleting cluster with fsid: 4901345a-7098-11ef-bcea-c7b262605968 2024-09-12T00:18:04.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4901345a-7098-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T00:18:04.640 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 4901345a-7098-11ef-bcea-c7b262605968 2024-09-12T00:18:07.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:18:07.043 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:18:07.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:18:07.105 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T00:18:07.107 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495/remote/smithi006/crash 2024-09-12T00:18:07.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/crash -- . 2024-09-12T00:18:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:tar: /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T00:18:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:tar: Error is not recoverable: exiting now 2024-09-12T00:18:07.149 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495/remote/smithi039/crash 2024-09-12T00:18:07.150 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/crash -- . 2024-09-12T00:18:07.193 INFO:teuthology.orchestra.run.smithi039.stderr:tar: /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T00:18:07.193 INFO:teuthology.orchestra.run.smithi039.stderr:tar: Error is not recoverable: exiting now 2024-09-12T00:18:07.195 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495/remote/smithi134/crash 2024-09-12T00:18:07.196 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/crash -- . 2024-09-12T00:18:07.228 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/4901345a-7098-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T00:18:07.228 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2024-09-12T00:18:07.229 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T00:18:07.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T00:18:07.313 INFO:tasks.cephadm:Compressing logs... 2024-09-12T00:18:07.314 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:18:07.316 DEBUG:teuthology.orchestra.run.smithi039:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:18:07.319 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:18:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-12T00:18:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-12T00:18:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T00:18:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:gzip/var/log/ceph/ceph-client.admin.log: -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T00:18:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T00:18:07.366 INFO:teuthology.orchestra.run.smithi039.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-12T00:18:07.366 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T00:18:07.366 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T00:18:07.366 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T00:18:07.366 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T00:18:07.366 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T00:18:07.366 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T00:18:07.366 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T00:18:07.366 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.k.log: --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T00:18:07.367 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T00:18:07.367 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T00:18:07.367 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.log 2024-09-12T00:18:07.367 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T00:18:07.367 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T00:18:07.367 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T00:18:07.367 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T00:18:07.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T00:18:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 87.3% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T00:18:07.369 INFO:teuthology.orchestra.run.smithi006.stderr: 94.6% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T00:18:07.369 INFO:teuthology.orchestra.run.smithi006.stderr: 94.6% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T00:18:07.374 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory 2024-09-12T00:18:07.374 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T00:18:07.374 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T00:18:07.374 INFO:teuthology.orchestra.run.smithi134.stderr:gzip/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-volume.log: -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T00:18:07.374 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T00:18:07.374 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T00:18:07.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T00:18:07.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T00:18:07.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T00:18:07.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.log 2024-09-12T00:18:07.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T00:18:07.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T00:18:07.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T00:18:07.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T00:18:07.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T00:18:07.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T00:18:07.388 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 82.5% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T00:18:07.421 INFO:teuthology.orchestra.run.smithi006.stderr: 82.4% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T00:18:07.434 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 82.4% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T00:18:07.457 INFO:teuthology.orchestra.run.smithi006.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-12T00:18:07.458 INFO:teuthology.orchestra.run.smithi134.stderr: 92.8% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T00:18:07.461 INFO:teuthology.orchestra.run.smithi006.stderr: 90.3% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T00:18:07.486 INFO:teuthology.orchestra.run.smithi134.stderr: 93.2% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T00:18:07.546 INFO:teuthology.orchestra.run.smithi039.stderr: 93.1% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T00:18:07.589 INFO:teuthology.orchestra.run.smithi006.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T00:18:07.615 INFO:teuthology.orchestra.run.smithi134.stderr: 90.5% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T00:18:07.630 INFO:teuthology.orchestra.run.smithi039.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T00:18:07.633 INFO:teuthology.orchestra.run.smithi134.stderr: 87.3% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T00:18:07.686 INFO:teuthology.orchestra.run.smithi006.stderr: 91.1% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T00:18:07.721 INFO:teuthology.orchestra.run.smithi134.stderr: 91.0% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T00:18:07.773 INFO:teuthology.orchestra.run.smithi039.stderr: 90.9% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T00:18:07.792 INFO:teuthology.orchestra.run.smithi039.stderr: 90.4% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T00:18:07.793 INFO:teuthology.orchestra.run.smithi039.stderr: 87.3% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T00:18:07.922 INFO:teuthology.orchestra.run.smithi134.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T00:18:08.184 INFO:teuthology.orchestra.run.smithi006.stderr: 94.6% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T00:18:08.265 INFO:teuthology.orchestra.run.smithi006.stderr: 94.4% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T00:18:08.426 INFO:teuthology.orchestra.run.smithi134.stderr: 92.7% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T00:18:09.541 INFO:teuthology.orchestra.run.smithi134.stderr: 94.4% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T00:18:09.934 INFO:teuthology.orchestra.run.smithi039.stderr: 94.3% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T00:18:10.291 INFO:teuthology.orchestra.run.smithi134.stderr: 91.8% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T00:18:10.379 INFO:teuthology.orchestra.run.smithi039.stderr: 92.9% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T00:18:10.491 INFO:teuthology.orchestra.run.smithi006.stderr: 90.4% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T00:18:10.510 INFO:teuthology.orchestra.run.smithi039.stderr: 91.8% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T00:18:12.599 INFO:teuthology.orchestra.run.smithi039.stderr: 94.0% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T00:18:12.961 INFO:teuthology.orchestra.run.smithi134.stderr: 94.1% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T00:18:22.600 INFO:teuthology.orchestra.run.smithi006.stderr: 90.3% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T00:19:34.543 INFO:teuthology.orchestra.run.smithi039.stderr: 93.7% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T00:19:59.802 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T00:21:12.433 INFO:teuthology.orchestra.run.smithi039.stderr: 91.1% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T00:21:45.127 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T00:22:00.601 INFO:teuthology.orchestra.run.smithi039.stderr: 91.2% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T00:22:11.281 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T00:22:20.208 INFO:teuthology.orchestra.run.smithi039.stderr: 91.2% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T00:23:10.049 INFO:teuthology.orchestra.run.smithi134.stderr: 91.0% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T00:23:10.050 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-12T00:23:10.051 INFO:teuthology.orchestra.run.smithi134.stderr:real 5m2.712s 2024-09-12T00:23:10.051 INFO:teuthology.orchestra.run.smithi134.stderr:user 5m45.200s 2024-09-12T00:23:10.051 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m12.964s 2024-09-12T00:23:17.947 INFO:teuthology.orchestra.run.smithi039.stderr: 91.3% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T00:23:17.949 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-12T00:23:17.950 INFO:teuthology.orchestra.run.smithi039.stderr:real 5m10.615s 2024-09-12T00:23:17.950 INFO:teuthology.orchestra.run.smithi039.stderr:user 5m33.030s 2024-09-12T00:23:17.950 INFO:teuthology.orchestra.run.smithi039.stderr:sys 0m11.111s 2024-09-12T00:26:38.300 INFO:teuthology.orchestra.run.smithi006.stderr: 91.2% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T00:35:11.675 INFO:teuthology.orchestra.run.smithi006.stderr: 91.0% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T00:36:48.702 INFO:teuthology.orchestra.run.smithi006.stderr: 91.1% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T00:39:44.434 INFO:teuthology.orchestra.run.smithi006.stderr: 91.1% -- replaced with /var/log/ceph/4901345a-7098-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T00:41:08.149 INFO:teuthology.orchestra.run.smithi006.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-12T00:41:08.151 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-09-12T00:41:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:real 23m0.820s 2024-09-12T00:41:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:user 9m28.260s 2024-09-12T00:41:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m25.597s 2024-09-12T00:41:08.152 INFO:tasks.cephadm:Archiving logs... 2024-09-12T00:41:08.153 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495/remote/smithi006/log 2024-09-12T00:41:08.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:42:31.738 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495/remote/smithi039/log 2024-09-12T00:42:31.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:43:29.789 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495/remote/smithi134/log 2024-09-12T00:43:29.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:44:32.412 INFO:tasks.cephadm:Removing cluster... 2024-09-12T00:44:32.412 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4901345a-7098-11ef-bcea-c7b262605968 --force 2024-09-12T00:44:32.645 INFO:teuthology.orchestra.run.smithi006.stdout:Deleting cluster with fsid: 4901345a-7098-11ef-bcea-c7b262605968 2024-09-12T00:44:33.354 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4901345a-7098-11ef-bcea-c7b262605968 --force 2024-09-12T00:44:33.587 INFO:teuthology.orchestra.run.smithi039.stdout:Deleting cluster with fsid: 4901345a-7098-11ef-bcea-c7b262605968 2024-09-12T00:44:34.268 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4901345a-7098-11ef-bcea-c7b262605968 --force 2024-09-12T00:44:34.470 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 4901345a-7098-11ef-bcea-c7b262605968 2024-09-12T00:44:35.178 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T00:44:35.179 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T00:44:35.200 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T00:44:35.221 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T00:44:35.237 INFO:tasks.cephadm:Teardown complete 2024-09-12T00:44:35.237 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T00:44:35.516 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T00:44:35.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:44:35.519 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:44:35.522 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:44:35.672 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T00:44:35.997 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T00:44:35.998 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:44:36.001 DEBUG:teuthology.orchestra.run.smithi039:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:44:36.003 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:44:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:44:36.019 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:44:36.019 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:44:36.040 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:44:36.040 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-09-12T00:44:36.040 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 +507us[ +503us] +/- 48ms 2024-09-12T00:44:36.040 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -1053us[-1058us] +/- 72ms 2024-09-12T00:44:36.040 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +362us[ +362us] +/- 88ms 2024-09-12T00:44:36.040 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:44:36.042 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:44:36.042 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-12T00:44:36.042 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 +498us[ +500us] +/- 48ms 2024-09-12T00:44:36.042 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 -1042us[-1040us] +/- 72ms 2024-09-12T00:44:36.042 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +339us[ +341us] +/- 88ms 2024-09-12T00:44:36.042 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:44:36.043 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:44:36.043 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-09-12T00:44:36.043 INFO:teuthology.orchestra.run.smithi039.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 +546us[ +506us] +/- 48ms 2024-09-12T00:44:36.043 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -1008us[-1048us] +/- 72ms 2024-09-12T00:44:36.043 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +363us[ +323us] +/- 88ms 2024-09-12T00:44:36.043 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:44:36.044 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T00:44:36.171 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T00:44:36.172 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T00:44:36.199 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T00:44:36.345 DEBUG:teuthology.orchestra.run.smithi039:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T00:44:36.442 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T00:44:36.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T00:44:36.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:44:36.596 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T00:44:36.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:44:36.629 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T00:44:36.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:44:36.658 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T00:44:36.668 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T00:44:36.801 INFO:teuthology.task.internal:Duration was 3725.804220 seconds 2024-09-12T00:44:36.802 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T00:44:36.904 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T00:44:36.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:44:36.907 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:44:36.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:44:36.968 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:44:36.974 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:44:36.980 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:44:37.426 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T00:44:37.427 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2024-09-12T00:44:37.427 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:44:37.456 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T00:44:37.456 DEBUG:teuthology.orchestra.run.smithi039:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:44:37.495 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-12T00:44:37.496 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:44:37.527 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T00:44:37.527 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:44:37.530 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:44:37.540 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:44:37.595 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T00:44:37.595 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:44:37.601 DEBUG:teuthology.orchestra.run.smithi039:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:44:37.612 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:44:38.161 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T00:44:38.173 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T00:44:38.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:44:38.208 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:44:38.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:44:38.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T00:44:38.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:44:38.343 DEBUG:teuthology.orchestra.run.smithi039:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:44:38.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:44:38.371 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2024-09-12T00:44:38.372 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-12T00:44:38.386 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = core 2024-09-12T00:44:38.405 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:44:38.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:44:38.441 DEBUG:teuthology.orchestra.run.smithi039:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:44:38.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:44:38.460 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:44:38.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:44:38.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T00:44:38.485 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T00:44:38.486 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495/remote/smithi006 2024-09-12T00:44:38.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:44:38.534 DEBUG:teuthology.misc:Transferring archived files from smithi039:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495/remote/smithi039 2024-09-12T00:44:38.535 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:44:38.572 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901495/remote/smithi134 2024-09-12T00:44:38.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:44:38.610 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T00:44:38.610 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:44:38.613 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:44:38.615 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:44:38.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T00:44:38.672 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T00:44:38.673 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T00:44:38.682 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T00:44:38.682 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:44:38.685 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:44:38.687 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:44:38.697 INFO:teuthology.orchestra.run.smithi006.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:44 /home/ubuntu/cephtest 2024-09-12T00:44:38.700 INFO:teuthology.orchestra.run.smithi039.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:44 /home/ubuntu/cephtest 2024-09-12T00:44:38.714 INFO:teuthology.orchestra.run.smithi134.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:44 /home/ubuntu/cephtest 2024-09-12T00:44:38.715 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T00:44:38.726 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T00:44:38.789 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/ffsb}} duration: 3725.804219722748 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T00:44:38.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:44:38.913 INFO:teuthology.run:pass